2024-05-21T01:04:26.893 INFO:root:teuthology version: 0.0.1.dev276+g4fbe5e8 2024-05-21T01:04:26.894 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_leonidus@teuthology --archive /home/teuthworker/archive/leonidus-2024-05-20_23:57:18-fs-wip-lusov-quiesce-no-remote-ap-distro-default-smithi/7717467 --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/with-quiesce 2-workunit/suites/iozone}} --name leonidus-2024-05-20_23:57:18-fs-wip-lusov-quiesce-no-remote-ap-distro-default-smithi --verbose -- /home/teuthworker/archive/leonidus-2024-05-20_23:57:18-fs-wip-lusov-quiesce-no-remote-ap-distro-default-smithi/7717467/orig.config.yaml 2024-05-21T01:04:26.944 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-21T01:04:27.020 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/leonidus-2024-05-20_23:57:18-fs-wip-lusov-quiesce-no-remote-ap-distro-default-smithi/7717467 branch: wip-lusov-quiesce-no-remote-ap description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/with-quiesce 2-workunit/suites/iozone}} email: null first_in_suite: false job_id: '7717467' kernel: client: branch: testing kdb: true sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: leonidus-2024-05-20_23:57:18-fs-wip-lusov-quiesce-no-remote-ap-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-lusov-quiesce-no-remote-ap ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 3 session_timeout: 300 conf: client: client mount timeout: 600 client_shutdown_timeout: 120 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds oft prefetch dirfrags: true mds op complaint time: 180 mds verify scatter: true mds_dir_prefetch: true mds_sleep_rank_change: 5000000.0 mon client directed command retry: 5 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: client mds osd ms inject socket failures: 2500 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon client directed command retry: 5 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: client mds ms inject socket failures: 2500 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum sha1: 0051ea03417a66dbfd5a17ea02c9049bcda16863 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} check-counter: counters: mds: - mds.exported - mds.imported install: ceph: flavor: default sha1: 0051ea03417a66dbfd5a17ea02c9049bcda16863 kclient: syntax: v1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-lusov-quiesce-no-remote-ap sha1: 0051ea03417a66dbfd5a17ea02c9049bcda16863 owner: scheduled_leonidus@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 seed: 2958 sha1: 0051ea03417a66dbfd5a17ea02c9049bcda16863 sleep_before_teardown: 0 subset: 419/111111 suite: fs suite_branch: wip-lusov-quiesce-no-remote-ap suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_0051ea03417a66dbfd5a17ea02c9049bcda16863/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 0051ea03417a66dbfd5a17ea02c9049bcda16863 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi063.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ8ev5fIYgOC5H8Ncawz/WAfp1vxLJOOpleLo2T41CWN9fS/2rpsU897z2bQn2ho6sVvc22XgZRkBKTNGWKQDEw= smithi131.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH3WGAfy00T2Xg3OBCTXPer+e4tc6s++Pg42csDCig3wb5RsC8sHNTfeuJyOOX7/CvbQ62vA2nv2nkZa1+KL754= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - quiescer: null - workunit: clients: all: - suites/iozone.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: install-fix teuthology_sha1: 4fbe5e8dc899215f216853b8569a107d8be8861d timestamp: 2024-05-20_23:57:18 tube: smithi user: leonidus verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2698841 2024-05-21T01:04:27.021 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_0051ea03417a66dbfd5a17ea02c9049bcda16863/qa; will attempt to use it 2024-05-21T01:04:27.021 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_0051ea03417a66dbfd5a17ea02c9049bcda16863/qa/tasks 2024-05-21T01:04:27.022 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-21T01:04:27.023 INFO:teuthology.task.internal:Checking packages... 2024-05-21T01:04:27.046 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '0051ea03417a66dbfd5a17ea02c9049bcda16863' 2024-05-21T01:04:27.046 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-21T01:04:27.046 INFO:teuthology.packaging:ref: None 2024-05-21T01:04:27.046 INFO:teuthology.packaging:tag: None 2024-05-21T01:04:27.046 INFO:teuthology.packaging:branch: wip-lusov-quiesce-no-remote-ap 2024-05-21T01:04:27.046 INFO:teuthology.packaging:sha1: 0051ea03417a66dbfd5a17ea02c9049bcda16863 2024-05-21T01:04:27.046 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-lusov-quiesce-no-remote-ap 2024-05-21T01:04:27.190 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3830-g0051ea03-1jammy 2024-05-21T01:04:27.193 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-21T01:04:27.200 INFO:teuthology.task.internal:no buildpackages task found 2024-05-21T01:04:27.201 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-21T01:04:27.239 INFO:teuthology.task.internal:Saving configuration 2024-05-21T01:04:27.257 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-21T01:04:27.266 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-21T01:04:27.291 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi063.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-05-20_23:57:18-fs-wip-lusov-quiesce-no-remote-ap-distro-default-smithi/7717467', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-21 00:58:39.756248', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIB5jyN0VtU525KjGK33A/7a41pCIQUYYAZgL/KQlGRzm'} 2024-05-21T01:04:27.312 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi131.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-05-20_23:57:18-fs-wip-lusov-quiesce-no-remote-ap-distro-default-smithi/7717467', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-21 00:58:39.757716', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIJzkBw7UKaWnwgFLdYYpUqslNKfQnu/+r9UhibHCz4MY'} 2024-05-21T01:04:27.312 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-21T01:04:27.320 INFO:teuthology.task.internal:roles: ubuntu@smithi063.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-05-21T01:04:27.320 INFO:teuthology.task.internal:roles: ubuntu@smithi131.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-05-21T01:04:27.320 INFO:teuthology.run_tasks:Running task console_log... 2024-05-21T01:04:27.397 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f2508ea6b90>, signals=[15]) 2024-05-21T01:04:27.397 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-21T01:04:27.405 INFO:teuthology.task.internal:Opening connections... 2024-05-21T01:04:27.405 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi063.front.sepia.ceph.com 2024-05-21T01:04:27.407 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-21T01:04:27.489 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi131.front.sepia.ceph.com 2024-05-21T01:04:27.489 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-21T01:04:27.573 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-21T01:04:27.579 DEBUG:teuthology.orchestra.run.smithi063:> uname -m 2024-05-21T01:04:27.584 INFO:teuthology.orchestra.run.smithi063.stdout:x86_64 2024-05-21T01:04:27.584 DEBUG:teuthology.orchestra.run.smithi063:> cat /etc/os-release 2024-05-21T01:04:27.631 INFO:teuthology.orchestra.run.smithi063.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-05-21T01:04:27.631 INFO:teuthology.orchestra.run.smithi063.stdout:NAME="Ubuntu" 2024-05-21T01:04:27.631 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION_ID="22.04" 2024-05-21T01:04:27.631 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-05-21T01:04:27.631 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION_CODENAME=jammy 2024-05-21T01:04:27.631 INFO:teuthology.orchestra.run.smithi063.stdout:ID=ubuntu 2024-05-21T01:04:27.632 INFO:teuthology.orchestra.run.smithi063.stdout:ID_LIKE=debian 2024-05-21T01:04:27.632 INFO:teuthology.orchestra.run.smithi063.stdout:HOME_URL="https://www.ubuntu.com/" 2024-05-21T01:04:27.632 INFO:teuthology.orchestra.run.smithi063.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-05-21T01:04:27.632 INFO:teuthology.orchestra.run.smithi063.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-05-21T01:04:27.632 INFO:teuthology.orchestra.run.smithi063.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-05-21T01:04:27.632 INFO:teuthology.orchestra.run.smithi063.stdout:UBUNTU_CODENAME=jammy 2024-05-21T01:04:27.632 INFO:teuthology.lock.ops:Updating smithi063.front.sepia.ceph.com on lock server 2024-05-21T01:04:27.651 DEBUG:teuthology.orchestra.run.smithi131:> uname -m 2024-05-21T01:04:27.656 INFO:teuthology.orchestra.run.smithi131.stdout:x86_64 2024-05-21T01:04:27.656 DEBUG:teuthology.orchestra.run.smithi131:> cat /etc/os-release 2024-05-21T01:04:27.702 INFO:teuthology.orchestra.run.smithi131.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-05-21T01:04:27.702 INFO:teuthology.orchestra.run.smithi131.stdout:NAME="Ubuntu" 2024-05-21T01:04:27.703 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION_ID="22.04" 2024-05-21T01:04:27.703 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-05-21T01:04:27.703 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION_CODENAME=jammy 2024-05-21T01:04:27.703 INFO:teuthology.orchestra.run.smithi131.stdout:ID=ubuntu 2024-05-21T01:04:27.703 INFO:teuthology.orchestra.run.smithi131.stdout:ID_LIKE=debian 2024-05-21T01:04:27.703 INFO:teuthology.orchestra.run.smithi131.stdout:HOME_URL="https://www.ubuntu.com/" 2024-05-21T01:04:27.703 INFO:teuthology.orchestra.run.smithi131.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-05-21T01:04:27.703 INFO:teuthology.orchestra.run.smithi131.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-05-21T01:04:27.703 INFO:teuthology.orchestra.run.smithi131.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-05-21T01:04:27.703 INFO:teuthology.orchestra.run.smithi131.stdout:UBUNTU_CODENAME=jammy 2024-05-21T01:04:27.703 INFO:teuthology.lock.ops:Updating smithi131.front.sepia.ceph.com on lock server 2024-05-21T01:04:27.726 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-21T01:04:27.737 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-21T01:04:27.756 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-21T01:04:27.756 DEBUG:teuthology.orchestra.run.smithi063:> test '!' -e /home/ubuntu/cephtest 2024-05-21T01:04:27.759 DEBUG:teuthology.orchestra.run.smithi131:> test '!' -e /home/ubuntu/cephtest 2024-05-21T01:04:27.763 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-21T01:04:27.781 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-21T01:04:27.781 DEBUG:teuthology.orchestra.run.smithi063:> test -z $(ls -A /var/lib/ceph) 2024-05-21T01:04:27.805 DEBUG:teuthology.orchestra.run.smithi131:> test -z $(ls -A /var/lib/ceph) 2024-05-21T01:04:27.822 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-21T01:04:27.877 INFO:teuthology.run_tasks:Running task kernel... 2024-05-21T01:04:27.892 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'} 2024-05-21T01:04:27.893 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2024-05-21T01:04:27.893 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2024-05-21T01:04:27.893 DEBUG:teuthology.orchestra.run.smithi063:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-21T01:04:27.898 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-21T01:04:27.898 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2024-05-21T01:04:28.087 DEBUG:teuthology.task.kernel:sha1 for client.0 is 0fe9556839d28e65b29a64cc05a26a6884e8775d 2024-05-21T01:04:28.087 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "0fe9556839d28e65b29a64cc05a26a6884e8775d"... 2024-05-21T01:04:28.088 DEBUG:teuthology.orchestra.run.smithi063:> uname -r 2024-05-21T01:04:28.093 INFO:teuthology.orchestra.run.smithi063.stdout:5.15.0-56-generic 2024-05-21T01:04:28.093 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 0fe9556839d28e65b29a64cc05a26a6884e8775d 2024-05-21T01:04:28.094 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-05-21T01:04:28.094 INFO:teuthology.task.kernel:Installing linux-firmware on client.0... 2024-05-21T01:04:28.094 DEBUG:teuthology.orchestra.run.smithi063:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-05-21T01:04:28.148 INFO:teuthology.orchestra.run.smithi063.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-05-21T01:04:28.280 INFO:teuthology.orchestra.run.smithi063.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-05-21T01:04:28.281 INFO:teuthology.orchestra.run.smithi063.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-05-21T01:04:28.281 INFO:teuthology.orchestra.run.smithi063.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-05-21T01:04:28.281 INFO:teuthology.orchestra.run.smithi063.stderr:hint: 2024-05-21T01:04:28.281 INFO:teuthology.orchestra.run.smithi063.stderr:hint: git config --global init.defaultBranch 2024-05-21T01:04:28.281 INFO:teuthology.orchestra.run.smithi063.stderr:hint: 2024-05-21T01:04:28.281 INFO:teuthology.orchestra.run.smithi063.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-05-21T01:04:28.281 INFO:teuthology.orchestra.run.smithi063.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-05-21T01:04:28.281 INFO:teuthology.orchestra.run.smithi063.stderr:hint: 2024-05-21T01:04:28.281 INFO:teuthology.orchestra.run.smithi063.stderr:hint: git branch -m 2024-05-21T01:04:28.282 INFO:teuthology.orchestra.run.smithi063.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-05-21T01:04:28.283 DEBUG:teuthology.orchestra.run.smithi063:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-05-21T01:04:28.350 DEBUG:teuthology.orchestra.run.smithi063:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-05-21T01:04:28.404 DEBUG:teuthology.orchestra.run.smithi063:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-05-21T01:05:19.386 INFO:teuthology.orchestra.run.smithi063.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-05-21T01:05:19.387 INFO:teuthology.orchestra.run.smithi063.stderr: * [new branch] main -> origin/main 2024-05-21T01:05:19.421 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20190312 -> 20190312 2024-05-21T01:05:19.421 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20190416 -> 20190416 2024-05-21T01:05:19.421 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20190514 -> 20190514 2024-05-21T01:05:19.421 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20190618 -> 20190618 2024-05-21T01:05:19.421 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20190717 -> 20190717 2024-05-21T01:05:19.421 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20190815 -> 20190815 2024-05-21T01:05:19.421 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20190923 -> 20190923 2024-05-21T01:05:19.421 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20191022 -> 20191022 2024-05-21T01:05:19.421 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20191215 -> 20191215 2024-05-21T01:05:19.422 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20200122 -> 20200122 2024-05-21T01:05:19.427 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20200316 -> 20200316 2024-05-21T01:05:19.427 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20200421 -> 20200421 2024-05-21T01:05:19.428 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20200519 -> 20200519 2024-05-21T01:05:19.428 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20200619 -> 20200619 2024-05-21T01:05:19.428 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20200721 -> 20200721 2024-05-21T01:05:19.428 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20200817 -> 20200817 2024-05-21T01:05:19.428 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20200918 -> 20200918 2024-05-21T01:05:19.428 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20201022 -> 20201022 2024-05-21T01:05:19.428 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20201118 -> 20201118 2024-05-21T01:05:19.428 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20201218 -> 20201218 2024-05-21T01:05:19.428 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20210208 -> 20210208 2024-05-21T01:05:19.428 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20210315 -> 20210315 2024-05-21T01:05:19.428 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20210511 -> 20210511 2024-05-21T01:05:19.428 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20210716 -> 20210716 2024-05-21T01:05:19.429 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20210818 -> 20210818 2024-05-21T01:05:19.429 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20210919 -> 20210919 2024-05-21T01:05:19.429 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20211027 -> 20211027 2024-05-21T01:05:19.429 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20211216 -> 20211216 2024-05-21T01:05:19.429 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20220209 -> 20220209 2024-05-21T01:05:19.429 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20220310 -> 20220310 2024-05-21T01:05:19.429 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20220411 -> 20220411 2024-05-21T01:05:19.429 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20220509 -> 20220509 2024-05-21T01:05:19.429 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20220610 -> 20220610 2024-05-21T01:05:19.429 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20220708 -> 20220708 2024-05-21T01:05:19.429 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20220815 -> 20220815 2024-05-21T01:05:19.430 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20220913 -> 20220913 2024-05-21T01:05:19.430 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20221012 -> 20221012 2024-05-21T01:05:19.430 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20221109 -> 20221109 2024-05-21T01:05:19.430 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20221214 -> 20221214 2024-05-21T01:05:19.430 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20230117 -> 20230117 2024-05-21T01:05:19.430 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20230210 -> 20230210 2024-05-21T01:05:19.430 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20230310 -> 20230310 2024-05-21T01:05:19.430 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20230404 -> 20230404 2024-05-21T01:05:19.430 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20230515 -> 20230515 2024-05-21T01:05:19.430 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20230625 -> 20230625 2024-05-21T01:05:19.430 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20230804 -> 20230804 2024-05-21T01:05:19.431 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20230919 -> 20230919 2024-05-21T01:05:19.431 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20231030 -> 20231030 2024-05-21T01:05:19.431 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20231111 -> 20231111 2024-05-21T01:05:19.431 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20231211 -> 20231211 2024-05-21T01:05:19.431 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20240115 -> 20240115 2024-05-21T01:05:19.431 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20240220 -> 20240220 2024-05-21T01:05:19.431 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20240312 -> 20240312 2024-05-21T01:05:19.431 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20240410 -> 20240410 2024-05-21T01:05:19.431 INFO:teuthology.orchestra.run.smithi063.stderr: * [new tag] 20240513 -> 20240513 2024-05-21T01:05:23.971 INFO:teuthology.orchestra.run.smithi063.stderr:Updating files: 44% (1530/3421) Updating files: 45% (1540/3421) Updating files: 46% (1574/3421) Updating files: 47% (1608/3421) Updating files: 48% (1643/3421) Updating files: 49% (1677/3421) Updating files: 50% (1711/3421) Updating files: 51% (1745/3421) Updating files: 52% (1779/3421) Updating files: 53% (1814/3421) Updating files: 54% (1848/3421) Updating files: 55% (1882/3421) Updating files: 56% (1916/3421) Updating files: 57% (1950/3421) Updating files: 58% (1985/3421) Updating files: 58% (2013/3421) Updating files: 59% (2019/3421) Updating files: 60% (2053/3421) Updating files: 61% (2087/3421) Updating files: 62% (2122/3421) Updating files: 63% (2156/3421) Updating files: 64% (2190/3421) Updating files: 65% (2224/3421) Updating files: 66% (2258/3421) Updating files: 67% (2293/3421) Updating files: 68% (2327/3421) Updating files: 69% (2361/3421) Updating files: 69% (2366/3421) Updating files: 70% (2395/3421) Updating files: 71% (2429/3421) Updating files: 72% (2464/3421) Updating files: 73% (2498/3421) Updating files: 74% (2532/3421) Updating files: 75% (2566/3421) Updating files: 76% (2600/3421) Updating files: 77% (2635/3421) Updating files: 78% (2669/3421) Updating files: 79% (2703/3421) Updating files: 80% (2737/3421) Updating files: 81% (2772/3421) Updating files: 82% (2806/3421) Updating files: 82% (2820/3421) Updating files: 83% (2840/3421) Updating files: 84% (2874/3421) Updating files: 85% (2908/3421) Updating files: 86% (2943/3421) Updating files: 87% (2977/3421) Updating files: 88% (3011/3421) Updating files: 89% (3045/3421) Updating files: 90% (3079/3421) Updating files: 91% (3114/3421) Updating files: 92% (3148/3421) Updating files: 93% (3182/3421) Updating files: 94% (3216/3421) Updating files: 95% (3250/3421) Updating files: 96% (3285/3421) Updating files: 97% (3319/3421) Updating files: 98% (3353/3421) Updating files: 99% (3387/3421) Updating files: 100% (3421/3421) Updating files: 100% (3421/3421), done. 2024-05-21T01:05:23.976 INFO:teuthology.orchestra.run.smithi063.stdout:HEAD is now at ec8627ef Merge branch 'amd-isp-staging' into 'main' 2024-05-21T01:05:23.999 INFO:teuthology.task.kernel:Downloading kernel 0fe9556839d28e65b29a64cc05a26a6884e8775d on client.0... 2024-05-21T01:05:24.000 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=0fe9556839d28e65b29a64cc05a26a6884e8775d 2024-05-21T01:05:24.225 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/0fe9556839d28e65b29a64cc05a26a6884e8775d/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g0fe9556839d2/ 2024-05-21T01:05:24.226 DEBUG:teuthology.orchestra.run.smithi063:> rm -f /tmp/linux-image.deb && echo linux-image-6.9.0-rc3-g0fe9556839d2_6.9.0-rc3-g0fe9556839d2-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://2.chacra.ceph.com/r/kernel/testing/0fe9556839d28e65b29a64cc05a26a6884e8775d/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g0fe9556839d2/ --input-file=- 2024-05-21T01:05:24.228 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi063.front.sepia.ceph.com to complete... 2024-05-21T01:05:25.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21 01:05:25 URL:https://2.chacra.ceph.com/r/kernel/testing/0fe9556839d28e65b29a64cc05a26a6884e8775d/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g0fe9556839d2/linux-image-6.9.0-rc3-g0fe9556839d2_6.9.0-rc3-g0fe9556839d2-1_amd64.deb [44834432/44834432] -> "/tmp/linux-image.deb" [1] 2024-05-21T01:05:25.987 INFO:teuthology.orchestra.run.smithi063.stderr:FINISHED --2024-05-21 01:05:25-- 2024-05-21T01:05:25.987 INFO:teuthology.orchestra.run.smithi063.stderr:Total wall clock time: 1.7s 2024-05-21T01:05:25.987 INFO:teuthology.orchestra.run.smithi063.stderr:Downloaded: 1 files, 43M in 1.5s (27.6 MB/s) 2024-05-21T01:05:25.991 INFO:teuthology.task.kernel:Installing kernel 0fe9556839d28e65b29a64cc05a26a6884e8775d on client.0... 2024-05-21T01:05:25.992 DEBUG:teuthology.orchestra.run.smithi063:> sudo dpkg -i /tmp/linux-image.deb 2024-05-21T01:05:26.243 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package linux-image-6.9.0-rc3-g0fe9556839d2. 2024-05-21T01:05:28.201 INFO:teuthology.orchestra.run.smithi063.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-05-21T01:05:28.205 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-05-21T01:05:28.344 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking linux-image-6.9.0-rc3-g0fe9556839d2 (6.9.0-rc3-g0fe9556839d2-1) ... 2024-05-21T01:05:32.288 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up linux-image-6.9.0-rc3-g0fe9556839d2 (6.9.0-rc3-g0fe9556839d2-1) ... 2024-05-21T01:05:32.374 INFO:teuthology.orchestra.run.smithi063.stderr:update-initramfs: Generating /boot/initrd.img-6.9.0-rc3-g0fe9556839d2 2024-05-21T01:05:54.522 INFO:teuthology.orchestra.run.smithi063.stderr:Sourcing file `/etc/default/grub' 2024-05-21T01:05:54.536 INFO:teuthology.orchestra.run.smithi063.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-05-21T01:05:54.565 INFO:teuthology.orchestra.run.smithi063.stderr:Generating grub configuration file ... 2024-05-21T01:05:54.869 INFO:teuthology.orchestra.run.smithi063.stderr:Found linux image: /boot/vmlinuz-6.9.0-rc3-g0fe9556839d2 2024-05-21T01:05:54.890 INFO:teuthology.orchestra.run.smithi063.stderr:Found initrd image: /boot/initrd.img-6.9.0-rc3-g0fe9556839d2 2024-05-21T01:05:55.226 INFO:teuthology.orchestra.run.smithi063.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-05-21T01:05:55.237 INFO:teuthology.orchestra.run.smithi063.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-05-21T01:05:55.304 INFO:teuthology.orchestra.run.smithi063.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-05-21T01:05:55.310 INFO:teuthology.orchestra.run.smithi063.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-05-21T01:05:55.477 INFO:teuthology.orchestra.run.smithi063.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-05-21T01:05:55.477 INFO:teuthology.orchestra.run.smithi063.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-05-21T01:05:55.477 INFO:teuthology.orchestra.run.smithi063.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-05-21T01:05:55.511 INFO:teuthology.orchestra.run.smithi063.stderr:done 2024-05-21T01:05:55.678 DEBUG:teuthology.orchestra.run.smithi063:> dpkg-deb -c /tmp/linux-image.deb 2024-05-21T01:05:55.686 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./ 2024-05-21T01:05:55.686 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./boot/ 2024-05-21T01:05:55.687 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 7002012 2024-05-17 02:26 ./boot/System.map-6.9.0-rc3-g0fe9556839d2 2024-05-21T01:05:55.706 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 172073 2024-05-17 02:26 ./boot/config-6.9.0-rc3-g0fe9556839d2 2024-05-21T01:05:55.706 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13120512 2024-05-17 02:26 ./boot/vmlinuz-6.9.0-rc3-g0fe9556839d2 2024-05-21T01:05:55.730 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./etc/ 2024-05-21T01:05:55.730 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./etc/kernel/ 2024-05-21T01:05:55.730 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./etc/kernel/postinst.d/ 2024-05-21T01:05:55.730 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./etc/kernel/postrm.d/ 2024-05-21T01:05:55.730 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./etc/kernel/preinst.d/ 2024-05-21T01:05:55.730 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./etc/kernel/prerm.d/ 2024-05-21T01:05:55.730 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/ 2024-05-21T01:05:55.731 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/ 2024-05-21T01:05:55.731 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/ 2024-05-21T01:05:55.731 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/ 2024-05-21T01:05:55.731 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/arch/ 2024-05-21T01:05:55.731 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/arch/x86/ 2024-05-21T01:05:55.731 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/arch/x86/crypto/ 2024-05-21T01:05:55.731 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 507569 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/arch/x86/crypto/aesni-intel.ko 2024-05-21T01:05:55.733 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 28361 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-05-21T01:05:55.734 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 34313 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-05-21T01:05:55.734 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 35009 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-05-21T01:05:55.734 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 97953 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-05-21T01:05:55.734 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 109905 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-05-21T01:05:55.734 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 155249 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-05-21T01:05:55.734 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15241 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-05-21T01:05:55.734 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16089 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-05-21T01:05:55.734 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 87009 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-05-21T01:05:55.734 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 22865 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-05-21T01:05:55.734 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 50305 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-05-21T01:05:55.734 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 50377 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/arch/x86/crypto/serpent-avx2.ko 2024-05-21T01:05:55.734 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 54513 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-05-21T01:05:55.735 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 44657 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-05-21T01:05:55.735 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 48049 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-05-21T01:05:55.735 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 62873 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-05-21T01:05:55.735 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 53569 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-05-21T01:05:55.735 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 34761 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-05-21T01:05:55.735 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14809 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-05-21T01:05:55.735 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/arch/x86/kernel/ 2024-05-21T01:05:55.735 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/arch/x86/kernel/cpu/ 2024-05-21T01:05:55.735 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/arch/x86/kernel/cpu/mce/ 2024-05-21T01:05:55.735 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 49081 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-05-21T01:05:55.735 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15993 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/arch/x86/kernel/cpuid.ko 2024-05-21T01:05:55.735 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 21625 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/arch/x86/kernel/msr.ko 2024-05-21T01:05:55.735 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/arch/x86/kvm/ 2024-05-21T01:05:55.736 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 444425 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/arch/x86/kvm/kvm-amd.ko 2024-05-21T01:05:55.736 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 1035881 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/arch/x86/kvm/kvm-intel.ko 2024-05-21T01:05:55.737 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 2849609 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/arch/x86/kvm/kvm.ko 2024-05-21T01:05:55.755 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/crypto/ 2024-05-21T01:05:55.755 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 65025 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/crypto/af_alg.ko 2024-05-21T01:05:55.755 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 27961 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/crypto/algif_hash.ko 2024-05-21T01:05:55.755 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 25721 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/crypto/algif_skcipher.ko 2024-05-21T01:05:55.755 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20225 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/crypto/ansi_cprng.ko 2024-05-21T01:05:55.755 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 21065 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/crypto/anubis.ko 2024-05-21T01:05:55.755 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 10929 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/crypto/arc4.ko 2024-05-21T01:05:55.755 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/crypto/asymmetric_keys/ 2024-05-21T01:05:55.755 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11457 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-05-21T01:05:55.756 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/crypto/async_tx/ 2024-05-21T01:05:55.756 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12617 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/crypto/async_tx/async_memcpy.ko 2024-05-21T01:05:55.756 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 22609 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/crypto/async_tx/async_pq.ko 2024-05-21T01:05:55.756 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 24841 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/crypto/async_tx/async_raid6_recov.ko 2024-05-21T01:05:55.756 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16313 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/crypto/async_tx/async_tx.ko 2024-05-21T01:05:55.756 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20649 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/crypto/async_tx/async_xor.ko 2024-05-21T01:05:55.756 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20737 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/crypto/async_tx/raid6test.ko 2024-05-21T01:05:55.756 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 25137 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/crypto/authenc.ko 2024-05-21T01:05:55.756 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 27953 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/crypto/authencesn.ko 2024-05-21T01:05:55.756 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 24049 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/crypto/blake2b_generic.ko 2024-05-21T01:05:55.756 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13713 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/crypto/blowfish_common.ko 2024-05-21T01:05:55.756 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11617 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/crypto/blowfish_generic.ko 2024-05-21T01:05:55.757 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 40889 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/crypto/camellia_generic.ko 2024-05-21T01:05:55.757 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 29113 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/crypto/cast5_generic.ko 2024-05-21T01:05:55.757 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20625 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/crypto/cast6_generic.ko 2024-05-21T01:05:55.757 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 10489 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/crypto/cast_common.ko 2024-05-21T01:05:55.757 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 43281 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/crypto/ccm.ko 2024-05-21T01:05:55.757 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17497 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/crypto/cmac.ko 2024-05-21T01:05:55.757 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11721 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/crypto/crc32_generic.ko 2024-05-21T01:05:55.757 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 59129 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/crypto/cryptd.ko 2024-05-21T01:05:55.757 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 48113 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/crypto/crypto_engine.ko 2024-05-21T01:05:55.757 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 32169 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/crypto/crypto_simd.ko 2024-05-21T01:05:55.757 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 30881 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/crypto/crypto_user.ko 2024-05-21T01:05:55.757 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 21697 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/crypto/cts.ko 2024-05-21T01:05:55.757 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12481 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/crypto/des_generic.ko 2024-05-21T01:05:55.758 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 18561 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/crypto/dh_generic.ko 2024-05-21T01:05:55.758 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12857 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/crypto/echainiv.ko 2024-05-21T01:05:55.758 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 30689 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/crypto/essiv.ko 2024-05-21T01:05:55.758 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19209 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/crypto/fcrypt.ko 2024-05-21T01:05:55.758 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 28201 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/crypto/khazad.ko 2024-05-21T01:05:55.758 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19089 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/crypto/lrw.ko 2024-05-21T01:05:55.758 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14105 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/crypto/lz4.ko 2024-05-21T01:05:55.758 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14073 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/crypto/lz4hc.ko 2024-05-21T01:05:55.758 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13393 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/crypto/md4.ko 2024-05-21T01:05:55.758 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11249 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/crypto/michael_mic.ko 2024-05-21T01:05:55.758 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12993 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/crypto/pcbc.ko 2024-05-21T01:05:55.758 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 23073 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/crypto/pcrypt.ko 2024-05-21T01:05:55.759 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17665 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/crypto/rmd160.ko 2024-05-21T01:05:55.759 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 30673 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/crypto/seed.ko 2024-05-21T01:05:55.759 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 28865 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/crypto/serpent_generic.ko 2024-05-21T01:05:55.759 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 169065 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/crypto/tcrypt.ko 2024-05-21T01:05:55.759 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12945 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/crypto/tea.ko 2024-05-21T01:05:55.759 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 29641 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/crypto/twofish_common.ko 2024-05-21T01:05:55.759 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14313 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/crypto/twofish_generic.ko 2024-05-21T01:05:55.759 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19905 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/crypto/vmac.ko 2024-05-21T01:05:55.759 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 38209 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/crypto/wp512.ko 2024-05-21T01:05:55.759 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16617 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/crypto/xcbc.ko 2024-05-21T01:05:55.759 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 30345 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/crypto/xor.ko 2024-05-21T01:05:55.759 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 23833 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/crypto/xts.ko 2024-05-21T01:05:55.759 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11281 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/crypto/xxhash_generic.ko 2024-05-21T01:05:55.759 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/ 2024-05-21T01:05:55.760 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/acpi/ 2024-05-21T01:05:55.760 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 21121 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/acpi/acpi_extlog.ko 2024-05-21T01:05:55.760 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 31921 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/acpi/acpi_ipmi.ko 2024-05-21T01:05:55.760 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 32281 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/acpi/acpi_pad.ko 2024-05-21T01:05:55.760 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/acpi/apei/ 2024-05-21T01:05:55.760 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 44705 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/acpi/apei/einj.ko 2024-05-21T01:05:55.760 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14505 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/acpi/ec_sys.ko 2024-05-21T01:05:55.760 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17705 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/acpi/platform_profile.ko 2024-05-21T01:05:55.760 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 29017 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/acpi/sbs.ko 2024-05-21T01:05:55.760 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 23385 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/acpi/sbshc.ko 2024-05-21T01:05:55.760 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 119033 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/acpi/video.ko 2024-05-21T01:05:55.760 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/ata/ 2024-05-21T01:05:55.761 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 24497 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/ata/acard-ahci.ko 2024-05-21T01:05:55.761 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 96825 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/ata/ahci.ko 2024-05-21T01:05:55.761 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15857 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/ata/ahci_platform.ko 2024-05-21T01:05:55.761 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 107737 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/ata/libahci.ko 2024-05-21T01:05:55.761 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 42001 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/ata/libahci_platform.ko 2024-05-21T01:05:55.761 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19665 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/ata/pata_acpi.ko 2024-05-21T01:05:55.761 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 35705 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/ata/pata_ali.ko 2024-05-21T01:05:55.761 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 38329 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/ata/pata_amd.ko 2024-05-21T01:05:55.761 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 24649 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/ata/pata_artop.ko 2024-05-21T01:05:55.761 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 23777 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/ata/pata_atiixp.ko 2024-05-21T01:05:55.761 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 28785 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/ata/pata_atp867x.ko 2024-05-21T01:05:55.761 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20409 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/ata/pata_cmd640.ko 2024-05-21T01:05:55.761 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 28929 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/ata/pata_cmd64x.ko 2024-05-21T01:05:55.761 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16633 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/ata/pata_cypress.ko 2024-05-21T01:05:55.762 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20129 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/ata/pata_efar.ko 2024-05-21T01:05:55.762 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 25209 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/ata/pata_hpt366.ko 2024-05-21T01:05:55.762 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 38913 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/ata/pata_hpt37x.ko 2024-05-21T01:05:55.762 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 26969 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/ata/pata_hpt3x2n.ko 2024-05-21T01:05:55.762 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19105 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/ata/pata_hpt3x3.ko 2024-05-21T01:05:55.762 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19201 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/ata/pata_it8213.ko 2024-05-21T01:05:55.762 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 41289 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/ata/pata_it821x.ko 2024-05-21T01:05:55.762 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14097 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/ata/pata_jmicron.ko 2024-05-21T01:05:55.762 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 60257 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/ata/pata_legacy.ko 2024-05-21T01:05:55.762 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17017 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/ata/pata_marvell.ko 2024-05-21T01:05:55.762 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 18065 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/ata/pata_mpiix.ko 2024-05-21T01:05:55.762 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14129 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/ata/pata_netcell.ko 2024-05-21T01:05:55.763 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 18977 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/ata/pata_ninja32.ko 2024-05-21T01:05:55.763 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16761 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/ata/pata_ns87410.ko 2024-05-21T01:05:55.763 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20321 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/ata/pata_ns87415.ko 2024-05-21T01:05:55.763 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 18425 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/ata/pata_oldpiix.ko 2024-05-21T01:05:55.763 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17481 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/ata/pata_opti.ko 2024-05-21T01:05:55.763 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 23681 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/ata/pata_optidma.ko 2024-05-21T01:05:55.763 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 35145 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/ata/pata_pcmcia.ko 2024-05-21T01:05:55.763 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 43009 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/ata/pata_pdc2027x.ko 2024-05-21T01:05:55.763 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 23873 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-05-21T01:05:55.763 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15609 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/ata/pata_piccolo.ko 2024-05-21T01:05:55.763 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17257 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/ata/pata_radisys.ko 2024-05-21T01:05:55.763 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 22233 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/ata/pata_rdc.ko 2024-05-21T01:05:55.763 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17297 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/ata/pata_rz1000.ko 2024-05-21T01:05:55.764 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15377 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/ata/pata_sch.ko 2024-05-21T01:05:55.764 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 26793 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/ata/pata_serverworks.ko 2024-05-21T01:05:55.764 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 27305 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/ata/pata_sil680.ko 2024-05-21T01:05:55.764 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 22833 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/ata/pata_sl82c105.ko 2024-05-21T01:05:55.764 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 18041 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/ata/pata_triflex.ko 2024-05-21T01:05:55.764 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 35025 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/ata/pata_via.ko 2024-05-21T01:05:55.764 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 26337 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/ata/pdc_adma.ko 2024-05-21T01:05:55.764 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 34889 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/ata/sata_inic162x.ko 2024-05-21T01:05:55.764 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 102121 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/ata/sata_mv.ko 2024-05-21T01:05:55.764 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 85409 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/ata/sata_nv.ko 2024-05-21T01:05:55.764 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 44313 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/ata/sata_promise.ko 2024-05-21T01:05:55.764 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 26673 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/ata/sata_qstor.ko 2024-05-21T01:05:55.764 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 34025 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/ata/sata_sil.ko 2024-05-21T01:05:55.765 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 45905 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/ata/sata_sil24.ko 2024-05-21T01:05:55.765 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20185 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/ata/sata_sis.ko 2024-05-21T01:05:55.765 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 24257 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/ata/sata_svw.ko 2024-05-21T01:05:55.765 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 53353 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/ata/sata_sx4.ko 2024-05-21T01:05:55.765 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17273 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/ata/sata_uli.ko 2024-05-21T01:05:55.765 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 41049 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/ata/sata_via.ko 2024-05-21T01:05:55.765 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 23257 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/ata/sata_vsc.ko 2024-05-21T01:05:55.765 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/auxdisplay/ 2024-05-21T01:05:55.765 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19113 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/auxdisplay/ks0108.ko 2024-05-21T01:05:55.765 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/bcma/ 2024-05-21T01:05:55.765 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 163969 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/bcma/bcma.ko 2024-05-21T01:05:55.765 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/block/ 2024-05-21T01:05:55.765 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/block/aoe/ 2024-05-21T01:05:55.766 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 140865 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/block/aoe/aoe.ko 2024-05-21T01:05:55.766 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/block/drbd/ 2024-05-21T01:05:55.766 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 1241657 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/block/drbd/drbd.ko 2024-05-21T01:05:55.766 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 203289 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/block/floppy.ko 2024-05-21T01:05:55.800 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/block/mtip32xx/ 2024-05-21T01:05:55.800 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 115265 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-05-21T01:05:55.800 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 143433 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/block/nbd.ko 2024-05-21T01:05:55.800 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/block/null_blk/ 2024-05-21T01:05:55.800 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 126617 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/block/null_blk/null_blk.ko 2024-05-21T01:05:55.800 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 119873 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/block/pktcdvd.ko 2024-05-21T01:05:55.801 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 313217 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/block/rbd.ko 2024-05-21T01:05:55.801 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/block/xen-blkback/ 2024-05-21T01:05:55.801 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 117233 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-05-21T01:05:55.801 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/block/zram/ 2024-05-21T01:05:55.801 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 70385 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/block/zram/zram.ko 2024-05-21T01:05:55.801 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/char/ 2024-05-21T01:05:55.801 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 35377 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/char/applicom.ko 2024-05-21T01:05:55.801 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13369 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/char/hangcheck-timer.ko 2024-05-21T01:05:55.801 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/char/hw_random/ 2024-05-21T01:05:55.801 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16137 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/char/hw_random/amd-rng.ko 2024-05-21T01:05:55.801 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 21537 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/char/hw_random/intel-rng.ko 2024-05-21T01:05:55.801 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15305 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-05-21T01:05:55.801 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12801 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/char/hw_random/via-rng.ko 2024-05-21T01:05:55.802 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19273 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/char/hw_random/virtio-rng.ko 2024-05-21T01:05:55.802 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/char/ipmi/ 2024-05-21T01:05:55.802 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 37257 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-05-21T01:05:55.802 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 186921 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-05-21T01:05:55.802 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 32521 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-05-21T01:05:55.802 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 179561 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/char/ipmi/ipmi_si.ko 2024-05-21T01:05:55.802 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 85441 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-05-21T01:05:55.802 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 65313 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-05-21T01:05:55.802 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 43857 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/char/lp.ko 2024-05-21T01:05:55.802 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/char/mwave/ 2024-05-21T01:05:55.802 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 103409 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/char/mwave/mwave.ko 2024-05-21T01:05:55.802 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 31833 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/char/nvram.ko 2024-05-21T01:05:55.803 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 38977 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/char/ppdev.ko 2024-05-21T01:05:55.803 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 59241 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/char/tlclk.ko 2024-05-21T01:05:55.803 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/char/tpm/ 2024-05-21T01:05:55.803 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 18889 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/char/tpm/tpm_atmel.ko 2024-05-21T01:05:55.803 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 18177 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-05-21T01:05:55.803 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 29425 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-05-21T01:05:55.803 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 39193 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-05-21T01:05:55.803 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 34169 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/char/tpm/tpm_infineon.ko 2024-05-21T01:05:55.803 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 25961 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/char/tpm/tpm_nsc.ko 2024-05-21T01:05:55.803 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 28497 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-05-21T01:05:55.803 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/char/xillybus/ 2024-05-21T01:05:55.803 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19225 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/char/xillybus/xillybus_class.ko 2024-05-21T01:05:55.803 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 62545 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/char/xillybus/xillybus_core.ko 2024-05-21T01:05:55.803 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13929 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-05-21T01:05:55.804 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/clk/ 2024-05-21T01:05:55.804 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14537 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/clk/clk-palmas.ko 2024-05-21T01:05:55.804 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 57289 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/clk/clk-si5351.ko 2024-05-21T01:05:55.804 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13385 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/clk/clk-twl6040.ko 2024-05-21T01:05:55.804 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 24129 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/clk/clk-wm831x.ko 2024-05-21T01:05:55.804 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/cpufreq/ 2024-05-21T01:05:55.804 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11593 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-05-21T01:05:55.804 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19185 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/cpufreq/p4-clockmod.ko 2024-05-21T01:05:55.804 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 28633 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/cpufreq/speedstep-lib.ko 2024-05-21T01:05:55.804 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/crypto/ 2024-05-21T01:05:55.804 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/crypto/ccp/ 2024-05-21T01:05:55.804 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 89257 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-05-21T01:05:55.804 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 333657 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/crypto/ccp/ccp.ko 2024-05-21T01:05:55.805 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/crypto/intel/ 2024-05-21T01:05:55.805 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/crypto/intel/qat/ 2024-05-21T01:05:55.805 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/crypto/intel/qat/qat_common/ 2024-05-21T01:05:55.805 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 751713 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-05-21T01:05:55.805 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-05-21T01:05:55.805 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 29497 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-05-21T01:05:55.805 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 23169 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/crypto/padlock-aes.ko 2024-05-21T01:05:55.805 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 26721 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/crypto/padlock-sha.ko 2024-05-21T01:05:55.805 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/crypto/virtio/ 2024-05-21T01:05:55.805 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 90441 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-05-21T01:05:55.805 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/dca/ 2024-05-21T01:05:55.805 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 36105 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/dca/dca.ko 2024-05-21T01:05:55.805 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/dma/ 2024-05-21T01:05:55.805 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/dma/dw/ 2024-05-21T01:05:55.806 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 18593 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/dma/dw/dw_dmac.ko 2024-05-21T01:05:55.806 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/dma/ioat/ 2024-05-21T01:05:55.806 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 146769 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/dma/ioat/ioatdma.ko 2024-05-21T01:05:55.806 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/edac/ 2024-05-21T01:05:55.806 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 96145 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/edac/amd64_edac.ko 2024-05-21T01:05:55.806 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 41993 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/edac/e752x_edac.ko 2024-05-21T01:05:55.806 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 51105 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/edac/edac_mce_amd.ko 2024-05-21T01:05:55.806 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 21017 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/edac/i3000_edac.ko 2024-05-21T01:05:55.806 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20729 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/edac/i3200_edac.ko 2024-05-21T01:05:55.806 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 26729 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/edac/i5100_edac.ko 2024-05-21T01:05:55.806 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 29593 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/edac/i5400_edac.ko 2024-05-21T01:05:55.806 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 28385 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/edac/i7300_edac.ko 2024-05-21T01:05:55.806 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 64161 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/edac/i7core_edac.ko 2024-05-21T01:05:55.807 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 21289 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/edac/i82975x_edac.ko 2024-05-21T01:05:55.807 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 22369 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/edac/ie31200_edac.ko 2024-05-21T01:05:55.807 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 68697 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/edac/sb_edac.ko 2024-05-21T01:05:55.807 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20241 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/edac/x38_edac.ko 2024-05-21T01:05:55.807 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/extcon/ 2024-05-21T01:05:55.807 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14593 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/extcon/extcon-gpio.ko 2024-05-21T01:05:55.807 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 31369 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/extcon/extcon-max14577.ko 2024-05-21T01:05:55.807 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 35601 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/extcon/extcon-max77693.ko 2024-05-21T01:05:55.807 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 29273 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/extcon/extcon-max8997.ko 2024-05-21T01:05:55.807 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 30961 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/extcon/extcon-palmas.ko 2024-05-21T01:05:55.807 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 27201 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/extcon/extcon-rt8973a.ko 2024-05-21T01:05:55.807 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 31993 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/extcon/extcon-sm5502.ko 2024-05-21T01:05:55.807 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/firmware/ 2024-05-21T01:05:55.808 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 42953 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/firmware/dmi-sysfs.ko 2024-05-21T01:05:55.808 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/firmware/efi/ 2024-05-21T01:05:55.808 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19721 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/firmware/efi/efi-pstore.ko 2024-05-21T01:05:55.808 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 26361 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/firmware/iscsi_ibft.ko 2024-05-21T01:05:55.808 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/gpio/ 2024-05-21T01:05:55.808 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14281 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/gpio/gpio-adp5520.ko 2024-05-21T01:05:55.808 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 23233 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/gpio/gpio-amd8111.ko 2024-05-21T01:05:55.808 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17689 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/gpio/gpio-arizona.ko 2024-05-21T01:05:55.808 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16745 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/gpio/gpio-da9052.ko 2024-05-21T01:05:55.808 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13993 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/gpio/gpio-da9055.ko 2024-05-21T01:05:55.808 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 26945 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/gpio/gpio-dln2.ko 2024-05-21T01:05:55.808 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 81073 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/gpio/gpio-f7188x.ko 2024-05-21T01:05:55.808 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 40761 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/gpio/gpio-generic.ko 2024-05-21T01:05:55.809 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 22513 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/gpio/gpio-ich.ko 2024-05-21T01:05:55.809 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14033 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-05-21T01:05:55.809 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16889 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/gpio/gpio-kempld.ko 2024-05-21T01:05:55.809 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14681 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/gpio/gpio-lp3943.ko 2024-05-21T01:05:55.809 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11153 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/gpio/gpio-max7300.ko 2024-05-21T01:05:55.809 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14817 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/gpio/gpio-max730x.ko 2024-05-21T01:05:55.809 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 24745 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/gpio/gpio-max732x.ko 2024-05-21T01:05:55.809 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 29945 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-05-21T01:05:55.809 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 55505 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/gpio/gpio-pca953x.ko 2024-05-21T01:05:55.809 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 31881 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/gpio/gpio-pcf857x.ko 2024-05-21T01:05:55.809 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16689 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/gpio/gpio-rdc321x.ko 2024-05-21T01:05:55.809 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 24353 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/gpio/gpio-sch.ko 2024-05-21T01:05:55.809 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 23145 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/gpio/gpio-sch311x.ko 2024-05-21T01:05:55.810 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14265 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/gpio/gpio-tps65912.ko 2024-05-21T01:05:55.810 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 25009 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/gpio/gpio-twl4030.ko 2024-05-21T01:05:55.810 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13113 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/gpio/gpio-twl6040.ko 2024-05-21T01:05:55.810 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 24457 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/gpio/gpio-viperboard.ko 2024-05-21T01:05:55.810 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17897 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/gpio/gpio-vx855.ko 2024-05-21T01:05:55.810 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19129 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/gpio/gpio-wm831x.ko 2024-05-21T01:05:55.810 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13665 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/gpio/gpio-wm8350.ko 2024-05-21T01:05:55.810 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20401 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/gpio/gpio-wm8994.ko 2024-05-21T01:05:55.810 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hid/ 2024-05-21T01:05:55.810 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13521 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hid/hid-a4tech.ko 2024-05-21T01:05:55.810 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 43553 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hid/hid-apple.ko 2024-05-21T01:05:55.810 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16881 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hid/hid-appleir.ko 2024-05-21T01:05:55.811 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 9393 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hid/hid-aureal.ko 2024-05-21T01:05:55.811 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17097 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hid/hid-axff.ko 2024-05-21T01:05:55.811 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12697 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hid/hid-belkin.ko 2024-05-21T01:05:55.811 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11713 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hid/hid-cherry.ko 2024-05-21T01:05:55.811 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19089 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hid/hid-chicony.ko 2024-05-21T01:05:55.811 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 74393 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hid/hid-cp2112.ko 2024-05-21T01:05:55.811 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12817 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hid/hid-cypress.ko 2024-05-21T01:05:55.811 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 18769 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hid/hid-dr.ko 2024-05-21T01:05:55.811 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12113 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hid/hid-elecom.ko 2024-05-21T01:05:55.811 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20449 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hid/hid-elo.ko 2024-05-21T01:05:55.811 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15137 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hid/hid-emsff.ko 2024-05-21T01:05:55.811 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11665 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hid/hid-ezkey.ko 2024-05-21T01:05:55.811 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16089 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hid/hid-gaff.ko 2024-05-21T01:05:55.812 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 10681 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hid/hid-generic.ko 2024-05-21T01:05:55.812 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19793 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hid/hid-gt683r.ko 2024-05-21T01:05:55.812 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14665 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hid/hid-gyration.ko 2024-05-21T01:05:55.812 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12081 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hid/hid-holtek-kbd.ko 2024-05-21T01:05:55.812 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11921 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hid/hid-holtek-mouse.ko 2024-05-21T01:05:55.812 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16433 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hid/hid-holtekff.ko 2024-05-21T01:05:55.812 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 22889 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hid/hid-hyperv.ko 2024-05-21T01:05:55.812 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11889 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hid/hid-icade.ko 2024-05-21T01:05:55.812 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 10457 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hid/hid-kensington.ko 2024-05-21T01:05:55.812 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 9529 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hid/hid-keytouch.ko 2024-05-21T01:05:55.812 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19169 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hid/hid-kye.ko 2024-05-21T01:05:55.812 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12265 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hid/hid-lcpower.ko 2024-05-21T01:05:55.812 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 24961 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hid/hid-led.ko 2024-05-21T01:05:55.812 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 54217 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hid/hid-lenovo.ko 2024-05-21T01:05:55.813 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 37553 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hid/hid-lg-g15.ko 2024-05-21T01:05:55.813 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 68081 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hid/hid-logitech-dj.ko 2024-05-21T01:05:55.813 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 121369 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-05-21T01:05:55.813 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 97953 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hid/hid-logitech.ko 2024-05-21T01:05:55.813 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 36689 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hid/hid-magicmouse.ko 2024-05-21T01:05:55.813 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 25769 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hid/hid-microsoft.ko 2024-05-21T01:05:55.813 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11825 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hid/hid-monterey.ko 2024-05-21T01:05:55.813 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 59001 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hid/hid-multitouch.ko 2024-05-21T01:05:55.813 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 39697 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hid/hid-ntrig.ko 2024-05-21T01:05:55.813 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 9985 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hid/hid-ortek.ko 2024-05-21T01:05:55.813 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 10177 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hid/hid-penmount.ko 2024-05-21T01:05:55.813 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14281 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hid/hid-petalynx.ko 2024-05-21T01:05:55.813 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 91241 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hid/hid-picolcd.ko 2024-05-21T01:05:55.814 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15793 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hid/hid-pl.ko 2024-05-21T01:05:55.814 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16817 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hid/hid-plantronics.ko 2024-05-21T01:05:55.814 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 9417 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hid/hid-primax.ko 2024-05-21T01:05:55.814 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 42889 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hid/hid-rmi.ko 2024-05-21T01:05:55.814 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 25177 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hid/hid-roccat-arvo.ko 2024-05-21T01:05:55.814 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16321 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hid/hid-roccat-common.ko 2024-05-21T01:05:55.814 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 38865 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hid/hid-roccat-isku.ko 2024-05-21T01:05:55.814 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 36305 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hid/hid-roccat-kone.ko 2024-05-21T01:05:55.814 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 38073 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-05-21T01:05:55.814 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 26097 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hid/hid-roccat-konepure.ko 2024-05-21T01:05:55.814 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 35625 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-05-21T01:05:55.814 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15481 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hid/hid-roccat-lua.ko 2024-05-21T01:05:55.814 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 35425 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hid/hid-roccat-pyra.ko 2024-05-21T01:05:55.815 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 35561 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hid/hid-roccat-ryos.ko 2024-05-21T01:05:55.815 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 23993 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hid/hid-roccat-savu.ko 2024-05-21T01:05:55.815 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 28001 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hid/hid-roccat.ko 2024-05-21T01:05:55.815 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15721 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hid/hid-saitek.ko 2024-05-21T01:05:55.815 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 42305 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hid/hid-samsung.ko 2024-05-21T01:05:55.815 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 43609 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hid/hid-sensor-hub.ko 2024-05-21T01:05:55.815 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15145 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hid/hid-sjoy.ko 2024-05-21T01:05:55.815 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 62129 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hid/hid-sony.ko 2024-05-21T01:05:55.815 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 9353 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hid/hid-speedlink.ko 2024-05-21T01:05:55.815 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 30017 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hid/hid-steelseries.ko 2024-05-21T01:05:55.815 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11185 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hid/hid-sunplus.ko 2024-05-21T01:05:55.815 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19289 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hid/hid-thrustmaster.ko 2024-05-21T01:05:55.815 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11857 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hid/hid-tivo.ko 2024-05-21T01:05:55.816 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16681 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hid/hid-tmff.ko 2024-05-21T01:05:55.816 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16537 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hid/hid-topseed.ko 2024-05-21T01:05:55.816 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19273 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hid/hid-twinhan.ko 2024-05-21T01:05:55.816 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 81113 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hid/hid-uclogic.ko 2024-05-21T01:05:55.816 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12569 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hid/hid-waltop.ko 2024-05-21T01:05:55.816 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 184745 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hid/hid-wiimote.ko 2024-05-21T01:05:55.816 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 9185 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hid/hid-xinmo.ko 2024-05-21T01:05:55.816 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14961 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hid/hid-zpff.ko 2024-05-21T01:05:55.816 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19201 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hid/hid-zydacron.ko 2024-05-21T01:05:55.816 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 319921 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hid/hid.ko 2024-05-21T01:05:55.816 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 39529 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hid/uhid.ko 2024-05-21T01:05:55.816 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hid/usbhid/ 2024-05-21T01:05:55.817 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 153633 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hid/usbhid/usbhid.ko 2024-05-21T01:05:55.817 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 22361 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hid/usbhid/usbkbd.ko 2024-05-21T01:05:55.817 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17457 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hid/usbhid/usbmouse.ko 2024-05-21T01:05:55.817 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 261945 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hid/wacom.ko 2024-05-21T01:05:55.817 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hv/ 2024-05-21T01:05:55.817 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 75065 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hv/hv_balloon.ko 2024-05-21T01:05:55.817 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 110681 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hv/hv_utils.ko 2024-05-21T01:05:55.817 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 382033 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hv/hv_vmbus.ko 2024-05-21T01:05:55.817 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/ 2024-05-21T01:05:55.817 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 77153 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/abituguru.ko 2024-05-21T01:05:55.817 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 67009 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/abituguru3.ko 2024-05-21T01:05:55.817 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 42249 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/acpi_power_meter.ko 2024-05-21T01:05:55.817 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20297 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/ad7414.ko 2024-05-21T01:05:55.817 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 22009 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/ad7418.ko 2024-05-21T01:05:55.818 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 29449 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/adc128d818.ko 2024-05-21T01:05:55.818 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 38097 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/adm1025.ko 2024-05-21T01:05:55.818 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 115057 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/adm1026.ko 2024-05-21T01:05:55.818 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 23321 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/adm1029.ko 2024-05-21T01:05:55.818 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 55225 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/adm1031.ko 2024-05-21T01:05:55.818 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 31441 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/adm9240.ko 2024-05-21T01:05:55.818 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16257 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/ads7828.ko 2024-05-21T01:05:55.818 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12249 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/adt7410.ko 2024-05-21T01:05:55.818 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 26505 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/adt7411.ko 2024-05-21T01:05:55.818 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 89025 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/adt7462.ko 2024-05-21T01:05:55.818 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 49153 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/adt7470.ko 2024-05-21T01:05:55.818 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 81473 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/adt7475.ko 2024-05-21T01:05:55.819 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 22913 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/adt7x10.ko 2024-05-21T01:05:55.819 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 48177 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/amc6821.ko 2024-05-21T01:05:55.819 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 68865 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/applesmc.ko 2024-05-21T01:05:55.819 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 60193 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/asb100.ko 2024-05-21T01:05:55.819 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 69009 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/asc7621.ko 2024-05-21T01:05:55.819 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 47977 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/asus_atk0110.ko 2024-05-21T01:05:55.819 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20321 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/atxp1.ko 2024-05-21T01:05:55.819 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 33641 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/coretemp.ko 2024-05-21T01:05:55.819 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 29401 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/da9052-hwmon.ko 2024-05-21T01:05:55.819 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19801 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/da9055-hwmon.ko 2024-05-21T01:05:55.819 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 55713 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-05-21T01:05:55.819 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 113201 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/dme1737.ko 2024-05-21T01:05:55.819 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 22689 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/ds1621.ko 2024-05-21T01:05:55.819 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17489 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/ds620.ko 2024-05-21T01:05:55.820 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 33665 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/emc1403.ko 2024-05-21T01:05:55.820 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 40177 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/emc2103.ko 2024-05-21T01:05:55.820 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 34649 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/emc6w201.ko 2024-05-21T01:05:55.820 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 78921 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/f71805f.ko 2024-05-21T01:05:55.820 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 108961 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/f71882fg.ko 2024-05-21T01:05:55.820 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 50697 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/f75375s.ko 2024-05-21T01:05:55.820 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 25361 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/fam15h_power.ko 2024-05-21T01:05:55.820 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 65769 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/fschmd.ko 2024-05-21T01:05:55.820 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17201 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/g760a.ko 2024-05-21T01:05:55.820 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 30585 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/g762.ko 2024-05-21T01:05:55.820 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 59761 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/gl518sm.ko 2024-05-21T01:05:55.820 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 56313 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/gl520sm.ko 2024-05-21T01:05:55.820 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15473 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/hih6130.ko 2024-05-21T01:05:55.821 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12089 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/hwmon-vid.ko 2024-05-21T01:05:55.821 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13137 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/i5500_temp.ko 2024-05-21T01:05:55.821 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 27633 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/i5k_amb.ko 2024-05-21T01:05:55.821 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 42585 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/ibmaem.ko 2024-05-21T01:05:55.821 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 24945 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/ibmpex.ko 2024-05-21T01:05:55.821 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 28409 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/ina209.ko 2024-05-21T01:05:55.821 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14537 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/ina2xx.ko 2024-05-21T01:05:55.821 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 156465 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/it87.ko 2024-05-21T01:05:55.821 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 23129 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/jc42.ko 2024-05-21T01:05:55.821 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 28273 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/k10temp.ko 2024-05-21T01:05:55.821 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15729 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/k8temp.ko 2024-05-21T01:05:55.821 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 21713 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/lineage-pem.ko 2024-05-21T01:05:55.821 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 57769 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/lm63.ko 2024-05-21T01:05:55.822 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19777 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/lm73.ko 2024-05-21T01:05:55.822 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 44121 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/lm75.ko 2024-05-21T01:05:55.822 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 23241 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/lm77.ko 2024-05-21T01:05:55.822 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 41473 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/lm78.ko 2024-05-21T01:05:55.822 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 37049 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/lm80.ko 2024-05-21T01:05:55.822 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20545 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/lm83.ko 2024-05-21T01:05:55.822 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 86497 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/lm85.ko 2024-05-21T01:05:55.822 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 55641 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/lm87.ko 2024-05-21T01:05:55.822 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 42249 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/lm90.ko 2024-05-21T01:05:55.822 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 23385 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/lm92.ko 2024-05-21T01:05:55.822 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 131505 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/lm93.ko 2024-05-21T01:05:55.822 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 40225 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/lm95234.ko 2024-05-21T01:05:55.823 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19137 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/lm95241.ko 2024-05-21T01:05:55.823 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 21689 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/lm95245.ko 2024-05-21T01:05:55.823 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 26393 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/ltc2945.ko 2024-05-21T01:05:55.823 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15481 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/ltc4151.ko 2024-05-21T01:05:55.823 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17793 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/ltc4215.ko 2024-05-21T01:05:55.823 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16633 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/ltc4222.ko 2024-05-21T01:05:55.823 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 18377 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/ltc4245.ko 2024-05-21T01:05:55.823 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14905 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/ltc4260.ko 2024-05-21T01:05:55.823 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17113 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/ltc4261.ko 2024-05-21T01:05:55.823 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 36769 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/max16065.ko 2024-05-21T01:05:55.823 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 21585 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/max1619.ko 2024-05-21T01:05:55.823 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 28313 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/max1668.ko 2024-05-21T01:05:55.823 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 22753 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/max197.ko 2024-05-21T01:05:55.823 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 32505 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/max6639.ko 2024-05-21T01:05:55.824 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 27305 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/max6650.ko 2024-05-21T01:05:55.824 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 39729 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/max6697.ko 2024-05-21T01:05:55.824 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 21513 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/mc13783-adc.ko 2024-05-21T01:05:55.824 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12353 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/mcp3021.ko 2024-05-21T01:05:55.824 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17873 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-05-21T01:05:55.824 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 56505 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/nct6683.ko 2024-05-21T01:05:55.824 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 141353 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/nct6775-core.ko 2024-05-21T01:05:55.824 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 72737 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/nct6775.ko 2024-05-21T01:05:55.824 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 67841 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/nct7802.ko 2024-05-21T01:05:55.824 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 97777 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/pc87360.ko 2024-05-21T01:05:55.824 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 61921 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/pc87427.ko 2024-05-21T01:05:55.824 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 21825 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/pcf8591.ko 2024-05-21T01:05:55.824 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/pmbus/ 2024-05-21T01:05:55.824 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 24753 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-05-21T01:05:55.825 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19313 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-05-21T01:05:55.825 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 33265 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-05-21T01:05:55.825 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 10793 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/pmbus/max16064.ko 2024-05-21T01:05:55.825 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19841 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/pmbus/max34440.ko 2024-05-21T01:05:55.825 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11961 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/pmbus/max8688.ko 2024-05-21T01:05:55.825 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17585 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-05-21T01:05:55.825 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 101233 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-05-21T01:05:55.825 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 9337 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-05-21T01:05:55.825 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 36177 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-05-21T01:05:55.825 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16873 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-05-21T01:05:55.825 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 24441 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-05-21T01:05:55.825 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15353 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/powr1220.ko 2024-05-21T01:05:55.825 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 25433 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/sch5627.ko 2024-05-21T01:05:55.826 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 32945 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/sch5636.ko 2024-05-21T01:05:55.826 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 34561 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/sch56xx-common.ko 2024-05-21T01:05:55.826 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 40849 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/sht15.ko 2024-05-21T01:05:55.826 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15977 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/sht21.ko 2024-05-21T01:05:55.826 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19337 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/shtc1.ko 2024-05-21T01:05:55.826 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 48713 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/sis5595.ko 2024-05-21T01:05:55.826 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 22401 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/smsc47b397.ko 2024-05-21T01:05:55.826 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 46473 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/smsc47m1.ko 2024-05-21T01:05:55.826 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 44313 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/smsc47m192.ko 2024-05-21T01:05:55.826 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 31417 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/thmc50.ko 2024-05-21T01:05:55.826 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20089 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/tmp102.ko 2024-05-21T01:05:55.826 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16441 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/tmp103.ko 2024-05-21T01:05:55.826 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 25185 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/tmp401.ko 2024-05-21T01:05:55.827 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 23097 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/tmp421.ko 2024-05-21T01:05:55.827 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 23033 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/via-cputemp.ko 2024-05-21T01:05:55.827 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 50217 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/via686a.ko 2024-05-21T01:05:55.827 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 59665 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/vt1211.ko 2024-05-21T01:05:55.827 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 62737 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/vt8231.ko 2024-05-21T01:05:55.827 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 71169 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/w83627ehf.ko 2024-05-21T01:05:55.827 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 96577 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/w83627hf.ko 2024-05-21T01:05:55.827 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 85913 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/w83781d.ko 2024-05-21T01:05:55.827 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 75129 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/w83791d.ko 2024-05-21T01:05:55.827 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 83425 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/w83792d.ko 2024-05-21T01:05:55.827 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 116777 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/w83793.ko 2024-05-21T01:05:55.827 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 134441 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/w83795.ko 2024-05-21T01:05:55.827 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20121 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/w83l785ts.ko 2024-05-21T01:05:55.828 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 43385 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/w83l786ng.ko 2024-05-21T01:05:55.828 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15481 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-05-21T01:05:55.828 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12001 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-05-21T01:05:55.828 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/i2c/ 2024-05-21T01:05:55.828 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/i2c/algos/ 2024-05-21T01:05:55.828 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 27353 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-05-21T01:05:55.828 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 25273 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-05-21T01:05:55.828 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/i2c/busses/ 2024-05-21T01:05:55.828 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 33345 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-05-21T01:05:55.828 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 35073 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-05-21T01:05:55.828 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 32905 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-05-21T01:05:55.828 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 21369 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-05-21T01:05:55.828 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 30361 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-05-21T01:05:55.829 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19313 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-05-21T01:05:55.829 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17737 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-05-21T01:05:55.829 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 7729 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-05-21T01:05:55.829 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15841 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-05-21T01:05:55.829 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 64233 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-05-21T01:05:55.829 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 28161 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-05-21T01:05:55.829 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 24233 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-05-21T01:05:55.829 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19905 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-05-21T01:05:55.829 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14409 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-05-21T01:05:55.829 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20257 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-05-21T01:05:55.829 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 76969 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/i2c/busses/i2c-i801.ko 2024-05-21T01:05:55.829 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 24705 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/i2c/busses/i2c-isch.ko 2024-05-21T01:05:55.829 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 52937 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-05-21T01:05:55.830 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20953 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-05-21T01:05:55.830 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 21305 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-05-21T01:05:55.830 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 25945 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-05-21T01:05:55.830 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 33209 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-05-21T01:05:55.830 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 30049 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/i2c/busses/i2c-parport.ko 2024-05-21T01:05:55.830 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20057 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-05-21T01:05:55.830 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 57217 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-05-21T01:05:55.830 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17441 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-05-21T01:05:55.830 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 21145 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-05-21T01:05:55.830 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13961 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-05-21T01:05:55.830 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 24713 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-05-21T01:05:55.830 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 32585 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-05-21T01:05:55.830 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 22609 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-05-21T01:05:55.831 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 22825 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-05-21T01:05:55.831 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 22649 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-05-21T01:05:55.831 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15833 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/i2c/busses/i2c-via.ko 2024-05-21T01:05:55.831 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 29993 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-05-21T01:05:55.831 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 21793 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-05-21T01:05:55.831 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 59193 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-05-21T01:05:55.831 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 27849 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/i2c/i2c-mux.ko 2024-05-21T01:05:55.831 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 21873 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/i2c/i2c-smbus.ko 2024-05-21T01:05:55.831 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 29577 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/i2c/i2c-stub.ko 2024-05-21T01:05:55.831 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/i2c/muxes/ 2024-05-21T01:05:55.831 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17649 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-05-21T01:05:55.831 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16001 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-05-21T01:05:55.832 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 36569 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-05-21T01:05:55.832 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/infiniband/ 2024-05-21T01:05:55.832 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/infiniband/core/ 2024-05-21T01:05:55.832 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 329697 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/infiniband/core/ib_cm.ko 2024-05-21T01:05:55.832 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 1119913 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/infiniband/core/ib_core.ko 2024-05-21T01:05:55.832 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 83905 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/infiniband/core/ib_umad.ko 2024-05-21T01:05:55.832 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 408433 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-05-21T01:05:55.832 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 120921 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/infiniband/core/iw_cm.ko 2024-05-21T01:05:55.832 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 347217 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/infiniband/core/rdma_cm.ko 2024-05-21T01:05:55.832 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 84945 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-05-21T01:05:55.832 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/infiniband/hw/ 2024-05-21T01:05:55.832 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/infiniband/hw/cxgb4/ 2024-05-21T01:05:55.832 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 590929 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-05-21T01:05:55.832 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/infiniband/hw/mlx4/ 2024-05-21T01:05:55.833 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 514641 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-05-21T01:05:55.833 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/infiniband/hw/mlx5/ 2024-05-21T01:05:55.833 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 911665 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-05-21T01:05:55.855 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/infiniband/hw/mthca/ 2024-05-21T01:05:55.855 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 375545 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-05-21T01:05:55.855 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/infiniband/hw/ocrdma/ 2024-05-21T01:05:55.855 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 197121 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-05-21T01:05:55.856 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/infiniband/hw/usnic/ 2024-05-21T01:05:55.856 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 212553 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-05-21T01:05:55.856 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/infiniband/ulp/ 2024-05-21T01:05:55.856 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/infiniband/ulp/ipoib/ 2024-05-21T01:05:55.856 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 334401 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-05-21T01:05:55.856 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/infiniband/ulp/iser/ 2024-05-21T01:05:55.856 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 120673 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-05-21T01:05:55.856 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/infiniband/ulp/isert/ 2024-05-21T01:05:55.856 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 132585 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-05-21T01:05:55.856 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/infiniband/ulp/srp/ 2024-05-21T01:05:55.856 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 157937 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-05-21T01:05:55.856 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/infiniband/ulp/srpt/ 2024-05-21T01:05:55.856 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 156673 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-05-21T01:05:55.857 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/input/ 2024-05-21T01:05:55.857 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12201 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/input/evbug.ko 2024-05-21T01:05:55.857 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 27609 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/input/ff-memless.ko 2024-05-21T01:05:55.857 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/input/gameport/ 2024-05-21T01:05:55.857 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13401 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-05-21T01:05:55.857 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13985 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/input/gameport/fm801-gp.ko 2024-05-21T01:05:55.857 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 50713 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/input/gameport/gameport.ko 2024-05-21T01:05:55.857 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 49441 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/input/joydev.ko 2024-05-21T01:05:55.857 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/input/keyboard/ 2024-05-21T01:05:55.857 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15537 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-05-21T01:05:55.857 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14753 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-05-21T01:05:55.857 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 35665 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-05-21T01:05:55.857 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 28305 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-05-21T01:05:55.858 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 45473 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/input/keyboard/gpio_keys.ko 2024-05-21T01:05:55.858 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 22257 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-05-21T01:05:55.858 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 25617 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/input/keyboard/lkkbd.ko 2024-05-21T01:05:55.858 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 31857 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/input/keyboard/lm8323.ko 2024-05-21T01:05:55.858 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16761 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/input/keyboard/lm8333.ko 2024-05-21T01:05:55.858 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 25825 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-05-21T01:05:55.858 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 21465 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-05-21T01:05:55.858 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19257 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-05-21T01:05:55.858 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19121 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-05-21T01:05:55.858 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13281 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/input/keyboard/newtonkbd.ko 2024-05-21T01:05:55.858 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12233 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-05-21T01:05:55.858 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17105 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/input/keyboard/qt1070.ko 2024-05-21T01:05:55.862 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 21561 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/input/keyboard/qt2160.ko 2024-05-21T01:05:55.862 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 28689 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-05-21T01:05:55.862 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13121 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/input/keyboard/stowaway.ko 2024-05-21T01:05:55.862 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 22337 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/input/keyboard/sunkbd.ko 2024-05-21T01:05:55.862 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20649 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-05-21T01:05:55.862 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 18921 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-05-21T01:05:55.862 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19569 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-05-21T01:05:55.862 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13457 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/input/keyboard/xtkbd.ko 2024-05-21T01:05:55.862 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13137 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/input/matrix-keymap.ko 2024-05-21T01:05:55.862 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/input/mouse/ 2024-05-21T01:05:55.862 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 40617 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/input/mouse/appletouch.ko 2024-05-21T01:05:55.863 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 39553 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/input/mouse/bcm5974.ko 2024-05-21T01:05:55.863 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 160017 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/input/mouse/cyapatp.ko 2024-05-21T01:05:55.863 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 114273 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/input/mouse/elan_i2c.ko 2024-05-21T01:05:55.863 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15985 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/input/mouse/gpio_mouse.ko 2024-05-21T01:05:55.863 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 428185 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/input/mouse/psmouse.ko 2024-05-21T01:05:55.863 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16937 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/input/mouse/sermouse.ko 2024-05-21T01:05:55.863 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 27865 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-05-21T01:05:55.863 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 27193 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/input/mouse/synaptics_usb.ko 2024-05-21T01:05:55.863 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 18809 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/input/mouse/vsxxxaa.ko 2024-05-21T01:05:55.863 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/input/rmi4/ 2024-05-21T01:05:55.863 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 140969 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/input/rmi4/rmi_core.ko 2024-05-21T01:05:55.863 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/input/serio/ 2024-05-21T01:05:55.864 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13721 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/input/serio/altera_ps2.ko 2024-05-21T01:05:55.864 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 18865 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/input/serio/arc_ps2.ko 2024-05-21T01:05:55.864 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20385 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/input/serio/ct82c710.ko 2024-05-21T01:05:55.864 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20289 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-05-21T01:05:55.864 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 18393 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/input/serio/parkbd.ko 2024-05-21T01:05:55.864 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15537 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/input/serio/pcips2.ko 2024-05-21T01:05:55.864 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 23777 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/input/serio/ps2mult.ko 2024-05-21T01:05:55.864 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 28905 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/input/serio/serio_raw.ko 2024-05-21T01:05:55.864 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 21721 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/input/serio/serport.ko 2024-05-21T01:05:55.864 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16321 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/input/sparse-keymap.ko 2024-05-21T01:05:55.864 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/leds/ 2024-05-21T01:05:55.864 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15737 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/leds/leds-88pm860x.ko 2024-05-21T01:05:55.864 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13161 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/leds/leds-adp5520.ko 2024-05-21T01:05:55.865 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 77265 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/leds/leds-bd2802.ko 2024-05-21T01:05:55.865 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 31097 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/leds/leds-blinkm.ko 2024-05-21T01:05:55.865 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11897 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/leds/leds-da903x.ko 2024-05-21T01:05:55.865 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14729 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/leds/leds-da9052.ko 2024-05-21T01:05:55.865 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20017 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/leds/leds-gpio.ko 2024-05-21T01:05:55.865 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 18721 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/leds/leds-lm3530.ko 2024-05-21T01:05:55.865 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 36705 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/leds/leds-lm3533.ko 2024-05-21T01:05:55.865 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 22873 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/leds/leds-lm355x.ko 2024-05-21T01:05:55.865 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 23833 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/leds/leds-lm3642.ko 2024-05-21T01:05:55.865 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 18769 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/leds/leds-lp3944.ko 2024-05-21T01:05:55.865 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12809 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/leds/leds-lp8788.ko 2024-05-21T01:05:55.865 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 18041 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/leds/leds-max8997.ko 2024-05-21T01:05:55.865 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14177 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/leds/leds-mc13783.ko 2024-05-21T01:05:55.866 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14617 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/leds/leds-menf21bmc.ko 2024-05-21T01:05:55.866 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 25617 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/leds/leds-pca9532.ko 2024-05-21T01:05:55.866 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 23809 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/leds/leds-pca955x.ko 2024-05-21T01:05:55.866 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 21817 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/leds/leds-pca963x.ko 2024-05-21T01:05:55.866 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 38113 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/leds/leds-ss4200.ko 2024-05-21T01:05:55.866 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 28337 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/leds/leds-tca6507.ko 2024-05-21T01:05:55.866 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 18177 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/leds/leds-wm831x-status.ko 2024-05-21T01:05:55.866 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13633 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/leds/leds-wm8350.ko 2024-05-21T01:05:55.866 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/leds/trigger/ 2024-05-21T01:05:55.866 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11761 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-05-21T01:05:55.866 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12649 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-05-21T01:05:55.867 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 10233 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-05-21T01:05:55.867 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 8641 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-05-21T01:05:55.867 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15073 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-05-21T01:05:55.867 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16601 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-05-21T01:05:55.867 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16769 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-05-21T01:05:55.867 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13961 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-05-21T01:05:55.867 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16713 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-05-21T01:05:55.867 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/md/ 2024-05-21T01:05:55.867 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/md/bcache/ 2024-05-21T01:05:55.867 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 790753 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/md/bcache/bcache.ko 2024-05-21T01:05:55.867 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 49081 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/md/dm-bio-prison.ko 2024-05-21T01:05:55.867 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 116825 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/md/dm-bufio.ko 2024-05-21T01:05:55.867 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 58281 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/md/dm-cache-smq.ko 2024-05-21T01:05:55.868 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 199041 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/md/dm-cache.ko 2024-05-21T01:05:55.868 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 134945 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/md/dm-crypt.ko 2024-05-21T01:05:55.868 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 28897 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/md/dm-delay.ko 2024-05-21T01:05:55.868 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 67497 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/md/dm-era.ko 2024-05-21T01:05:55.868 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 33017 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/md/dm-flakey.ko 2024-05-21T01:05:55.868 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 50457 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/md/dm-log-userspace.ko 2024-05-21T01:05:55.868 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 41145 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/md/dm-log.ko 2024-05-21T01:05:55.868 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 60977 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/md/dm-mirror.ko 2024-05-21T01:05:55.868 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 97209 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/md/dm-multipath.ko 2024-05-21T01:05:55.868 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19809 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/md/dm-queue-length.ko 2024-05-21T01:05:55.868 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 85689 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/md/dm-raid.ko 2024-05-21T01:05:55.868 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 44289 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/md/dm-region-hash.ko 2024-05-21T01:05:55.868 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 18993 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/md/dm-round-robin.ko 2024-05-21T01:05:55.869 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20097 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/md/dm-service-time.ko 2024-05-21T01:05:55.869 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 139817 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/md/dm-snapshot.ko 2024-05-21T01:05:55.869 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 22873 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/md/dm-switch.ko 2024-05-21T01:05:55.869 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 234457 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/md/dm-thin-pool.ko 2024-05-21T01:05:55.869 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 66425 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/md/dm-verity.ko 2024-05-21T01:05:55.869 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 9985 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/md/dm-zero.ko 2024-05-21T01:05:55.869 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/md/persistent-data/ 2024-05-21T01:05:55.869 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 264329 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-05-21T01:05:55.869 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 43137 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/md/raid0.ko 2024-05-21T01:05:55.869 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 125009 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/md/raid1.ko 2024-05-21T01:05:55.869 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 157681 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/md/raid10.ko 2024-05-21T01:05:55.869 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 444665 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/md/raid456.ko 2024-05-21T01:05:55.869 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/message/ 2024-05-21T01:05:55.870 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/message/fusion/ 2024-05-21T01:05:55.870 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 214841 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/message/fusion/mptbase.ko 2024-05-21T01:05:55.870 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 77985 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/message/fusion/mptctl.ko 2024-05-21T01:05:55.870 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 54785 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/message/fusion/mptfc.ko 2024-05-21T01:05:55.870 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 44633 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/message/fusion/mptlan.ko 2024-05-21T01:05:55.870 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 150761 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/message/fusion/mptsas.ko 2024-05-21T01:05:55.870 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 97281 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/message/fusion/mptscsih.ko 2024-05-21T01:05:55.870 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 63873 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/message/fusion/mptspi.ko 2024-05-21T01:05:55.870 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/mfd/ 2024-05-21T01:05:55.870 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19977 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/mfd/88pm800.ko 2024-05-21T01:05:55.870 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14689 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/mfd/88pm805.ko 2024-05-21T01:05:55.870 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12905 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/mfd/88pm80x.ko 2024-05-21T01:05:55.871 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12961 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/mfd/arizona-i2c.ko 2024-05-21T01:05:55.871 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 148633 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/mfd/arizona.ko 2024-05-21T01:05:55.871 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13281 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/mfd/bcm590xx.ko 2024-05-21T01:05:55.871 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20049 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/mfd/cros_ec_dev.ko 2024-05-21T01:05:55.871 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 41009 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/mfd/dln2.ko 2024-05-21T01:05:55.871 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 18601 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/mfd/janz-cmodio.ko 2024-05-21T01:05:55.871 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 59089 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/mfd/kempld-core.ko 2024-05-21T01:05:55.871 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 31897 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/mfd/lm3533-core.ko 2024-05-21T01:05:55.871 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17889 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-05-21T01:05:55.871 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14633 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/mfd/lp3943.ko 2024-05-21T01:05:55.871 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 60497 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/mfd/lpc_ich.ko 2024-05-21T01:05:55.871 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13617 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/mfd/lpc_sch.ko 2024-05-21T01:05:55.871 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 21113 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/mfd/max8907.ko 2024-05-21T01:05:55.871 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 35537 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/mfd/mc13xxx-core.ko 2024-05-21T01:05:55.872 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12937 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-05-21T01:05:55.872 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13441 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/mfd/menf21bmc.ko 2024-05-21T01:05:55.872 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20281 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/mfd/pcf50633-adc.ko 2024-05-21T01:05:55.872 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 10449 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/mfd/pcf50633-gpio.ko 2024-05-21T01:05:55.872 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 42297 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/mfd/pcf50633.ko 2024-05-21T01:05:55.872 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11177 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-05-21T01:05:55.872 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 22913 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/mfd/retu-mfd.ko 2024-05-21T01:05:55.872 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 99425 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/mfd/si476x-core.ko 2024-05-21T01:05:55.872 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 58057 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/mfd/sm501.ko 2024-05-21T01:05:55.872 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 60681 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/mfd/tps65010.ko 2024-05-21T01:05:55.872 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11785 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/mfd/tps6507x.ko 2024-05-21T01:05:55.872 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14953 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/mfd/viperboard.ko 2024-05-21T01:05:55.873 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11753 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/mfd/vx855.ko 2024-05-21T01:05:55.873 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 21137 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/mfd/wl1273-core.ko 2024-05-21T01:05:55.873 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 52361 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/mfd/wm8994.ko 2024-05-21T01:05:55.873 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/misc/ 2024-05-21T01:05:55.873 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15945 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-05-21T01:05:55.873 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 64265 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/misc/ad525x_dpot.ko 2024-05-21T01:05:55.873 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/misc/altera-stapl/ 2024-05-21T01:05:55.873 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 57521 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-05-21T01:05:55.873 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 22201 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/misc/apds9802als.ko 2024-05-21T01:05:55.873 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 47689 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/misc/apds990x.ko 2024-05-21T01:05:55.873 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 58633 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/misc/bh1770glc.ko 2024-05-21T01:05:55.873 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/misc/c2port/ 2024-05-21T01:05:55.873 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12825 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-05-21T01:05:55.874 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 47449 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/misc/c2port/core.ko 2024-05-21T01:05:55.874 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/misc/cb710/ 2024-05-21T01:05:55.874 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 29721 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/misc/cb710/cb710.ko 2024-05-21T01:05:55.874 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20401 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/misc/ds1682.ko 2024-05-21T01:05:55.874 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 10153 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/misc/dummy-irq.ko 2024-05-21T01:05:55.874 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/misc/echo/ 2024-05-21T01:05:55.874 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15905 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/misc/echo/echo.ko 2024-05-21T01:05:55.874 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/misc/eeprom/ 2024-05-21T01:05:55.874 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 43041 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/misc/eeprom/at24.ko 2024-05-21T01:05:55.874 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 18777 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-05-21T01:05:55.874 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15609 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/misc/eeprom/max6875.ko 2024-05-21T01:05:55.874 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 41185 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/misc/enclosure.ko 2024-05-21T01:05:55.874 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/misc/genwqe/ 2024-05-21T01:05:55.875 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 191649 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-05-21T01:05:55.875 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16537 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/misc/hmc6352.ko 2024-05-21T01:05:55.875 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 37761 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/misc/hpilo.ko 2024-05-21T01:05:55.875 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/misc/ibmasm/ 2024-05-21T01:05:55.875 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 92345 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-05-21T01:05:55.875 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 23961 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/misc/ics932s401.ko 2024-05-21T01:05:55.875 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 26737 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/misc/isl29003.ko 2024-05-21T01:05:55.875 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 18617 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/misc/isl29020.ko 2024-05-21T01:05:55.875 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/misc/lis3lv02d/ 2024-05-21T01:05:55.875 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 54865 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-05-21T01:05:55.875 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17825 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-05-21T01:05:55.875 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/misc/mei/ 2024-05-21T01:05:55.875 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 154169 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/misc/mei/mei-me.ko 2024-05-21T01:05:55.875 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 69809 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/misc/mei/mei-txe.ko 2024-05-21T01:05:55.876 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 389033 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/misc/mei/mei.ko 2024-05-21T01:05:55.876 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 37961 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/misc/phantom.ko 2024-05-21T01:05:55.876 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/misc/ti-st/ 2024-05-21T01:05:55.876 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 91145 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/misc/ti-st/st_drv.ko 2024-05-21T01:05:55.876 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 28865 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/misc/tifm_7xx1.ko 2024-05-21T01:05:55.876 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 34457 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/misc/tifm_core.ko 2024-05-21T01:05:55.876 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 22233 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/misc/tsl2550.ko 2024-05-21T01:05:55.876 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 55793 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/misc/vmw_balloon.ko 2024-05-21T01:05:55.876 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/misc/vmw_vmci/ 2024-05-21T01:05:55.876 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 234905 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-05-21T01:05:55.876 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ 2024-05-21T01:05:55.876 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/bonding/ 2024-05-21T01:05:55.877 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 620961 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/bonding/bonding.ko 2024-05-21T01:05:55.877 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/dsa/ 2024-05-21T01:05:55.877 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/dsa/b53/ 2024-05-21T01:05:55.877 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 139817 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/dsa/b53/b53_common.ko 2024-05-21T01:05:55.877 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 49545 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/dsa/bcm-sf2.ko 2024-05-21T01:05:55.877 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 18921 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/dsa/mv88e6060.ko 2024-05-21T01:05:55.877 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/dsa/mv88e6xxx/ 2024-05-21T01:05:55.877 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 587065 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-05-21T01:05:55.877 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19553 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/dummy.ko 2024-05-21T01:05:55.877 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 21369 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/eql.ko 2024-05-21T01:05:55.877 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/ 2024-05-21T01:05:55.877 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/3com/ 2024-05-21T01:05:55.877 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 53753 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-05-21T01:05:55.878 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 49201 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-05-21T01:05:55.878 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 158649 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-05-21T01:05:55.878 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 85953 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-05-21T01:05:55.878 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/8390/ 2024-05-21T01:05:55.878 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 44161 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/8390/8390.ko 2024-05-21T01:05:55.878 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 73865 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-05-21T01:05:55.878 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 33313 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-05-21T01:05:55.878 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 109521 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-05-21T01:05:55.878 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/adaptec/ 2024-05-21T01:05:55.878 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 64705 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-05-21T01:05:55.878 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/agere/ 2024-05-21T01:05:55.878 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 84329 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/agere/et131x.ko 2024-05-21T01:05:55.878 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/alteon/ 2024-05-21T01:05:55.879 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 70737 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-05-21T01:05:55.879 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/altera/ 2024-05-21T01:05:55.879 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 52705 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-05-21T01:05:55.879 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/amd/ 2024-05-21T01:05:55.879 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 65857 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-05-21T01:05:55.879 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 56057 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-05-21T01:05:55.879 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 115881 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-05-21T01:05:55.879 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/atheros/ 2024-05-21T01:05:55.879 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/atheros/alx/ 2024-05-21T01:05:55.879 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 124497 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-05-21T01:05:55.879 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-05-21T01:05:55.879 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 128409 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-05-21T01:05:55.879 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-05-21T01:05:55.880 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 110345 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-05-21T01:05:55.880 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/atheros/atlx/ 2024-05-21T01:05:55.880 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 101857 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-05-21T01:05:55.880 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 88953 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-05-21T01:05:55.880 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/broadcom/ 2024-05-21T01:05:55.880 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 105633 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-05-21T01:05:55.880 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 228985 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-05-21T01:05:55.880 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-05-21T01:05:55.880 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 1733353 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-05-21T01:05:55.880 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 167185 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-05-21T01:05:55.880 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/broadcom/genet/ 2024-05-21T01:05:55.880 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 161417 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-05-21T01:05:55.880 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 440625 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-05-21T01:05:55.881 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/brocade/ 2024-05-21T01:05:55.881 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/brocade/bna/ 2024-05-21T01:05:55.881 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 432201 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-05-21T01:05:55.881 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/chelsio/ 2024-05-21T01:05:55.881 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-05-21T01:05:55.881 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 257201 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-05-21T01:05:55.881 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-05-21T01:05:55.881 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 446177 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-05-21T01:05:55.881 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-05-21T01:05:55.881 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 1311433 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-05-21T01:05:55.881 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-05-21T01:05:55.881 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 206689 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-05-21T01:05:55.881 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-05-21T01:05:55.882 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 40161 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-05-21T01:05:55.882 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/cisco/ 2024-05-21T01:05:55.882 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/cisco/enic/ 2024-05-21T01:05:55.882 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 269313 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-05-21T01:05:55.882 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/dec/ 2024-05-21T01:05:55.882 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/dec/tulip/ 2024-05-21T01:05:55.882 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 85385 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-05-21T01:05:55.882 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 77457 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-05-21T01:05:55.882 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 169089 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-05-21T01:05:55.882 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 65913 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-05-21T01:05:55.882 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 76209 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-05-21T01:05:55.882 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 38065 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-05-21T01:05:55.882 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/dlink/ 2024-05-21T01:05:55.883 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 75945 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-05-21T01:05:55.883 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 78705 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-05-21T01:05:55.883 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 52313 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/dnet.ko 2024-05-21T01:05:55.883 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 30409 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/ec_bhf.ko 2024-05-21T01:05:55.883 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/emulex/ 2024-05-21T01:05:55.883 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/emulex/benet/ 2024-05-21T01:05:55.883 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 356377 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-05-21T01:05:55.883 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 61737 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/ethoc.ko 2024-05-21T01:05:55.883 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 63185 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/fealnx.ko 2024-05-21T01:05:55.883 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/fujitsu/ 2024-05-21T01:05:55.883 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 51513 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-05-21T01:05:55.883 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/intel/ 2024-05-21T01:05:55.883 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 115569 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/intel/e100.ko 2024-05-21T01:05:55.884 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/intel/e1000/ 2024-05-21T01:05:55.884 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 366217 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-05-21T01:05:55.884 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/intel/e1000e/ 2024-05-21T01:05:55.884 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 755793 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-05-21T01:05:55.884 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/intel/fm10k/ 2024-05-21T01:05:55.884 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 324577 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-05-21T01:05:55.884 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/intel/i40e/ 2024-05-21T01:05:55.884 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 1196297 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-05-21T01:05:55.912 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/intel/iavf/ 2024-05-21T01:05:55.912 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 362593 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-05-21T01:05:55.912 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/intel/igb/ 2024-05-21T01:05:55.912 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 671801 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-05-21T01:05:55.912 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/intel/igbvf/ 2024-05-21T01:05:55.912 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 121537 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-05-21T01:05:55.912 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-05-21T01:05:55.913 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 966705 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-05-21T01:05:55.913 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-05-21T01:05:55.913 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 193585 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-05-21T01:05:55.913 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 108633 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/jme.ko 2024-05-21T01:05:55.913 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/marvell/ 2024-05-21T01:05:55.913 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 25697 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-05-21T01:05:55.913 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 126881 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/marvell/skge.ko 2024-05-21T01:05:55.913 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 150777 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-05-21T01:05:55.913 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/mellanox/ 2024-05-21T01:05:55.913 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-05-21T01:05:55.913 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 905033 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-05-21T01:05:55.913 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 344145 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-05-21T01:05:55.913 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-05-21T01:05:55.914 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-05-21T01:05:55.914 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 1412417 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-05-21T01:05:55.914 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/micrel/ 2024-05-21T01:05:55.914 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 65913 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-05-21T01:05:55.914 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 54497 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-05-21T01:05:55.914 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 22417 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-05-21T01:05:55.914 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 117353 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-05-21T01:05:55.914 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/myricom/ 2024-05-21T01:05:55.914 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-05-21T01:05:55.914 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 131425 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-05-21T01:05:55.914 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/natsemi/ 2024-05-21T01:05:55.914 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 91465 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-05-21T01:05:55.914 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 56689 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-05-21T01:05:55.915 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/neterion/ 2024-05-21T01:05:55.915 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 181081 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-05-21T01:05:55.915 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/nvidia/ 2024-05-21T01:05:55.915 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 171417 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-05-21T01:05:55.915 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/packetengines/ 2024-05-21T01:05:55.915 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 58249 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-05-21T01:05:55.915 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 50121 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-05-21T01:05:55.915 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/qlogic/ 2024-05-21T01:05:55.915 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-05-21T01:05:55.915 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 300817 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-05-21T01:05:55.915 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 105689 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-05-21T01:05:55.915 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-05-21T01:05:55.915 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 885129 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-05-21T01:05:55.916 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/rdc/ 2024-05-21T01:05:55.916 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 52305 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-05-21T01:05:55.916 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/realtek/ 2024-05-21T01:05:55.916 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 81641 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-05-21T01:05:55.916 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 100689 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-05-21T01:05:55.916 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 34073 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/realtek/atp.ko 2024-05-21T01:05:55.916 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 264161 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-05-21T01:05:55.916 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/samsung/ 2024-05-21T01:05:55.916 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-05-21T01:05:55.916 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 142449 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-05-21T01:05:55.916 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/sfc/ 2024-05-21T01:05:55.916 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 1350385 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-05-21T01:05:55.916 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/silan/ 2024-05-21T01:05:55.916 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 57953 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-05-21T01:05:55.917 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/sis/ 2024-05-21T01:05:55.917 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 66505 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/sis/sis190.ko 2024-05-21T01:05:55.917 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 80065 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/sis/sis900.ko 2024-05-21T01:05:55.917 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/smsc/ 2024-05-21T01:05:55.917 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 74289 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-05-21T01:05:55.917 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 79457 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-05-21T01:05:55.917 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 100785 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-05-21T01:05:55.917 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 83441 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-05-21T01:05:55.917 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/stmicro/ 2024-05-21T01:05:55.917 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-05-21T01:05:55.917 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14225 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-05-21T01:05:55.917 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 46985 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-05-21T01:05:55.917 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 23345 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-05-21T01:05:55.918 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 644537 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-05-21T01:05:55.918 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/sun/ 2024-05-21T01:05:55.918 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 128497 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/sun/cassini.ko 2024-05-21T01:05:55.918 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 207993 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/sun/niu.ko 2024-05-21T01:05:55.918 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 82633 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/sun/sungem.ko 2024-05-21T01:05:55.918 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 91353 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-05-21T01:05:55.918 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/tehuti/ 2024-05-21T01:05:55.918 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 59865 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-05-21T01:05:55.918 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/ti/ 2024-05-21T01:05:55.918 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 110729 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/ti/tlan.ko 2024-05-21T01:05:55.918 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/via/ 2024-05-21T01:05:55.918 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 98689 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-05-21T01:05:55.919 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 102513 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-05-21T01:05:55.919 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/wiznet/ 2024-05-21T01:05:55.919 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 61497 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-05-21T01:05:55.919 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 40609 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-05-21T01:05:55.919 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/xircom/ 2024-05-21T01:05:55.919 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 69913 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-05-21T01:05:55.919 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/fddi/ 2024-05-21T01:05:55.919 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 49449 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/fddi/defxx.ko 2024-05-21T01:05:55.919 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/fddi/skfp/ 2024-05-21T01:05:55.919 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 275801 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/fddi/skfp/skfp.ko 2024-05-21T01:05:55.919 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 91105 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/geneve.ko 2024-05-21T01:05:55.919 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/hyperv/ 2024-05-21T01:05:55.919 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 290441 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-05-21T01:05:55.919 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ieee802154/ 2024-05-21T01:05:55.920 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 21409 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ieee802154/fakelb.ko 2024-05-21T01:05:55.920 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 30001 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ifb.ko 2024-05-21T01:05:55.920 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ipvlan/ 2024-05-21T01:05:55.920 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 108329 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ipvlan/ipvlan.ko 2024-05-21T01:05:55.920 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 78065 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/macvlan.ko 2024-05-21T01:05:55.920 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19273 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/macvtap.ko 2024-05-21T01:05:55.920 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/mdio/ 2024-05-21T01:05:55.920 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 26105 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-05-21T01:05:55.920 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 18209 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-05-21T01:05:55.920 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15697 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/mdio/mdio-gpio.ko 2024-05-21T01:05:55.920 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 10025 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/mdio/mdio-regmap.ko 2024-05-21T01:05:55.920 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20857 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/mdio.ko 2024-05-21T01:05:55.920 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 26417 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/mii.ko 2024-05-21T01:05:55.921 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 62681 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/netconsole.ko 2024-05-21T01:05:55.921 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13145 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/nlmon.ko 2024-05-21T01:05:55.921 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/pcs/ 2024-05-21T01:05:55.921 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20585 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/pcs/pcs-lynx.ko 2024-05-21T01:05:55.921 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 48313 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-05-21T01:05:55.921 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/phy/ 2024-05-21T01:05:55.921 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12025 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/phy/amd.ko 2024-05-21T01:05:55.921 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 61985 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-05-21T01:05:55.921 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 52865 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/phy/bcm7xxx.ko 2024-05-21T01:05:55.921 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14281 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/phy/bcm87xx.ko 2024-05-21T01:05:55.921 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 53409 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/phy/broadcom.ko 2024-05-21T01:05:55.921 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12289 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/phy/cicada.ko 2024-05-21T01:05:55.921 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15065 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/phy/davicom.ko 2024-05-21T01:05:55.922 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 10753 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/phy/et1011c.ko 2024-05-21T01:05:55.922 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 31313 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/phy/icplus.ko 2024-05-21T01:05:55.922 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19177 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/phy/lxt.ko 2024-05-21T01:05:55.922 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 103377 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/phy/marvell.ko 2024-05-21T01:05:55.922 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 96025 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/phy/micrel.ko 2024-05-21T01:05:55.922 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14049 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/phy/national.ko 2024-05-21T01:05:55.922 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 121105 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/phy/phylink.ko 2024-05-21T01:05:55.922 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11801 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/phy/qsemi.ko 2024-05-21T01:05:55.922 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 62113 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/phy/realtek.ko 2024-05-21T01:05:55.922 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 35513 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/phy/smsc.ko 2024-05-21T01:05:55.922 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12681 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/phy/ste10Xp.ko 2024-05-21T01:05:55.922 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 29217 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/phy/vitesse.ko 2024-05-21T01:05:55.923 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/plip/ 2024-05-21T01:05:55.923 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 55353 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/plip/plip.ko 2024-05-21T01:05:55.923 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ppp/ 2024-05-21T01:05:55.923 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19361 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ppp/bsd_comp.ko 2024-05-21T01:05:55.923 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 36273 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ppp/ppp_async.ko 2024-05-21T01:05:55.923 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 21529 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ppp/ppp_deflate.ko 2024-05-21T01:05:55.923 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 23105 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ppp/ppp_mppe.ko 2024-05-21T01:05:55.923 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 35369 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ppp/ppp_synctty.ko 2024-05-21T01:05:55.923 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 53233 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ppp/pppoe.ko 2024-05-21T01:05:55.923 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15913 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ppp/pppox.ko 2024-05-21T01:05:55.923 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 40081 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/ppp/pptp.ko 2024-05-21T01:05:55.923 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 35937 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/sb1000.ko 2024-05-21T01:05:55.923 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/slip/ 2024-05-21T01:05:55.924 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 52073 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/slip/slip.ko 2024-05-21T01:05:55.924 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 42409 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/sungem_phy.ko 2024-05-21T01:05:55.924 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 80161 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/tap.ko 2024-05-21T01:05:55.924 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/team/ 2024-05-21T01:05:55.924 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 137321 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/team/team.ko 2024-05-21T01:05:55.924 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16033 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/team/team_mode_activebackup.ko 2024-05-21T01:05:55.924 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11409 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/team/team_mode_broadcast.ko 2024-05-21T01:05:55.924 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 36209 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-05-21T01:05:55.924 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 10841 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/team/team_mode_random.ko 2024-05-21T01:05:55.924 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 10473 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-05-21T01:05:55.924 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 108089 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/veth.ko 2024-05-21T01:05:55.924 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/vmxnet3/ 2024-05-21T01:05:55.924 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 176497 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-05-21T01:05:55.925 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/vxlan/ 2024-05-21T01:05:55.925 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 383593 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/vxlan/vxlan.ko 2024-05-21T01:05:55.925 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/xen-netback/ 2024-05-21T01:05:55.925 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 175537 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/net/xen-netback/xen-netback.ko 2024-05-21T01:05:55.925 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/ntb/ 2024-05-21T01:05:55.925 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 25489 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/ntb/ntb.ko 2024-05-21T01:05:55.925 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/nvme/ 2024-05-21T01:05:55.925 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/nvme/host/ 2024-05-21T01:05:55.925 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 335857 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/nvme/host/nvme-core.ko 2024-05-21T01:05:55.925 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 126553 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/nvme/host/nvme.ko 2024-05-21T01:05:55.925 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/parport/ 2024-05-21T01:05:55.925 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 168145 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/parport/parport.ko 2024-05-21T01:05:55.925 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16185 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/parport/parport_cs.ko 2024-05-21T01:05:55.925 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 103889 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/parport/parport_pc.ko 2024-05-21T01:05:55.926 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 30313 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/parport/parport_serial.ko 2024-05-21T01:05:55.926 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/pci/ 2024-05-21T01:05:55.926 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/pci/hotplug/ 2024-05-21T01:05:55.926 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 28489 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-05-21T01:05:55.926 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20201 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-05-21T01:05:55.926 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 23889 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-05-21T01:05:55.926 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13089 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/pci/pci-stub.ko 2024-05-21T01:05:55.926 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 55329 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/pci/xen-pcifront.ko 2024-05-21T01:05:55.926 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/pcmcia/ 2024-05-21T01:05:55.926 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 31529 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/pcmcia/i82092.ko 2024-05-21T01:05:55.926 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 179961 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/pcmcia/pcmcia.ko 2024-05-21T01:05:55.926 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 78161 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/pcmcia/pcmcia_core.ko 2024-05-21T01:05:55.927 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 41945 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-05-21T01:05:55.927 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 40457 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/pcmcia/pd6729.ko 2024-05-21T01:05:55.927 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 133753 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/pcmcia/yenta_socket.ko 2024-05-21T01:05:55.927 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/phy/ 2024-05-21T01:05:55.927 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/phy/broadcom/ 2024-05-21T01:05:55.927 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12425 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-05-21T01:05:55.927 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/phy/samsung/ 2024-05-21T01:05:55.927 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 9481 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-05-21T01:05:55.927 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/pinctrl/ 2024-05-21T01:05:55.927 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/pinctrl/intel/ 2024-05-21T01:05:55.927 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 78193 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-05-21T01:05:55.927 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/platform/ 2024-05-21T01:05:55.927 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/platform/chrome/ 2024-05-21T01:05:55.928 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 61041 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-05-21T01:05:55.928 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 29657 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/platform/chrome/cros_ec.ko 2024-05-21T01:05:55.928 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 25521 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-05-21T01:05:55.928 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 30217 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-05-21T01:05:55.928 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 31801 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-05-21T01:05:55.928 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 21721 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-05-21T01:05:55.928 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20153 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-05-21T01:05:55.928 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/platform/x86/ 2024-05-21T01:05:55.928 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 87481 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/platform/x86/acer-wmi.ko 2024-05-21T01:05:55.928 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 44105 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/platform/x86/acerhdf.ko 2024-05-21T01:05:55.928 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 48257 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/platform/x86/apple-gmux.ko 2024-05-21T01:05:55.928 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 73865 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/platform/x86/asus-laptop.ko 2024-05-21T01:05:55.928 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 33321 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-05-21T01:05:55.929 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 164769 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/platform/x86/asus-wmi.ko 2024-05-21T01:05:55.929 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 46185 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/platform/x86/classmate-laptop.ko 2024-05-21T01:05:55.929 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 62073 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-05-21T01:05:55.929 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15865 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-05-21T01:05:55.929 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 51881 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-05-21T01:05:55.929 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 25889 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-05-21T01:05:55.929 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 42761 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/platform/x86/hdaps.ko 2024-05-21T01:05:55.929 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 22905 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/platform/x86/ibm_rtl.ko 2024-05-21T01:05:55.929 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/platform/x86/intel/ 2024-05-21T01:05:55.929 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14193 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-05-21T01:05:55.929 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 10033 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-05-21T01:05:55.929 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 54001 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/platform/x86/intel_ips.ko 2024-05-21T01:05:55.929 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 22913 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/platform/x86/msi-wmi.ko 2024-05-21T01:05:55.930 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12033 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/platform/x86/mxm-wmi.ko 2024-05-21T01:05:55.930 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 43753 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-05-21T01:05:55.930 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 51897 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/platform/x86/samsung-laptop.ko 2024-05-21T01:05:55.930 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15953 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/platform/x86/samsung-q10.ko 2024-05-21T01:05:55.930 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20169 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/platform/x86/topstar-laptop.ko 2024-05-21T01:05:55.930 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15593 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-05-21T01:05:55.930 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20273 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/platform/x86/toshiba_haps.ko 2024-05-21T01:05:55.930 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11657 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/platform/x86/wmi-bmof.ko 2024-05-21T01:05:55.930 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 61417 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/platform/x86/wmi.ko 2024-05-21T01:05:55.930 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/power/ 2024-05-21T01:05:55.930 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/power/supply/ 2024-05-21T01:05:55.930 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 36513 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/power/supply/88pm860x_battery.ko 2024-05-21T01:05:55.930 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 40425 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/power/supply/88pm860x_charger.ko 2024-05-21T01:05:55.930 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 68833 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/power/supply/bq2415x_charger.ko 2024-05-21T01:05:55.931 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 73073 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/power/supply/bq24190_charger.ko 2024-05-21T01:05:55.931 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 25953 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/power/supply/bq24735-charger.ko 2024-05-21T01:05:55.931 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20241 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-05-21T01:05:55.931 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 23233 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/power/supply/da9030_battery.ko 2024-05-21T01:05:55.931 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 23297 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/power/supply/da9052-battery.ko 2024-05-21T01:05:55.931 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 34489 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/power/supply/ds2760_battery.ko 2024-05-21T01:05:55.931 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 28641 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/power/supply/ds2780_battery.ko 2024-05-21T01:05:55.931 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 28809 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/power/supply/ds2781_battery.ko 2024-05-21T01:05:55.931 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 28657 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/power/supply/ds2782_battery.ko 2024-05-21T01:05:55.931 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 24217 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/power/supply/gpio-charger.ko 2024-05-21T01:05:55.931 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 23225 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/power/supply/isp1704_charger.ko 2024-05-21T01:05:55.931 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 24121 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/power/supply/lp8727_charger.ko 2024-05-21T01:05:55.931 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14009 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/power/supply/max14577_charger.ko 2024-05-21T01:05:55.932 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 37833 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/power/supply/max17042_battery.ko 2024-05-21T01:05:55.932 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 22017 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/power/supply/max8903_charger.ko 2024-05-21T01:05:55.932 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 27689 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/power/supply/max8925_power.ko 2024-05-21T01:05:55.932 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 25833 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/power/supply/pcf50633-charger.ko 2024-05-21T01:05:55.932 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 44841 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/power/supply/sbs-battery.ko 2024-05-21T01:05:55.932 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 34905 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/power/supply/test_power.ko 2024-05-21T01:05:55.932 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 21585 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/power/supply/tps65090-charger.ko 2024-05-21T01:05:55.932 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13353 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/power/supply/wm831x_backup.ko 2024-05-21T01:05:55.932 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 29081 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/power/supply/wm831x_power.ko 2024-05-21T01:05:55.932 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 27441 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/power/supply/wm8350_power.ko 2024-05-21T01:05:55.932 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/powercap/ 2024-05-21T01:05:55.932 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 73297 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/powercap/intel_rapl_common.ko 2024-05-21T01:05:55.932 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20433 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/powercap/intel_rapl_msr.ko 2024-05-21T01:05:55.933 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/pps/ 2024-05-21T01:05:55.933 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/pps/clients/ 2024-05-21T01:05:55.933 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17913 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/pps/clients/pps-gpio.ko 2024-05-21T01:05:55.933 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15529 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/pps/clients/pps-ldisc.ko 2024-05-21T01:05:55.933 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 18985 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/pps/clients/pps_parport.ko 2024-05-21T01:05:55.933 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 49817 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/pps/pps_core.ko 2024-05-21T01:05:55.933 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/ptp/ 2024-05-21T01:05:55.933 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 91393 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/ptp/ptp.ko 2024-05-21T01:05:55.933 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 21945 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/ptp/ptp_kvm.ko 2024-05-21T01:05:55.933 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/ras/ 2024-05-21T01:05:55.933 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/ras/amd/ 2024-05-21T01:05:55.933 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/ras/amd/atl/ 2024-05-21T01:05:55.933 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 67513 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-05-21T01:05:55.933 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 47137 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/ras/amd/fmpm.ko 2024-05-21T01:05:55.934 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/rtc/ 2024-05-21T01:05:55.934 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 27593 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/rtc/rtc-88pm80x.ko 2024-05-21T01:05:55.934 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 28969 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/rtc/rtc-88pm860x.ko 2024-05-21T01:05:55.934 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 18457 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/rtc/rtc-bq32k.ko 2024-05-21T01:05:55.934 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 24721 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/rtc/rtc-da9052.ko 2024-05-21T01:05:55.934 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 22569 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/rtc/rtc-da9055.ko 2024-05-21T01:05:55.934 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 24337 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/rtc/rtc-da9063.ko 2024-05-21T01:05:55.934 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19729 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/rtc/rtc-ds1286.ko 2024-05-21T01:05:55.934 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 82225 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/rtc/rtc-ds1307.ko 2024-05-21T01:05:55.934 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 24481 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/rtc/rtc-ds1374.ko 2024-05-21T01:05:55.934 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 21993 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/rtc/rtc-ds1511.ko 2024-05-21T01:05:55.934 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20289 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/rtc/rtc-ds1553.ko 2024-05-21T01:05:55.934 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16057 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/rtc/rtc-ds1672.ko 2024-05-21T01:05:55.935 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15665 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/rtc/rtc-ds1742.ko 2024-05-21T01:05:55.935 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 18025 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/rtc/rtc-ds2404.ko 2024-05-21T01:05:55.935 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 29017 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/rtc/rtc-ds3232.ko 2024-05-21T01:05:55.935 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13289 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/rtc/rtc-em3027.ko 2024-05-21T01:05:55.935 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 28665 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/rtc/rtc-fm3130.ko 2024-05-21T01:05:55.935 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 24097 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/rtc/rtc-isl12022.ko 2024-05-21T01:05:55.935 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 44129 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/rtc/rtc-isl1208.ko 2024-05-21T01:05:55.935 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17145 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/rtc/rtc-lp8788.ko 2024-05-21T01:05:55.935 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 46913 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/rtc/rtc-m41t80.ko 2024-05-21T01:05:55.935 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13961 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/rtc/rtc-m48t35.ko 2024-05-21T01:05:55.935 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 33969 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/rtc/rtc-m48t59.ko 2024-05-21T01:05:55.935 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17337 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/rtc/rtc-m48t86.ko 2024-05-21T01:05:55.935 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13985 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/rtc/rtc-max6900.ko 2024-05-21T01:05:55.936 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17921 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/rtc/rtc-max8907.ko 2024-05-21T01:05:55.936 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 18521 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/rtc/rtc-max8925.ko 2024-05-21T01:05:55.936 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 31337 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/rtc/rtc-max8997.ko 2024-05-21T01:05:55.936 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20329 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/rtc/rtc-max8998.ko 2024-05-21T01:05:55.936 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 22409 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-05-21T01:05:55.936 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13153 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/rtc/rtc-msm6242.ko 2024-05-21T01:05:55.936 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 24329 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/rtc/rtc-palmas.ko 2024-05-21T01:05:55.936 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 56777 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/rtc/rtc-pcf2127.ko 2024-05-21T01:05:55.936 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 21601 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/rtc/rtc-pcf50633.ko 2024-05-21T01:05:55.936 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 32657 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/rtc/rtc-pcf85063.ko 2024-05-21T01:05:55.936 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 28289 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/rtc/rtc-pcf8523.ko 2024-05-21T01:05:55.936 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 36065 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/rtc/rtc-pcf8563.ko 2024-05-21T01:05:55.936 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14905 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/rtc/rtc-pcf8583.ko 2024-05-21T01:05:55.936 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 21921 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/rtc/rtc-rc5t583.ko 2024-05-21T01:05:55.937 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15209 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/rtc/rtc-rp5c01.ko 2024-05-21T01:05:55.937 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 40081 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/rtc/rtc-rs5c372.ko 2024-05-21T01:05:55.937 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 34529 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-05-21T01:05:55.937 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 29977 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/rtc/rtc-rx8025.ko 2024-05-21T01:05:55.937 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 22865 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/rtc/rtc-rx8581.ko 2024-05-21T01:05:55.937 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 26185 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/rtc/rtc-s35390a.ko 2024-05-21T01:05:55.937 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20425 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-05-21T01:05:55.937 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 21697 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/rtc/rtc-tps6586x.ko 2024-05-21T01:05:55.937 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 25993 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/rtc/rtc-tps65910.ko 2024-05-21T01:05:55.937 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 24801 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/rtc/rtc-wm831x.ko 2024-05-21T01:05:55.937 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 25801 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/rtc/rtc-wm8350.ko 2024-05-21T01:05:55.937 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 33409 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/rtc/rtc-x1205.ko 2024-05-21T01:05:55.937 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/ 2024-05-21T01:05:55.938 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 90377 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/3w-9xxx.ko 2024-05-21T01:05:55.938 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 69593 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/3w-sas.ko 2024-05-21T01:05:55.938 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 65945 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/3w-xxxx.ko 2024-05-21T01:05:55.938 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 164569 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/BusLogic.ko 2024-05-21T01:05:55.938 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 31617 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/a100u2w.ko 2024-05-21T01:05:55.938 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/aacraid/ 2024-05-21T01:05:55.938 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 340721 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/aacraid/aacraid.ko 2024-05-21T01:05:55.938 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 120337 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/advansys.ko 2024-05-21T01:05:55.938 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/aic7xxx/ 2024-05-21T01:05:55.938 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 468081 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-05-21T01:05:55.938 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 380673 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-05-21T01:05:55.938 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/aic94xx/ 2024-05-21T01:05:55.938 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 243705 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-05-21T01:05:55.939 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 28841 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/am53c974.ko 2024-05-21T01:05:55.939 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/arcmsr/ 2024-05-21T01:05:55.939 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 135617 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-05-21T01:05:55.939 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 44289 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/atp870u.ko 2024-05-21T01:05:55.939 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/be2iscsi/ 2024-05-21T01:05:55.939 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 304993 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-05-21T01:05:55.939 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/bfa/ 2024-05-21T01:05:55.939 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 1527113 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/bfa/bfa.ko 2024-05-21T01:05:55.939 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/bnx2fc/ 2024-05-21T01:05:55.939 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 297801 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-05-21T01:05:55.939 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/bnx2i/ 2024-05-21T01:05:55.939 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 144401 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-05-21T01:05:55.939 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 47457 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/ch.ko 2024-05-21T01:05:55.940 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/csiostor/ 2024-05-21T01:05:55.940 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 390713 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/csiostor/csiostor.ko 2024-05-21T01:05:55.940 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/cxgbi/ 2024-05-21T01:05:55.940 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-05-21T01:05:55.940 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 88881 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-05-21T01:05:55.940 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-05-21T01:05:55.940 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 117481 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-05-21T01:05:55.940 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 173017 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-05-21T01:05:55.940 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 91569 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/dc395x.ko 2024-05-21T01:05:55.940 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 45401 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/dmx3191d.ko 2024-05-21T01:05:55.940 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/esas2r/ 2024-05-21T01:05:55.940 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 267577 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/esas2r/esas2r.ko 2024-05-21T01:05:55.940 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 78969 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/esp_scsi.ko 2024-05-21T01:05:55.941 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/fcoe/ 2024-05-21T01:05:55.941 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 95329 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/fcoe/fcoe.ko 2024-05-21T01:05:55.941 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 194017 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-05-21T01:05:55.941 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 22617 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/fdomain.ko 2024-05-21T01:05:55.941 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/fnic/ 2024-05-21T01:05:55.941 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 366529 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/fnic/fnic.ko 2024-05-21T01:05:55.941 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 251505 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/hpsa.ko 2024-05-21T01:05:55.941 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 65761 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/hptiop.ko 2024-05-21T01:05:55.941 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 57097 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/hv_storvsc.ko 2024-05-21T01:05:55.941 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 44689 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/imm.ko 2024-05-21T01:05:55.941 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 55153 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/initio.ko 2024-05-21T01:05:55.941 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 327841 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/ipr.ko 2024-05-21T01:05:55.942 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 129785 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/ips.ko 2024-05-21T01:05:55.976 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/isci/ 2024-05-21T01:05:55.976 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 397785 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/isci/isci.ko 2024-05-21T01:05:55.976 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 32017 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-05-21T01:05:55.976 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 63121 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/iscsi_tcp.ko 2024-05-21T01:05:55.976 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/libfc/ 2024-05-21T01:05:55.976 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 386849 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/libfc/libfc.ko 2024-05-21T01:05:55.976 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 178177 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/libiscsi.ko 2024-05-21T01:05:55.976 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 64809 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/libiscsi_tcp.ko 2024-05-21T01:05:55.976 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/libsas/ 2024-05-21T01:05:55.976 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 274009 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/libsas/libsas.ko 2024-05-21T01:05:55.976 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/lpfc/ 2024-05-21T01:05:55.977 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 2736001 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/lpfc/lpfc.ko 2024-05-21T01:05:55.977 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/megaraid/ 2024-05-21T01:05:55.977 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 88529 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-05-21T01:05:55.977 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 40145 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-05-21T01:05:55.977 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 389177 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-05-21T01:05:55.977 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 104769 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/megaraid.ko 2024-05-21T01:05:55.977 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/mpt3sas/ 2024-05-21T01:05:55.977 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 836945 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-05-21T01:05:55.977 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/mvsas/ 2024-05-21T01:05:55.977 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 158729 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/mvsas/mvsas.ko 2024-05-21T01:05:55.977 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 96537 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/mvumi.ko 2024-05-21T01:05:55.977 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/pcmcia/ 2024-05-21T01:05:55.977 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 101625 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-05-21T01:05:55.978 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13273 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-05-21T01:05:55.978 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 23153 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-05-21T01:05:55.978 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 28265 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-05-21T01:05:55.978 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/pm8001/ 2024-05-21T01:05:55.978 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 443745 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-05-21T01:05:55.978 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 152033 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/pmcraid.ko 2024-05-21T01:05:55.978 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 41625 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/ppa.ko 2024-05-21T01:05:55.978 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 66977 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/qla1280.ko 2024-05-21T01:05:55.978 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/qla2xxx/ 2024-05-21T01:05:55.978 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 2324809 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-05-21T01:05:55.978 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 103601 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-05-21T01:05:55.978 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/qla4xxx/ 2024-05-21T01:05:55.978 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 697337 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-05-21T01:05:55.979 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 23801 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/qlogicfas408.ko 2024-05-21T01:05:55.979 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 18993 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/raid_class.ko 2024-05-21T01:05:55.979 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 322865 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/scsi_debug.ko 2024-05-21T01:05:55.979 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 219857 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/scsi_transport_fc.ko 2024-05-21T01:05:55.979 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 357153 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-05-21T01:05:55.979 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 121185 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/scsi_transport_sas.ko 2024-05-21T01:05:55.979 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 93481 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/scsi_transport_spi.ko 2024-05-21T01:05:55.979 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 55401 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/scsi_transport_srp.ko 2024-05-21T01:05:55.979 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 33009 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/ses.ko 2024-05-21T01:05:55.979 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 138121 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/st.ko 2024-05-21T01:05:55.979 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 57401 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/stex.ko 2024-05-21T01:05:55.979 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/sym53c8xx_2/ 2024-05-21T01:05:55.979 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 205025 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-05-21T01:05:55.980 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 55425 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/virtio_scsi.ko 2024-05-21T01:05:55.980 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 59185 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/vmw_pvscsi.ko 2024-05-21T01:05:55.980 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 48777 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/wd719x.ko 2024-05-21T01:05:55.980 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 59417 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/scsi/xen-scsifront.ko 2024-05-21T01:05:55.980 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/ssb/ 2024-05-21T01:05:55.980 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 174913 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/ssb/ssb.ko 2024-05-21T01:05:55.980 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/target/ 2024-05-21T01:05:55.980 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/target/iscsi/ 2024-05-21T01:05:55.980 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 920169 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-05-21T01:05:55.980 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/target/loopback/ 2024-05-21T01:05:55.980 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 60321 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/target/loopback/tcm_loop.ko 2024-05-21T01:05:55.980 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 48129 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/target/target_core_file.ko 2024-05-21T01:05:55.980 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 54233 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/target/target_core_iblock.ko 2024-05-21T01:05:55.981 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 1170033 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/target/target_core_mod.ko 2024-05-21T01:05:55.981 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 51897 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/target/target_core_pscsi.ko 2024-05-21T01:05:55.981 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 149721 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/target/target_core_user.ko 2024-05-21T01:05:55.981 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/target/tcm_fc/ 2024-05-21T01:05:55.981 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 90057 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-05-21T01:05:55.981 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/thermal/ 2024-05-21T01:05:55.981 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/thermal/intel/ 2024-05-21T01:05:55.981 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/thermal/intel/int340x_thermal/ 2024-05-21T01:05:55.981 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 28121 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-05-21T01:05:55.981 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 35209 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-05-21T01:05:55.981 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11329 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-05-21T01:05:55.981 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11705 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-05-21T01:05:55.981 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17385 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-05-21T01:05:55.982 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 18993 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-05-21T01:05:55.982 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 36729 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-05-21T01:05:55.982 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 26289 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-05-21T01:05:55.982 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16745 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-05-21T01:05:55.982 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12929 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-05-21T01:05:55.982 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12281 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-05-21T01:05:55.982 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15241 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-05-21T01:05:55.982 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 46065 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-05-21T01:05:55.982 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17673 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-05-21T01:05:55.982 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13345 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-05-21T01:05:55.982 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 35913 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-05-21T01:05:55.982 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 21665 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-05-21T01:05:55.982 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12849 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-05-21T01:05:55.983 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 30577 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-05-21T01:05:55.983 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/tty/ 2024-05-21T01:05:55.983 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/tty/ipwireless/ 2024-05-21T01:05:55.983 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 99313 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-05-21T01:05:55.983 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 69729 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/tty/moxa.ko 2024-05-21T01:05:55.983 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 61649 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/tty/mxser.ko 2024-05-21T01:05:55.983 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 134401 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/tty/n_gsm.ko 2024-05-21T01:05:55.983 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 37905 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/tty/n_hdlc.ko 2024-05-21T01:05:55.983 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 78969 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/tty/nozomi.ko 2024-05-21T01:05:55.983 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/tty/serial/ 2024-05-21T01:05:55.983 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/tty/serial/8250/ 2024-05-21T01:05:55.983 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 44057 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-05-21T01:05:55.983 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 65121 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-05-21T01:05:55.984 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 23121 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-05-21T01:05:55.984 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 28161 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/tty/serial/altera_uart.ko 2024-05-21T01:05:55.984 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 10673 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/tty/serial/arc_uart.ko 2024-05-21T01:05:55.984 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 91665 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-05-21T01:05:55.984 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/tty/serial/jsm/ 2024-05-21T01:05:55.984 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 120577 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/tty/serial/jsm/jsm.ko 2024-05-21T01:05:55.984 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 35161 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/tty/serial/rp2.ko 2024-05-21T01:05:55.984 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 65641 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/tty/serial/sc16is7xx.ko 2024-05-21T01:05:55.984 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/ufs/ 2024-05-21T01:05:55.984 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/ufs/core/ 2024-05-21T01:05:55.984 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 693081 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/ufs/core/ufshcd-core.ko 2024-05-21T01:05:55.984 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/ufs/host/ 2024-05-21T01:05:55.984 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 34449 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-05-21T01:05:55.984 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16697 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-05-21T01:05:55.985 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/uio/ 2024-05-21T01:05:55.985 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 55617 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/uio/uio.ko 2024-05-21T01:05:55.985 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14305 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/uio/uio_aec.ko 2024-05-21T01:05:55.985 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12961 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/uio/uio_cif.ko 2024-05-21T01:05:55.985 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20913 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/uio/uio_dmem_genirq.ko 2024-05-21T01:05:55.985 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15633 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/uio/uio_mf624.ko 2024-05-21T01:05:55.985 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13913 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/uio/uio_netx.ko 2024-05-21T01:05:55.985 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12049 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/uio/uio_pci_generic.ko 2024-05-21T01:05:55.985 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 18633 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-05-21T01:05:55.985 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16025 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/uio/uio_sercos3.ko 2024-05-21T01:05:55.985 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/ 2024-05-21T01:05:55.985 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/c67x00/ 2024-05-21T01:05:55.985 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 90321 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/c67x00/c67x00.ko 2024-05-21T01:05:55.985 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/chipidea/ 2024-05-21T01:05:55.986 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 189209 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-05-21T01:05:55.986 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 21529 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-05-21T01:05:55.986 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15121 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-05-21T01:05:55.986 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14105 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-05-21T01:05:55.986 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14777 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-05-21T01:05:55.986 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/class/ 2024-05-21T01:05:55.986 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 101545 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/class/cdc-acm.ko 2024-05-21T01:05:55.986 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 63073 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/class/cdc-wdm.ko 2024-05-21T01:05:55.986 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 56721 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/class/usblp.ko 2024-05-21T01:05:55.986 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 107417 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/class/usbtmc.ko 2024-05-21T01:05:55.986 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/common/ 2024-05-21T01:05:55.986 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 29353 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/common/ulpi.ko 2024-05-21T01:05:55.987 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/dwc2/ 2024-05-21T01:05:55.987 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13097 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-05-21T01:05:55.987 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/dwc3/ 2024-05-21T01:05:55.987 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13529 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-05-21T01:05:55.987 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 33465 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-05-21T01:05:55.987 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 574593 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/dwc3/dwc3.ko 2024-05-21T01:05:55.987 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/gadget/ 2024-05-21T01:05:55.987 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/gadget/function/ 2024-05-21T01:05:55.987 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 72249 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/gadget/function/u_ether.ko 2024-05-21T01:05:55.987 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 61953 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/gadget/function/u_serial.ko 2024-05-21T01:05:55.987 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 33721 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-05-21T01:05:55.987 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 49737 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-05-21T01:05:55.987 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 33041 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-05-21T01:05:55.987 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 43553 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-05-21T01:05:55.988 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 131345 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-05-21T01:05:55.988 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 62321 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-05-21T01:05:55.988 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 146617 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-05-21T01:05:55.988 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 70689 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-05-21T01:05:55.988 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 25705 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-05-21T01:05:55.988 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 37649 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-05-21T01:05:55.988 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 70017 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-05-21T01:05:55.988 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 101249 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-05-21T01:05:55.988 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 22425 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-05-21T01:05:55.988 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 71257 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-05-21T01:05:55.988 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 84937 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-05-21T01:05:55.988 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/gadget/legacy/ 2024-05-21T01:05:55.988 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 23441 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-05-21T01:05:55.988 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20281 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-05-21T01:05:55.989 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20993 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-05-21T01:05:55.989 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 24497 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-05-21T01:05:55.989 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 33041 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-05-21T01:05:55.989 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 21609 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-05-21T01:05:55.989 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 22385 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-05-21T01:05:55.989 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 18913 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-05-21T01:05:55.989 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 35689 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-05-21T01:05:55.989 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 18521 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-05-21T01:05:55.989 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 21705 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-05-21T01:05:55.989 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 30345 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-05-21T01:05:55.989 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 78073 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-05-21T01:05:55.989 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17505 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-05-21T01:05:55.989 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 204049 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/gadget/libcomposite.ko 2024-05-21T01:05:55.990 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/gadget/udc/ 2024-05-21T01:05:55.990 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19569 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-05-21T01:05:55.990 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/gadget/udc/bdc/ 2024-05-21T01:05:55.990 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 182561 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-05-21T01:05:55.990 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 45545 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-05-21T01:05:55.990 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 66513 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-05-21T01:05:55.990 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 85217 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-05-21T01:05:55.990 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 69313 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-05-21T01:05:55.990 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 90313 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/gadget/udc/net2272.ko 2024-05-21T01:05:55.990 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 90361 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/gadget/udc/net2280.ko 2024-05-21T01:05:55.990 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 94841 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-05-21T01:05:55.990 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 80521 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-05-21T01:05:55.990 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 87465 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-05-21T01:05:55.991 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 95441 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-05-21T01:05:55.991 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 195969 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-05-21T01:05:55.991 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/host/ 2024-05-21T01:05:55.991 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13945 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/host/bcma-hcd.ko 2024-05-21T01:05:55.991 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 108321 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/host/isp116x-hcd.ko 2024-05-21T01:05:55.991 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 104377 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-05-21T01:05:55.991 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 102273 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-05-21T01:05:55.991 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 60105 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/host/sl811-hcd.ko 2024-05-21T01:05:55.991 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17505 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/host/sl811_cs.ko 2024-05-21T01:05:55.991 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16377 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/host/ssb-hcd.ko 2024-05-21T01:05:55.991 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 32553 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-05-21T01:05:55.991 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/image/ 2024-05-21T01:05:55.991 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 40409 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/image/mdc800.ko 2024-05-21T01:05:55.992 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 25113 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/image/microtek.ko 2024-05-21T01:05:55.992 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/misc/ 2024-05-21T01:05:55.992 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 47353 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/misc/adutux.ko 2024-05-21T01:05:55.992 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 23825 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/misc/appledisplay.ko 2024-05-21T01:05:55.992 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20257 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-05-21T01:05:55.992 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 26673 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/misc/cytherm.ko 2024-05-21T01:05:55.992 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15561 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/misc/ehset.ko 2024-05-21T01:05:55.992 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17873 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/misc/emi26.ko 2024-05-21T01:05:55.992 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 18881 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/misc/emi62.ko 2024-05-21T01:05:55.992 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13057 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/misc/ezusb.ko 2024-05-21T01:05:55.992 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 22241 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/misc/idmouse.ko 2024-05-21T01:05:55.992 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 42729 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/misc/iowarrior.ko 2024-05-21T01:05:55.992 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12993 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/misc/isight_firmware.ko 2024-05-21T01:05:55.992 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 42241 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/misc/ldusb.ko 2024-05-21T01:05:55.993 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 42233 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/misc/legousbtower.ko 2024-05-21T01:05:55.993 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 33641 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/misc/lvstest.ko 2024-05-21T01:05:55.993 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/misc/sisusbvga/ 2024-05-21T01:05:55.993 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 85313 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-05-21T01:05:55.993 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14601 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/misc/trancevibrator.ko 2024-05-21T01:05:55.993 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 24593 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/misc/usb3503.ko 2024-05-21T01:05:55.993 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 29625 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/misc/usblcd.ko 2024-05-21T01:05:55.993 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 27809 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/misc/usbsevseg.ko 2024-05-21T01:05:55.993 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 84265 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/misc/usbtest.ko 2024-05-21T01:05:55.993 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 52065 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/misc/uss720.ko 2024-05-21T01:05:55.993 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 32345 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/misc/yurex.ko 2024-05-21T01:05:55.993 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/mon/ 2024-05-21T01:05:55.993 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 91529 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/mon/usbmon.ko 2024-05-21T01:05:55.993 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/musb/ 2024-05-21T01:05:55.994 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 396209 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/musb/musb_hdrc.ko 2024-05-21T01:05:55.994 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/phy/ 2024-05-21T01:05:55.994 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 25497 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/phy/phy-generic.ko 2024-05-21T01:05:55.994 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 23697 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-05-21T01:05:55.994 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14417 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/phy/phy-isp1301.ko 2024-05-21T01:05:55.994 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 26361 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/phy/phy-tahvo.ko 2024-05-21T01:05:55.994 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/serial/ 2024-05-21T01:05:55.994 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14761 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/serial/aircable.ko 2024-05-21T01:05:55.994 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 38209 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/serial/ark3116.ko 2024-05-21T01:05:55.994 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 30681 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/serial/belkin_sa.ko 2024-05-21T01:05:55.994 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 44329 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/serial/ch341.ko 2024-05-21T01:05:55.994 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 79681 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/serial/cp210x.ko 2024-05-21T01:05:55.994 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 35137 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/serial/cyberjack.ko 2024-05-21T01:05:55.995 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 66873 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/serial/cypress_m8.ko 2024-05-21T01:05:55.995 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 58329 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/serial/digi_acceleport.ko 2024-05-21T01:05:55.995 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 10625 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/serial/empeg.ko 2024-05-21T01:05:55.995 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 53009 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/serial/f81232.ko 2024-05-21T01:05:55.995 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 188609 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/serial/ftdi_sio.ko 2024-05-21T01:05:55.995 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 61489 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/serial/garmin_gps.ko 2024-05-21T01:05:55.995 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 152305 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/serial/io_edgeport.ko 2024-05-21T01:05:55.995 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 142833 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/serial/io_ti.ko 2024-05-21T01:05:55.995 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 69217 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/serial/ipaq.ko 2024-05-21T01:05:55.995 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 21425 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/serial/ipw.ko 2024-05-21T01:05:55.995 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 29769 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/serial/ir-usb.ko 2024-05-21T01:05:55.995 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 66361 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-05-21T01:05:55.995 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 122329 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/serial/keyspan.ko 2024-05-21T01:05:55.996 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 41297 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/serial/keyspan_pda.ko 2024-05-21T01:05:55.996 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 29465 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/serial/kl5kusb105.ko 2024-05-21T01:05:55.996 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 38049 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/serial/kobil_sct.ko 2024-05-21T01:05:55.996 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 38041 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/serial/mct_u232.ko 2024-05-21T01:05:55.996 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 25569 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/serial/metro-usb.ko 2024-05-21T01:05:55.996 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 79681 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/serial/mos7720.ko 2024-05-21T01:05:55.996 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 89969 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/serial/mos7840.ko 2024-05-21T01:05:55.996 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 65073 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/serial/mxuport.ko 2024-05-21T01:05:55.996 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15857 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/serial/navman.ko 2024-05-21T01:05:55.996 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13761 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/serial/omninet.ko 2024-05-21T01:05:55.996 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 28881 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/serial/opticon.ko 2024-05-21T01:05:55.996 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 193857 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/serial/option.ko 2024-05-21T01:05:55.996 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 45337 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/serial/oti6858.ko 2024-05-21T01:05:55.997 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 61761 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/serial/pl2303.ko 2024-05-21T01:05:55.997 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 10321 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/serial/qcaux.ko 2024-05-21T01:05:55.997 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 39985 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/serial/qcserial.ko 2024-05-21T01:05:55.997 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 40529 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/serial/quatech2.ko 2024-05-21T01:05:55.997 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16993 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/serial/safe_serial.ko 2024-05-21T01:05:55.997 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 59345 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/serial/sierra.ko 2024-05-21T01:05:55.997 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 25225 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/serial/spcp8x5.ko 2024-05-21T01:05:55.997 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 34065 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/serial/ssu100.ko 2024-05-21T01:05:55.997 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19601 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/serial/symbolserial.ko 2024-05-21T01:05:55.997 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 70497 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-05-21T01:05:55.997 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 24297 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-05-21T01:05:55.997 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11465 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/serial/usb_debug.ko 2024-05-21T01:05:55.997 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 39321 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/serial/usb_wwan.ko 2024-05-21T01:05:55.997 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 151137 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/serial/usbserial.ko 2024-05-21T01:05:55.998 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 32505 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/serial/visor.ko 2024-05-21T01:05:55.998 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 43577 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/serial/whiteheat.ko 2024-05-21T01:05:55.998 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11945 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/serial/wishbone-serial.ko 2024-05-21T01:05:55.998 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 10257 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/serial/xsens_mt.ko 2024-05-21T01:05:55.998 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/storage/ 2024-05-21T01:05:55.998 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 64049 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/storage/uas.ko 2024-05-21T01:05:55.998 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 30209 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/storage/ums-alauda.ko 2024-05-21T01:05:55.998 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14369 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/storage/ums-cypress.ko 2024-05-21T01:05:55.998 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 25665 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/storage/ums-datafab.ko 2024-05-21T01:05:55.998 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 41073 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-05-21T01:05:55.998 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15689 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/storage/ums-freecom.ko 2024-05-21T01:05:55.998 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 22953 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/storage/ums-isd200.ko 2024-05-21T01:05:55.998 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 22769 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-05-21T01:05:55.999 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15617 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/storage/ums-karma.ko 2024-05-21T01:05:55.999 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20721 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/storage/ums-onetouch.ko 2024-05-21T01:05:55.999 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 33873 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/storage/ums-realtek.ko 2024-05-21T01:05:55.999 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 33849 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/storage/ums-sddr09.ko 2024-05-21T01:05:55.999 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 22577 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/storage/ums-sddr55.ko 2024-05-21T01:05:55.999 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 41785 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/storage/ums-usbat.ko 2024-05-21T01:05:55.999 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 201193 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/storage/usb-storage.ko 2024-05-21T01:05:55.999 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/usbip/ 2024-05-21T01:05:55.999 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 76041 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/usbip/usbip-core.ko 2024-05-21T01:05:55.999 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 85257 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/usbip/usbip-host.ko 2024-05-21T01:05:55.999 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 122321 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-05-21T01:05:55.999 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/vfio/ 2024-05-21T01:05:55.999 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/vfio/pci/ 2024-05-21T01:05:55.999 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 206921 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-05-21T01:05:56.000 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 33577 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/vfio/pci/vfio-pci.ko 2024-05-21T01:05:56.000 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 134265 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/vfio/vfio.ko 2024-05-21T01:05:56.000 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 93673 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-05-21T01:05:56.000 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/vhost/ 2024-05-21T01:05:56.000 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 138721 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/vhost/vhost.ko 2024-05-21T01:05:56.000 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20161 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/vhost/vhost_iotlb.ko 2024-05-21T01:05:56.000 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 71281 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/vhost/vhost_net.ko 2024-05-21T01:05:56.000 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 107905 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/vhost/vhost_scsi.ko 2024-05-21T01:05:56.000 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/video/ 2024-05-21T01:05:56.000 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/video/backlight/ 2024-05-21T01:05:56.000 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17993 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-05-21T01:05:56.001 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14433 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/video/backlight/aat2870_bl.ko 2024-05-21T01:05:56.001 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 29153 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/video/backlight/adp5520_bl.ko 2024-05-21T01:05:56.001 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 41169 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/video/backlight/adp8860_bl.ko 2024-05-21T01:05:56.001 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 51745 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/video/backlight/adp8870_bl.ko 2024-05-21T01:05:56.001 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20305 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/video/backlight/apple_bl.ko 2024-05-21T01:05:56.001 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19825 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/video/backlight/as3711_bl.ko 2024-05-21T01:05:56.001 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14737 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/video/backlight/bd6107.ko 2024-05-21T01:05:56.001 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13337 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/video/backlight/da903x_bl.ko 2024-05-21T01:05:56.001 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13649 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/video/backlight/da9052_bl.ko 2024-05-21T01:05:56.001 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13785 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/video/backlight/gpio_backlight.ko 2024-05-21T01:05:56.001 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17473 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/video/backlight/kb3886_bl.ko 2024-05-21T01:05:56.001 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 26457 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/video/backlight/lcd.ko 2024-05-21T01:05:56.002 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 28209 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/video/backlight/lm3533_bl.ko 2024-05-21T01:05:56.002 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 23393 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/video/backlight/lm3639_bl.ko 2024-05-21T01:05:56.002 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13689 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/video/backlight/lv5207lp.ko 2024-05-21T01:05:56.002 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16665 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/video/backlight/max8925_bl.ko 2024-05-21T01:05:56.002 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13025 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/video/backlight/pandora_bl.ko 2024-05-21T01:05:56.002 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13057 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-05-21T01:05:56.002 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13329 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/video/backlight/platform_lcd.ko 2024-05-21T01:05:56.002 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15113 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/video/backlight/wm831x_bl.ko 2024-05-21T01:05:56.002 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/w1/ 2024-05-21T01:05:56.002 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/w1/masters/ 2024-05-21T01:05:56.002 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 23033 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/w1/masters/ds2482.ko 2024-05-21T01:05:56.002 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 46801 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/w1/masters/ds2490.ko 2024-05-21T01:05:56.002 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12945 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/w1/masters/matrox_w1.ko 2024-05-21T01:05:56.003 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13345 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/w1/masters/w1-gpio.ko 2024-05-21T01:05:56.003 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/w1/slaves/ 2024-05-21T01:05:56.003 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14001 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-05-21T01:05:56.003 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 27257 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-05-21T01:05:56.003 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16865 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-05-21T01:05:56.003 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12121 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-05-21T01:05:56.003 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16449 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-05-21T01:05:56.003 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16201 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-05-21T01:05:56.003 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16401 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-05-21T01:05:56.003 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16401 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-05-21T01:05:56.003 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 21513 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-05-21T01:05:56.003 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 8313 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/w1/slaves/w1_smem.ko 2024-05-21T01:05:56.003 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 70369 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/w1/slaves/w1_therm.ko 2024-05-21T01:05:56.004 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 129433 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/w1/wire.ko 2024-05-21T01:05:56.004 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/watchdog/ 2024-05-21T01:05:56.004 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 22337 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/watchdog/acquirewdt.ko 2024-05-21T01:05:56.004 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 23825 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/watchdog/advantechwdt.ko 2024-05-21T01:05:56.004 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 22209 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/watchdog/alim1535_wdt.ko 2024-05-21T01:05:56.004 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 27401 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/watchdog/alim7101_wdt.ko 2024-05-21T01:05:56.004 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 21985 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/watchdog/cpu5wdt.ko 2024-05-21T01:05:56.004 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16465 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/watchdog/da9052_wdt.ko 2024-05-21T01:05:56.004 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14625 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/watchdog/da9055_wdt.ko 2024-05-21T01:05:56.004 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20905 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/watchdog/da9063_wdt.ko 2024-05-21T01:05:56.004 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 24457 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/watchdog/dw_wdt.ko 2024-05-21T01:05:56.004 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 23521 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/watchdog/eurotechwdt.ko 2024-05-21T01:05:56.004 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 26817 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/watchdog/f71808e_wdt.ko 2024-05-21T01:05:56.005 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 32857 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/watchdog/hpwdt.ko 2024-05-21T01:05:56.005 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 18049 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/watchdog/i6300esb.ko 2024-05-21T01:05:56.005 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12673 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-05-21T01:05:56.005 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 26737 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/watchdog/iTCO_wdt.ko 2024-05-21T01:05:56.005 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 23289 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/watchdog/ib700wdt.ko 2024-05-21T01:05:56.005 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 21721 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/watchdog/ibmasr.ko 2024-05-21T01:05:56.005 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 22713 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-05-21T01:05:56.005 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 24857 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/watchdog/it8712f_wdt.ko 2024-05-21T01:05:56.005 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15921 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/watchdog/it87_wdt.ko 2024-05-21T01:05:56.005 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 26441 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/watchdog/kempld_wdt.ko 2024-05-21T01:05:56.005 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 21569 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/watchdog/machzwd.ko 2024-05-21T01:05:56.005 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17105 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/watchdog/mena21_wdt.ko 2024-05-21T01:05:56.005 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15001 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-05-21T01:05:56.006 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 29753 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/watchdog/nv_tco.ko 2024-05-21T01:05:56.006 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20569 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-05-21T01:05:56.006 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 27721 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/watchdog/pc87413_wdt.ko 2024-05-21T01:05:56.006 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 46953 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/watchdog/pcwd_pci.ko 2024-05-21T01:05:56.006 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 37193 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/watchdog/pcwd_usb.ko 2024-05-21T01:05:56.006 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15177 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/watchdog/retu_wdt.ko 2024-05-21T01:05:56.006 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 24433 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-05-21T01:05:56.006 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16985 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-05-21T01:05:56.006 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20345 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-05-21T01:05:56.006 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 29169 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/watchdog/sc1200wdt.ko 2024-05-21T01:05:56.006 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 27489 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/watchdog/sch311x_wdt.ko 2024-05-21T01:05:56.006 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 25625 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-05-21T01:05:56.007 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19721 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/watchdog/softdog.ko 2024-05-21T01:05:56.007 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 26009 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/watchdog/sp5100_tco.ko 2024-05-21T01:05:56.007 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14865 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/watchdog/twl4030_wdt.ko 2024-05-21T01:05:56.007 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20177 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/watchdog/via_wdt.ko 2024-05-21T01:05:56.007 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 23393 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-05-21T01:05:56.007 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 24905 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/watchdog/w83877f_wdt.ko 2024-05-21T01:05:56.007 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 32481 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/watchdog/w83977f_wdt.ko 2024-05-21T01:05:56.007 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 22577 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/watchdog/wafer5823wdt.ko 2024-05-21T01:05:56.007 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 33465 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/watchdog/wdt_pci.ko 2024-05-21T01:05:56.007 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 18905 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/watchdog/wm831x_wdt.ko 2024-05-21T01:05:56.007 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16081 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/watchdog/wm8350_wdt.ko 2024-05-21T01:05:56.007 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 18457 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/watchdog/xen_wdt.ko 2024-05-21T01:05:56.007 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/xen/ 2024-05-21T01:05:56.008 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 30049 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/xen/xen-evtchn.ko 2024-05-21T01:05:56.008 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 30649 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/xen/xen-gntalloc.ko 2024-05-21T01:05:56.008 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 55713 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/xen/xen-gntdev.ko 2024-05-21T01:05:56.008 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/xen/xen-pciback/ 2024-05-21T01:05:56.008 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 213913 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-05-21T01:05:56.008 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 47689 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/xen/xen-privcmd.ko 2024-05-21T01:05:56.008 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 85713 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/xen/xen-scsiback.ko 2024-05-21T01:05:56.008 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/xen/xenfs/ 2024-05-21T01:05:56.008 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 23433 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/drivers/xen/xenfs/xenfs.ko 2024-05-21T01:05:56.008 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/ 2024-05-21T01:05:56.008 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/9p/ 2024-05-21T01:05:56.008 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 192617 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/9p/9p.ko 2024-05-21T01:05:56.008 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/adfs/ 2024-05-21T01:05:56.008 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 78153 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/adfs/adfs.ko 2024-05-21T01:05:56.009 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/affs/ 2024-05-21T01:05:56.009 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 197849 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/affs/affs.ko 2024-05-21T01:05:56.009 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/afs/ 2024-05-21T01:05:56.009 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 1261113 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/afs/kafs.ko 2024-05-21T01:05:56.009 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/autofs/ 2024-05-21T01:05:56.009 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 127377 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/autofs/autofs4.ko 2024-05-21T01:05:56.009 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/befs/ 2024-05-21T01:05:56.009 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 80521 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/befs/befs.ko 2024-05-21T01:05:56.009 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/bfs/ 2024-05-21T01:05:56.009 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 50473 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/bfs/bfs.ko 2024-05-21T01:05:56.009 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 45561 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/binfmt_misc.ko 2024-05-21T01:05:56.009 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/btrfs/ 2024-05-21T01:05:56.009 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 4489593 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/btrfs/btrfs.ko 2024-05-21T01:05:56.018 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/cachefiles/ 2024-05-21T01:05:56.018 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 376857 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/cachefiles/cachefiles.ko 2024-05-21T01:05:56.018 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/ceph/ 2024-05-21T01:05:56.018 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 1587233 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/ceph/ceph.ko 2024-05-21T01:05:56.019 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/coda/ 2024-05-21T01:05:56.019 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 130073 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/coda/coda.ko 2024-05-21T01:05:56.019 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/configfs/ 2024-05-21T01:05:56.019 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 139081 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/configfs/configfs.ko 2024-05-21T01:05:56.019 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/cramfs/ 2024-05-21T01:05:56.019 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 35665 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/cramfs/cramfs.ko 2024-05-21T01:05:56.019 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/dlm/ 2024-05-21T01:05:56.019 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 813225 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/dlm/dlm.ko 2024-05-21T01:05:56.019 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/efs/ 2024-05-21T01:05:56.019 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 46409 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/efs/efs.ko 2024-05-21T01:05:56.019 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/f2fs/ 2024-05-21T01:05:56.019 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 1906817 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/f2fs/f2fs.ko 2024-05-21T01:05:56.019 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/fat/ 2024-05-21T01:05:56.020 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 35137 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/fat/msdos.ko 2024-05-21T01:05:56.020 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/freevxfs/ 2024-05-21T01:05:56.020 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 52313 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/freevxfs/freevxfs.ko 2024-05-21T01:05:56.020 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/fuse/ 2024-05-21T01:05:56.020 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 29177 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/fuse/cuse.ko 2024-05-21T01:05:56.020 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/gfs2/ 2024-05-21T01:05:56.020 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 1486521 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/gfs2/gfs2.ko 2024-05-21T01:05:56.020 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/hfs/ 2024-05-21T01:05:56.020 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 183305 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/hfs/hfs.ko 2024-05-21T01:05:56.020 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/hfsplus/ 2024-05-21T01:05:56.020 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 282097 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/hfsplus/hfsplus.ko 2024-05-21T01:05:56.020 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/hpfs/ 2024-05-21T01:05:56.020 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 249009 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/hpfs/hpfs.ko 2024-05-21T01:05:56.021 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/isofs/ 2024-05-21T01:05:56.021 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 93033 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/isofs/isofs.ko 2024-05-21T01:05:56.021 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/jfs/ 2024-05-21T01:05:56.021 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 533073 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/jfs/jfs.ko 2024-05-21T01:05:56.021 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/lockd/ 2024-05-21T01:05:56.021 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 361369 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/lockd/lockd.ko 2024-05-21T01:05:56.021 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/minix/ 2024-05-21T01:05:56.021 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 112609 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/minix/minix.ko 2024-05-21T01:05:56.021 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/netfs/ 2024-05-21T01:05:56.021 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 591585 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/netfs/netfs.ko 2024-05-21T01:05:56.021 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/nfs/ 2024-05-21T01:05:56.021 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/nfs/blocklayout/ 2024-05-21T01:05:56.022 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 102561 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-05-21T01:05:56.022 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/nfs/filelayout/ 2024-05-21T01:05:56.022 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 74353 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-05-21T01:05:56.022 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/nfs/flexfilelayout/ 2024-05-21T01:05:56.022 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 147689 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-05-21T01:05:56.022 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 1320249 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/nfs/nfs.ko 2024-05-21T01:05:56.022 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 82105 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/nfs/nfsv2.ko 2024-05-21T01:05:56.022 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 151641 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/nfs/nfsv3.ko 2024-05-21T01:05:56.022 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 2518505 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/nfs/nfsv4.ko 2024-05-21T01:05:56.022 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/nfs_common/ 2024-05-21T01:05:56.022 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19849 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/nfs_common/grace.ko 2024-05-21T01:05:56.022 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19345 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/nfs_common/nfs_acl.ko 2024-05-21T01:05:56.022 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/nfsd/ 2024-05-21T01:05:56.023 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 2024049 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/nfsd/nfsd.ko 2024-05-21T01:05:56.023 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/nilfs2/ 2024-05-21T01:05:56.023 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 734025 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/nilfs2/nilfs2.ko 2024-05-21T01:05:56.023 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/nls/ 2024-05-21T01:05:56.023 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14977 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/nls/mac-celtic.ko 2024-05-21T01:05:56.023 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14353 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/nls/mac-centeuro.ko 2024-05-21T01:05:56.023 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14977 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/nls/mac-croatian.ko 2024-05-21T01:05:56.023 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14049 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/nls/mac-cyrillic.ko 2024-05-21T01:05:56.023 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14665 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/nls/mac-gaelic.ko 2024-05-21T01:05:56.023 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14041 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/nls/mac-greek.ko 2024-05-21T01:05:56.023 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14977 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/nls/mac-iceland.ko 2024-05-21T01:05:56.023 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14353 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/nls/mac-inuit.ko 2024-05-21T01:05:56.023 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15281 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/nls/mac-roman.ko 2024-05-21T01:05:56.024 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14977 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/nls/mac-romanian.ko 2024-05-21T01:05:56.024 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14977 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/nls/mac-turkish.ko 2024-05-21T01:05:56.024 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12481 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/nls/nls_ascii.ko 2024-05-21T01:05:56.024 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13721 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/nls/nls_cp1250.ko 2024-05-21T01:05:56.024 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13417 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/nls/nls_cp1251.ko 2024-05-21T01:05:56.024 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14105 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/nls/nls_cp1255.ko 2024-05-21T01:05:56.024 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13721 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/nls/nls_cp737.ko 2024-05-21T01:05:56.024 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13721 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/nls/nls_cp775.ko 2024-05-21T01:05:56.024 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13409 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/nls/nls_cp850.ko 2024-05-21T01:05:56.024 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13409 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/nls/nls_cp852.ko 2024-05-21T01:05:56.024 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13409 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/nls/nls_cp855.ko 2024-05-21T01:05:56.024 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13097 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/nls/nls_cp857.ko 2024-05-21T01:05:56.024 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14033 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/nls/nls_cp860.ko 2024-05-21T01:05:56.025 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14345 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/nls/nls_cp861.ko 2024-05-21T01:05:56.025 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14657 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/nls/nls_cp862.ko 2024-05-21T01:05:56.025 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14345 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/nls/nls_cp863.ko 2024-05-21T01:05:56.025 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14033 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/nls/nls_cp864.ko 2024-05-21T01:05:56.025 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14345 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/nls/nls_cp865.ko 2024-05-21T01:05:56.025 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13721 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/nls/nls_cp866.ko 2024-05-21T01:05:56.025 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13409 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/nls/nls_cp869.ko 2024-05-21T01:05:56.025 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13169 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/nls/nls_cp874.ko 2024-05-21T01:05:56.025 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 95625 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/nls/nls_cp932.ko 2024-05-21T01:05:56.025 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 144209 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/nls/nls_cp936.ko 2024-05-21T01:05:56.025 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 167137 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/nls/nls_cp949.ko 2024-05-21T01:05:56.025 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 119513 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/nls/nls_cp950.ko 2024-05-21T01:05:56.025 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14049 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/nls/nls_euc-jp.ko 2024-05-21T01:05:56.025 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12489 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/nls/nls_iso8859-1.ko 2024-05-21T01:05:56.026 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13113 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/nls/nls_iso8859-13.ko 2024-05-21T01:05:56.026 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13113 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/nls/nls_iso8859-14.ko 2024-05-21T01:05:56.026 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13113 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/nls/nls_iso8859-15.ko 2024-05-21T01:05:56.026 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13105 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/nls/nls_iso8859-2.ko 2024-05-21T01:05:56.026 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13105 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/nls/nls_iso8859-3.ko 2024-05-21T01:05:56.026 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13105 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/nls/nls_iso8859-4.ko 2024-05-21T01:05:56.026 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13105 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/nls/nls_iso8859-5.ko 2024-05-21T01:05:56.026 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12801 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/nls/nls_iso8859-6.ko 2024-05-21T01:05:56.026 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13417 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/nls/nls_iso8859-7.ko 2024-05-21T01:05:56.026 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12801 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/nls/nls_iso8859-9.ko 2024-05-21T01:05:56.026 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13721 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/nls/nls_koi8-r.ko 2024-05-21T01:05:56.026 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 9833 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/nls/nls_koi8-ru.ko 2024-05-21T01:05:56.026 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13721 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/nls/nls_koi8-u.ko 2024-05-21T01:05:56.027 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 7521 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/nls/nls_ucs2_utils.ko 2024-05-21T01:05:56.027 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 9601 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/nls/nls_utf8.ko 2024-05-21T01:05:56.027 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/ocfs2/ 2024-05-21T01:05:56.027 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/ocfs2/cluster/ 2024-05-21T01:05:56.027 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 302073 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-05-21T01:05:56.027 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/ocfs2/dlm/ 2024-05-21T01:05:56.027 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 548169 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-05-21T01:05:56.027 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/ocfs2/dlmfs/ 2024-05-21T01:05:56.027 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 66361 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-05-21T01:05:56.027 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 3245617 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/ocfs2/ocfs2.ko 2024-05-21T01:05:56.027 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 22113 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-05-21T01:05:56.027 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 39313 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-05-21T01:05:56.027 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 43073 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-05-21T01:05:56.028 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/omfs/ 2024-05-21T01:05:56.028 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 67489 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/omfs/omfs.ko 2024-05-21T01:05:56.028 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/overlayfs/ 2024-05-21T01:05:56.028 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 462873 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/overlayfs/overlay.ko 2024-05-21T01:05:56.028 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/pstore/ 2024-05-21T01:05:56.028 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 67977 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/pstore/ramoops.ko 2024-05-21T01:05:56.028 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/qnx4/ 2024-05-21T01:05:56.028 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 33209 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/qnx4/qnx4.ko 2024-05-21T01:05:56.028 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/qnx6/ 2024-05-21T01:05:56.028 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 56097 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/qnx6/qnx6.ko 2024-05-21T01:05:56.028 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/quota/ 2024-05-21T01:05:56.028 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 40313 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/quota/quota_tree.ko 2024-05-21T01:05:56.028 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17513 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/quota/quota_v1.ko 2024-05-21T01:05:56.028 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 28817 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/quota/quota_v2.ko 2024-05-21T01:05:56.029 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/reiserfs/ 2024-05-21T01:05:56.029 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 684841 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/reiserfs/reiserfs.ko 2024-05-21T01:05:56.029 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/romfs/ 2024-05-21T01:05:56.029 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 34673 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/romfs/romfs.ko 2024-05-21T01:05:56.029 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/smb/ 2024-05-21T01:05:56.029 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/smb/client/ 2024-05-21T01:05:56.029 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 3319041 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/smb/client/cifs.ko 2024-05-21T01:05:56.032 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/smb/common/ 2024-05-21T01:05:56.032 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 8073 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/smb/common/cifs_arc4.ko 2024-05-21T01:05:56.032 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12737 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/smb/common/cifs_md4.ko 2024-05-21T01:05:56.032 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/squashfs/ 2024-05-21T01:05:56.032 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 164185 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/squashfs/squashfs.ko 2024-05-21T01:05:56.032 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/sysv/ 2024-05-21T01:05:56.032 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 115977 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/sysv/sysv.ko 2024-05-21T01:05:56.033 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/udf/ 2024-05-21T01:05:56.033 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 310017 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/udf/udf.ko 2024-05-21T01:05:56.033 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/ufs/ 2024-05-21T01:05:56.033 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 198233 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/ufs/ufs.ko 2024-05-21T01:05:56.033 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/xfs/ 2024-05-21T01:05:56.033 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 5192705 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/fs/xfs/xfs.ko 2024-05-21T01:05:56.033 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/kernel/ 2024-05-21T01:05:56.033 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/kernel/locking/ 2024-05-21T01:05:56.033 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 97625 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/kernel/locking/locktorture.ko 2024-05-21T01:05:56.033 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/kernel/time/ 2024-05-21T01:05:56.033 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15753 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/kernel/time/test_udelay.ko 2024-05-21T01:05:56.033 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 72665 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/kernel/torture.ko 2024-05-21T01:05:56.033 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/lib/ 2024-05-21T01:05:56.033 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 7313 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/lib/crc-itu-t.ko 2024-05-21T01:05:56.034 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 7081 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/lib/crc7.ko 2024-05-21T01:05:56.034 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 7953 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/lib/crc8.ko 2024-05-21T01:05:56.034 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/lib/crypto/ 2024-05-21T01:05:56.034 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 8009 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/lib/crypto/libarc4.ko 2024-05-21T01:05:56.034 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 38985 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/lib/crypto/libdes.ko 2024-05-21T01:05:56.034 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14689 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/lib/interval_tree_test.ko 2024-05-21T01:05:56.034 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 9401 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/lib/libcrc32c.ko 2024-05-21T01:05:56.034 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 29065 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/lib/lru_cache.ko 2024-05-21T01:05:56.034 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/lib/lz4/ 2024-05-21T01:05:56.034 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 36169 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/lib/lz4/lz4_compress.ko 2024-05-21T01:05:56.034 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 24729 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/lib/lz4/lz4hc_compress.ko 2024-05-21T01:05:56.034 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/lib/math/ 2024-05-21T01:05:56.035 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 7281 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/lib/math/cordic.ko 2024-05-21T01:05:56.035 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 9169 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/lib/memory-notifier-error-inject.ko 2024-05-21T01:05:56.035 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12537 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/lib/notifier-error-inject.ko 2024-05-21T01:05:56.035 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15921 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/lib/percpu_test.ko 2024-05-21T01:05:56.035 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 9249 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/lib/pm-notifier-error-inject.ko 2024-05-21T01:05:56.035 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/lib/raid6/ 2024-05-21T01:05:56.035 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 152025 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/lib/raid6/raid6_pq.ko 2024-05-21T01:05:56.035 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 24481 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/lib/rbtree_test.ko 2024-05-21T01:05:56.035 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/lib/reed_solomon/ 2024-05-21T01:05:56.035 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 21385 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/lib/reed_solomon/reed_solomon.ko 2024-05-21T01:05:56.035 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 40969 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/lib/test-kstrtox.ko 2024-05-21T01:05:56.035 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 4912441 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/lib/test_bpf.ko 2024-05-21T01:05:56.038 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 61169 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/lib/test_firmware.ko 2024-05-21T01:05:56.038 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 7121 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/lib/test_module.ko 2024-05-21T01:05:56.038 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 24937 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/lib/test_user_copy.ko 2024-05-21T01:05:56.038 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11329 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/lib/ts_bm.ko 2024-05-21T01:05:56.038 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13289 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/lib/ts_fsm.ko 2024-05-21T01:05:56.038 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11369 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/lib/ts_kmp.ko 2024-05-21T01:05:56.038 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/lib/xz/ 2024-05-21T01:05:56.038 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15865 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/lib/xz/xz_dec_test.ko 2024-05-21T01:05:56.038 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/mm/ 2024-05-21T01:05:56.038 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20529 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/mm/hwpoison-inject.ko 2024-05-21T01:05:56.038 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ 2024-05-21T01:05:56.039 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/6lowpan/ 2024-05-21T01:05:56.039 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 66969 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/6lowpan/6lowpan.ko 2024-05-21T01:05:56.039 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 7577 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/6lowpan/nhc_dest.ko 2024-05-21T01:05:56.039 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 7529 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/6lowpan/nhc_fragment.ko 2024-05-21T01:05:56.039 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 7513 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/6lowpan/nhc_hop.ko 2024-05-21T01:05:56.039 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 7513 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/6lowpan/nhc_ipv6.ko 2024-05-21T01:05:56.039 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 7529 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/6lowpan/nhc_mobility.ko 2024-05-21T01:05:56.039 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 7521 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/6lowpan/nhc_routing.ko 2024-05-21T01:05:56.039 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17225 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/6lowpan/nhc_udp.ko 2024-05-21T01:05:56.039 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/802/ 2024-05-21T01:05:56.039 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 36729 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/802/garp.ko 2024-05-21T01:05:56.039 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 42297 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/802/mrp.ko 2024-05-21T01:05:56.039 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 9849 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/802/p8022.ko 2024-05-21T01:05:56.040 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19417 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/802/psnap.ko 2024-05-21T01:05:56.040 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13537 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/802/stp.ko 2024-05-21T01:05:56.040 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/8021q/ 2024-05-21T01:05:56.040 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 106793 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/8021q/8021q.ko 2024-05-21T01:05:56.040 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/9p/ 2024-05-21T01:05:56.040 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 236793 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/9p/9pnet.ko 2024-05-21T01:05:56.040 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 44449 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/9p/9pnet_fd.ko 2024-05-21T01:05:56.040 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 32209 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/9p/9pnet_rdma.ko 2024-05-21T01:05:56.040 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 39513 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/9p/9pnet_virtio.ko 2024-05-21T01:05:56.040 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/batman-adv/ 2024-05-21T01:05:56.040 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 879697 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/batman-adv/batman-adv.ko 2024-05-21T01:05:56.042 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/bridge/ 2024-05-21T01:05:56.042 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 84761 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/bridge/br_netfilter.ko 2024-05-21T01:05:56.043 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 1030873 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/bridge/bridge.ko 2024-05-21T01:05:56.043 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/bridge/netfilter/ 2024-05-21T01:05:56.043 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 8905 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-05-21T01:05:56.043 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14569 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/bridge/netfilter/ebt_among.ko 2024-05-21T01:05:56.043 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 10457 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/bridge/netfilter/ebt_arp.ko 2024-05-21T01:05:56.043 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 10417 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-05-21T01:05:56.043 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 10953 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-05-21T01:05:56.043 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 10001 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/bridge/netfilter/ebt_ip.ko 2024-05-21T01:05:56.043 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 10337 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-05-21T01:05:56.043 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11145 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/bridge/netfilter/ebt_limit.ko 2024-05-21T01:05:56.043 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15385 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/bridge/netfilter/ebt_log.ko 2024-05-21T01:05:56.043 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 8841 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/bridge/netfilter/ebt_mark.ko 2024-05-21T01:05:56.043 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 8777 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-05-21T01:05:56.044 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 9569 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-05-21T01:05:56.044 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 8625 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-05-21T01:05:56.044 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 10913 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-05-21T01:05:56.044 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 9953 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/bridge/netfilter/ebt_snat.ko 2024-05-21T01:05:56.044 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 10105 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/bridge/netfilter/ebt_stp.ko 2024-05-21T01:05:56.044 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13713 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-05-21T01:05:56.044 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13249 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-05-21T01:05:56.044 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11209 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-05-21T01:05:56.044 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11185 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-05-21T01:05:56.044 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 70529 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/bridge/netfilter/ebtables.ko 2024-05-21T01:05:56.044 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16113 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-05-21T01:05:56.044 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16217 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-05-21T01:05:56.044 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ceph/ 2024-05-21T01:05:56.045 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 1243505 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ceph/libceph.ko 2024-05-21T01:05:56.045 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/core/ 2024-05-21T01:05:56.045 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 153801 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/core/pktgen.ko 2024-05-21T01:05:56.045 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/dccp/ 2024-05-21T01:05:56.045 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 244889 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/dccp/dccp.ko 2024-05-21T01:05:56.072 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 10273 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/dccp/dccp_diag.ko 2024-05-21T01:05:56.072 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 71033 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/dccp/dccp_ipv4.ko 2024-05-21T01:05:56.072 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 74993 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/dccp/dccp_ipv6.ko 2024-05-21T01:05:56.072 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/dsa/ 2024-05-21T01:05:56.073 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 507705 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/dsa/dsa_core.ko 2024-05-21T01:05:56.073 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15841 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/dsa/tag_brcm.ko 2024-05-21T01:05:56.073 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14921 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/dsa/tag_dsa.ko 2024-05-21T01:05:56.073 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 8873 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/dsa/tag_none.ko 2024-05-21T01:05:56.073 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 10465 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/dsa/tag_trailer.ko 2024-05-21T01:05:56.073 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/hsr/ 2024-05-21T01:05:56.073 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 128873 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/hsr/hsr.ko 2024-05-21T01:05:56.073 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ieee802154/ 2024-05-21T01:05:56.073 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ieee802154/6lowpan/ 2024-05-21T01:05:56.073 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 55505 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-05-21T01:05:56.073 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 357425 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ieee802154/ieee802154.ko 2024-05-21T01:05:56.073 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 59393 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ieee802154/ieee802154_socket.ko 2024-05-21T01:05:56.073 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv4/ 2024-05-21T01:05:56.074 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 29041 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv4/ah4.ko 2024-05-21T01:05:56.074 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 46417 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv4/esp4.ko 2024-05-21T01:05:56.074 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 60233 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv4/fou.ko 2024-05-21T01:05:56.074 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 21937 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv4/gre.ko 2024-05-21T01:05:56.074 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 65665 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv4/inet_diag.ko 2024-05-21T01:05:56.074 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 75489 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv4/ip_gre.ko 2024-05-21T01:05:56.074 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 77721 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv4/ip_tunnel.ko 2024-05-21T01:05:56.074 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 43705 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv4/ip_vti.ko 2024-05-21T01:05:56.074 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16513 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv4/ipcomp.ko 2024-05-21T01:05:56.074 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 34745 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv4/ipip.ko 2024-05-21T01:05:56.074 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv4/netfilter/ 2024-05-21T01:05:56.074 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 45521 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv4/netfilter/arp_tables.ko 2024-05-21T01:05:56.074 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 10137 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-05-21T01:05:56.075 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11905 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-05-21T01:05:56.075 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 50169 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv4/netfilter/ip_tables.ko 2024-05-21T01:05:56.075 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11369 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-05-21T01:05:56.075 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11457 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-05-21T01:05:56.075 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16353 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-05-21T01:05:56.075 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12513 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-05-21T01:05:56.075 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17289 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-05-21T01:05:56.075 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12993 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-05-21T01:05:56.075 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13377 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-05-21T01:05:56.075 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17297 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-05-21T01:05:56.075 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13241 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-05-21T01:05:56.075 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11969 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv4/netfilter/iptable_security.ko 2024-05-21T01:05:56.075 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14505 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-05-21T01:05:56.076 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 9705 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-05-21T01:05:56.076 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 32473 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-05-21T01:05:56.076 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20737 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-05-21T01:05:56.076 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15017 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-05-21T01:05:56.076 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 25753 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-05-21T01:05:56.076 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 10249 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-05-21T01:05:56.076 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17161 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-05-21T01:05:56.076 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11457 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-05-21T01:05:56.076 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19513 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-05-21T01:05:56.076 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 10065 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-05-21T01:05:56.076 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14689 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv4/tcp_bic.ko 2024-05-21T01:05:56.076 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16113 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv4/tcp_dctcp.ko 2024-05-21T01:05:56.076 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19409 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv4/tcp_diag.ko 2024-05-21T01:05:56.077 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11017 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv4/tcp_highspeed.ko 2024-05-21T01:05:56.077 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14385 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv4/tcp_htcp.ko 2024-05-21T01:05:56.077 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11665 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv4/tcp_hybla.ko 2024-05-21T01:05:56.077 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13449 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv4/tcp_illinois.ko 2024-05-21T01:05:56.077 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11737 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv4/tcp_lp.ko 2024-05-21T01:05:56.077 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 9601 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv4/tcp_scalable.ko 2024-05-21T01:05:56.077 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16721 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv4/tcp_vegas.ko 2024-05-21T01:05:56.077 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12105 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv4/tcp_veno.ko 2024-05-21T01:05:56.077 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13257 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv4/tcp_westwood.ko 2024-05-21T01:05:56.077 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11745 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv4/tcp_yeah.ko 2024-05-21T01:05:56.077 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 28585 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv4/tunnel4.ko 2024-05-21T01:05:56.077 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 21137 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv4/udp_diag.ko 2024-05-21T01:05:56.078 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 54441 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv4/udp_tunnel.ko 2024-05-21T01:05:56.078 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13857 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv4/xfrm4_tunnel.ko 2024-05-21T01:05:56.078 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv6/ 2024-05-21T01:05:56.078 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 31073 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv6/ah6.ko 2024-05-21T01:05:56.078 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 47433 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv6/esp6.ko 2024-05-21T01:05:56.078 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17113 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv6/fou6.ko 2024-05-21T01:05:56.078 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 103177 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv6/ip6_gre.ko 2024-05-21T01:05:56.078 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 118881 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv6/ip6_tunnel.ko 2024-05-21T01:05:56.078 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16249 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-05-21T01:05:56.078 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 71089 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv6/ip6_vti.ko 2024-05-21T01:05:56.078 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16249 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv6/ipcomp6.ko 2024-05-21T01:05:56.078 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 23017 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv6/mip6.ko 2024-05-21T01:05:56.078 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv6/netfilter/ 2024-05-21T01:05:56.079 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 50673 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-05-21T01:05:56.079 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13833 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-05-21T01:05:56.079 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11593 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-05-21T01:05:56.079 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16361 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-05-21T01:05:56.079 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15929 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-05-21T01:05:56.079 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 8721 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-05-21T01:05:56.079 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17953 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-05-21T01:05:56.079 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17625 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-05-21T01:05:56.079 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 10049 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-05-21T01:05:56.079 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11137 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-05-21T01:05:56.079 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12473 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-05-21T01:05:56.079 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12185 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-05-21T01:05:56.079 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13001 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-05-21T01:05:56.080 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12857 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-05-21T01:05:56.080 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17449 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-05-21T01:05:56.080 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13249 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-05-21T01:05:56.080 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11977 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-05-21T01:05:56.080 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 46313 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-05-21T01:05:56.080 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 9361 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-05-21T01:05:56.080 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 29817 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-05-21T01:05:56.080 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 10833 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-05-21T01:05:56.080 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17257 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-05-21T01:05:56.080 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11097 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-05-21T01:05:56.080 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 18521 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-05-21T01:05:56.080 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 10065 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-05-21T01:05:56.080 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 94089 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv6/sit.ko 2024-05-21T01:05:56.081 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 30297 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv6/tunnel6.ko 2024-05-21T01:05:56.081 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 28369 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/ipv6/xfrm6_tunnel.ko 2024-05-21T01:05:56.081 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/key/ 2024-05-21T01:05:56.081 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 106369 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/key/af_key.ko 2024-05-21T01:05:56.081 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/l2tp/ 2024-05-21T01:05:56.081 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 153217 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/l2tp/l2tp_core.ko 2024-05-21T01:05:56.081 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 24273 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/l2tp/l2tp_debugfs.ko 2024-05-21T01:05:56.081 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 31985 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/l2tp/l2tp_eth.ko 2024-05-21T01:05:56.081 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 43641 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/l2tp/l2tp_ip.ko 2024-05-21T01:05:56.081 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 44993 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/l2tp/l2tp_ip6.ko 2024-05-21T01:05:56.081 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 42049 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/l2tp/l2tp_netlink.ko 2024-05-21T01:05:56.081 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 66241 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/l2tp/l2tp_ppp.ko 2024-05-21T01:05:56.081 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/lapb/ 2024-05-21T01:05:56.082 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 63345 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/lapb/lapb.ko 2024-05-21T01:05:56.082 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/llc/ 2024-05-21T01:05:56.082 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 27385 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/llc/llc.ko 2024-05-21T01:05:56.082 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 332889 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/llc/llc2.ko 2024-05-21T01:05:56.082 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/mac802154/ 2024-05-21T01:05:56.082 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 388873 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/mac802154/mac802154.ko 2024-05-21T01:05:56.082 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/mpls/ 2024-05-21T01:05:56.082 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 10577 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/mpls/mpls_gso.ko 2024-05-21T01:05:56.082 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/ 2024-05-21T01:05:56.082 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/ipset/ 2024-05-21T01:05:56.082 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 147745 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/ipset/ip_set.ko 2024-05-21T01:05:56.082 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 34473 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-05-21T01:05:56.082 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 33073 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-05-21T01:05:56.083 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 32553 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-05-21T01:05:56.083 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 124041 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-05-21T01:05:56.083 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 124345 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-05-21T01:05:56.083 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 126681 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-05-21T01:05:56.083 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 126473 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-05-21T01:05:56.083 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 137833 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-05-21T01:05:56.083 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 72353 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-05-21T01:05:56.083 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 133681 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-05-21T01:05:56.083 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 139073 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-05-21T01:05:56.083 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 138265 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-05-21T01:05:56.083 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 136177 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-05-21T01:05:56.083 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 139897 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-05-21T01:05:56.083 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 37129 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-05-21T01:05:56.084 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/ipvs/ 2024-05-21T01:05:56.084 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 534113 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/ipvs/ip_vs.ko 2024-05-21T01:05:56.084 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14201 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-05-21T01:05:56.084 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 8801 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-05-21T01:05:56.084 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20561 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-05-21T01:05:56.084 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20953 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-05-21T01:05:56.084 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 24577 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-05-21T01:05:56.084 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 8801 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-05-21T01:05:56.084 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 8865 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-05-21T01:05:56.084 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12649 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-05-21T01:05:56.084 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 10873 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-05-21T01:05:56.084 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 8921 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-05-21T01:05:56.084 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15977 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-05-21T01:05:56.084 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 8921 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-05-21T01:05:56.085 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12809 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-05-21T01:05:56.085 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 55217 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/nf_conncount.ko 2024-05-21T01:05:56.085 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 496817 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/nf_conntrack.ko 2024-05-21T01:05:56.085 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 18097 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-05-21T01:05:56.085 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11793 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-05-21T01:05:56.085 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 37865 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-05-21T01:05:56.085 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 134377 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/nf_conntrack_h323.ko 2024-05-21T01:05:56.085 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 24513 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/nf_conntrack_irc.ko 2024-05-21T01:05:56.085 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 9401 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-05-21T01:05:56.085 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 140801 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-05-21T01:05:56.085 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 38305 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-05-21T01:05:56.085 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 18937 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/nf_conntrack_sane.ko 2024-05-21T01:05:56.086 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 79873 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/nf_conntrack_sip.ko 2024-05-21T01:05:56.086 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12561 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-05-21T01:05:56.086 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 21089 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-05-21T01:05:56.086 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11401 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/nf_dup_netdev.ko 2024-05-21T01:05:56.086 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 117201 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/nf_flow_table.ko 2024-05-21T01:05:56.086 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 10961 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/nf_flow_table_inet.ko 2024-05-21T01:05:56.086 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 46105 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/nf_log_syslog.ko 2024-05-21T01:05:56.086 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 118369 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/nf_nat.ko 2024-05-21T01:05:56.086 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11369 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/nf_nat_amanda.ko 2024-05-21T01:05:56.086 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14185 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/nf_nat_ftp.ko 2024-05-21T01:05:56.086 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13345 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/nf_nat_irc.ko 2024-05-21T01:05:56.086 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 34609 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/nf_nat_sip.ko 2024-05-21T01:05:56.086 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 9889 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/nf_nat_tftp.ko 2024-05-21T01:05:56.087 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 53393 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/nf_synproxy_core.ko 2024-05-21T01:05:56.087 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 807985 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/nf_tables.ko 2024-05-21T01:05:56.087 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 53049 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/nfnetlink.ko 2024-05-21T01:05:56.087 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 36481 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/nfnetlink_acct.ko 2024-05-21T01:05:56.087 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 37209 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-05-21T01:05:56.087 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 49297 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/nfnetlink_log.ko 2024-05-21T01:05:56.087 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 26473 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/nfnetlink_osf.ko 2024-05-21T01:05:56.087 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 65145 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/nfnetlink_queue.ko 2024-05-21T01:05:56.087 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11993 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/nft_chain_nat.ko 2024-05-21T01:05:56.087 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 41769 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/nft_compat.ko 2024-05-21T01:05:56.087 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 50657 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/nft_ct.ko 2024-05-21T01:05:56.087 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11081 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/nft_dup_netdev.ko 2024-05-21T01:05:56.087 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13745 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/nft_fib.ko 2024-05-21T01:05:56.087 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16545 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/nft_fwd_netdev.ko 2024-05-21T01:05:56.088 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17177 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/nft_hash.ko 2024-05-21T01:05:56.088 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 25225 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/nft_limit.ko 2024-05-21T01:05:56.088 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17921 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/nft_log.ko 2024-05-21T01:05:56.088 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17449 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/nft_masq.ko 2024-05-21T01:05:56.088 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16873 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/nft_nat.ko 2024-05-21T01:05:56.088 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16473 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/nft_numgen.ko 2024-05-21T01:05:56.088 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13945 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/nft_osf.ko 2024-05-21T01:05:56.088 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16833 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/nft_queue.ko 2024-05-21T01:05:56.088 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16657 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/nft_redir.ko 2024-05-21T01:05:56.088 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12209 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/nft_reject.ko 2024-05-21T01:05:56.088 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11377 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/nft_reject_inet.ko 2024-05-21T01:05:56.088 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15057 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/nft_socket.ko 2024-05-21T01:05:56.088 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 24993 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/nft_synproxy.ko 2024-05-21T01:05:56.089 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17641 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/nft_tproxy.ko 2024-05-21T01:05:56.089 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 108393 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/x_tables.ko 2024-05-21T01:05:56.089 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14193 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/xt_AUDIT.ko 2024-05-21T01:05:56.089 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 10865 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/xt_CHECKSUM.ko 2024-05-21T01:05:56.089 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 8625 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/xt_CLASSIFY.ko 2024-05-21T01:05:56.089 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13409 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-05-21T01:05:56.089 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 21865 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/xt_CT.ko 2024-05-21T01:05:56.089 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12289 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/xt_DSCP.ko 2024-05-21T01:05:56.089 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11073 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/xt_HL.ko 2024-05-21T01:05:56.089 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15745 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/xt_HMARK.ko 2024-05-21T01:05:56.089 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 45217 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/xt_IDLETIMER.ko 2024-05-21T01:05:56.089 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15937 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/xt_LED.ko 2024-05-21T01:05:56.090 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13017 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/xt_LOG.ko 2024-05-21T01:05:56.090 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13377 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/xt_MASQUERADE.ko 2024-05-21T01:05:56.090 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13321 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/xt_NETMAP.ko 2024-05-21T01:05:56.090 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 10857 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/xt_NFLOG.ko 2024-05-21T01:05:56.090 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15361 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/xt_NFQUEUE.ko 2024-05-21T01:05:56.090 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 23089 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/xt_RATEEST.ko 2024-05-21T01:05:56.090 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12553 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/xt_REDIRECT.ko 2024-05-21T01:05:56.090 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16689 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/xt_SECMARK.ko 2024-05-21T01:05:56.090 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 18985 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/xt_TCPMSS.ko 2024-05-21T01:05:56.090 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11769 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-05-21T01:05:56.090 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20697 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/xt_TEE.ko 2024-05-21T01:05:56.090 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19625 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/xt_TPROXY.ko 2024-05-21T01:05:56.090 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 9449 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/xt_TRACE.ko 2024-05-21T01:05:56.091 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15289 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/xt_addrtype.ko 2024-05-21T01:05:56.091 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16633 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/xt_bpf.ko 2024-05-21T01:05:56.091 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20489 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/xt_cgroup.ko 2024-05-21T01:05:56.091 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12865 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/xt_cluster.ko 2024-05-21T01:05:56.091 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 8465 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/xt_comment.ko 2024-05-21T01:05:56.091 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11961 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/xt_connbytes.ko 2024-05-21T01:05:56.091 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12969 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/xt_connlabel.ko 2024-05-21T01:05:56.091 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 10617 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/xt_connlimit.ko 2024-05-21T01:05:56.091 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15841 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/xt_connmark.ko 2024-05-21T01:05:56.091 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14209 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/xt_conntrack.ko 2024-05-21T01:05:56.091 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 8913 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/xt_cpu.ko 2024-05-21T01:05:56.091 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12489 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/xt_dccp.ko 2024-05-21T01:05:56.091 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 9001 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/xt_devgroup.ko 2024-05-21T01:05:56.091 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 10257 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/xt_dscp.ko 2024-05-21T01:05:56.092 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12657 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/xt_ecn.ko 2024-05-21T01:05:56.092 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12873 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/xt_esp.ko 2024-05-21T01:05:56.092 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 52817 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/xt_hashlimit.ko 2024-05-21T01:05:56.092 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12833 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/xt_helper.ko 2024-05-21T01:05:56.092 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 9521 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/xt_hl.ko 2024-05-21T01:05:56.092 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13241 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/xt_ipcomp.ko 2024-05-21T01:05:56.092 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12801 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/xt_iprange.ko 2024-05-21T01:05:56.092 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13409 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/xt_ipvs.ko 2024-05-21T01:05:56.092 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19193 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/xt_l2tp.ko 2024-05-21T01:05:56.092 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 9137 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/xt_length.ko 2024-05-21T01:05:56.092 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11521 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/xt_limit.ko 2024-05-21T01:05:56.092 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 8449 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/xt_mac.ko 2024-05-21T01:05:56.092 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 9881 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/xt_mark.ko 2024-05-21T01:05:56.093 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13417 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/xt_multiport.ko 2024-05-21T01:05:56.093 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 16161 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/xt_nat.ko 2024-05-21T01:05:56.093 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11433 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/xt_nfacct.ko 2024-05-21T01:05:56.093 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 9433 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/xt_osf.ko 2024-05-21T01:05:56.093 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11561 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/xt_owner.ko 2024-05-21T01:05:56.093 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11457 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/xt_physdev.ko 2024-05-21T01:05:56.093 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 8625 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/xt_pkttype.ko 2024-05-21T01:05:56.093 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13553 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/xt_policy.ko 2024-05-21T01:05:56.093 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 10905 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/xt_quota.ko 2024-05-21T01:05:56.093 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 11881 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/xt_rateest.ko 2024-05-21T01:05:56.093 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 9273 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/xt_realm.ko 2024-05-21T01:05:56.093 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 43465 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/xt_recent.ko 2024-05-21T01:05:56.093 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14833 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/xt_sctp.ko 2024-05-21T01:05:56.094 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 36489 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/xt_set.ko 2024-05-21T01:05:56.094 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 19777 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/xt_socket.ko 2024-05-21T01:05:56.094 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 10753 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/xt_state.ko 2024-05-21T01:05:56.094 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 10849 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/xt_statistic.ko 2024-05-21T01:05:56.094 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 10025 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/xt_string.ko 2024-05-21T01:05:56.094 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 9593 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/xt_tcpmss.ko 2024-05-21T01:05:56.094 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 18449 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/xt_tcpudp.ko 2024-05-21T01:05:56.094 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12441 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/xt_time.ko 2024-05-21T01:05:56.094 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 10617 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netfilter/xt_u32.ko 2024-05-21T01:05:56.094 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netlink/ 2024-05-21T01:05:56.094 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 17233 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/netlink/netlink_diag.ko 2024-05-21T01:05:56.094 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/nsh/ 2024-05-21T01:05:56.094 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 14073 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/nsh/nsh.ko 2024-05-21T01:05:56.095 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/openvswitch/ 2024-05-21T01:05:56.095 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 488825 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/openvswitch/openvswitch.ko 2024-05-21T01:05:56.095 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12009 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/openvswitch/vport-geneve.ko 2024-05-21T01:05:56.095 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 10873 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/openvswitch/vport-gre.ko 2024-05-21T01:05:56.095 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13905 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/openvswitch/vport-vxlan.ko 2024-05-21T01:05:56.095 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/packet/ 2024-05-21T01:05:56.095 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15929 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/packet/af_packet_diag.ko 2024-05-21T01:05:56.095 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/phonet/ 2024-05-21T01:05:56.095 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 142025 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/phonet/phonet.ko 2024-05-21T01:05:56.095 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 68817 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/phonet/pn_pep.ko 2024-05-21T01:05:56.095 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/rds/ 2024-05-21T01:05:56.095 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 318617 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/rds/rds.ko 2024-05-21T01:05:56.095 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 202305 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/rds/rds_rdma.ko 2024-05-21T01:05:56.096 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 85105 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/rds/rds_tcp.ko 2024-05-21T01:05:56.096 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/rxrpc/ 2024-05-21T01:05:56.096 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 1027897 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/rxrpc/rxrpc.ko 2024-05-21T01:05:56.096 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/sched/ 2024-05-21T01:05:56.096 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 39001 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/sched/act_csum.ko 2024-05-21T01:05:56.096 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 28721 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/sched/act_gact.ko 2024-05-21T01:05:56.096 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 45409 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/sched/act_mirred.ko 2024-05-21T01:05:56.096 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 27593 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/sched/act_nat.ko 2024-05-21T01:05:56.096 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 53465 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/sched/act_pedit.ko 2024-05-21T01:05:56.096 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 38705 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/sched/act_police.ko 2024-05-21T01:05:56.096 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 23969 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/sched/act_simple.ko 2024-05-21T01:05:56.096 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 43417 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/sched/act_skbedit.ko 2024-05-21T01:05:56.096 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 45673 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/sched/act_vlan.ko 2024-05-21T01:05:56.097 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 32129 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/sched/cls_basic.ko 2024-05-21T01:05:56.097 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 41457 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/sched/cls_bpf.ko 2024-05-21T01:05:56.097 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 23225 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/sched/cls_cgroup.ko 2024-05-21T01:05:56.097 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 37305 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/sched/cls_flow.ko 2024-05-21T01:05:56.097 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 39601 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/sched/cls_fw.ko 2024-05-21T01:05:56.097 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 49321 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/sched/cls_route.ko 2024-05-21T01:05:56.097 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 79145 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/sched/cls_u32.ko 2024-05-21T01:05:56.097 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 8713 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/sched/em_cmp.ko 2024-05-21T01:05:56.097 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 15385 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/sched/em_ipset.ko 2024-05-21T01:05:56.097 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 48785 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/sched/em_meta.ko 2024-05-21T01:05:56.097 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 9241 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/sched/em_nbyte.ko 2024-05-21T01:05:56.097 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13369 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/sched/em_text.ko 2024-05-21T01:05:56.097 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 8377 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/sched/em_u32.ko 2024-05-21T01:05:56.098 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 25801 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/sched/sch_choke.ko 2024-05-21T01:05:56.098 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 25097 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/sched/sch_codel.ko 2024-05-21T01:05:56.098 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 43481 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/sched/sch_drr.ko 2024-05-21T01:05:56.098 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 43153 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/sched/sch_fq.ko 2024-05-21T01:05:56.098 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 39177 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/sched/sch_fq_codel.ko 2024-05-21T01:05:56.098 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 42889 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/sched/sch_gred.ko 2024-05-21T01:05:56.098 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 62817 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/sched/sch_hfsc.ko 2024-05-21T01:05:56.098 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 26585 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/sched/sch_hhf.ko 2024-05-21T01:05:56.098 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 81833 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/sched/sch_htb.ko 2024-05-21T01:05:56.098 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 33545 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/sched/sch_ingress.ko 2024-05-21T01:05:56.098 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 36625 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/sched/sch_mqprio.ko 2024-05-21T01:05:56.098 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12297 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/sched/sch_mqprio_lib.ko 2024-05-21T01:05:56.098 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 33065 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/sched/sch_multiq.ko 2024-05-21T01:05:56.099 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 44793 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/sched/sch_netem.ko 2024-05-21T01:05:56.099 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 32833 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/sched/sch_pie.ko 2024-05-21T01:05:56.099 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 13505 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/sched/sch_plug.ko 2024-05-21T01:05:56.099 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 31801 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/sched/sch_prio.ko 2024-05-21T01:05:56.099 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 60249 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/sched/sch_qfq.ko 2024-05-21T01:05:56.099 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 40889 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/sched/sch_red.ko 2024-05-21T01:05:56.099 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 33433 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/sched/sch_sfb.ko 2024-05-21T01:05:56.099 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 38329 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/sched/sch_sfq.ko 2024-05-21T01:05:56.099 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 35777 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/sched/sch_tbf.ko 2024-05-21T01:05:56.099 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 34161 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/sched/sch_teql.ko 2024-05-21T01:05:56.099 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/sctp/ 2024-05-21T01:05:56.099 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 1187313 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/sctp/sctp.ko 2024-05-21T01:05:56.099 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 23913 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/sctp/sctp_diag.ko 2024-05-21T01:05:56.100 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/sunrpc/ 2024-05-21T01:05:56.100 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/sunrpc/auth_gss/ 2024-05-21T01:05:56.100 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 432409 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-05-21T01:05:56.100 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 70113 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-05-21T01:05:56.100 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 1940889 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/sunrpc/sunrpc.ko 2024-05-21T01:05:56.103 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/sunrpc/xprtrdma/ 2024-05-21T01:05:56.103 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 890729 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-05-21T01:05:56.103 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/tipc/ 2024-05-21T01:05:56.103 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 1122337 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/tipc/tipc.ko 2024-05-21T01:05:56.103 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12153 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/tipc/tipc_diag.ko 2024-05-21T01:05:56.103 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/unix/ 2024-05-21T01:05:56.103 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 18801 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/unix/unix_diag.ko 2024-05-21T01:05:56.103 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/vmw_vsock/ 2024-05-21T01:05:56.103 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 105609 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-05-21T01:05:56.103 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 90265 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-05-21T01:05:56.104 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 123769 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/vmw_vsock/vsock.ko 2024-05-21T01:05:56.104 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 12905 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/vmw_vsock/vsock_diag.ko 2024-05-21T01:05:56.104 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 20401 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/vmw_vsock/vsock_loopback.ko 2024-05-21T01:05:56.104 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/x25/ 2024-05-21T01:05:56.104 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 165841 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/x25/x25.ko 2024-05-21T01:05:56.104 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/xfrm/ 2024-05-21T01:05:56.104 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 26729 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/xfrm/xfrm_algo.ko 2024-05-21T01:05:56.104 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 23353 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/xfrm/xfrm_ipcomp.ko 2024-05-21T01:05:56.104 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 131865 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/kernel/net/xfrm/xfrm_user.ko 2024-05-21T01:05:56.104 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 644769 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/modules.alias 2024-05-21T01:05:56.104 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 628542 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/modules.alias.bin 2024-05-21T01:05:56.104 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 7706 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/modules.builtin 2024-05-21T01:05:56.104 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 23609 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/modules.builtin.alias.bin 2024-05-21T01:05:56.104 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 9941 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/modules.builtin.bin 2024-05-21T01:05:56.105 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 70990 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/modules.builtin.modinfo 2024-05-21T01:05:56.105 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 146959 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/modules.dep 2024-05-21T01:05:56.105 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 232835 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/modules.dep.bin 2024-05-21T01:05:56.105 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 210 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/modules.devname 2024-05-21T01:05:56.105 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 72602 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/modules.order 2024-05-21T01:05:56.105 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 879 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/modules.softdep 2024-05-21T01:05:56.105 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 258450 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/modules.symbols 2024-05-21T01:05:56.105 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 313019 2024-05-17 02:26 ./lib/modules/6.9.0-rc3-g0fe9556839d2/modules.symbols.bin 2024-05-21T01:05:56.105 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./usr/ 2024-05-21T01:05:56.105 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./usr/share/ 2024-05-21T01:05:56.105 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./usr/share/doc/ 2024-05-21T01:05:56.105 INFO:teuthology.orchestra.run.smithi063.stdout:drwxr-xr-x root/root 0 2024-05-17 02:26 ./usr/share/doc/linux-image-6.9.0-rc3-g0fe9556839d2/ 2024-05-21T01:05:56.105 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 173 2024-05-17 02:26 ./usr/share/doc/linux-image-6.9.0-rc3-g0fe9556839d2/changelog.Debian.gz 2024-05-21T01:05:56.106 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-r--r-- root/root 691 2024-05-17 02:26 ./usr/share/doc/linux-image-6.9.0-rc3-g0fe9556839d2/copyright 2024-05-21T01:05:56.111 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g0fe9556839d2 2024-05-21T01:05:56.111 INFO:teuthology.task.kernel:searching for kernel 6.9.0-rc3-g0fe9556839d2 2024-05-21T01:05:56.111 DEBUG:teuthology.orchestra.run.smithi063:> egrep '(submenu|menuentry.*6.9.0-rc3-g0fe9556839d2).*{' /boot/grub/grub.cfg 2024-05-21T01:05:56.149 INFO:teuthology.orchestra.run.smithi063.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-05-21T01:05:56.149 INFO:teuthology.orchestra.run.smithi063.stdout: menuentry 'Ubuntu, with Linux 6.9.0-rc3-g0fe9556839d2' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.9.0-rc3-g0fe9556839d2-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-05-21T01:05:56.150 INFO:teuthology.orchestra.run.smithi063.stdout: menuentry 'Ubuntu, with Linux 6.9.0-rc3-g0fe9556839d2 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.9.0-rc3-g0fe9556839d2-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-05-21T01:05:56.150 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-05-21T01:05:56.150 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.9.0-rc3-g0fe9556839d2 2024-05-21T01:05:56.150 DEBUG:teuthology.orchestra.run.smithi063:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-05-21T01:05:56.193 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi063.front.sepia.ceph.com to complete... 2024-05-21T01:05:56.551 INFO:teuthology.orchestra.run.smithi063.stderr:Sourcing file `/etc/default/grub' 2024-05-21T01:05:56.552 INFO:teuthology.orchestra.run.smithi063.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-05-21T01:05:56.580 INFO:teuthology.orchestra.run.smithi063.stderr:Generating grub configuration file ... 2024-05-21T01:05:56.789 INFO:teuthology.orchestra.run.smithi063.stderr:Found linux image: /boot/vmlinuz-6.9.0-rc3-g0fe9556839d2 2024-05-21T01:05:56.795 INFO:teuthology.orchestra.run.smithi063.stderr:Found initrd image: /boot/initrd.img-6.9.0-rc3-g0fe9556839d2 2024-05-21T01:05:56.999 INFO:teuthology.orchestra.run.smithi063.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-05-21T01:05:57.005 INFO:teuthology.orchestra.run.smithi063.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-05-21T01:05:57.046 INFO:teuthology.orchestra.run.smithi063.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-05-21T01:05:57.052 INFO:teuthology.orchestra.run.smithi063.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-05-21T01:05:57.202 INFO:teuthology.orchestra.run.smithi063.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-05-21T01:05:57.202 INFO:teuthology.orchestra.run.smithi063.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-05-21T01:05:57.202 INFO:teuthology.orchestra.run.smithi063.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-05-21T01:05:57.230 INFO:teuthology.orchestra.run.smithi063.stderr:done 2024-05-21T01:06:28.334 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-05-21T01:06:28.335 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-05-21T01:06:28.336 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-21T01:07:02.818 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.63 2024-05-21T01:07:11.819 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-05-21T01:07:11.820 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-21T01:07:43.267 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.63 2024-05-21T01:07:55.268 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-05-21T01:07:55.269 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-21T01:07:55.502 DEBUG:teuthology.orchestra.run.smithi063:> true 2024-05-21T01:07:56.221 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-05-21T01:07:56.222 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.9.0-rc3-g0fe9556839d2"... 2024-05-21T01:07:56.222 DEBUG:teuthology.orchestra.run.smithi063:> uname -r 2024-05-21T01:07:56.273 INFO:teuthology.orchestra.run.smithi063.stdout:6.9.0-rc3-g0fe9556839d2 2024-05-21T01:07:56.273 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g0fe9556839d2 vs 6.9.0-rc3-g0fe9556839d2 2024-05-21T01:07:56.273 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-21T01:07:56.273 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-05-21T01:07:57.274 DEBUG:teuthology.parallel:result is None 2024-05-21T01:07:57.274 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-21T01:07:57.282 INFO:teuthology.task.internal:Creating test directory... 2024-05-21T01:07:57.282 DEBUG:teuthology.orchestra.run.smithi063:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-21T01:07:57.285 DEBUG:teuthology.orchestra.run.smithi131:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-21T01:07:57.292 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-21T01:07:57.305 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-21T01:07:57.340 INFO:teuthology.task.internal:Creating archive directory... 2024-05-21T01:07:57.340 DEBUG:teuthology.orchestra.run.smithi063:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-21T01:07:57.343 DEBUG:teuthology.orchestra.run.smithi131:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-21T01:07:57.368 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-21T01:07:57.374 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-21T01:07:57.374 DEBUG:teuthology.orchestra.run.smithi131:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-21T01:07:57.408 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-21T01:07:57.409 DEBUG:teuthology.orchestra.run.smithi063:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-21T01:07:57.412 DEBUG:teuthology.orchestra.run.smithi131:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-21T01:07:57.477 INFO:teuthology.orchestra.run.smithi131.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-21T01:07:57.488 INFO:teuthology.orchestra.run.smithi131.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-21T01:07:57.494 INFO:teuthology.orchestra.run.smithi063.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-21T01:07:57.512 INFO:teuthology.orchestra.run.smithi063.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-21T01:07:57.514 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-21T01:07:57.521 INFO:teuthology.task.internal:Configuring sudo... 2024-05-21T01:07:57.521 DEBUG:teuthology.orchestra.run.smithi063:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-21T01:07:57.525 DEBUG:teuthology.orchestra.run.smithi131:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-21T01:07:57.545 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-21T01:07:57.567 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-21T01:07:57.568 DEBUG:teuthology.orchestra.run.smithi063:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-21T01:07:57.588 DEBUG:teuthology.orchestra.run.smithi131:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-21T01:07:57.594 DEBUG:teuthology.orchestra.run.smithi063:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-21T01:07:57.646 DEBUG:teuthology.orchestra.run.smithi063:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-21T01:07:57.698 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-05-21T01:07:57.698 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-21T01:07:57.772 DEBUG:teuthology.orchestra.run.smithi131:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-21T01:07:57.778 DEBUG:teuthology.orchestra.run.smithi131:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-21T01:07:57.825 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-05-21T01:07:57.825 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-21T01:07:57.886 DEBUG:teuthology.orchestra.run.smithi063:> sudo service rsyslog restart 2024-05-21T01:07:57.890 DEBUG:teuthology.orchestra.run.smithi131:> sudo service rsyslog restart 2024-05-21T01:07:58.012 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-21T01:07:58.020 INFO:teuthology.task.internal:Starting timer... 2024-05-21T01:07:58.020 INFO:teuthology.run_tasks:Running task pcp... 2024-05-21T01:07:58.113 INFO:teuthology.run_tasks:Running task selinux... 2024-05-21T01:07:58.220 DEBUG:teuthology.task.selinux:Excluding smithi063: OS 'ubuntu' does not support SELinux 2024-05-21T01:07:58.220 DEBUG:teuthology.task.selinux:Excluding smithi131: OS 'ubuntu' does not support SELinux 2024-05-21T01:07:58.220 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-21T01:07:58.221 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-05-21T01:07:58.221 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-21T01:07:58.221 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-21T01:07:58.229 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-21T01:07:58.239 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-21T01:07:58.240 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi063.front.sepia.ceph.com,smithi131.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-21T01:15:49.130 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi063.front.sepia.ceph.com'), Remote(name='ubuntu@smithi131.front.sepia.ceph.com')] 2024-05-21T01:15:49.131 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-05-21T01:15:49.132 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-21T01:15:49.218 DEBUG:teuthology.orchestra.run.smithi063:> true 2024-05-21T01:15:49.337 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-05-21T01:15:49.337 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com' 2024-05-21T01:15:49.338 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-21T01:15:49.417 DEBUG:teuthology.orchestra.run.smithi131:> true 2024-05-21T01:15:49.526 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi131.front.sepia.ceph.com' 2024-05-21T01:15:49.526 INFO:teuthology.run_tasks:Running task clock... 2024-05-21T01:15:49.537 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-21T01:15:49.537 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-21T01:15:49.537 DEBUG:teuthology.orchestra.run.smithi063:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-21T01:15:49.540 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-21T01:15:49.541 DEBUG:teuthology.orchestra.run.smithi131:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-21T01:15:49.577 INFO:teuthology.orchestra.run.smithi063.stdout:21 May 01:15:49 ntpd[17273]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-05-21T01:15:49.577 INFO:teuthology.orchestra.run.smithi063.stdout:21 May 01:15:49 ntpd[17273]: Command line: ntpd -gq 2024-05-21T01:15:49.577 INFO:teuthology.orchestra.run.smithi063.stdout:21 May 01:15:49 ntpd[17273]: ---------------------------------------------------- 2024-05-21T01:15:49.577 INFO:teuthology.orchestra.run.smithi063.stdout:21 May 01:15:49 ntpd[17273]: ntp-4 is maintained by Network Time Foundation, 2024-05-21T01:15:49.577 INFO:teuthology.orchestra.run.smithi063.stdout:21 May 01:15:49 ntpd[17273]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-05-21T01:15:49.578 INFO:teuthology.orchestra.run.smithi063.stdout:21 May 01:15:49 ntpd[17273]: corporation. Support and training for ntp-4 are 2024-05-21T01:15:49.578 INFO:teuthology.orchestra.run.smithi063.stdout:21 May 01:15:49 ntpd[17273]: available at https://www.nwtime.org/support 2024-05-21T01:15:49.578 INFO:teuthology.orchestra.run.smithi063.stdout:21 May 01:15:49 ntpd[17273]: ---------------------------------------------------- 2024-05-21T01:15:49.578 INFO:teuthology.orchestra.run.smithi063.stdout:21 May 01:15:49 ntpd[17273]: proto: precision = 0.047 usec (-24) 2024-05-21T01:15:49.578 INFO:teuthology.orchestra.run.smithi063.stdout:21 May 01:15:49 ntpd[17273]: basedate set to 2022-02-04 2024-05-21T01:15:49.578 INFO:teuthology.orchestra.run.smithi063.stdout:21 May 01:15:49 ntpd[17273]: gps base set to 2022-02-06 (week 2196) 2024-05-21T01:15:49.579 INFO:teuthology.orchestra.run.smithi063.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-21T01:15:49.579 INFO:teuthology.orchestra.run.smithi063.stdout:21 May 01:15:49 ntpd[17273]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-21T01:15:49.579 INFO:teuthology.orchestra.run.smithi063.stdout:21 May 01:15:49 ntpd[17273]: restrict ::: KOD does nothing without LIMITED. 2024-05-21T01:15:49.579 INFO:teuthology.orchestra.run.smithi063.stderr:restrict ::: KOD does nothing without LIMITED. 2024-05-21T01:15:49.580 INFO:teuthology.orchestra.run.smithi063.stdout:21 May 01:15:49 ntpd[17273]: Listen and drop on 0 v6wildcard [::]:123 2024-05-21T01:15:49.580 INFO:teuthology.orchestra.run.smithi063.stdout:21 May 01:15:49 ntpd[17273]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-05-21T01:15:49.580 INFO:teuthology.orchestra.run.smithi063.stdout:21 May 01:15:49 ntpd[17273]: Listen normally on 2 lo 127.0.0.1:123 2024-05-21T01:15:49.581 INFO:teuthology.orchestra.run.smithi063.stdout:21 May 01:15:49 ntpd[17273]: Listen normally on 3 enp3s0f1 172.21.15.63:123 2024-05-21T01:15:49.581 INFO:teuthology.orchestra.run.smithi063.stdout:21 May 01:15:49 ntpd[17273]: Listen normally on 4 lo [::1]:123 2024-05-21T01:15:49.581 INFO:teuthology.orchestra.run.smithi063.stdout:21 May 01:15:49 ntpd[17273]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:feb6:f8d7%5]:123 2024-05-21T01:15:49.581 INFO:teuthology.orchestra.run.smithi063.stdout:21 May 01:15:49 ntpd[17273]: Listening on routing socket on fd #22 for interface updates 2024-05-21T01:15:49.595 INFO:teuthology.orchestra.run.smithi131.stdout:21 May 01:15:49 ntpd[17711]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-05-21T01:15:49.595 INFO:teuthology.orchestra.run.smithi131.stdout:21 May 01:15:49 ntpd[17711]: Command line: ntpd -gq 2024-05-21T01:15:49.595 INFO:teuthology.orchestra.run.smithi131.stdout:21 May 01:15:49 ntpd[17711]: ---------------------------------------------------- 2024-05-21T01:15:49.595 INFO:teuthology.orchestra.run.smithi131.stdout:21 May 01:15:49 ntpd[17711]: ntp-4 is maintained by Network Time Foundation, 2024-05-21T01:15:49.595 INFO:teuthology.orchestra.run.smithi131.stdout:21 May 01:15:49 ntpd[17711]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-05-21T01:15:49.595 INFO:teuthology.orchestra.run.smithi131.stdout:21 May 01:15:49 ntpd[17711]: corporation. Support and training for ntp-4 are 2024-05-21T01:15:49.595 INFO:teuthology.orchestra.run.smithi131.stdout:21 May 01:15:49 ntpd[17711]: available at https://www.nwtime.org/support 2024-05-21T01:15:49.596 INFO:teuthology.orchestra.run.smithi131.stdout:21 May 01:15:49 ntpd[17711]: ---------------------------------------------------- 2024-05-21T01:15:49.596 INFO:teuthology.orchestra.run.smithi131.stdout:21 May 01:15:49 ntpd[17711]: proto: precision = 0.063 usec (-24) 2024-05-21T01:15:49.596 INFO:teuthology.orchestra.run.smithi131.stdout:21 May 01:15:49 ntpd[17711]: basedate set to 2022-02-04 2024-05-21T01:15:49.596 INFO:teuthology.orchestra.run.smithi131.stdout:21 May 01:15:49 ntpd[17711]: gps base set to 2022-02-06 (week 2196) 2024-05-21T01:15:49.597 INFO:teuthology.orchestra.run.smithi131.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-21T01:15:49.597 INFO:teuthology.orchestra.run.smithi131.stdout:21 May 01:15:49 ntpd[17711]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-21T01:15:49.597 INFO:teuthology.orchestra.run.smithi131.stdout:21 May 01:15:49 ntpd[17711]: restrict ::: KOD does nothing without LIMITED. 2024-05-21T01:15:49.597 INFO:teuthology.orchestra.run.smithi131.stderr:restrict ::: KOD does nothing without LIMITED. 2024-05-21T01:15:49.598 INFO:teuthology.orchestra.run.smithi131.stdout:21 May 01:15:49 ntpd[17711]: Listen and drop on 0 v6wildcard [::]:123 2024-05-21T01:15:49.598 INFO:teuthology.orchestra.run.smithi131.stdout:21 May 01:15:49 ntpd[17711]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-05-21T01:15:49.599 INFO:teuthology.orchestra.run.smithi131.stdout:21 May 01:15:49 ntpd[17711]: Listen normally on 2 lo 127.0.0.1:123 2024-05-21T01:15:49.599 INFO:teuthology.orchestra.run.smithi131.stdout:21 May 01:15:49 ntpd[17711]: Listen normally on 3 enp3s0f1 172.21.15.131:123 2024-05-21T01:15:49.599 INFO:teuthology.orchestra.run.smithi131.stdout:21 May 01:15:49 ntpd[17711]: Listen normally on 4 lo [::1]:123 2024-05-21T01:15:49.599 INFO:teuthology.orchestra.run.smithi131.stdout:21 May 01:15:49 ntpd[17711]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:72f9%5]:123 2024-05-21T01:15:49.599 INFO:teuthology.orchestra.run.smithi131.stdout:21 May 01:15:49 ntpd[17711]: Listening on routing socket on fd #22 for interface updates 2024-05-21T01:15:50.578 INFO:teuthology.orchestra.run.smithi063.stderr:21 May 01:15:50 ntpd[17273]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T01:15:50.579 INFO:teuthology.orchestra.run.smithi063.stderr:21 May 01:15:50 ntpd[17273]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T01:15:50.579 INFO:teuthology.orchestra.run.smithi063.stderr:21 May 01:15:50 ntpd[17273]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T01:15:50.579 INFO:teuthology.orchestra.run.smithi063.stderr:21 May 01:15:50 ntpd[17273]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T01:15:50.579 INFO:teuthology.orchestra.run.smithi063.stderr:21 May 01:15:50 ntpd[17273]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T01:15:50.579 INFO:teuthology.orchestra.run.smithi063.stderr:21 May 01:15:50 ntpd[17273]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T01:15:50.579 INFO:teuthology.orchestra.run.smithi063.stderr:21 May 01:15:50 ntpd[17273]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-21T01:15:50.579 INFO:teuthology.orchestra.run.smithi063.stderr:21 May 01:15:50 ntpd[17273]: can't open /var/log/ntpstats/peerstats.20240521: Permission denied 2024-05-21T01:15:50.579 INFO:teuthology.orchestra.run.smithi063.stderr:21 May 01:15:50 ntpd[17273]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T01:15:50.579 INFO:teuthology.orchestra.run.smithi063.stderr:21 May 01:15:50 ntpd[17273]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T01:15:50.580 INFO:teuthology.orchestra.run.smithi063.stderr:21 May 01:15:50 ntpd[17273]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-21T01:15:50.580 INFO:teuthology.orchestra.run.smithi063.stderr:21 May 01:15:50 ntpd[17273]: can't open /var/log/ntpstats/peerstats.20240521: Permission denied 2024-05-21T01:15:52.579 INFO:teuthology.orchestra.run.smithi063.stderr:21 May 01:15:52 ntpd[17273]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T01:15:52.579 INFO:teuthology.orchestra.run.smithi063.stderr:21 May 01:15:52 ntpd[17273]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T01:15:52.579 INFO:teuthology.orchestra.run.smithi063.stderr:21 May 01:15:52 ntpd[17273]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T01:15:52.579 INFO:teuthology.orchestra.run.smithi063.stderr:21 May 01:15:52 ntpd[17273]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T01:15:52.579 INFO:teuthology.orchestra.run.smithi063.stderr:21 May 01:15:52 ntpd[17273]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T01:15:52.579 INFO:teuthology.orchestra.run.smithi063.stderr:21 May 01:15:52 ntpd[17273]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T01:15:52.579 INFO:teuthology.orchestra.run.smithi063.stderr:21 May 01:15:52 ntpd[17273]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T01:15:52.579 INFO:teuthology.orchestra.run.smithi063.stderr:21 May 01:15:52 ntpd[17273]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T01:15:52.579 INFO:teuthology.orchestra.run.smithi063.stderr:21 May 01:15:52 ntpd[17273]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-21T01:15:52.579 INFO:teuthology.orchestra.run.smithi063.stderr:21 May 01:15:52 ntpd[17273]: can't open /var/log/ntpstats/peerstats.20240521: Permission denied 2024-05-21T01:15:52.580 INFO:teuthology.orchestra.run.smithi063.stderr:21 May 01:15:52 ntpd[17273]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T01:15:52.580 INFO:teuthology.orchestra.run.smithi063.stderr:21 May 01:15:52 ntpd[17273]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T01:15:52.580 INFO:teuthology.orchestra.run.smithi063.stderr:21 May 01:15:52 ntpd[17273]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-21T01:15:52.580 INFO:teuthology.orchestra.run.smithi063.stderr:21 May 01:15:52 ntpd[17273]: can't open /var/log/ntpstats/peerstats.20240521: Permission denied 2024-05-21T01:15:52.596 INFO:teuthology.orchestra.run.smithi131.stderr:21 May 01:15:52 ntpd[17711]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T01:15:52.596 INFO:teuthology.orchestra.run.smithi131.stderr:21 May 01:15:52 ntpd[17711]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T01:15:52.596 INFO:teuthology.orchestra.run.smithi131.stderr:21 May 01:15:52 ntpd[17711]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T01:15:52.596 INFO:teuthology.orchestra.run.smithi131.stderr:21 May 01:15:52 ntpd[17711]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T01:15:52.596 INFO:teuthology.orchestra.run.smithi131.stderr:21 May 01:15:52 ntpd[17711]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T01:15:52.596 INFO:teuthology.orchestra.run.smithi131.stderr:21 May 01:15:52 ntpd[17711]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T01:15:52.596 INFO:teuthology.orchestra.run.smithi131.stderr:21 May 01:15:52 ntpd[17711]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-21T01:15:52.596 INFO:teuthology.orchestra.run.smithi131.stderr:21 May 01:15:52 ntpd[17711]: can't open /var/log/ntpstats/peerstats.20240521: Permission denied 2024-05-21T01:15:53.596 INFO:teuthology.orchestra.run.smithi131.stderr:21 May 01:15:53 ntpd[17711]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T01:15:53.596 INFO:teuthology.orchestra.run.smithi131.stderr:21 May 01:15:53 ntpd[17711]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T01:15:53.596 INFO:teuthology.orchestra.run.smithi131.stderr:21 May 01:15:53 ntpd[17711]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T01:15:53.596 INFO:teuthology.orchestra.run.smithi131.stderr:21 May 01:15:53 ntpd[17711]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T01:15:53.596 INFO:teuthology.orchestra.run.smithi131.stderr:21 May 01:15:53 ntpd[17711]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-21T01:15:53.597 INFO:teuthology.orchestra.run.smithi131.stderr:21 May 01:15:53 ntpd[17711]: can't open /var/log/ntpstats/peerstats.20240521: Permission denied 2024-05-21T01:15:54.580 INFO:teuthology.orchestra.run.smithi063.stderr:21 May 01:15:54 ntpd[17273]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T01:15:54.580 INFO:teuthology.orchestra.run.smithi063.stderr:21 May 01:15:54 ntpd[17273]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T01:15:54.580 INFO:teuthology.orchestra.run.smithi063.stderr:21 May 01:15:54 ntpd[17273]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T01:15:54.580 INFO:teuthology.orchestra.run.smithi063.stderr:21 May 01:15:54 ntpd[17273]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T01:15:54.580 INFO:teuthology.orchestra.run.smithi063.stderr:21 May 01:15:54 ntpd[17273]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T01:15:54.581 INFO:teuthology.orchestra.run.smithi063.stderr:21 May 01:15:54 ntpd[17273]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T01:15:54.581 INFO:teuthology.orchestra.run.smithi063.stderr:21 May 01:15:54 ntpd[17273]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T01:15:54.581 INFO:teuthology.orchestra.run.smithi063.stderr:21 May 01:15:54 ntpd[17273]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T01:15:54.581 INFO:teuthology.orchestra.run.smithi063.stderr:21 May 01:15:54 ntpd[17273]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-21T01:15:54.581 INFO:teuthology.orchestra.run.smithi063.stderr:21 May 01:15:54 ntpd[17273]: can't open /var/log/ntpstats/peerstats.20240521: Permission denied 2024-05-21T01:15:54.581 INFO:teuthology.orchestra.run.smithi063.stderr:21 May 01:15:54 ntpd[17273]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T01:15:54.581 INFO:teuthology.orchestra.run.smithi063.stderr:21 May 01:15:54 ntpd[17273]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T01:15:54.581 INFO:teuthology.orchestra.run.smithi063.stderr:21 May 01:15:54 ntpd[17273]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-21T01:15:54.581 INFO:teuthology.orchestra.run.smithi063.stderr:21 May 01:15:54 ntpd[17273]: can't open /var/log/ntpstats/peerstats.20240521: Permission denied 2024-05-21T01:15:54.582 INFO:teuthology.orchestra.run.smithi063.stderr:21 May 01:15:54 ntpd[17273]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T01:15:54.582 INFO:teuthology.orchestra.run.smithi063.stderr:21 May 01:15:54 ntpd[17273]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T01:15:54.582 INFO:teuthology.orchestra.run.smithi063.stderr:21 May 01:15:54 ntpd[17273]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-21T01:15:54.582 INFO:teuthology.orchestra.run.smithi063.stderr:21 May 01:15:54 ntpd[17273]: can't open /var/log/ntpstats/peerstats.20240521: Permission denied 2024-05-21T01:15:54.596 INFO:teuthology.orchestra.run.smithi131.stderr:21 May 01:15:54 ntpd[17711]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T01:15:54.597 INFO:teuthology.orchestra.run.smithi131.stderr:21 May 01:15:54 ntpd[17711]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T01:15:54.597 INFO:teuthology.orchestra.run.smithi131.stderr:21 May 01:15:54 ntpd[17711]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T01:15:54.597 INFO:teuthology.orchestra.run.smithi131.stderr:21 May 01:15:54 ntpd[17711]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T01:15:54.597 INFO:teuthology.orchestra.run.smithi131.stderr:21 May 01:15:54 ntpd[17711]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T01:15:54.597 INFO:teuthology.orchestra.run.smithi131.stderr:21 May 01:15:54 ntpd[17711]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T01:15:54.597 INFO:teuthology.orchestra.run.smithi131.stderr:21 May 01:15:54 ntpd[17711]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-21T01:15:54.597 INFO:teuthology.orchestra.run.smithi131.stderr:21 May 01:15:54 ntpd[17711]: can't open /var/log/ntpstats/peerstats.20240521: Permission denied 2024-05-21T01:15:54.597 INFO:teuthology.orchestra.run.smithi131.stderr:21 May 01:15:54 ntpd[17711]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T01:15:54.598 INFO:teuthology.orchestra.run.smithi131.stderr:21 May 01:15:54 ntpd[17711]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T01:15:54.598 INFO:teuthology.orchestra.run.smithi131.stderr:21 May 01:15:54 ntpd[17711]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-21T01:15:54.598 INFO:teuthology.orchestra.run.smithi131.stderr:21 May 01:15:54 ntpd[17711]: can't open /var/log/ntpstats/peerstats.20240521: Permission denied 2024-05-21T01:15:55.596 INFO:teuthology.orchestra.run.smithi131.stderr:21 May 01:15:55 ntpd[17711]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T01:15:55.596 INFO:teuthology.orchestra.run.smithi131.stderr:21 May 01:15:55 ntpd[17711]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T01:15:55.596 INFO:teuthology.orchestra.run.smithi131.stderr:21 May 01:15:55 ntpd[17711]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T01:15:55.596 INFO:teuthology.orchestra.run.smithi131.stderr:21 May 01:15:55 ntpd[17711]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T01:15:55.596 INFO:teuthology.orchestra.run.smithi131.stderr:21 May 01:15:55 ntpd[17711]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-21T01:15:55.596 INFO:teuthology.orchestra.run.smithi131.stderr:21 May 01:15:55 ntpd[17711]: can't open /var/log/ntpstats/peerstats.20240521: Permission denied 2024-05-21T01:15:56.579 INFO:teuthology.orchestra.run.smithi063.stderr:21 May 01:15:56 ntpd[17273]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T01:15:56.579 INFO:teuthology.orchestra.run.smithi063.stderr:21 May 01:15:56 ntpd[17273]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T01:15:56.579 INFO:teuthology.orchestra.run.smithi063.stderr:21 May 01:15:56 ntpd[17273]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T01:15:56.579 INFO:teuthology.orchestra.run.smithi063.stderr:21 May 01:15:56 ntpd[17273]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T01:15:56.579 INFO:teuthology.orchestra.run.smithi063.stderr:21 May 01:15:56 ntpd[17273]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T01:15:56.579 INFO:teuthology.orchestra.run.smithi063.stderr:21 May 01:15:56 ntpd[17273]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T01:15:56.579 INFO:teuthology.orchestra.run.smithi063.stderr:21 May 01:15:56 ntpd[17273]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T01:15:56.579 INFO:teuthology.orchestra.run.smithi063.stderr:21 May 01:15:56 ntpd[17273]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T01:15:56.579 INFO:teuthology.orchestra.run.smithi063.stderr:21 May 01:15:56 ntpd[17273]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-21T01:15:56.579 INFO:teuthology.orchestra.run.smithi063.stderr:21 May 01:15:56 ntpd[17273]: can't open /var/log/ntpstats/peerstats.20240521: Permission denied 2024-05-21T01:15:56.579 INFO:teuthology.orchestra.run.smithi063.stderr:21 May 01:15:56 ntpd[17273]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T01:15:56.579 INFO:teuthology.orchestra.run.smithi063.stderr:21 May 01:15:56 ntpd[17273]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T01:15:56.580 INFO:teuthology.orchestra.run.smithi063.stderr:21 May 01:15:56 ntpd[17273]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-21T01:15:56.580 INFO:teuthology.orchestra.run.smithi063.stderr:21 May 01:15:56 ntpd[17273]: can't open /var/log/ntpstats/peerstats.20240521: Permission denied 2024-05-21T01:15:56.580 INFO:teuthology.orchestra.run.smithi063.stdout:21 May 01:15:56 ntpd[17273]: ntpd: time slew +0.001025 s 2024-05-21T01:15:56.580 INFO:teuthology.orchestra.run.smithi063.stdout:ntpd: time slew +0.001025s 2024-05-21T01:15:56.580 INFO:teuthology.orchestra.run.smithi063.stderr:21 May 01:15:56 ntpd[17273]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-05-21T01:15:56.581 INFO:teuthology.orchestra.run.smithi063.stderr:21 May 01:15:56 ntpd[17273]: can't open /var/log/ntpstats/loopstats.20240521: Permission denied 2024-05-21T01:15:56.596 INFO:teuthology.orchestra.run.smithi131.stderr:21 May 01:15:56 ntpd[17711]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T01:15:56.596 INFO:teuthology.orchestra.run.smithi131.stderr:21 May 01:15:56 ntpd[17711]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T01:15:56.596 INFO:teuthology.orchestra.run.smithi131.stderr:21 May 01:15:56 ntpd[17711]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T01:15:56.596 INFO:teuthology.orchestra.run.smithi131.stderr:21 May 01:15:56 ntpd[17711]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T01:15:56.596 INFO:teuthology.orchestra.run.smithi131.stderr:21 May 01:15:56 ntpd[17711]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T01:15:56.597 INFO:teuthology.orchestra.run.smithi131.stderr:21 May 01:15:56 ntpd[17711]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T01:15:56.597 INFO:teuthology.orchestra.run.smithi131.stderr:21 May 01:15:56 ntpd[17711]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-21T01:15:56.597 INFO:teuthology.orchestra.run.smithi131.stderr:21 May 01:15:56 ntpd[17711]: can't open /var/log/ntpstats/peerstats.20240521: Permission denied 2024-05-21T01:15:56.597 INFO:teuthology.orchestra.run.smithi131.stderr:21 May 01:15:56 ntpd[17711]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T01:15:56.597 INFO:teuthology.orchestra.run.smithi131.stderr:21 May 01:15:56 ntpd[17711]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T01:15:56.597 INFO:teuthology.orchestra.run.smithi131.stderr:21 May 01:15:56 ntpd[17711]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-21T01:15:56.597 INFO:teuthology.orchestra.run.smithi131.stderr:21 May 01:15:56 ntpd[17711]: can't open /var/log/ntpstats/peerstats.20240521: Permission denied 2024-05-21T01:15:56.665 INFO:teuthology.orchestra.run.smithi063.stdout: remote refid st t when poll reach delay offset jitter 2024-05-21T01:15:56.665 INFO:teuthology.orchestra.run.smithi063.stdout:============================================================================== 2024-05-21T01:15:56.665 INFO:teuthology.orchestra.run.smithi063.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-21T01:15:56.665 INFO:teuthology.orchestra.run.smithi063.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-21T01:15:56.665 INFO:teuthology.orchestra.run.smithi063.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-21T01:15:56.665 INFO:teuthology.orchestra.run.smithi063.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-21T01:15:57.596 INFO:teuthology.orchestra.run.smithi131.stderr:21 May 01:15:57 ntpd[17711]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T01:15:57.596 INFO:teuthology.orchestra.run.smithi131.stderr:21 May 01:15:57 ntpd[17711]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T01:15:57.596 INFO:teuthology.orchestra.run.smithi131.stderr:21 May 01:15:57 ntpd[17711]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T01:15:57.596 INFO:teuthology.orchestra.run.smithi131.stderr:21 May 01:15:57 ntpd[17711]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T01:15:57.596 INFO:teuthology.orchestra.run.smithi131.stderr:21 May 01:15:57 ntpd[17711]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-21T01:15:57.596 INFO:teuthology.orchestra.run.smithi131.stderr:21 May 01:15:57 ntpd[17711]: can't open /var/log/ntpstats/peerstats.20240521: Permission denied 2024-05-21T01:15:58.596 INFO:teuthology.orchestra.run.smithi131.stderr:21 May 01:15:58 ntpd[17711]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T01:15:58.596 INFO:teuthology.orchestra.run.smithi131.stderr:21 May 01:15:58 ntpd[17711]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T01:15:58.597 INFO:teuthology.orchestra.run.smithi131.stderr:21 May 01:15:58 ntpd[17711]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T01:15:58.597 INFO:teuthology.orchestra.run.smithi131.stderr:21 May 01:15:58 ntpd[17711]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T01:15:58.597 INFO:teuthology.orchestra.run.smithi131.stderr:21 May 01:15:58 ntpd[17711]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T01:15:58.597 INFO:teuthology.orchestra.run.smithi131.stderr:21 May 01:15:58 ntpd[17711]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T01:15:58.597 INFO:teuthology.orchestra.run.smithi131.stderr:21 May 01:15:58 ntpd[17711]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-21T01:15:58.597 INFO:teuthology.orchestra.run.smithi131.stderr:21 May 01:15:58 ntpd[17711]: can't open /var/log/ntpstats/peerstats.20240521: Permission denied 2024-05-21T01:15:58.597 INFO:teuthology.orchestra.run.smithi131.stdout:21 May 01:15:58 ntpd[17711]: ntpd: time slew -0.002932 s 2024-05-21T01:15:58.597 INFO:teuthology.orchestra.run.smithi131.stdout:ntpd: time slew -0.002932s 2024-05-21T01:15:58.598 INFO:teuthology.orchestra.run.smithi131.stderr:21 May 01:15:58 ntpd[17711]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-05-21T01:15:58.598 INFO:teuthology.orchestra.run.smithi131.stderr:21 May 01:15:58 ntpd[17711]: can't open /var/log/ntpstats/loopstats.20240521: Permission denied 2024-05-21T01:15:58.681 INFO:teuthology.orchestra.run.smithi131.stdout: remote refid st t when poll reach delay offset jitter 2024-05-21T01:15:58.681 INFO:teuthology.orchestra.run.smithi131.stdout:============================================================================== 2024-05-21T01:15:58.682 INFO:teuthology.orchestra.run.smithi131.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-21T01:15:58.682 INFO:teuthology.orchestra.run.smithi131.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-21T01:15:58.682 INFO:teuthology.orchestra.run.smithi131.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-21T01:15:58.682 INFO:teuthology.orchestra.run.smithi131.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-21T01:15:58.683 INFO:teuthology.run_tasks:Running task install... 2024-05-21T01:15:58.692 DEBUG:teuthology.task.install:project ceph 2024-05-21T01:15:58.692 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '0051ea03417a66dbfd5a17ea02c9049bcda16863'}} 2024-05-21T01:15:58.692 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '0051ea03417a66dbfd5a17ea02c9049bcda16863'} 2024-05-21T01:15:58.692 INFO:teuthology.task.install:Using flavor: default 2024-05-21T01:15:58.698 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-05-21T01:15:58.698 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-05-21T01:15:58.701 DEBUG:teuthology.orchestra.run.smithi063:> sudo apt-key list | grep Ceph 2024-05-21T01:15:58.702 DEBUG:teuthology.orchestra.run.smithi131:> sudo apt-key list | grep Ceph 2024-05-21T01:15:58.783 INFO:teuthology.orchestra.run.smithi131.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-05-21T01:15:58.809 INFO:teuthology.orchestra.run.smithi131.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-05-21T01:15:58.809 INFO:teuthology.orchestra.run.smithi131.stdout:uid [ unknown] Ceph.com (release key) 2024-05-21T01:15:58.810 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-05-21T01:15:58.810 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-05-21T01:15:58.810 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=0051ea03417a66dbfd5a17ea02c9049bcda16863 2024-05-21T01:15:58.814 INFO:teuthology.orchestra.run.smithi063.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-05-21T01:15:58.863 INFO:teuthology.orchestra.run.smithi063.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-05-21T01:15:58.863 INFO:teuthology.orchestra.run.smithi063.stdout:uid [ unknown] Ceph.com (release key) 2024-05-21T01:15:58.864 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-05-21T01:15:58.864 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-05-21T01:15:58.865 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=0051ea03417a66dbfd5a17ea02c9049bcda16863 2024-05-21T01:15:58.967 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-lusov-quiesce-no-remote-ap/0051ea03417a66dbfd5a17ea02c9049bcda16863/ubuntu/jammy/flavors/default/ 2024-05-21T01:15:58.968 INFO:teuthology.task.install.deb:Package version is 19.0.0-3830-g0051ea03-1jammy 2024-05-21T01:15:59.012 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-lusov-quiesce-no-remote-ap/0051ea03417a66dbfd5a17ea02c9049bcda16863/ubuntu/jammy/flavors/default/ 2024-05-21T01:15:59.013 INFO:teuthology.task.install.deb:Package version is 19.0.0-3830-g0051ea03-1jammy 2024-05-21T01:15:59.087 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-05-21T01:15:59.087 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-05-21T01:15:59.101 DEBUG:teuthology.orchestra.run.smithi131:> sudo apt-get update 2024-05-21T01:15:59.126 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-05-21T01:15:59.126 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-05-21T01:15:59.147 DEBUG:teuthology.orchestra.run.smithi063:> sudo apt-get update 2024-05-21T01:15:59.276 INFO:teuthology.orchestra.run.smithi131.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-21T01:15:59.288 INFO:teuthology.orchestra.run.smithi131.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-05-21T01:15:59.307 INFO:teuthology.orchestra.run.smithi131.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-05-21T01:15:59.342 INFO:teuthology.orchestra.run.smithi063.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-21T01:15:59.350 INFO:teuthology.orchestra.run.smithi063.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-05-21T01:15:59.370 INFO:teuthology.orchestra.run.smithi063.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-05-21T01:15:59.386 INFO:teuthology.orchestra.run.smithi063.stdout:Ign:4 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiesce-no-remote-ap/0051ea03417a66dbfd5a17ea02c9049bcda16863/ubuntu/jammy/flavors/default jammy InRelease 2024-05-21T01:15:59.386 INFO:teuthology.orchestra.run.smithi131.stdout:Ign:4 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiesce-no-remote-ap/0051ea03417a66dbfd5a17ea02c9049bcda16863/ubuntu/jammy/flavors/default jammy InRelease 2024-05-21T01:15:59.391 INFO:teuthology.orchestra.run.smithi131.stdout:Hit:5 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-05-21T01:15:59.407 INFO:teuthology.orchestra.run.smithi063.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiesce-no-remote-ap/0051ea03417a66dbfd5a17ea02c9049bcda16863/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-05-21T01:15:59.423 INFO:teuthology.orchestra.run.smithi131.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiesce-no-remote-ap/0051ea03417a66dbfd5a17ea02c9049bcda16863/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-05-21T01:15:59.430 INFO:teuthology.orchestra.run.smithi063.stdout:Ign:6 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiesce-no-remote-ap/0051ea03417a66dbfd5a17ea02c9049bcda16863/ubuntu/jammy/flavors/default jammy Release.gpg 2024-05-21T01:15:59.451 INFO:teuthology.orchestra.run.smithi063.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiesce-no-remote-ap/0051ea03417a66dbfd5a17ea02c9049bcda16863/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,399 B] 2024-05-21T01:15:59.460 INFO:teuthology.orchestra.run.smithi131.stdout:Ign:7 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiesce-no-remote-ap/0051ea03417a66dbfd5a17ea02c9049bcda16863/ubuntu/jammy/flavors/default jammy Release.gpg 2024-05-21T01:15:59.462 INFO:teuthology.orchestra.run.smithi063.stdout:Hit:8 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-05-21T01:15:59.484 INFO:teuthology.orchestra.run.smithi063.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiesce-no-remote-ap/0051ea03417a66dbfd5a17ea02c9049bcda16863/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-05-21T01:15:59.496 INFO:teuthology.orchestra.run.smithi131.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiesce-no-remote-ap/0051ea03417a66dbfd5a17ea02c9049bcda16863/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,399 B] 2024-05-21T01:15:59.538 INFO:teuthology.orchestra.run.smithi131.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiesce-no-remote-ap/0051ea03417a66dbfd5a17ea02c9049bcda16863/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-05-21T01:15:59.629 INFO:teuthology.orchestra.run.smithi131.stdout:Fetched 29.2 kB in 0s (84.2 kB/s) 2024-05-21T01:15:59.952 INFO:teuthology.orchestra.run.smithi063.stdout:Fetched 29.2 kB in 1s (50.8 kB/s) 2024-05-21T01:16:00.563 INFO:teuthology.orchestra.run.smithi131.stdout:Reading package lists... 2024-05-21T01:16:00.579 DEBUG:teuthology.orchestra.run.smithi131:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3830-g0051ea03-1jammy cephadm=19.0.0-3830-g0051ea03-1jammy ceph-mds=19.0.0-3830-g0051ea03-1jammy ceph-mgr=19.0.0-3830-g0051ea03-1jammy ceph-common=19.0.0-3830-g0051ea03-1jammy ceph-fuse=19.0.0-3830-g0051ea03-1jammy ceph-test=19.0.0-3830-g0051ea03-1jammy ceph-volume=19.0.0-3830-g0051ea03-1jammy radosgw=19.0.0-3830-g0051ea03-1jammy python3-rados=19.0.0-3830-g0051ea03-1jammy python3-rgw=19.0.0-3830-g0051ea03-1jammy python3-cephfs=19.0.0-3830-g0051ea03-1jammy python3-rbd=19.0.0-3830-g0051ea03-1jammy libcephfs2=19.0.0-3830-g0051ea03-1jammy libcephfs-dev=19.0.0-3830-g0051ea03-1jammy librados2=19.0.0-3830-g0051ea03-1jammy librbd1=19.0.0-3830-g0051ea03-1jammy rbd-fuse=19.0.0-3830-g0051ea03-1jammy python3-cephfs=19.0.0-3830-g0051ea03-1jammy cephfs-shell=19.0.0-3830-g0051ea03-1jammy cephfs-top=19.0.0-3830-g0051ea03-1jammy cephfs-mirror=19.0.0-3830-g0051ea03-1jammy 2024-05-21T01:16:00.642 INFO:teuthology.orchestra.run.smithi131.stdout:Reading package lists... 2024-05-21T01:16:00.838 INFO:teuthology.orchestra.run.smithi131.stdout:Building dependency tree... 2024-05-21T01:16:00.838 INFO:teuthology.orchestra.run.smithi131.stdout:Reading state information... 2024-05-21T01:16:00.983 INFO:teuthology.orchestra.run.smithi063.stdout:Reading package lists... 2024-05-21T01:16:00.999 DEBUG:teuthology.orchestra.run.smithi063:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3830-g0051ea03-1jammy cephadm=19.0.0-3830-g0051ea03-1jammy ceph-mds=19.0.0-3830-g0051ea03-1jammy ceph-mgr=19.0.0-3830-g0051ea03-1jammy ceph-common=19.0.0-3830-g0051ea03-1jammy ceph-fuse=19.0.0-3830-g0051ea03-1jammy ceph-test=19.0.0-3830-g0051ea03-1jammy ceph-volume=19.0.0-3830-g0051ea03-1jammy radosgw=19.0.0-3830-g0051ea03-1jammy python3-rados=19.0.0-3830-g0051ea03-1jammy python3-rgw=19.0.0-3830-g0051ea03-1jammy python3-cephfs=19.0.0-3830-g0051ea03-1jammy python3-rbd=19.0.0-3830-g0051ea03-1jammy libcephfs2=19.0.0-3830-g0051ea03-1jammy libcephfs-dev=19.0.0-3830-g0051ea03-1jammy librados2=19.0.0-3830-g0051ea03-1jammy librbd1=19.0.0-3830-g0051ea03-1jammy rbd-fuse=19.0.0-3830-g0051ea03-1jammy python3-cephfs=19.0.0-3830-g0051ea03-1jammy cephfs-shell=19.0.0-3830-g0051ea03-1jammy cephfs-top=19.0.0-3830-g0051ea03-1jammy cephfs-mirror=19.0.0-3830-g0051ea03-1jammy 2024-05-21T01:16:01.012 INFO:teuthology.orchestra.run.smithi131.stdout:The following packages were automatically installed and are no longer required: 2024-05-21T01:16:01.013 INFO:teuthology.orchestra.run.smithi131.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-21T01:16:01.013 INFO:teuthology.orchestra.run.smithi131.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-21T01:16:01.013 INFO:teuthology.orchestra.run.smithi131.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-21T01:16:01.013 INFO:teuthology.orchestra.run.smithi131.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-05-21T01:16:01.013 INFO:teuthology.orchestra.run.smithi131.stdout: python2.7-minimal 2024-05-21T01:16:01.014 INFO:teuthology.orchestra.run.smithi131.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-21T01:16:01.014 INFO:teuthology.orchestra.run.smithi131.stdout:The following additional packages will be installed: 2024-05-21T01:16:01.014 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-05-21T01:16:01.014 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-05-21T01:16:01.014 INFO:teuthology.orchestra.run.smithi131.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-05-21T01:16:01.015 INFO:teuthology.orchestra.run.smithi131.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-05-21T01:16:01.016 INFO:teuthology.orchestra.run.smithi131.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-05-21T01:16:01.016 INFO:teuthology.orchestra.run.smithi131.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-05-21T01:16:01.016 INFO:teuthology.orchestra.run.smithi131.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-05-21T01:16:01.016 INFO:teuthology.orchestra.run.smithi131.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-05-21T01:16:01.016 INFO:teuthology.orchestra.run.smithi131.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-05-21T01:16:01.016 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-05-21T01:16:01.016 INFO:teuthology.orchestra.run.smithi131.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-05-21T01:16:01.016 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-05-21T01:16:01.016 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-05-21T01:16:01.016 INFO:teuthology.orchestra.run.smithi131.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-05-21T01:16:01.017 INFO:teuthology.orchestra.run.smithi131.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-05-21T01:16:01.017 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-05-21T01:16:01.017 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-05-21T01:16:01.017 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-05-21T01:16:01.017 INFO:teuthology.orchestra.run.smithi131.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-05-21T01:16:01.017 INFO:teuthology.orchestra.run.smithi131.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-05-21T01:16:01.017 INFO:teuthology.orchestra.run.smithi131.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-05-21T01:16:01.017 INFO:teuthology.orchestra.run.smithi131.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-05-21T01:16:01.017 INFO:teuthology.orchestra.run.smithi131.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-05-21T01:16:01.017 INFO:teuthology.orchestra.run.smithi131.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-05-21T01:16:01.018 INFO:teuthology.orchestra.run.smithi131.stdout:Suggested packages: 2024-05-21T01:16:01.018 INFO:teuthology.orchestra.run.smithi131.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-05-21T01:16:01.018 INFO:teuthology.orchestra.run.smithi131.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-05-21T01:16:01.018 INFO:teuthology.orchestra.run.smithi131.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-05-21T01:16:01.018 INFO:teuthology.orchestra.run.smithi131.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-05-21T01:16:01.018 INFO:teuthology.orchestra.run.smithi131.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-05-21T01:16:01.018 INFO:teuthology.orchestra.run.smithi131.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-05-21T01:16:01.018 INFO:teuthology.orchestra.run.smithi131.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-05-21T01:16:01.018 INFO:teuthology.orchestra.run.smithi131.stdout:Recommended packages: 2024-05-21T01:16:01.018 INFO:teuthology.orchestra.run.smithi131.stdout: btrfs-tools 2024-05-21T01:16:01.075 INFO:teuthology.orchestra.run.smithi063.stdout:Reading package lists... 2024-05-21T01:16:01.120 INFO:teuthology.orchestra.run.smithi131.stdout:The following NEW packages will be installed: 2024-05-21T01:16:01.120 INFO:teuthology.orchestra.run.smithi131.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-05-21T01:16:01.120 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-05-21T01:16:01.120 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-05-21T01:16:01.121 INFO:teuthology.orchestra.run.smithi131.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-05-21T01:16:01.122 INFO:teuthology.orchestra.run.smithi131.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-05-21T01:16:01.123 INFO:teuthology.orchestra.run.smithi131.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-05-21T01:16:01.123 INFO:teuthology.orchestra.run.smithi131.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-05-21T01:16:01.123 INFO:teuthology.orchestra.run.smithi131.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-05-21T01:16:01.123 INFO:teuthology.orchestra.run.smithi131.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-05-21T01:16:01.123 INFO:teuthology.orchestra.run.smithi131.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-05-21T01:16:01.123 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-05-21T01:16:01.123 INFO:teuthology.orchestra.run.smithi131.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-05-21T01:16:01.123 INFO:teuthology.orchestra.run.smithi131.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-05-21T01:16:01.123 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-05-21T01:16:01.123 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-05-21T01:16:01.123 INFO:teuthology.orchestra.run.smithi131.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-05-21T01:16:01.123 INFO:teuthology.orchestra.run.smithi131.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-05-21T01:16:01.123 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-05-21T01:16:01.124 INFO:teuthology.orchestra.run.smithi131.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-05-21T01:16:01.124 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-05-21T01:16:01.124 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-05-21T01:16:01.124 INFO:teuthology.orchestra.run.smithi131.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-05-21T01:16:01.124 INFO:teuthology.orchestra.run.smithi131.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-05-21T01:16:01.124 INFO:teuthology.orchestra.run.smithi131.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-05-21T01:16:01.124 INFO:teuthology.orchestra.run.smithi131.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-05-21T01:16:01.124 INFO:teuthology.orchestra.run.smithi131.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-05-21T01:16:01.124 INFO:teuthology.orchestra.run.smithi131.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-05-21T01:16:01.124 INFO:teuthology.orchestra.run.smithi131.stdout: socat unzip xmlstarlet zip 2024-05-21T01:16:01.184 INFO:teuthology.orchestra.run.smithi131.stdout:0 upgraded, 124 newly installed, 0 to remove and 310 not upgraded. 2024-05-21T01:16:01.184 INFO:teuthology.orchestra.run.smithi131.stdout:Need to get 190 MB of archives. 2024-05-21T01:16:01.184 INFO:teuthology.orchestra.run.smithi131.stdout:After this operation, 864 MB of additional disk space will be used. 2024-05-21T01:16:01.184 INFO:teuthology.orchestra.run.smithi131.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-05-21T01:16:01.204 INFO:teuthology.orchestra.run.smithi131.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-05-21T01:16:01.216 INFO:teuthology.orchestra.run.smithi131.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-05-21T01:16:01.262 INFO:teuthology.orchestra.run.smithi063.stdout:Building dependency tree... 2024-05-21T01:16:01.262 INFO:teuthology.orchestra.run.smithi131.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-05-21T01:16:01.262 INFO:teuthology.orchestra.run.smithi131.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiesce-no-remote-ap/0051ea03417a66dbfd5a17ea02c9049bcda16863/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3830-g0051ea03-1jammy [3,558 kB] 2024-05-21T01:16:01.262 INFO:teuthology.orchestra.run.smithi063.stdout:Reading state information... 2024-05-21T01:16:01.286 INFO:teuthology.orchestra.run.smithi131.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-05-21T01:16:01.289 INFO:teuthology.orchestra.run.smithi131.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-05-21T01:16:01.302 INFO:teuthology.orchestra.run.smithi131.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-05-21T01:16:01.353 INFO:teuthology.orchestra.run.smithi131.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-05-21T01:16:01.357 INFO:teuthology.orchestra.run.smithi131.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-05-21T01:16:01.369 INFO:teuthology.orchestra.run.smithi131.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-05-21T01:16:01.373 INFO:teuthology.orchestra.run.smithi131.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-05-21T01:16:01.373 INFO:teuthology.orchestra.run.smithi131.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-05-21T01:16:01.382 INFO:teuthology.orchestra.run.smithi131.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-05-21T01:16:01.384 INFO:teuthology.orchestra.run.smithi131.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-05-21T01:16:01.386 INFO:teuthology.orchestra.run.smithi131.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-05-21T01:16:01.387 INFO:teuthology.orchestra.run.smithi131.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-05-21T01:16:01.388 INFO:teuthology.orchestra.run.smithi131.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-05-21T01:16:01.396 INFO:teuthology.orchestra.run.smithi131.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-05-21T01:16:01.398 INFO:teuthology.orchestra.run.smithi131.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-05-21T01:16:01.399 INFO:teuthology.orchestra.run.smithi131.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-05-21T01:16:01.415 INFO:teuthology.orchestra.run.smithi131.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-05-21T01:16:01.415 INFO:teuthology.orchestra.run.smithi131.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-05-21T01:16:01.417 INFO:teuthology.orchestra.run.smithi131.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-05-21T01:16:01.417 INFO:teuthology.orchestra.run.smithi131.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-05-21T01:16:01.417 INFO:teuthology.orchestra.run.smithi131.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-05-21T01:16:01.418 INFO:teuthology.orchestra.run.smithi131.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-05-21T01:16:01.418 INFO:teuthology.orchestra.run.smithi131.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-05-21T01:16:01.435 INFO:teuthology.orchestra.run.smithi131.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-05-21T01:16:01.435 INFO:teuthology.orchestra.run.smithi131.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-05-21T01:16:01.438 INFO:teuthology.orchestra.run.smithi131.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-05-21T01:16:01.451 INFO:teuthology.orchestra.run.smithi063.stdout:The following packages were automatically installed and are no longer required: 2024-05-21T01:16:01.451 INFO:teuthology.orchestra.run.smithi063.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-21T01:16:01.451 INFO:teuthology.orchestra.run.smithi063.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-21T01:16:01.451 INFO:teuthology.orchestra.run.smithi063.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-21T01:16:01.451 INFO:teuthology.orchestra.run.smithi063.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-21T01:16:01.452 INFO:teuthology.orchestra.run.smithi063.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-21T01:16:01.452 INFO:teuthology.orchestra.run.smithi063.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-21T01:16:01.452 INFO:teuthology.orchestra.run.smithi063.stdout:The following additional packages will be installed: 2024-05-21T01:16:01.452 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-05-21T01:16:01.454 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-05-21T01:16:01.454 INFO:teuthology.orchestra.run.smithi063.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-05-21T01:16:01.454 INFO:teuthology.orchestra.run.smithi063.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-05-21T01:16:01.454 INFO:teuthology.orchestra.run.smithi063.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-05-21T01:16:01.455 INFO:teuthology.orchestra.run.smithi063.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-05-21T01:16:01.455 INFO:teuthology.orchestra.run.smithi063.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-05-21T01:16:01.455 INFO:teuthology.orchestra.run.smithi063.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-05-21T01:16:01.455 INFO:teuthology.orchestra.run.smithi063.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-05-21T01:16:01.455 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-05-21T01:16:01.455 INFO:teuthology.orchestra.run.smithi063.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-05-21T01:16:01.455 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-05-21T01:16:01.455 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-05-21T01:16:01.455 INFO:teuthology.orchestra.run.smithi063.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-05-21T01:16:01.455 INFO:teuthology.orchestra.run.smithi063.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-05-21T01:16:01.455 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-05-21T01:16:01.455 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-05-21T01:16:01.455 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-05-21T01:16:01.456 INFO:teuthology.orchestra.run.smithi063.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-05-21T01:16:01.456 INFO:teuthology.orchestra.run.smithi063.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-05-21T01:16:01.456 INFO:teuthology.orchestra.run.smithi063.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-05-21T01:16:01.456 INFO:teuthology.orchestra.run.smithi063.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-05-21T01:16:01.456 INFO:teuthology.orchestra.run.smithi063.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-05-21T01:16:01.456 INFO:teuthology.orchestra.run.smithi063.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-05-21T01:16:01.457 INFO:teuthology.orchestra.run.smithi063.stdout:Suggested packages: 2024-05-21T01:16:01.457 INFO:teuthology.orchestra.run.smithi063.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-05-21T01:16:01.457 INFO:teuthology.orchestra.run.smithi063.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-05-21T01:16:01.457 INFO:teuthology.orchestra.run.smithi063.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-05-21T01:16:01.457 INFO:teuthology.orchestra.run.smithi063.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-05-21T01:16:01.457 INFO:teuthology.orchestra.run.smithi063.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-05-21T01:16:01.457 INFO:teuthology.orchestra.run.smithi063.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-05-21T01:16:01.457 INFO:teuthology.orchestra.run.smithi063.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-05-21T01:16:01.457 INFO:teuthology.orchestra.run.smithi063.stdout:Recommended packages: 2024-05-21T01:16:01.457 INFO:teuthology.orchestra.run.smithi063.stdout: btrfs-tools 2024-05-21T01:16:01.458 INFO:teuthology.orchestra.run.smithi131.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-05-21T01:16:01.458 INFO:teuthology.orchestra.run.smithi131.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-05-21T01:16:01.458 INFO:teuthology.orchestra.run.smithi131.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-05-21T01:16:01.458 INFO:teuthology.orchestra.run.smithi131.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-05-21T01:16:01.458 INFO:teuthology.orchestra.run.smithi131.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-05-21T01:16:01.458 INFO:teuthology.orchestra.run.smithi131.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-05-21T01:16:01.459 INFO:teuthology.orchestra.run.smithi131.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-05-21T01:16:01.470 INFO:teuthology.orchestra.run.smithi131.stdout:Get:39 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiesce-no-remote-ap/0051ea03417a66dbfd5a17ea02c9049bcda16863/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3830-g0051ea03-1jammy [3,225 kB] 2024-05-21T01:16:01.473 INFO:teuthology.orchestra.run.smithi131.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-05-21T01:16:01.474 INFO:teuthology.orchestra.run.smithi131.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-05-21T01:16:01.479 INFO:teuthology.orchestra.run.smithi131.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-05-21T01:16:01.493 INFO:teuthology.orchestra.run.smithi131.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-05-21T01:16:01.494 INFO:teuthology.orchestra.run.smithi131.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-05-21T01:16:01.494 INFO:teuthology.orchestra.run.smithi131.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-05-21T01:16:01.495 INFO:teuthology.orchestra.run.smithi131.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-05-21T01:16:01.497 INFO:teuthology.orchestra.run.smithi131.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-05-21T01:16:01.498 INFO:teuthology.orchestra.run.smithi131.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-05-21T01:16:01.499 INFO:teuthology.orchestra.run.smithi131.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-05-21T01:16:01.512 INFO:teuthology.orchestra.run.smithi131.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-05-21T01:16:01.515 INFO:teuthology.orchestra.run.smithi131.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-05-21T01:16:01.515 INFO:teuthology.orchestra.run.smithi131.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-05-21T01:16:01.532 INFO:teuthology.orchestra.run.smithi131.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-05-21T01:16:01.534 INFO:teuthology.orchestra.run.smithi131.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-05-21T01:16:01.568 INFO:teuthology.orchestra.run.smithi131.stdout:Get:55 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiesce-no-remote-ap/0051ea03417a66dbfd5a17ea02c9049bcda16863/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3830-g0051ea03-1jammy [713 kB] 2024-05-21T01:16:01.586 INFO:teuthology.orchestra.run.smithi131.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-05-21T01:16:01.587 INFO:teuthology.orchestra.run.smithi131.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-05-21T01:16:01.589 INFO:teuthology.orchestra.run.smithi131.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-05-21T01:16:01.589 INFO:teuthology.orchestra.run.smithi131.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-05-21T01:16:01.590 INFO:teuthology.orchestra.run.smithi131.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-05-21T01:16:01.590 INFO:teuthology.orchestra.run.smithi131.stdout:Get:61 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiesce-no-remote-ap/0051ea03417a66dbfd5a17ea02c9049bcda16863/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3830-g0051ea03-1jammy [356 kB] 2024-05-21T01:16:01.602 INFO:teuthology.orchestra.run.smithi131.stdout:Get:62 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiesce-no-remote-ap/0051ea03417a66dbfd5a17ea02c9049bcda16863/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3830-g0051ea03-1jammy [32.8 kB] 2024-05-21T01:16:01.603 INFO:teuthology.orchestra.run.smithi131.stdout:Get:63 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiesce-no-remote-ap/0051ea03417a66dbfd5a17ea02c9049bcda16863/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3830-g0051ea03-1jammy [180 kB] 2024-05-21T01:16:01.607 INFO:teuthology.orchestra.run.smithi131.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-05-21T01:16:01.609 INFO:teuthology.orchestra.run.smithi131.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-05-21T01:16:01.609 INFO:teuthology.orchestra.run.smithi131.stdout:Get:66 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiesce-no-remote-ap/0051ea03417a66dbfd5a17ea02c9049bcda16863/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3830-g0051ea03-1jammy [67.5 kB] 2024-05-21T01:16:01.610 INFO:teuthology.orchestra.run.smithi131.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-05-21T01:16:01.611 INFO:teuthology.orchestra.run.smithi131.stdout:Get:68 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiesce-no-remote-ap/0051ea03417a66dbfd5a17ea02c9049bcda16863/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3830-g0051ea03-1jammy [334 kB] 2024-05-21T01:16:01.612 INFO:teuthology.orchestra.run.smithi063.stdout:The following NEW packages will be installed: 2024-05-21T01:16:01.612 INFO:teuthology.orchestra.run.smithi063.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-05-21T01:16:01.612 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-05-21T01:16:01.613 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-05-21T01:16:01.614 INFO:teuthology.orchestra.run.smithi063.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-05-21T01:16:01.614 INFO:teuthology.orchestra.run.smithi063.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-05-21T01:16:01.614 INFO:teuthology.orchestra.run.smithi063.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-05-21T01:16:01.615 INFO:teuthology.orchestra.run.smithi063.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-05-21T01:16:01.615 INFO:teuthology.orchestra.run.smithi063.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-05-21T01:16:01.615 INFO:teuthology.orchestra.run.smithi063.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-05-21T01:16:01.615 INFO:teuthology.orchestra.run.smithi063.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-05-21T01:16:01.615 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-05-21T01:16:01.615 INFO:teuthology.orchestra.run.smithi063.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-05-21T01:16:01.615 INFO:teuthology.orchestra.run.smithi063.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-05-21T01:16:01.615 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-05-21T01:16:01.615 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-05-21T01:16:01.615 INFO:teuthology.orchestra.run.smithi063.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-05-21T01:16:01.615 INFO:teuthology.orchestra.run.smithi063.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-05-21T01:16:01.615 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-05-21T01:16:01.615 INFO:teuthology.orchestra.run.smithi063.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-05-21T01:16:01.616 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-05-21T01:16:01.616 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-05-21T01:16:01.616 INFO:teuthology.orchestra.run.smithi063.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-05-21T01:16:01.616 INFO:teuthology.orchestra.run.smithi063.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-05-21T01:16:01.616 INFO:teuthology.orchestra.run.smithi063.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-05-21T01:16:01.616 INFO:teuthology.orchestra.run.smithi063.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-05-21T01:16:01.616 INFO:teuthology.orchestra.run.smithi063.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-05-21T01:16:01.616 INFO:teuthology.orchestra.run.smithi063.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-05-21T01:16:01.616 INFO:teuthology.orchestra.run.smithi063.stdout: socat unzip xmlstarlet zip 2024-05-21T01:16:01.623 INFO:teuthology.orchestra.run.smithi131.stdout:Get:69 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiesce-no-remote-ap/0051ea03417a66dbfd5a17ea02c9049bcda16863/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3830-g0051ea03-1jammy [7,881 kB] 2024-05-21T01:16:01.624 INFO:teuthology.orchestra.run.smithi131.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-05-21T01:16:01.625 INFO:teuthology.orchestra.run.smithi131.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-05-21T01:16:01.627 INFO:teuthology.orchestra.run.smithi131.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-05-21T01:16:01.628 INFO:teuthology.orchestra.run.smithi131.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-05-21T01:16:01.628 INFO:teuthology.orchestra.run.smithi131.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-05-21T01:16:01.629 INFO:teuthology.orchestra.run.smithi131.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-05-21T01:16:01.647 INFO:teuthology.orchestra.run.smithi131.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-05-21T01:16:01.647 INFO:teuthology.orchestra.run.smithi131.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-05-21T01:16:01.651 INFO:teuthology.orchestra.run.smithi131.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-05-21T01:16:01.652 INFO:teuthology.orchestra.run.smithi131.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-05-21T01:16:01.654 INFO:teuthology.orchestra.run.smithi131.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-05-21T01:16:01.654 INFO:teuthology.orchestra.run.smithi131.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-05-21T01:16:01.666 INFO:teuthology.orchestra.run.smithi131.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-05-21T01:16:01.669 INFO:teuthology.orchestra.run.smithi131.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-05-21T01:16:01.669 INFO:teuthology.orchestra.run.smithi131.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-05-21T01:16:01.670 INFO:teuthology.orchestra.run.smithi131.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-05-21T01:16:01.686 INFO:teuthology.orchestra.run.smithi131.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-05-21T01:16:01.690 INFO:teuthology.orchestra.run.smithi131.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-05-21T01:16:01.690 INFO:teuthology.orchestra.run.smithi131.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-05-21T01:16:01.693 INFO:teuthology.orchestra.run.smithi131.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-05-21T01:16:01.693 INFO:teuthology.orchestra.run.smithi131.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-05-21T01:16:01.694 INFO:teuthology.orchestra.run.smithi131.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-05-21T01:16:01.694 INFO:teuthology.orchestra.run.smithi063.stdout:0 upgraded, 124 newly installed, 0 to remove and 310 not upgraded. 2024-05-21T01:16:01.694 INFO:teuthology.orchestra.run.smithi063.stdout:Need to get 190 MB of archives. 2024-05-21T01:16:01.694 INFO:teuthology.orchestra.run.smithi063.stdout:After this operation, 864 MB of additional disk space will be used. 2024-05-21T01:16:01.695 INFO:teuthology.orchestra.run.smithi063.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-05-21T01:16:01.705 INFO:teuthology.orchestra.run.smithi131.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-05-21T01:16:01.707 INFO:teuthology.orchestra.run.smithi131.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-05-21T01:16:01.707 INFO:teuthology.orchestra.run.smithi131.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-05-21T01:16:01.714 INFO:teuthology.orchestra.run.smithi131.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-05-21T01:16:01.716 INFO:teuthology.orchestra.run.smithi063.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-05-21T01:16:01.724 INFO:teuthology.orchestra.run.smithi131.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-05-21T01:16:01.725 INFO:teuthology.orchestra.run.smithi131.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-05-21T01:16:01.727 INFO:teuthology.orchestra.run.smithi131.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-05-21T01:16:01.727 INFO:teuthology.orchestra.run.smithi131.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-05-21T01:16:01.735 INFO:teuthology.orchestra.run.smithi063.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-05-21T01:16:01.788 INFO:teuthology.orchestra.run.smithi063.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-05-21T01:16:01.815 INFO:teuthology.orchestra.run.smithi063.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-05-21T01:16:01.819 INFO:teuthology.orchestra.run.smithi063.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-05-21T01:16:01.833 INFO:teuthology.orchestra.run.smithi063.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-05-21T01:16:01.877 INFO:teuthology.orchestra.run.smithi063.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-05-21T01:16:01.879 INFO:teuthology.orchestra.run.smithi063.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-05-21T01:16:01.883 INFO:teuthology.orchestra.run.smithi131.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiesce-no-remote-ap/0051ea03417a66dbfd5a17ea02c9049bcda16863/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3830-g0051ea03-1jammy [112 kB] 2024-05-21T01:16:01.886 INFO:teuthology.orchestra.run.smithi131.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiesce-no-remote-ap/0051ea03417a66dbfd5a17ea02c9049bcda16863/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3830-g0051ea03-1jammy [467 kB] 2024-05-21T01:16:01.886 INFO:teuthology.orchestra.run.smithi063.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-05-21T01:16:01.889 INFO:teuthology.orchestra.run.smithi063.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-05-21T01:16:01.890 INFO:teuthology.orchestra.run.smithi063.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-05-21T01:16:01.896 INFO:teuthology.orchestra.run.smithi063.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-05-21T01:16:01.898 INFO:teuthology.orchestra.run.smithi063.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-05-21T01:16:01.899 INFO:teuthology.orchestra.run.smithi063.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-05-21T01:16:01.900 INFO:teuthology.orchestra.run.smithi131.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiesce-no-remote-ap/0051ea03417a66dbfd5a17ea02c9049bcda16863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3830-g0051ea03-1jammy [27.8 MB] 2024-05-21T01:16:01.901 INFO:teuthology.orchestra.run.smithi063.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-05-21T01:16:01.901 INFO:teuthology.orchestra.run.smithi063.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-05-21T01:16:01.918 INFO:teuthology.orchestra.run.smithi063.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-05-21T01:16:01.920 INFO:teuthology.orchestra.run.smithi063.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-05-21T01:16:01.922 INFO:teuthology.orchestra.run.smithi063.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-05-21T01:16:01.922 INFO:teuthology.orchestra.run.smithi063.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-05-21T01:16:01.923 INFO:teuthology.orchestra.run.smithi063.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-05-21T01:16:01.938 INFO:teuthology.orchestra.run.smithi063.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-05-21T01:16:01.938 INFO:teuthology.orchestra.run.smithi063.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-05-21T01:16:01.938 INFO:teuthology.orchestra.run.smithi063.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-05-21T01:16:01.939 INFO:teuthology.orchestra.run.smithi063.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-05-21T01:16:01.939 INFO:teuthology.orchestra.run.smithi063.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-05-21T01:16:01.958 INFO:teuthology.orchestra.run.smithi063.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-05-21T01:16:01.958 INFO:teuthology.orchestra.run.smithi063.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-05-21T01:16:01.960 INFO:teuthology.orchestra.run.smithi063.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-05-21T01:16:01.961 INFO:teuthology.orchestra.run.smithi063.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-05-21T01:16:01.961 INFO:teuthology.orchestra.run.smithi063.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-05-21T01:16:01.977 INFO:teuthology.orchestra.run.smithi063.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-05-21T01:16:01.978 INFO:teuthology.orchestra.run.smithi063.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-05-21T01:16:01.978 INFO:teuthology.orchestra.run.smithi063.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-05-21T01:16:01.979 INFO:teuthology.orchestra.run.smithi063.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-05-21T01:16:01.980 INFO:teuthology.orchestra.run.smithi063.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-05-21T01:16:01.997 INFO:teuthology.orchestra.run.smithi063.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-05-21T01:16:01.997 INFO:teuthology.orchestra.run.smithi063.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-05-21T01:16:02.002 INFO:teuthology.orchestra.run.smithi063.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-05-21T01:16:02.002 INFO:teuthology.orchestra.run.smithi063.stdout:Get:41 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiesce-no-remote-ap/0051ea03417a66dbfd5a17ea02c9049bcda16863/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3830-g0051ea03-1jammy [3,558 kB] 2024-05-21T01:16:02.002 INFO:teuthology.orchestra.run.smithi063.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-05-21T01:16:02.003 INFO:teuthology.orchestra.run.smithi063.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-05-21T01:16:02.016 INFO:teuthology.orchestra.run.smithi063.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-05-21T01:16:02.018 INFO:teuthology.orchestra.run.smithi063.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-05-21T01:16:02.019 INFO:teuthology.orchestra.run.smithi063.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-05-21T01:16:02.020 INFO:teuthology.orchestra.run.smithi063.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-05-21T01:16:02.021 INFO:teuthology.orchestra.run.smithi063.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-05-21T01:16:02.036 INFO:teuthology.orchestra.run.smithi063.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-05-21T01:16:02.038 INFO:teuthology.orchestra.run.smithi063.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-05-21T01:16:02.038 INFO:teuthology.orchestra.run.smithi063.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-05-21T01:16:02.039 INFO:teuthology.orchestra.run.smithi063.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-05-21T01:16:02.041 INFO:teuthology.orchestra.run.smithi063.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-05-21T01:16:02.087 INFO:teuthology.orchestra.run.smithi063.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-05-21T01:16:02.088 INFO:teuthology.orchestra.run.smithi063.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-05-21T01:16:02.089 INFO:teuthology.orchestra.run.smithi063.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-05-21T01:16:02.090 INFO:teuthology.orchestra.run.smithi063.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-05-21T01:16:02.091 INFO:teuthology.orchestra.run.smithi063.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-05-21T01:16:02.110 INFO:teuthology.orchestra.run.smithi063.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-05-21T01:16:02.112 INFO:teuthology.orchestra.run.smithi063.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-05-21T01:16:02.112 INFO:teuthology.orchestra.run.smithi063.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-05-21T01:16:02.129 INFO:teuthology.orchestra.run.smithi063.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-05-21T01:16:02.130 INFO:teuthology.orchestra.run.smithi063.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-05-21T01:16:02.130 INFO:teuthology.orchestra.run.smithi063.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-05-21T01:16:02.131 INFO:teuthology.orchestra.run.smithi063.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-05-21T01:16:02.131 INFO:teuthology.orchestra.run.smithi063.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-05-21T01:16:02.132 INFO:teuthology.orchestra.run.smithi063.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-05-21T01:16:02.147 INFO:teuthology.orchestra.run.smithi063.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-05-21T01:16:02.148 INFO:teuthology.orchestra.run.smithi063.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-05-21T01:16:02.151 INFO:teuthology.orchestra.run.smithi063.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-05-21T01:16:02.166 INFO:teuthology.orchestra.run.smithi063.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-05-21T01:16:02.170 INFO:teuthology.orchestra.run.smithi063.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-05-21T01:16:02.170 INFO:teuthology.orchestra.run.smithi063.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-05-21T01:16:02.173 INFO:teuthology.orchestra.run.smithi063.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-05-21T01:16:02.176 INFO:teuthology.orchestra.run.smithi063.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-05-21T01:16:02.176 INFO:teuthology.orchestra.run.smithi063.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-05-21T01:16:02.177 INFO:teuthology.orchestra.run.smithi063.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-05-21T01:16:02.186 INFO:teuthology.orchestra.run.smithi063.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-05-21T01:16:02.191 INFO:teuthology.orchestra.run.smithi063.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-05-21T01:16:02.191 INFO:teuthology.orchestra.run.smithi063.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-05-21T01:16:02.206 INFO:teuthology.orchestra.run.smithi063.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-05-21T01:16:02.206 INFO:teuthology.orchestra.run.smithi063.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-05-21T01:16:02.207 INFO:teuthology.orchestra.run.smithi063.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-05-21T01:16:02.207 INFO:teuthology.orchestra.run.smithi063.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-05-21T01:16:02.209 INFO:teuthology.orchestra.run.smithi063.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-05-21T01:16:02.210 INFO:teuthology.orchestra.run.smithi063.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-05-21T01:16:02.217 INFO:teuthology.orchestra.run.smithi063.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-05-21T01:16:02.225 INFO:teuthology.orchestra.run.smithi063.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-05-21T01:16:02.226 INFO:teuthology.orchestra.run.smithi063.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-05-21T01:16:02.228 INFO:teuthology.orchestra.run.smithi063.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-05-21T01:16:02.245 INFO:teuthology.orchestra.run.smithi063.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-05-21T01:16:03.002 INFO:teuthology.orchestra.run.smithi131.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiesce-no-remote-ap/0051ea03417a66dbfd5a17ea02c9049bcda16863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3830-g0051ea03-1jammy [5,093 kB] 2024-05-21T01:16:03.082 INFO:teuthology.orchestra.run.smithi131.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiesce-no-remote-ap/0051ea03417a66dbfd5a17ea02c9049bcda16863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3830-g0051ea03-1jammy [245 kB] 2024-05-21T01:16:03.084 INFO:teuthology.orchestra.run.smithi131.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiesce-no-remote-ap/0051ea03417a66dbfd5a17ea02c9049bcda16863/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3830-g0051ea03-1jammy [124 kB] 2024-05-21T01:16:03.086 INFO:teuthology.orchestra.run.smithi131.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiesce-no-remote-ap/0051ea03417a66dbfd5a17ea02c9049bcda16863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3830-g0051ea03-1jammy [1,545 kB] 2024-05-21T01:16:03.137 INFO:teuthology.orchestra.run.smithi131.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiesce-no-remote-ap/0051ea03417a66dbfd5a17ea02c9049bcda16863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3830-g0051ea03-1jammy [6,260 kB] 2024-05-21T01:16:03.369 INFO:teuthology.orchestra.run.smithi131.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiesce-no-remote-ap/0051ea03417a66dbfd5a17ea02c9049bcda16863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3830-g0051ea03-1jammy [22.8 MB] 2024-05-21T01:16:03.421 INFO:teuthology.orchestra.run.smithi063.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiesce-no-remote-ap/0051ea03417a66dbfd5a17ea02c9049bcda16863/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3830-g0051ea03-1jammy [3,225 kB] 2024-05-21T01:16:04.100 INFO:teuthology.orchestra.run.smithi063.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiesce-no-remote-ap/0051ea03417a66dbfd5a17ea02c9049bcda16863/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3830-g0051ea03-1jammy [713 kB] 2024-05-21T01:16:04.206 INFO:teuthology.orchestra.run.smithi063.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiesce-no-remote-ap/0051ea03417a66dbfd5a17ea02c9049bcda16863/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3830-g0051ea03-1jammy [356 kB] 2024-05-21T01:16:04.267 INFO:teuthology.orchestra.run.smithi063.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiesce-no-remote-ap/0051ea03417a66dbfd5a17ea02c9049bcda16863/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3830-g0051ea03-1jammy [32.8 kB] 2024-05-21T01:16:04.269 INFO:teuthology.orchestra.run.smithi063.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiesce-no-remote-ap/0051ea03417a66dbfd5a17ea02c9049bcda16863/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3830-g0051ea03-1jammy [180 kB] 2024-05-21T01:16:04.300 INFO:teuthology.orchestra.run.smithi063.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiesce-no-remote-ap/0051ea03417a66dbfd5a17ea02c9049bcda16863/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3830-g0051ea03-1jammy [67.5 kB] 2024-05-21T01:16:04.316 INFO:teuthology.orchestra.run.smithi063.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiesce-no-remote-ap/0051ea03417a66dbfd5a17ea02c9049bcda16863/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3830-g0051ea03-1jammy [334 kB] 2024-05-21T01:16:04.348 INFO:teuthology.orchestra.run.smithi063.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiesce-no-remote-ap/0051ea03417a66dbfd5a17ea02c9049bcda16863/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3830-g0051ea03-1jammy [7,881 kB] 2024-05-21T01:16:04.351 INFO:teuthology.orchestra.run.smithi131.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiesce-no-remote-ap/0051ea03417a66dbfd5a17ea02c9049bcda16863/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3830-g0051ea03-1jammy [14.0 kB] 2024-05-21T01:16:04.351 INFO:teuthology.orchestra.run.smithi131.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiesce-no-remote-ap/0051ea03417a66dbfd5a17ea02c9049bcda16863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3830-g0051ea03-1jammy [870 kB] 2024-05-21T01:16:04.369 INFO:teuthology.orchestra.run.smithi131.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiesce-no-remote-ap/0051ea03417a66dbfd5a17ea02c9049bcda16863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3830-g0051ea03-1jammy [2,445 kB] 2024-05-21T01:16:04.410 INFO:teuthology.orchestra.run.smithi131.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiesce-no-remote-ap/0051ea03417a66dbfd5a17ea02c9049bcda16863/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3830-g0051ea03-1jammy [792 kB] 2024-05-21T01:16:04.431 INFO:teuthology.orchestra.run.smithi131.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiesce-no-remote-ap/0051ea03417a66dbfd5a17ea02c9049bcda16863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3830-g0051ea03-1jammy [149 kB] 2024-05-21T01:16:04.435 INFO:teuthology.orchestra.run.smithi131.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiesce-no-remote-ap/0051ea03417a66dbfd5a17ea02c9049bcda16863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3830-g0051ea03-1jammy [2,222 kB] 2024-05-21T01:16:04.528 INFO:teuthology.orchestra.run.smithi131.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiesce-no-remote-ap/0051ea03417a66dbfd5a17ea02c9049bcda16863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3830-g0051ea03-1jammy [8,625 kB] 2024-05-21T01:16:04.932 INFO:teuthology.orchestra.run.smithi131.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiesce-no-remote-ap/0051ea03417a66dbfd5a17ea02c9049bcda16863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3830-g0051ea03-1jammy [14.2 kB] 2024-05-21T01:16:04.932 INFO:teuthology.orchestra.run.smithi131.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiesce-no-remote-ap/0051ea03417a66dbfd5a17ea02c9049bcda16863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3830-g0051ea03-1jammy [54.7 MB] 2024-05-21T01:16:05.359 INFO:teuthology.orchestra.run.smithi063.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiesce-no-remote-ap/0051ea03417a66dbfd5a17ea02c9049bcda16863/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3830-g0051ea03-1jammy [112 kB] 2024-05-21T01:16:05.361 INFO:teuthology.orchestra.run.smithi063.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiesce-no-remote-ap/0051ea03417a66dbfd5a17ea02c9049bcda16863/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3830-g0051ea03-1jammy [467 kB] 2024-05-21T01:16:05.428 INFO:teuthology.orchestra.run.smithi063.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiesce-no-remote-ap/0051ea03417a66dbfd5a17ea02c9049bcda16863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3830-g0051ea03-1jammy [27.8 MB] 2024-05-21T01:16:07.531 INFO:teuthology.orchestra.run.smithi063.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiesce-no-remote-ap/0051ea03417a66dbfd5a17ea02c9049bcda16863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3830-g0051ea03-1jammy [5,093 kB] 2024-05-21T01:16:07.886 INFO:teuthology.orchestra.run.smithi063.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiesce-no-remote-ap/0051ea03417a66dbfd5a17ea02c9049bcda16863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3830-g0051ea03-1jammy [245 kB] 2024-05-21T01:16:07.904 INFO:teuthology.orchestra.run.smithi063.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiesce-no-remote-ap/0051ea03417a66dbfd5a17ea02c9049bcda16863/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3830-g0051ea03-1jammy [124 kB] 2024-05-21T01:16:07.912 INFO:teuthology.orchestra.run.smithi063.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiesce-no-remote-ap/0051ea03417a66dbfd5a17ea02c9049bcda16863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3830-g0051ea03-1jammy [1,545 kB] 2024-05-21T01:16:08.028 INFO:teuthology.orchestra.run.smithi063.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiesce-no-remote-ap/0051ea03417a66dbfd5a17ea02c9049bcda16863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3830-g0051ea03-1jammy [6,260 kB] 2024-05-21T01:16:08.278 INFO:teuthology.orchestra.run.smithi131.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiesce-no-remote-ap/0051ea03417a66dbfd5a17ea02c9049bcda16863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3830-g0051ea03-1jammy [124 kB] 2024-05-21T01:16:08.281 INFO:teuthology.orchestra.run.smithi131.stdout:Get:119 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiesce-no-remote-ap/0051ea03417a66dbfd5a17ea02c9049bcda16863/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-3830-g0051ea03-1jammy [232 kB] 2024-05-21T01:16:08.286 INFO:teuthology.orchestra.run.smithi131.stdout:Get:120 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiesce-no-remote-ap/0051ea03417a66dbfd5a17ea02c9049bcda16863/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-3830-g0051ea03-1jammy [33.9 kB] 2024-05-21T01:16:08.287 INFO:teuthology.orchestra.run.smithi131.stdout:Get:121 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiesce-no-remote-ap/0051ea03417a66dbfd5a17ea02c9049bcda16863/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-3830-g0051ea03-1jammy [23.4 kB] 2024-05-21T01:16:08.288 INFO:teuthology.orchestra.run.smithi131.stdout:Get:122 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiesce-no-remote-ap/0051ea03417a66dbfd5a17ea02c9049bcda16863/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3830-g0051ea03-1jammy [38.9 kB] 2024-05-21T01:16:08.289 INFO:teuthology.orchestra.run.smithi131.stdout:Get:123 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiesce-no-remote-ap/0051ea03417a66dbfd5a17ea02c9049bcda16863/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3830-g0051ea03-1jammy [15.7 MB] 2024-05-21T01:16:08.372 INFO:teuthology.orchestra.run.smithi063.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiesce-no-remote-ap/0051ea03417a66dbfd5a17ea02c9049bcda16863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3830-g0051ea03-1jammy [22.8 MB] 2024-05-21T01:16:09.104 INFO:teuthology.orchestra.run.smithi131.stdout:Get:124 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiesce-no-remote-ap/0051ea03417a66dbfd5a17ea02c9049bcda16863/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3830-g0051ea03-1jammy [91.4 kB] 2024-05-21T01:16:09.502 INFO:teuthology.orchestra.run.smithi063.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiesce-no-remote-ap/0051ea03417a66dbfd5a17ea02c9049bcda16863/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3830-g0051ea03-1jammy [14.0 kB] 2024-05-21T01:16:09.502 INFO:teuthology.orchestra.run.smithi063.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiesce-no-remote-ap/0051ea03417a66dbfd5a17ea02c9049bcda16863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3830-g0051ea03-1jammy [870 kB] 2024-05-21T01:16:09.522 INFO:teuthology.orchestra.run.smithi063.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiesce-no-remote-ap/0051ea03417a66dbfd5a17ea02c9049bcda16863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3830-g0051ea03-1jammy [2,445 kB] 2024-05-21T01:16:09.603 INFO:teuthology.orchestra.run.smithi063.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiesce-no-remote-ap/0051ea03417a66dbfd5a17ea02c9049bcda16863/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3830-g0051ea03-1jammy [792 kB] 2024-05-21T01:16:09.632 INFO:teuthology.orchestra.run.smithi063.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiesce-no-remote-ap/0051ea03417a66dbfd5a17ea02c9049bcda16863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3830-g0051ea03-1jammy [149 kB] 2024-05-21T01:16:09.633 INFO:teuthology.orchestra.run.smithi063.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiesce-no-remote-ap/0051ea03417a66dbfd5a17ea02c9049bcda16863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3830-g0051ea03-1jammy [2,222 kB] 2024-05-21T01:16:09.707 INFO:teuthology.orchestra.run.smithi063.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiesce-no-remote-ap/0051ea03417a66dbfd5a17ea02c9049bcda16863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3830-g0051ea03-1jammy [8,625 kB] 2024-05-21T01:16:09.728 INFO:teuthology.orchestra.run.smithi131.stdout:Fetched 190 MB in 8s (23.8 MB/s) 2024-05-21T01:16:09.991 INFO:teuthology.orchestra.run.smithi063.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiesce-no-remote-ap/0051ea03417a66dbfd5a17ea02c9049bcda16863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3830-g0051ea03-1jammy [14.2 kB] 2024-05-21T01:16:09.991 INFO:teuthology.orchestra.run.smithi063.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiesce-no-remote-ap/0051ea03417a66dbfd5a17ea02c9049bcda16863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3830-g0051ea03-1jammy [54.7 MB] 2024-05-21T01:16:10.201 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-pyperclip. 2024-05-21T01:16:10.288 INFO:teuthology.orchestra.run.smithi131.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 130504 files and directories currently installed.) 2024-05-21T01:16:10.292 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-05-21T01:16:10.341 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-05-21T01:16:10.711 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-wcwidth. 2024-05-21T01:16:10.731 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-05-21T01:16:10.769 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-21T01:16:11.089 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-cmd2. 2024-05-21T01:16:11.109 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-05-21T01:16:11.147 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-05-21T01:16:11.500 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-05-21T01:16:11.521 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-05-21T01:16:11.634 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-21T01:16:11.834 INFO:teuthology.orchestra.run.smithi063.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiesce-no-remote-ap/0051ea03417a66dbfd5a17ea02c9049bcda16863/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3830-g0051ea03-1jammy [124 kB] 2024-05-21T01:16:11.835 INFO:teuthology.orchestra.run.smithi063.stdout:Get:119 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiesce-no-remote-ap/0051ea03417a66dbfd5a17ea02c9049bcda16863/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-3830-g0051ea03-1jammy [232 kB] 2024-05-21T01:16:11.837 INFO:teuthology.orchestra.run.smithi063.stdout:Get:120 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiesce-no-remote-ap/0051ea03417a66dbfd5a17ea02c9049bcda16863/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-3830-g0051ea03-1jammy [33.9 kB] 2024-05-21T01:16:11.837 INFO:teuthology.orchestra.run.smithi063.stdout:Get:121 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiesce-no-remote-ap/0051ea03417a66dbfd5a17ea02c9049bcda16863/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-3830-g0051ea03-1jammy [23.4 kB] 2024-05-21T01:16:11.838 INFO:teuthology.orchestra.run.smithi063.stdout:Get:122 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiesce-no-remote-ap/0051ea03417a66dbfd5a17ea02c9049bcda16863/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3830-g0051ea03-1jammy [38.9 kB] 2024-05-21T01:16:11.838 INFO:teuthology.orchestra.run.smithi063.stdout:Get:123 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiesce-no-remote-ap/0051ea03417a66dbfd5a17ea02c9049bcda16863/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3830-g0051ea03-1jammy [15.7 MB] 2024-05-21T01:16:12.029 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-05-21T01:16:12.050 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-05-21T01:16:12.087 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-21T01:16:12.351 INFO:teuthology.orchestra.run.smithi063.stdout:Get:124 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiesce-no-remote-ap/0051ea03417a66dbfd5a17ea02c9049bcda16863/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3830-g0051ea03-1jammy [91.4 kB] 2024-05-21T01:16:12.432 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-05-21T01:16:12.452 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-05-21T01:16:12.482 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-21T01:16:12.944 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-05-21T01:16:12.965 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-21T01:16:13.015 INFO:teuthology.orchestra.run.smithi063.stdout:Fetched 190 MB in 11s (17.7 MB/s) 2024-05-21T01:16:13.044 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-21T01:16:13.141 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-pyperclip. 2024-05-21T01:16:13.210 INFO:teuthology.orchestra.run.smithi063.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132922 files and directories currently installed.) 2024-05-21T01:16:13.214 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-05-21T01:16:13.249 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-05-21T01:16:13.489 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-05-21T01:16:13.501 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-wcwidth. 2024-05-21T01:16:13.510 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-21T01:16:13.515 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-05-21T01:16:13.572 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-21T01:16:13.576 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-21T01:16:13.854 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-cmd2. 2024-05-21T01:16:13.868 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-05-21T01:16:13.913 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-05-21T01:16:13.951 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-05-21T01:16:13.972 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-21T01:16:14.001 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-21T01:16:14.265 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-05-21T01:16:14.280 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-05-21T01:16:14.366 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-21T01:16:14.379 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-05-21T01:16:14.400 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-05-21T01:16:14.471 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-21T01:16:14.711 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-05-21T01:16:14.727 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-05-21T01:16:14.769 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-21T01:16:14.832 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package librados2. 2024-05-21T01:16:14.853 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../010-librados2_19.0.0-3830-g0051ea03-1jammy_amd64.deb ... 2024-05-21T01:16:14.916 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking librados2 (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:16:15.098 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-05-21T01:16:15.113 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-05-21T01:16:15.148 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-21T01:16:15.510 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package librbd1. 2024-05-21T01:16:15.523 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../011-librbd1_19.0.0-3830-g0051ea03-1jammy_amd64.deb ... 2024-05-21T01:16:15.552 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking librbd1 (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:16:15.601 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-05-21T01:16:15.616 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-21T01:16:15.668 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-21T01:16:16.014 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libcephfs2. 2024-05-21T01:16:16.035 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-3830-g0051ea03-1jammy_amd64.deb ... 2024-05-21T01:16:16.071 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-05-21T01:16:16.072 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libcephfs2 (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:16:16.086 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-21T01:16:16.129 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-21T01:16:16.400 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-rados. 2024-05-21T01:16:16.420 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../013-python3-rados_19.0.0-3830-g0051ea03-1jammy_amd64.deb ... 2024-05-21T01:16:16.441 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-05-21T01:16:16.456 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-21T01:16:16.491 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-21T01:16:16.491 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-rados (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:16:16.853 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-05-21T01:16:16.861 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-05-21T01:16:16.874 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-3830-g0051ea03-1jammy_all.deb ... 2024-05-21T01:16:16.876 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-05-21T01:16:16.911 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-ceph-argparse (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:16:16.919 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-21T01:16:17.164 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-cephfs. 2024-05-21T01:16:17.185 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-3830-g0051ea03-1jammy_amd64.deb ... 2024-05-21T01:16:17.222 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-cephfs (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:16:17.240 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package librados2. 2024-05-21T01:16:17.255 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../010-librados2_19.0.0-3830-g0051ea03-1jammy_amd64.deb ... 2024-05-21T01:16:17.290 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking librados2 (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:16:17.642 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-ceph-common. 2024-05-21T01:16:17.663 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-3830-g0051ea03-1jammy_all.deb ... 2024-05-21T01:16:17.700 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-ceph-common (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:16:17.918 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package librbd1. 2024-05-21T01:16:17.934 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../011-librbd1_19.0.0-3830-g0051ea03-1jammy_amd64.deb ... 2024-05-21T01:16:17.976 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking librbd1 (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:16:18.062 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-prettytable. 2024-05-21T01:16:18.083 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-05-21T01:16:18.120 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-05-21T01:16:18.398 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-rbd. 2024-05-21T01:16:18.410 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-3830-g0051ea03-1jammy_amd64.deb ... 2024-05-21T01:16:18.412 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libcephfs2. 2024-05-21T01:16:18.428 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-3830-g0051ea03-1jammy_amd64.deb ... 2024-05-21T01:16:18.466 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-rbd (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:16:18.470 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libcephfs2 (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:16:18.748 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-rados. 2024-05-21T01:16:18.763 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../013-python3-rados_19.0.0-3830-g0051ea03-1jammy_amd64.deb ... 2024-05-21T01:16:18.831 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-rados (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:16:18.843 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-05-21T01:16:18.864 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-05-21T01:16:18.901 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-21T01:16:19.101 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-05-21T01:16:19.116 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-3830-g0051ea03-1jammy_all.deb ... 2024-05-21T01:16:19.150 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-ceph-argparse (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:16:19.204 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-05-21T01:16:19.216 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-05-21T01:16:19.253 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-05-21T01:16:19.378 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-cephfs. 2024-05-21T01:16:19.393 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-3830-g0051ea03-1jammy_amd64.deb ... 2024-05-21T01:16:19.428 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-cephfs (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:16:19.590 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-05-21T01:16:19.611 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-05-21T01:16:19.690 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-05-21T01:16:19.730 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-ceph-common. 2024-05-21T01:16:19.746 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-3830-g0051ea03-1jammy_all.deb ... 2024-05-21T01:16:19.789 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-ceph-common (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:16:20.052 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package lua5.1. 2024-05-21T01:16:20.073 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-05-21T01:16:20.110 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-05-21T01:16:20.142 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-prettytable. 2024-05-21T01:16:20.157 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-05-21T01:16:20.200 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-05-21T01:16:20.453 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-rbd. 2024-05-21T01:16:20.468 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-3830-g0051ea03-1jammy_amd64.deb ... 2024-05-21T01:16:20.511 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-rbd (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:16:20.738 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package lua-any. 2024-05-21T01:16:20.751 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-05-21T01:16:20.808 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking lua-any (27ubuntu1) ... 2024-05-21T01:16:20.880 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-05-21T01:16:20.896 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-05-21T01:16:20.947 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-21T01:16:21.397 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package zip. 2024-05-21T01:16:21.398 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-05-21T01:16:21.398 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking zip (3.0-12build2) ... 2024-05-21T01:16:21.398 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-05-21T01:16:21.398 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-05-21T01:16:21.398 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-05-21T01:16:21.487 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package unzip. 2024-05-21T01:16:21.508 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-05-21T01:16:21.544 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-05-21T01:16:21.545 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-05-21T01:16:21.559 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-05-21T01:16:21.593 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-05-21T01:16:21.880 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package lua5.1. 2024-05-21T01:16:21.895 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-05-21T01:16:21.938 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-05-21T01:16:21.982 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package luarocks. 2024-05-21T01:16:22.003 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-05-21T01:16:22.040 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-05-21T01:16:22.257 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package lua-any. 2024-05-21T01:16:22.273 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-05-21T01:16:22.316 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking lua-any (27ubuntu1) ... 2024-05-21T01:16:22.432 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package librgw2. 2024-05-21T01:16:22.453 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../027-librgw2_19.0.0-3830-g0051ea03-1jammy_amd64.deb ... 2024-05-21T01:16:22.490 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking librgw2 (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:16:22.560 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package zip. 2024-05-21T01:16:22.575 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-05-21T01:16:22.610 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking zip (3.0-12build2) ... 2024-05-21T01:16:22.913 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package unzip. 2024-05-21T01:16:22.928 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-05-21T01:16:22.962 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-05-21T01:16:23.185 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-rgw. 2024-05-21T01:16:23.206 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-3830-g0051ea03-1jammy_amd64.deb ... 2024-05-21T01:16:23.243 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-rgw (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:16:23.341 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package luarocks. 2024-05-21T01:16:23.357 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-05-21T01:16:23.416 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-05-21T01:16:23.621 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package liboath0:amd64. 2024-05-21T01:16:23.642 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-05-21T01:16:23.680 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-05-21T01:16:23.782 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package librgw2. 2024-05-21T01:16:23.797 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../027-librgw2_19.0.0-3830-g0051ea03-1jammy_amd64.deb ... 2024-05-21T01:16:23.832 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking librgw2 (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:16:23.999 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libradosstriper1. 2024-05-21T01:16:24.020 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-3830-g0051ea03-1jammy_amd64.deb ... 2024-05-21T01:16:24.099 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libradosstriper1 (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:16:24.409 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-rgw. 2024-05-21T01:16:24.424 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-3830-g0051ea03-1jammy_amd64.deb ... 2024-05-21T01:16:24.467 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-rgw (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:16:24.563 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-common. 2024-05-21T01:16:24.584 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../031-ceph-common_19.0.0-3830-g0051ea03-1jammy_amd64.deb ... 2024-05-21T01:16:24.646 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-common (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:16:24.812 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package liboath0:amd64. 2024-05-21T01:16:24.827 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-05-21T01:16:24.862 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-05-21T01:16:25.115 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libradosstriper1. 2024-05-21T01:16:25.130 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-3830-g0051ea03-1jammy_amd64.deb ... 2024-05-21T01:16:25.164 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libradosstriper1 (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:16:25.601 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ceph-common. 2024-05-21T01:16:25.616 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../031-ceph-common_19.0.0-3830-g0051ea03-1jammy_amd64.deb ... 2024-05-21T01:16:25.659 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ceph-common (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:16:26.302 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-base. 2024-05-21T01:16:26.323 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../032-ceph-base_19.0.0-3830-g0051ea03-1jammy_amd64.deb ... 2024-05-21T01:16:26.378 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-base (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:16:26.814 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ceph-base. 2024-05-21T01:16:26.829 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../032-ceph-base_19.0.0-3830-g0051ea03-1jammy_amd64.deb ... 2024-05-21T01:16:26.882 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ceph-base (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:16:27.090 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-05-21T01:16:27.111 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-05-21T01:16:27.148 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-05-21T01:16:27.443 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-05-21T01:16:27.457 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-05-21T01:16:27.485 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-cheroot. 2024-05-21T01:16:27.501 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-05-21T01:16:27.505 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-05-21T01:16:27.543 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-21T01:16:27.787 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-cheroot. 2024-05-21T01:16:27.802 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-05-21T01:16:27.837 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-21T01:16:27.930 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-05-21T01:16:27.950 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-05-21T01:16:28.004 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-05-21T01:16:28.315 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-05-21T01:16:28.324 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-jaraco.text. 2024-05-21T01:16:28.331 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-05-21T01:16:28.345 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-05-21T01:16:28.373 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-05-21T01:16:28.382 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-05-21T01:16:28.710 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-jaraco.text. 2024-05-21T01:16:28.710 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-05-21T01:16:28.725 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-05-21T01:16:28.731 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-05-21T01:16:28.767 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-05-21T01:16:28.769 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-05-21T01:16:29.070 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-05-21T01:16:29.071 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-tempora. 2024-05-21T01:16:29.083 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-05-21T01:16:29.085 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-05-21T01:16:29.128 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-05-21T01:16:29.155 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-05-21T01:16:29.423 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-tempora. 2024-05-21T01:16:29.438 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-05-21T01:16:29.458 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-portend. 2024-05-21T01:16:29.472 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-05-21T01:16:29.479 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-05-21T01:16:29.516 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-05-21T01:16:29.709 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-portend. 2024-05-21T01:16:29.724 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-05-21T01:16:29.759 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-05-21T01:16:29.853 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-05-21T01:16:29.874 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-05-21T01:16:29.911 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-05-21T01:16:30.078 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-05-21T01:16:30.093 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-05-21T01:16:30.136 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-05-21T01:16:30.214 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-cherrypy3. 2024-05-21T01:16:30.235 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-05-21T01:16:30.314 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-05-21T01:16:30.397 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-cherrypy3. 2024-05-21T01:16:30.413 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-05-21T01:16:30.447 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-05-21T01:16:30.701 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-natsort. 2024-05-21T01:16:30.723 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-05-21T01:16:30.776 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-05-21T01:16:30.834 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-natsort. 2024-05-21T01:16:30.849 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-05-21T01:16:30.892 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-05-21T01:16:31.196 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-logutils. 2024-05-21T01:16:31.210 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-05-21T01:16:31.278 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-05-21T01:16:31.330 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-logutils. 2024-05-21T01:16:31.351 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-05-21T01:16:31.388 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-05-21T01:16:31.581 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-markupsafe. 2024-05-21T01:16:31.596 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-05-21T01:16:31.639 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-05-21T01:16:31.683 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-markupsafe. 2024-05-21T01:16:31.704 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-05-21T01:16:31.774 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-05-21T01:16:31.967 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-mako. 2024-05-21T01:16:31.982 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-05-21T01:16:32.017 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-21T01:16:32.119 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-mako. 2024-05-21T01:16:32.140 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-05-21T01:16:32.185 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-21T01:16:32.311 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-simplegeneric. 2024-05-21T01:16:32.327 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-05-21T01:16:32.361 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-05-21T01:16:32.531 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-simplegeneric. 2024-05-21T01:16:32.543 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-05-21T01:16:32.572 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-05-21T01:16:32.942 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-singledispatch. 2024-05-21T01:16:32.963 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-05-21T01:16:33.000 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-05-21T01:16:33.329 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-webob. 2024-05-21T01:16:33.350 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-05-21T01:16:33.381 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-singledispatch. 2024-05-21T01:16:33.386 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-05-21T01:16:33.396 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-05-21T01:16:33.439 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-05-21T01:16:33.742 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-webob. 2024-05-21T01:16:33.757 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-05-21T01:16:33.800 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-05-21T01:16:33.815 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-waitress. 2024-05-21T01:16:33.836 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-05-21T01:16:33.876 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-21T01:16:34.194 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-waitress. 2024-05-21T01:16:34.209 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-tempita. 2024-05-21T01:16:34.210 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-05-21T01:16:34.231 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-05-21T01:16:34.255 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-21T01:16:34.268 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-05-21T01:16:34.580 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-tempita. 2024-05-21T01:16:34.596 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-05-21T01:16:34.638 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-05-21T01:16:34.900 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-paste. 2024-05-21T01:16:34.915 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-05-21T01:16:34.949 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-05-21T01:16:35.197 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-paste. 2024-05-21T01:16:35.218 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-05-21T01:16:35.286 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-05-21T01:16:35.301 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-05-21T01:16:35.344 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-05-21T01:16:35.630 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-pastedeploy. 2024-05-21T01:16:35.646 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-05-21T01:16:35.668 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-05-21T01:16:35.688 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-05-21T01:16:36.009 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-05-21T01:16:36.030 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-05-21T01:16:36.041 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-webtest. 2024-05-21T01:16:36.057 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-05-21T01:16:36.067 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-05-21T01:16:36.100 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-05-21T01:16:36.377 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-pecan. 2024-05-21T01:16:36.393 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-05-21T01:16:36.412 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-pastedeploy. 2024-05-21T01:16:36.428 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-05-21T01:16:36.434 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-05-21T01:16:36.504 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-05-21T01:16:36.782 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-certifi. 2024-05-21T01:16:36.796 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-05-21T01:16:36.832 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-webtest. 2024-05-21T01:16:36.840 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-05-21T01:16:36.853 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-05-21T01:16:36.882 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-05-21T01:16:37.159 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-idna. 2024-05-21T01:16:37.175 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-05-21T01:16:37.193 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-pecan. 2024-05-21T01:16:37.214 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-05-21T01:16:37.217 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-idna (3.3-1) ... 2024-05-21T01:16:37.251 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-05-21T01:16:37.528 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-urllib3. 2024-05-21T01:16:37.544 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-05-21T01:16:37.586 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-21T01:16:37.673 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-certifi. 2024-05-21T01:16:37.694 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-05-21T01:16:37.731 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-05-21T01:16:37.956 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-requests. 2024-05-21T01:16:37.972 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-05-21T01:16:38.014 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-21T01:16:38.093 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-idna. 2024-05-21T01:16:38.113 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-05-21T01:16:38.159 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-idna (3.3-1) ... 2024-05-21T01:16:38.334 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-werkzeug. 2024-05-21T01:16:38.350 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-05-21T01:16:38.392 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-05-21T01:16:38.538 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-urllib3. 2024-05-21T01:16:38.558 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-05-21T01:16:38.596 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-21T01:16:38.712 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-05-21T01:16:38.727 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-3830-g0051ea03-1jammy_all.deb ... 2024-05-21T01:16:38.770 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:16:38.916 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-requests. 2024-05-21T01:16:38.937 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-05-21T01:16:38.966 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-21T01:16:39.166 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-05-21T01:16:39.181 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-3830-g0051ea03-1jammy_amd64.deb ... 2024-05-21T01:16:39.224 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:16:39.277 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-werkzeug. 2024-05-21T01:16:39.298 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-05-21T01:16:39.335 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-05-21T01:16:39.536 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-bcrypt. 2024-05-21T01:16:39.551 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-05-21T01:16:39.594 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-05-21T01:16:39.614 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-05-21T01:16:39.626 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-3830-g0051ea03-1jammy_all.deb ... 2024-05-21T01:16:39.684 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:16:39.938 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-openssl. 2024-05-21T01:16:39.953 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-05-21T01:16:39.996 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-05-21T01:16:40.111 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-05-21T01:16:40.131 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-3830-g0051ea03-1jammy_amd64.deb ... 2024-05-21T01:16:40.168 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:16:40.316 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ceph-mgr. 2024-05-21T01:16:40.331 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-3830-g0051ea03-1jammy_amd64.deb ... 2024-05-21T01:16:40.365 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ceph-mgr (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:16:40.505 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-bcrypt. 2024-05-21T01:16:40.526 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-05-21T01:16:40.580 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-05-21T01:16:40.727 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ceph-mon. 2024-05-21T01:16:40.743 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-3830-g0051ea03-1jammy_amd64.deb ... 2024-05-21T01:16:40.777 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ceph-mon (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:16:41.017 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-openssl. 2024-05-21T01:16:41.037 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-05-21T01:16:41.075 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-05-21T01:16:41.347 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ceph-osd. 2024-05-21T01:16:41.362 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-3830-g0051ea03-1jammy_amd64.deb ... 2024-05-21T01:16:41.405 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ceph-osd (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:16:41.608 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-mgr. 2024-05-21T01:16:41.629 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-3830-g0051ea03-1jammy_amd64.deb ... 2024-05-21T01:16:41.811 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-mgr (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:16:42.183 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ceph. 2024-05-21T01:16:42.198 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../068-ceph_19.0.0-3830-g0051ea03-1jammy_amd64.deb ... 2024-05-21T01:16:42.231 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-mon. 2024-05-21T01:16:42.241 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ceph (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:16:42.252 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-3830-g0051ea03-1jammy_amd64.deb ... 2024-05-21T01:16:42.289 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-mon (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:16:42.569 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ceph-fuse. 2024-05-21T01:16:42.584 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-3830-g0051ea03-1jammy_amd64.deb ... 2024-05-21T01:16:42.618 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ceph-fuse (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:16:42.868 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-osd. 2024-05-21T01:16:42.889 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-3830-g0051ea03-1jammy_amd64.deb ... 2024-05-21T01:16:42.930 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ceph-mds. 2024-05-21T01:16:42.945 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-3830-g0051ea03-1jammy_amd64.deb ... 2024-05-21T01:16:42.946 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-osd (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:16:42.988 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ceph-mds (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:16:43.583 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package cephadm. 2024-05-21T01:16:43.598 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../071-cephadm_19.0.0-3830-g0051ea03-1jammy_amd64.deb ... 2024-05-21T01:16:43.649 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking cephadm (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:16:43.994 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-asyncssh. 2024-05-21T01:16:44.009 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-05-21T01:16:44.039 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph. 2024-05-21T01:16:44.051 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-05-21T01:16:44.059 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../068-ceph_19.0.0-3830-g0051ea03-1jammy_amd64.deb ... 2024-05-21T01:16:44.088 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:16:44.362 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python-babel-localedata. 2024-05-21T01:16:44.378 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-05-21T01:16:44.391 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-fuse. 2024-05-21T01:16:44.412 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-3830-g0051ea03-1jammy_amd64.deb ... 2024-05-21T01:16:44.445 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-21T01:16:44.491 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-fuse (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:16:44.903 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-mds. 2024-05-21T01:16:44.924 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-3830-g0051ea03-1jammy_amd64.deb ... 2024-05-21T01:16:44.961 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-mds (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:16:45.398 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package cephadm. 2024-05-21T01:16:45.417 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-babel. 2024-05-21T01:16:45.418 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../071-cephadm_19.0.0-3830-g0051ea03-1jammy_amd64.deb ... 2024-05-21T01:16:45.431 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-05-21T01:16:45.447 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking cephadm (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:16:45.475 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-05-21T01:16:45.742 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-asyncssh. 2024-05-21T01:16:45.763 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-05-21T01:16:45.800 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-05-21T01:16:45.820 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-jinja2. 2024-05-21T01:16:45.834 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-05-21T01:16:45.878 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-05-21T01:16:46.162 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python-babel-localedata. 2024-05-21T01:16:46.183 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-05-21T01:16:46.222 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-05-21T01:16:46.237 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-3830-g0051ea03-1jammy_all.deb ... 2024-05-21T01:16:46.245 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-21T01:16:46.280 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:16:46.642 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-repoze.lru. 2024-05-21T01:16:46.658 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-05-21T01:16:46.700 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-05-21T01:16:46.987 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-routes. 2024-05-21T01:16:47.002 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-05-21T01:16:47.061 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-05-21T01:16:47.357 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-babel. 2024-05-21T01:16:47.378 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-05-21T01:16:47.397 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-05-21T01:16:47.413 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-3830-g0051ea03-1jammy_all.deb ... 2024-05-21T01:16:47.417 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-05-21T01:16:47.455 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:16:47.771 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-jinja2. 2024-05-21T01:16:47.791 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-05-21T01:16:47.828 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-05-21T01:16:48.265 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-05-21T01:16:48.286 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-3830-g0051ea03-1jammy_all.deb ... 2024-05-21T01:16:48.323 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:16:48.644 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-05-21T01:16:48.658 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-05-21T01:16:48.701 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-21T01:16:48.710 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-repoze.lru. 2024-05-21T01:16:48.732 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-05-21T01:16:48.803 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-05-21T01:16:49.147 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-routes. 2024-05-21T01:16:49.168 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-05-21T01:16:49.213 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-05-21T01:16:49.230 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-joblib. 2024-05-21T01:16:49.244 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-05-21T01:16:49.288 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-05-21T01:16:49.592 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-05-21T01:16:49.613 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-3830-g0051ea03-1jammy_all.deb ... 2024-05-21T01:16:49.616 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-05-21T01:16:49.631 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-05-21T01:16:49.658 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:16:49.760 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-05-21T01:16:50.071 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-sklearn. 2024-05-21T01:16:50.085 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-05-21T01:16:50.129 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-21T01:16:50.821 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-05-21T01:16:50.836 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-3830-g0051ea03-1jammy_all.deb ... 2024-05-21T01:16:50.880 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:16:51.064 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-05-21T01:16:51.085 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-05-21T01:16:51.130 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-21T01:16:51.684 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-joblib. 2024-05-21T01:16:51.705 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-05-21T01:16:51.750 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-05-21T01:16:51.866 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-cachetools. 2024-05-21T01:16:51.883 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-05-21T01:16:51.924 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-05-21T01:16:52.210 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-pyasn1. 2024-05-21T01:16:52.226 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-05-21T01:16:52.293 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-05-21T01:16:52.379 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-05-21T01:16:52.401 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-05-21T01:16:52.557 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-05-21T01:16:52.621 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-05-21T01:16:52.638 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-05-21T01:16:52.679 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-05-21T01:16:52.893 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-sklearn. 2024-05-21T01:16:52.914 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-05-21T01:16:52.951 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-21T01:16:53.008 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-rsa. 2024-05-21T01:16:53.024 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-05-21T01:16:53.066 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-rsa (4.8-1) ... 2024-05-21T01:16:53.378 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-google-auth. 2024-05-21T01:16:53.394 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-05-21T01:16:53.436 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-05-21T01:16:53.786 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-05-21T01:16:53.789 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-05-21T01:16:53.805 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-05-21T01:16:53.808 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-3830-g0051ea03-1jammy_all.deb ... 2024-05-21T01:16:53.838 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-21T01:16:53.852 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:16:54.252 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-websocket. 2024-05-21T01:16:54.268 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-05-21T01:16:54.310 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-05-21T01:16:54.630 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-kubernetes. 2024-05-21T01:16:54.643 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-05-21T01:16:54.679 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-21T01:16:54.979 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-cachetools. 2024-05-21T01:16:55.001 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-05-21T01:16:55.062 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-05-21T01:16:55.319 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-05-21T01:16:55.331 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-3830-g0051ea03-1jammy_all.deb ... 2024-05-21T01:16:55.368 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:16:55.384 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-pyasn1. 2024-05-21T01:16:55.406 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-05-21T01:16:55.434 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-05-21T01:16:55.696 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libonig5:amd64. 2024-05-21T01:16:55.707 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-05-21T01:16:55.737 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-21T01:16:55.842 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-05-21T01:16:55.864 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-05-21T01:16:55.905 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-05-21T01:16:56.073 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libjq1:amd64. 2024-05-21T01:16:56.085 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-05-21T01:16:56.131 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-21T01:16:56.216 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-rsa. 2024-05-21T01:16:56.238 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-05-21T01:16:56.274 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-rsa (4.8-1) ... 2024-05-21T01:16:56.459 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package jq. 2024-05-21T01:16:56.474 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-05-21T01:16:56.526 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-05-21T01:16:56.620 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-google-auth. 2024-05-21T01:16:56.642 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-05-21T01:16:56.720 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-05-21T01:16:56.858 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package socat. 2024-05-21T01:16:56.875 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-05-21T01:16:56.928 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-05-21T01:16:57.065 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-05-21T01:16:57.087 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-05-21T01:16:57.132 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-21T01:16:57.239 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package xmlstarlet. 2024-05-21T01:16:57.254 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-05-21T01:16:57.298 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-05-21T01:16:57.652 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ceph-test. 2024-05-21T01:16:57.665 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../099-ceph-test_19.0.0-3830-g0051ea03-1jammy_amd64.deb ... 2024-05-21T01:16:57.669 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-websocket. 2024-05-21T01:16:57.690 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-05-21T01:16:57.710 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ceph-test (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:16:57.726 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-05-21T01:16:58.089 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-kubernetes. 2024-05-21T01:16:58.110 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-05-21T01:16:58.181 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-21T01:16:58.928 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-05-21T01:16:58.950 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-3830-g0051ea03-1jammy_all.deb ... 2024-05-21T01:16:58.994 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:16:59.306 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libonig5:amd64. 2024-05-21T01:16:59.328 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-05-21T01:16:59.372 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-21T01:16:59.709 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libjq1:amd64. 2024-05-21T01:16:59.731 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-05-21T01:16:59.784 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-21T01:16:59.914 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ceph-volume. 2024-05-21T01:16:59.929 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-3830-g0051ea03-1jammy_all.deb ... 2024-05-21T01:16:59.972 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ceph-volume (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:17:00.096 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package jq. 2024-05-21T01:17:00.117 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-05-21T01:17:00.170 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-05-21T01:17:00.342 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package cephfs-mirror. 2024-05-21T01:17:00.357 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-3830-g0051ea03-1jammy_amd64.deb ... 2024-05-21T01:17:00.426 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking cephfs-mirror (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:17:00.465 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package socat. 2024-05-21T01:17:00.486 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-05-21T01:17:00.531 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-05-21T01:17:00.737 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-colorama. 2024-05-21T01:17:00.755 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-05-21T01:17:00.795 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-05-21T01:17:00.860 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package xmlstarlet. 2024-05-21T01:17:00.881 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-05-21T01:17:00.951 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-05-21T01:17:01.081 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package cephfs-shell. 2024-05-21T01:17:01.097 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-3830-g0051ea03-1jammy_all.deb ... 2024-05-21T01:17:01.139 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking cephfs-shell (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:17:01.347 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-test. 2024-05-21T01:17:01.361 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../099-ceph-test_19.0.0-3830-g0051ea03-1jammy_amd64.deb ... 2024-05-21T01:17:01.375 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package cephfs-top. 2024-05-21T01:17:01.391 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-3830-g0051ea03-1jammy_all.deb ... 2024-05-21T01:17:01.397 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-test (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:17:01.433 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking cephfs-top (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:17:01.652 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libcephfs-dev. 2024-05-21T01:17:01.668 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-3830-g0051ea03-1jammy_amd64.deb ... 2024-05-21T01:17:01.744 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libcephfs-dev (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:17:02.080 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package lua-socket:amd64. 2024-05-21T01:17:02.096 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-05-21T01:17:02.138 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-05-21T01:17:02.476 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package lua-sec:amd64. 2024-05-21T01:17:02.492 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-05-21T01:17:02.533 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-05-21T01:17:02.879 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package nvme-cli. 2024-05-21T01:17:02.895 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-05-21T01:17:02.937 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-05-21T01:17:03.375 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package pkg-config. 2024-05-21T01:17:03.391 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-05-21T01:17:03.433 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-05-21T01:17:03.720 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-05-21T01:17:03.736 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-05-21T01:17:03.778 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-05-21T01:17:04.069 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-volume. 2024-05-21T01:17:04.090 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-3830-g0051ea03-1jammy_all.deb ... 2024-05-21T01:17:04.127 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-volume (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:17:04.214 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-iniconfig. 2024-05-21T01:17:04.230 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-05-21T01:17:04.273 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-05-21T01:17:04.498 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package cephfs-mirror. 2024-05-21T01:17:04.521 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-3830-g0051ea03-1jammy_amd64.deb ... 2024-05-21T01:17:04.573 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking cephfs-mirror (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:17:04.608 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-pastescript. 2024-05-21T01:17:04.620 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-05-21T01:17:04.658 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-05-21T01:17:04.943 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-colorama. 2024-05-21T01:17:04.965 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-05-21T01:17:05.009 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-05-21T01:17:05.011 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-pluggy. 2024-05-21T01:17:05.027 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-05-21T01:17:05.078 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-05-21T01:17:05.305 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package cephfs-shell. 2024-05-21T01:17:05.326 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-3830-g0051ea03-1jammy_all.deb ... 2024-05-21T01:17:05.371 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking cephfs-shell (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:17:05.406 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-psutil. 2024-05-21T01:17:05.419 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-05-21T01:17:05.455 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-05-21T01:17:05.640 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package cephfs-top. 2024-05-21T01:17:05.653 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-3830-g0051ea03-1jammy_all.deb ... 2024-05-21T01:17:05.724 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking cephfs-top (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:17:05.784 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-py. 2024-05-21T01:17:05.797 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-05-21T01:17:05.833 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-py (1.10.0-1) ... 2024-05-21T01:17:05.987 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libcephfs-dev. 2024-05-21T01:17:06.009 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-3830-g0051ea03-1jammy_amd64.deb ... 2024-05-21T01:17:06.051 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libcephfs-dev (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:17:06.137 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-pygments. 2024-05-21T01:17:06.150 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-05-21T01:17:06.195 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-05-21T01:17:06.371 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package lua-socket:amd64. 2024-05-21T01:17:06.393 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-05-21T01:17:06.437 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-05-21T01:17:06.665 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-pyinotify. 2024-05-21T01:17:06.678 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-05-21T01:17:06.715 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-05-21T01:17:06.934 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package lua-sec:amd64. 2024-05-21T01:17:06.956 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-05-21T01:17:07.001 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-05-21T01:17:07.109 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-toml. 2024-05-21T01:17:07.122 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-05-21T01:17:07.167 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-05-21T01:17:07.425 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package nvme-cli. 2024-05-21T01:17:07.437 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-pytest. 2024-05-21T01:17:07.447 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-05-21T01:17:07.450 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-05-21T01:17:07.486 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-05-21T01:17:07.498 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-05-21T01:17:07.849 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package python3-simplejson. 2024-05-21T01:17:07.862 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-05-21T01:17:07.906 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-05-21T01:17:08.184 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-05-21T01:17:08.197 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-05-21T01:17:08.237 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package pkg-config. 2024-05-21T01:17:08.242 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-05-21T01:17:08.259 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-05-21T01:17:08.312 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-05-21T01:17:08.581 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-05-21T01:17:08.594 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-05-21T01:17:08.623 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-05-21T01:17:08.996 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package radosgw. 2024-05-21T01:17:09.008 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../122-radosgw_19.0.0-3830-g0051ea03-1jammy_amd64.deb ... 2024-05-21T01:17:09.046 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking radosgw (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:17:09.093 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-iniconfig. 2024-05-21T01:17:09.115 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-05-21T01:17:09.159 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-05-21T01:17:09.429 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-pastescript. 2024-05-21T01:17:09.451 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-05-21T01:17:09.487 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-05-21T01:17:09.707 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package rbd-fuse. 2024-05-21T01:17:09.720 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-3830-g0051ea03-1jammy_amd64.deb ... 2024-05-21T01:17:09.748 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking rbd-fuse (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:17:09.857 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-pluggy. 2024-05-21T01:17:09.879 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-05-21T01:17:09.923 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-05-21T01:17:10.042 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-05-21T01:17:10.260 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-psutil. 2024-05-21T01:17:10.282 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-05-21T01:17:10.320 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-21T01:17:10.326 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-05-21T01:17:10.446 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-05-21T01:17:10.710 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-05-21T01:17:10.720 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-py. 2024-05-21T01:17:10.742 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-05-21T01:17:10.787 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-py (1.10.0-1) ... 2024-05-21T01:17:11.105 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-05-21T01:17:11.116 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-pygments. 2024-05-21T01:17:11.129 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-05-21T01:17:11.157 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-05-21T01:17:11.670 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-pyinotify. 2024-05-21T01:17:11.692 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-05-21T01:17:11.698 INFO:teuthology.orchestra.run.smithi063.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-05-21T01:17:11.736 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-05-21T01:17:11.738 INFO:teuthology.orchestra.run.smithi063.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-05-21T01:17:11.781 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up cephadm (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:17:12.081 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-toml. 2024-05-21T01:17:12.102 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-05-21T01:17:12.147 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-05-21T01:17:12.349 INFO:teuthology.orchestra.run.smithi063.stdout:Adding system user cephadm....done 2024-05-21T01:17:12.500 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-pytest. 2024-05-21T01:17:12.511 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-21T01:17:12.522 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-05-21T01:17:12.566 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-05-21T01:17:12.805 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-05-21T01:17:12.928 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-simplejson. 2024-05-21T01:17:12.950 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-05-21T01:17:12.986 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-05-21T01:17:13.105 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-05-21T01:17:13.232 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-05-21T01:17:13.274 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-05-21T01:17:13.285 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-05-21T01:17:13.346 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-05-21T01:17:13.521 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-05-21T01:17:13.792 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-05-21T01:17:13.918 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-py (1.10.0-1) ... 2024-05-21T01:17:14.160 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package radosgw. 2024-05-21T01:17:14.182 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../122-radosgw_19.0.0-3830-g0051ea03-1jammy_amd64.deb ... 2024-05-21T01:17:14.226 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking radosgw (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:17:14.245 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-05-21T01:17:14.630 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-05-21T01:17:14.898 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-05-21T01:17:15.149 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-05-21T01:17:15.154 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package rbd-fuse. 2024-05-21T01:17:15.176 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-3830-g0051ea03-1jammy_amd64.deb ... 2024-05-21T01:17:15.245 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking rbd-fuse (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:17:15.458 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-05-21T01:17:15.590 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-05-21T01:17:15.693 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-05-21T01:17:15.859 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-21T01:17:15.985 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-05-21T01:17:15.994 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-05-21T01:17:16.273 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-05-21T01:17:16.312 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-05-21T01:17:16.588 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-ceph-argparse (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:17:16.677 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-05-21T01:17:16.864 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-21T01:17:16.973 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-05-21T01:17:17.074 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-05-21T01:17:17.138 INFO:teuthology.orchestra.run.smithi131.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-05-21T01:17:17.295 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up cephadm (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:17:17.350 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-05-21T01:17:17.501 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-05-21T01:17:17.769 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-05-21T01:17:18.196 INFO:teuthology.orchestra.run.smithi063.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-05-21T01:17:18.241 INFO:teuthology.orchestra.run.smithi063.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-05-21T01:17:18.313 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-21T01:17:18.321 INFO:teuthology.orchestra.run.smithi131.stdout:Adding system user cephadm....done 2024-05-21T01:17:18.423 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-05-21T01:17:18.527 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-21T01:17:18.799 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-21T01:17:18.836 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-05-21T01:17:18.916 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-05-21T01:17:19.104 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-05-21T01:17:19.176 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-05-21T01:17:19.230 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-05-21T01:17:19.468 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-05-21T01:17:19.507 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-05-21T01:17:19.766 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-05-21T01:17:19.795 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up zip (3.0-12build2) ... 2024-05-21T01:17:19.892 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-py (1.10.0-1) ... 2024-05-21T01:17:19.921 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-05-21T01:17:20.269 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-05-21T01:17:20.637 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-05-21T01:17:20.698 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-05-21T01:17:20.888 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-05-21T01:17:20.965 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-05-21T01:17:21.091 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-05-21T01:17:21.131 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-05-21T01:17:21.200 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-21T01:17:21.439 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-05-21T01:17:21.502 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-05-21T01:17:21.792 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-05-21T01:17:21.919 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-05-21T01:17:22.051 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-05-21T01:17:22.212 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-05-21T01:17:22.311 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-05-21T01:17:22.570 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-ceph-argparse (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:17:22.647 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-21T01:17:22.847 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-21T01:17:22.948 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-05-21T01:17:22.964 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-05-21T01:17:23.074 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-05-21T01:17:23.289 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-05-21T01:17:23.396 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-05-21T01:17:23.542 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-05-21T01:17:23.650 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-05-21T01:17:23.801 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-05-21T01:17:23.935 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-05-21T01:17:24.052 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-ceph-common (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:17:24.178 INFO:teuthology.orchestra.run.smithi131.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-05-21T01:17:24.257 INFO:teuthology.orchestra.run.smithi131.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-05-21T01:17:24.321 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-21T01:17:24.362 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-idna (3.3-1) ... 2024-05-21T01:17:24.464 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-05-21T01:17:24.721 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-21T01:17:24.874 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-21T01:17:25.000 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-05-21T01:17:25.293 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-05-21T01:17:25.602 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-05-21T01:17:25.920 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up zip (3.0-12build2) ... 2024-05-21T01:17:26.002 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-05-21T01:17:26.079 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-05-21T01:17:26.254 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-21T01:17:26.388 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-toml (0.10.2-1) ... 2024-05-21T01:17:26.664 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-21T01:17:26.765 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-05-21T01:17:26.765 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-05-21T01:17:26.874 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-21T01:17:27.057 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-05-21T01:17:27.192 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-05-21T01:17:27.225 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-05-21T01:17:27.351 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-21T01:17:27.443 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-05-21T01:17:27.685 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-05-21T01:17:27.711 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-21T01:17:27.862 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-05-21T01:17:28.111 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-05-21T01:17:28.188 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-05-21T01:17:28.363 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-05-21T01:17:28.473 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-05-21T01:17:28.732 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-05-21T01:17:29.008 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-05-21T01:17:29.056 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-21T01:17:29.292 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-05-21T01:17:29.349 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-05-21T01:17:29.551 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-21T01:17:29.667 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-05-21T01:17:29.677 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-05-21T01:17:30.003 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-21T01:17:30.018 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-05-21T01:17:30.129 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-21T01:17:30.277 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-05-21T01:17:30.403 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-ceph-common (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:17:30.430 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-05-21T01:17:30.756 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-idna (3.3-1) ... 2024-05-21T01:17:31.081 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-21T01:17:31.098 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-05-21T01:17:31.374 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-05-21T01:17:31.500 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-05-21T01:17:31.626 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-05-21T01:17:31.740 INFO:teuthology.orchestra.run.smithi063.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-05-21T01:17:31.978 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-21T01:17:32.079 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-05-21T01:17:32.303 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-05-21T01:17:32.489 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-05-21T01:17:32.580 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-21T01:17:32.706 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-toml (0.10.2-1) ... 2024-05-21T01:17:32.764 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up lua-any (27ubuntu1) ... 2024-05-21T01:17:32.874 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-portend (3.0.0-1) ... 2024-05-21T01:17:32.990 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-21T01:17:33.150 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-05-21T01:17:33.175 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-21T01:17:33.276 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-21T01:17:33.300 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-05-21T01:17:33.602 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-05-21T01:17:33.652 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-05-21T01:17:33.887 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-05-21T01:17:33.962 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-21T01:17:34.230 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-21T01:17:34.262 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-05-21T01:17:34.355 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-05-21T01:17:34.465 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-rsa (4.8-1) ... 2024-05-21T01:17:34.657 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-05-21T01:17:34.741 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-05-21T01:17:34.916 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-05-21T01:17:35.026 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-21T01:17:35.184 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-05-21T01:17:35.311 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-05-21T01:17:35.443 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-05-21T01:17:35.695 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-05-21T01:17:35.704 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-05-21T01:17:35.965 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-21T01:17:36.005 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-05-21T01:17:36.071 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-05-21T01:17:36.339 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-21T01:17:36.374 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-21T01:17:36.457 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-21T01:17:36.500 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up librados2 (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:17:36.626 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:17:36.744 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-05-21T01:17:36.825 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-05-21T01:17:37.072 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libcephfs2 (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:17:37.126 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-05-21T01:17:37.198 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libradosstriper1 (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:17:37.324 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-05-21T01:17:37.427 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-05-21T01:17:37.553 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-05-21T01:17:37.625 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up librbd1 (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:17:37.662 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-05-21T01:17:37.751 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ceph-mgr-modules-core (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:17:37.768 INFO:teuthology.orchestra.run.smithi131.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-05-21T01:17:37.877 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ceph-fuse (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:17:38.022 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-21T01:17:38.106 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-21T01:17:38.106 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-21T01:17:38.148 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-05-21T01:17:38.575 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-05-21T01:17:38.762 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libcephfs-dev (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:17:38.867 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up lua-any (27ubuntu1) ... 2024-05-21T01:17:38.904 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-rados (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:17:38.993 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-portend (3.0.0-1) ... 2024-05-21T01:17:39.030 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up librgw2 (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:17:39.156 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up cephfs-top (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:17:39.270 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-21T01:17:39.282 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-21T01:17:39.371 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-05-21T01:17:39.739 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-05-21T01:17:40.040 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-21T01:17:40.333 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-05-21T01:17:40.544 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-rsa (4.8-1) ... 2024-05-21T01:17:40.627 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-rbd (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:17:40.778 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up rbd-fuse (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:17:40.870 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-05-21T01:17:40.904 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-rgw (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:17:41.021 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up python3-cephfs (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:17:41.131 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up cephfs-shell (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:17:41.188 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-21T01:17:41.248 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ceph-common (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:17:41.481 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-05-21T01:17:41.785 INFO:teuthology.orchestra.run.smithi063.stdout:Adding group ceph....done 2024-05-21T01:17:41.857 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-05-21T01:17:42.142 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-05-21T01:17:42.203 INFO:teuthology.orchestra.run.smithi063.stdout:Adding system user ceph....done 2024-05-21T01:17:42.371 INFO:teuthology.orchestra.run.smithi063.stdout:Setting system user ceph properties....done 2024-05-21T01:17:42.392 INFO:teuthology.orchestra.run.smithi063.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-05-21T01:17:42.486 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-21T01:17:42.542 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-05-21T01:17:42.637 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up librados2 (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:17:42.763 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:17:42.906 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-05-21T01:17:42.958 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-05-21T01:17:43.284 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libcephfs2 (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:17:43.410 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libradosstriper1 (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:17:43.569 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-05-21T01:17:43.700 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up cephfs-mirror (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:17:43.837 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up librbd1 (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:17:43.963 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-mgr-modules-core (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:17:43.984 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-05-21T01:17:43.984 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-05-21T01:17:44.123 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-fuse (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:17:44.338 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-21T01:17:44.339 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-21T01:17:44.620 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ceph-test (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:17:44.780 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up radosgw (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:17:44.857 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libcephfs-dev (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:17:45.025 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-rados (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:17:45.151 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up librgw2 (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:17:45.310 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up cephfs-top (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:17:45.320 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-21T01:17:45.321 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-21T01:17:45.436 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-21T01:17:46.107 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ceph-base (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:17:46.475 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-05-21T01:17:46.665 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-rbd (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:17:46.791 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up rbd-fuse (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:17:46.950 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-rgw (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:17:47.076 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-cephfs (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:17:47.139 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ceph-mds (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:17:47.227 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up cephfs-shell (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:17:47.353 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-common (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:17:47.376 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-21T01:17:47.376 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-21T01:17:47.954 INFO:teuthology.orchestra.run.smithi131.stdout:Adding group ceph....done 2024-05-21T01:17:47.999 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ceph-mgr (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:17:48.220 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-21T01:17:48.220 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-21T01:17:48.397 INFO:teuthology.orchestra.run.smithi131.stdout:Adding system user ceph....done 2024-05-21T01:17:48.532 INFO:teuthology.orchestra.run.smithi131.stdout:Setting system user ceph properties....done 2024-05-21T01:17:48.546 INFO:teuthology.orchestra.run.smithi131.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-05-21T01:17:48.685 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-05-21T01:17:48.875 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ceph-osd (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:17:49.043 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-05-21T01:17:49.215 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-21T01:17:49.215 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-21T01:17:49.675 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up cephfs-mirror (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:17:49.885 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:17:49.994 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:17:50.002 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-05-21T01:17:50.002 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-05-21T01:17:50.154 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ceph-mon (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:17:50.380 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-21T01:17:50.380 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-21T01:17:50.547 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-test (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:17:50.707 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up radosgw (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:17:50.972 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ceph-mgr-cephadm (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:17:51.114 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ceph (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:17:51.189 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-21T01:17:51.189 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-21T01:17:51.274 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ceph-mgr-dashboard (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:17:51.425 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ceph-volume (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:17:51.701 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-base (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:17:51.794 INFO:teuthology.orchestra.run.smithi063.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-05-21T01:17:51.937 INFO:teuthology.orchestra.run.smithi063.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-05-21T01:17:52.065 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-05-21T01:17:52.097 INFO:teuthology.orchestra.run.smithi063.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-05-21T01:17:52.627 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-mds (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:17:52.895 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-21T01:17:52.895 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-21T01:17:52.897 INFO:teuthology.orchestra.run.smithi063.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-05-21T01:17:53.395 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-mgr (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:17:53.616 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-21T01:17:53.616 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-21T01:17:53.622 INFO:teuthology.orchestra.run.smithi063.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-05-21T01:17:53.626 DEBUG:teuthology.orchestra.run.smithi063:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-05-21T01:17:53.703 INFO:teuthology.orchestra.run.smithi063.stdout:Reading package lists... 2024-05-21T01:17:53.890 INFO:teuthology.orchestra.run.smithi063.stdout:Building dependency tree... 2024-05-21T01:17:53.891 INFO:teuthology.orchestra.run.smithi063.stdout:Reading state information... 2024-05-21T01:17:54.079 INFO:teuthology.orchestra.run.smithi063.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-05-21T01:17:54.079 INFO:teuthology.orchestra.run.smithi063.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-05-21T01:17:54.079 INFO:teuthology.orchestra.run.smithi063.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-05-21T01:17:54.079 INFO:teuthology.orchestra.run.smithi063.stdout:The following packages were automatically installed and are no longer required: 2024-05-21T01:17:54.079 INFO:teuthology.orchestra.run.smithi063.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-21T01:17:54.079 INFO:teuthology.orchestra.run.smithi063.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-21T01:17:54.079 INFO:teuthology.orchestra.run.smithi063.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-21T01:17:54.080 INFO:teuthology.orchestra.run.smithi063.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-21T01:17:54.080 INFO:teuthology.orchestra.run.smithi063.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-21T01:17:54.080 INFO:teuthology.orchestra.run.smithi063.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-21T01:17:54.081 INFO:teuthology.orchestra.run.smithi063.stdout:The following additional packages will be installed: 2024-05-21T01:17:54.081 INFO:teuthology.orchestra.run.smithi063.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-05-21T01:17:54.081 INFO:teuthology.orchestra.run.smithi063.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-05-21T01:17:54.082 INFO:teuthology.orchestra.run.smithi063.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-05-21T01:17:54.082 INFO:teuthology.orchestra.run.smithi063.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-05-21T01:17:54.082 INFO:teuthology.orchestra.run.smithi063.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-05-21T01:17:54.083 INFO:teuthology.orchestra.run.smithi063.stdout:Suggested packages: 2024-05-21T01:17:54.083 INFO:teuthology.orchestra.run.smithi063.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-05-21T01:17:54.083 INFO:teuthology.orchestra.run.smithi063.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-05-21T01:17:54.083 INFO:teuthology.orchestra.run.smithi063.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-05-21T01:17:54.139 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-osd (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:17:54.140 INFO:teuthology.orchestra.run.smithi063.stdout:The following NEW packages will be installed: 2024-05-21T01:17:54.140 INFO:teuthology.orchestra.run.smithi063.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-05-21T01:17:54.140 INFO:teuthology.orchestra.run.smithi063.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-05-21T01:17:54.140 INFO:teuthology.orchestra.run.smithi063.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-05-21T01:17:54.140 INFO:teuthology.orchestra.run.smithi063.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-05-21T01:17:54.141 INFO:teuthology.orchestra.run.smithi063.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-05-21T01:17:54.141 INFO:teuthology.orchestra.run.smithi063.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-05-21T01:17:54.141 INFO:teuthology.orchestra.run.smithi063.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-05-21T01:17:54.142 INFO:teuthology.orchestra.run.smithi063.stdout:The following packages will be upgraded: 2024-05-21T01:17:54.142 INFO:teuthology.orchestra.run.smithi063.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-05-21T01:17:54.206 INFO:teuthology.orchestra.run.smithi063.stdout:4 upgraded, 39 newly installed, 0 to remove and 306 not upgraded. 2024-05-21T01:17:54.206 INFO:teuthology.orchestra.run.smithi063.stdout:Need to get 55.7 MB of archives. 2024-05-21T01:17:54.206 INFO:teuthology.orchestra.run.smithi063.stdout:After this operation, 202 MB of additional disk space will be used. 2024-05-21T01:17:54.206 INFO:teuthology.orchestra.run.smithi063.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-05-21T01:17:54.383 INFO:teuthology.orchestra.run.smithi063.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-05-21T01:17:54.388 INFO:teuthology.orchestra.run.smithi063.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-05-21T01:17:54.421 INFO:teuthology.orchestra.run.smithi063.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-05-21T01:17:54.422 INFO:teuthology.orchestra.run.smithi063.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-05-21T01:17:54.422 INFO:teuthology.orchestra.run.smithi063.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-05-21T01:17:54.432 INFO:teuthology.orchestra.run.smithi063.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-05-21T01:17:54.432 INFO:teuthology.orchestra.run.smithi063.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-05-21T01:17:54.434 INFO:teuthology.orchestra.run.smithi063.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-05-21T01:17:54.435 INFO:teuthology.orchestra.run.smithi063.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-05-21T01:17:54.435 INFO:teuthology.orchestra.run.smithi063.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-05-21T01:17:54.437 INFO:teuthology.orchestra.run.smithi063.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-05-21T01:17:54.451 INFO:teuthology.orchestra.run.smithi063.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-05-21T01:17:54.451 INFO:teuthology.orchestra.run.smithi063.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-05-21T01:17:54.451 INFO:teuthology.orchestra.run.smithi063.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-05-21T01:17:54.464 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-21T01:17:54.464 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-21T01:17:54.471 INFO:teuthology.orchestra.run.smithi063.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-05-21T01:17:54.720 INFO:teuthology.orchestra.run.smithi063.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-05-21T01:17:54.721 INFO:teuthology.orchestra.run.smithi063.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-05-21T01:17:54.722 INFO:teuthology.orchestra.run.smithi063.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-05-21T01:17:54.725 INFO:teuthology.orchestra.run.smithi063.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-05-21T01:17:54.725 INFO:teuthology.orchestra.run.smithi063.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-05-21T01:17:54.729 INFO:teuthology.orchestra.run.smithi063.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-05-21T01:17:54.731 INFO:teuthology.orchestra.run.smithi063.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-05-21T01:17:54.738 INFO:teuthology.orchestra.run.smithi063.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-05-21T01:17:54.739 INFO:teuthology.orchestra.run.smithi063.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-05-21T01:17:54.761 INFO:teuthology.orchestra.run.smithi063.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-05-21T01:17:54.761 INFO:teuthology.orchestra.run.smithi063.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-05-21T01:17:54.772 INFO:teuthology.orchestra.run.smithi063.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-05-21T01:17:54.792 INFO:teuthology.orchestra.run.smithi063.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-05-21T01:17:54.796 INFO:teuthology.orchestra.run.smithi063.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-05-21T01:17:54.797 INFO:teuthology.orchestra.run.smithi063.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-05-21T01:17:54.797 INFO:teuthology.orchestra.run.smithi063.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-05-21T01:17:54.798 INFO:teuthology.orchestra.run.smithi063.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-05-21T01:17:54.810 INFO:teuthology.orchestra.run.smithi063.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-05-21T01:17:54.812 INFO:teuthology.orchestra.run.smithi063.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-05-21T01:17:54.980 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:17:54.980 INFO:teuthology.orchestra.run.smithi063.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-05-21T01:17:54.980 INFO:teuthology.orchestra.run.smithi063.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-05-21T01:17:54.981 INFO:teuthology.orchestra.run.smithi063.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-05-21T01:17:54.981 INFO:teuthology.orchestra.run.smithi063.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-05-21T01:17:54.981 INFO:teuthology.orchestra.run.smithi063.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-05-21T01:17:54.981 INFO:teuthology.orchestra.run.smithi063.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-05-21T01:17:54.994 INFO:teuthology.orchestra.run.smithi063.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-05-21T01:17:54.995 INFO:teuthology.orchestra.run.smithi063.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-05-21T01:17:55.092 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:17:55.327 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-mon (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:17:55.390 INFO:teuthology.orchestra.run.smithi063.stdout:Preconfiguring packages ... 2024-05-21T01:17:55.547 INFO:teuthology.orchestra.run.smithi063.stdout:Fetched 55.7 MB in 1s (66.0 MB/s) 2024-05-21T01:17:55.661 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-21T01:17:55.661 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-21T01:17:55.828 INFO:teuthology.orchestra.run.smithi063.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140918 files and directories currently installed.) 2024-05-21T01:17:55.831 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-05-21T01:17:55.970 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-05-21T01:17:56.225 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-mgr-cephadm (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:17:56.542 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:17:56.580 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-05-21T01:17:56.821 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-mgr-dashboard (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:17:57.066 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-volume (19.0.0-3830-g0051ea03-1jammy) ... 2024-05-21T01:17:57.419 INFO:teuthology.orchestra.run.smithi131.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-05-21T01:17:57.520 INFO:teuthology.orchestra.run.smithi131.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-05-21T01:17:57.662 INFO:teuthology.orchestra.run.smithi063.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-05-21T01:17:57.688 INFO:teuthology.orchestra.run.smithi131.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-05-21T01:17:58.101 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package flex. 2024-05-21T01:17:58.173 INFO:teuthology.orchestra.run.smithi063.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140918 files and directories currently installed.) 2024-05-21T01:17:58.176 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-05-21T01:17:58.216 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking flex (2.6.4-8build2) ... 2024-05-21T01:17:58.539 INFO:teuthology.orchestra.run.smithi131.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-05-21T01:17:58.744 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-05-21T01:17:58.972 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-05-21T01:17:59.230 INFO:teuthology.orchestra.run.smithi131.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-05-21T01:17:59.233 DEBUG:teuthology.orchestra.run.smithi131:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-05-21T01:17:59.286 INFO:teuthology.orchestra.run.smithi131.stdout:Reading package lists... 2024-05-21T01:17:59.354 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-05-21T01:17:59.490 INFO:teuthology.orchestra.run.smithi131.stdout:Building dependency tree... 2024-05-21T01:17:59.490 INFO:teuthology.orchestra.run.smithi131.stdout:Reading state information... 2024-05-21T01:17:59.683 INFO:teuthology.orchestra.run.smithi131.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-05-21T01:17:59.683 INFO:teuthology.orchestra.run.smithi131.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-05-21T01:17:59.684 INFO:teuthology.orchestra.run.smithi131.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-05-21T01:17:59.684 INFO:teuthology.orchestra.run.smithi131.stdout:The following packages were automatically installed and are no longer required: 2024-05-21T01:17:59.684 INFO:teuthology.orchestra.run.smithi131.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-21T01:17:59.684 INFO:teuthology.orchestra.run.smithi131.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-21T01:17:59.684 INFO:teuthology.orchestra.run.smithi131.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-21T01:17:59.684 INFO:teuthology.orchestra.run.smithi131.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-05-21T01:17:59.685 INFO:teuthology.orchestra.run.smithi131.stdout: python2.7-minimal 2024-05-21T01:17:59.685 INFO:teuthology.orchestra.run.smithi131.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-21T01:17:59.685 INFO:teuthology.orchestra.run.smithi131.stdout:The following additional packages will be installed: 2024-05-21T01:17:59.685 INFO:teuthology.orchestra.run.smithi131.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-05-21T01:17:59.685 INFO:teuthology.orchestra.run.smithi131.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-05-21T01:17:59.686 INFO:teuthology.orchestra.run.smithi131.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-05-21T01:17:59.686 INFO:teuthology.orchestra.run.smithi131.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-05-21T01:17:59.686 INFO:teuthology.orchestra.run.smithi131.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-05-21T01:17:59.687 INFO:teuthology.orchestra.run.smithi131.stdout:Suggested packages: 2024-05-21T01:17:59.687 INFO:teuthology.orchestra.run.smithi131.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-05-21T01:17:59.687 INFO:teuthology.orchestra.run.smithi131.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-05-21T01:17:59.687 INFO:teuthology.orchestra.run.smithi131.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-05-21T01:17:59.727 INFO:teuthology.orchestra.run.smithi131.stdout:The following NEW packages will be installed: 2024-05-21T01:17:59.727 INFO:teuthology.orchestra.run.smithi131.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-05-21T01:17:59.727 INFO:teuthology.orchestra.run.smithi131.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-05-21T01:17:59.728 INFO:teuthology.orchestra.run.smithi131.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-05-21T01:17:59.728 INFO:teuthology.orchestra.run.smithi131.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-05-21T01:17:59.728 INFO:teuthology.orchestra.run.smithi131.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-05-21T01:17:59.728 INFO:teuthology.orchestra.run.smithi131.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-05-21T01:17:59.728 INFO:teuthology.orchestra.run.smithi131.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-05-21T01:17:59.729 INFO:teuthology.orchestra.run.smithi131.stdout:The following packages will be upgraded: 2024-05-21T01:17:59.729 INFO:teuthology.orchestra.run.smithi131.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-05-21T01:17:59.879 INFO:teuthology.orchestra.run.smithi063.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140991 files and directories currently installed.) 2024-05-21T01:17:59.882 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-05-21T01:17:59.909 INFO:teuthology.orchestra.run.smithi131.stdout:4 upgraded, 39 newly installed, 0 to remove and 306 not upgraded. 2024-05-21T01:17:59.909 INFO:teuthology.orchestra.run.smithi131.stdout:Need to get 55.7 MB of archives. 2024-05-21T01:17:59.909 INFO:teuthology.orchestra.run.smithi131.stdout:After this operation, 202 MB of additional disk space will be used. 2024-05-21T01:17:59.909 INFO:teuthology.orchestra.run.smithi131.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-05-21T01:18:00.013 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-05-21T01:18:00.401 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-05-21T01:18:00.528 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-05-21T01:18:00.535 INFO:teuthology.orchestra.run.smithi131.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-05-21T01:18:00.552 INFO:teuthology.orchestra.run.smithi131.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-05-21T01:18:00.676 INFO:teuthology.orchestra.run.smithi131.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-05-21T01:18:00.678 INFO:teuthology.orchestra.run.smithi131.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-05-21T01:18:00.679 INFO:teuthology.orchestra.run.smithi131.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-05-21T01:18:00.707 INFO:teuthology.orchestra.run.smithi131.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-05-21T01:18:00.709 INFO:teuthology.orchestra.run.smithi131.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-05-21T01:18:00.713 INFO:teuthology.orchestra.run.smithi131.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-05-21T01:18:00.715 INFO:teuthology.orchestra.run.smithi131.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-05-21T01:18:00.716 INFO:teuthology.orchestra.run.smithi131.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-05-21T01:18:00.835 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-05-21T01:18:00.882 INFO:teuthology.orchestra.run.smithi131.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-05-21T01:18:01.175 INFO:teuthology.orchestra.run.smithi131.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-05-21T01:18:01.184 INFO:teuthology.orchestra.run.smithi131.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-05-21T01:18:01.188 INFO:teuthology.orchestra.run.smithi131.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-05-21T01:18:01.237 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package bison. 2024-05-21T01:18:01.273 INFO:teuthology.orchestra.run.smithi131.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-05-21T01:18:01.311 INFO:teuthology.orchestra.run.smithi063.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140991 files and directories currently installed.) 2024-05-21T01:18:01.315 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-05-21T01:18:01.356 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-05-21T01:18:02.266 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-05-21T01:18:02.282 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-05-21T01:18:02.324 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-05-21T01:18:02.328 INFO:teuthology.orchestra.run.smithi131.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-05-21T01:18:02.332 INFO:teuthology.orchestra.run.smithi131.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-05-21T01:18:02.333 INFO:teuthology.orchestra.run.smithi131.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-05-21T01:18:02.338 INFO:teuthology.orchestra.run.smithi131.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-05-21T01:18:02.390 INFO:teuthology.orchestra.run.smithi131.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-05-21T01:18:02.400 INFO:teuthology.orchestra.run.smithi131.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-05-21T01:18:02.568 INFO:teuthology.orchestra.run.smithi131.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-05-21T01:18:02.652 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package dump. 2024-05-21T01:18:02.668 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-05-21T01:18:02.702 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking dump (0.4b47-3) ... 2024-05-21T01:18:02.964 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package indent. 2024-05-21T01:18:02.981 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-05-21T01:18:03.023 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-05-21T01:18:03.166 INFO:teuthology.orchestra.run.smithi131.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-05-21T01:18:03.167 INFO:teuthology.orchestra.run.smithi131.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-05-21T01:18:03.284 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-05-21T01:18:03.300 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-05-21T01:18:03.342 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-05-21T01:18:03.346 INFO:teuthology.orchestra.run.smithi131.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-05-21T01:18:03.347 INFO:teuthology.orchestra.run.smithi131.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-05-21T01:18:03.385 INFO:teuthology.orchestra.run.smithi131.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-05-21T01:18:03.447 INFO:teuthology.orchestra.run.smithi131.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-05-21T01:18:03.454 INFO:teuthology.orchestra.run.smithi131.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-05-21T01:18:03.455 INFO:teuthology.orchestra.run.smithi131.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-05-21T01:18:03.456 INFO:teuthology.orchestra.run.smithi131.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-05-21T01:18:03.457 INFO:teuthology.orchestra.run.smithi131.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-05-21T01:18:03.664 INFO:teuthology.orchestra.run.smithi131.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-05-21T01:18:03.670 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-05-21T01:18:03.687 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-05-21T01:18:03.729 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-05-21T01:18:04.015 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-05-21T01:18:04.031 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-05-21T01:18:04.074 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-05-21T01:18:04.075 INFO:teuthology.orchestra.run.smithi131.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-05-21T01:18:04.377 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libfl2:amd64. 2024-05-21T01:18:04.394 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-05-21T01:18:04.435 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-05-21T01:18:04.688 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-05-21T01:18:04.704 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-05-21T01:18:04.746 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-05-21T01:18:04.867 INFO:teuthology.orchestra.run.smithi131.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-05-21T01:18:04.868 INFO:teuthology.orchestra.run.smithi131.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-05-21T01:18:04.868 INFO:teuthology.orchestra.run.smithi131.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-05-21T01:18:04.868 INFO:teuthology.orchestra.run.smithi131.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-05-21T01:18:04.869 INFO:teuthology.orchestra.run.smithi131.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-05-21T01:18:04.869 INFO:teuthology.orchestra.run.smithi131.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-05-21T01:18:04.896 INFO:teuthology.orchestra.run.smithi131.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-05-21T01:18:04.897 INFO:teuthology.orchestra.run.smithi131.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-05-21T01:18:04.999 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libjson-perl. 2024-05-21T01:18:05.015 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-05-21T01:18:05.057 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-05-21T01:18:05.303 INFO:teuthology.orchestra.run.smithi131.stdout:Preconfiguring packages ... 2024-05-21T01:18:05.402 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libllvm14:amd64. 2024-05-21T01:18:05.419 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-05-21T01:18:05.461 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-05-21T01:18:05.500 INFO:teuthology.orchestra.run.smithi131.stdout:Fetched 55.7 MB in 5s (10.8 MB/s) 2024-05-21T01:18:05.788 INFO:teuthology.orchestra.run.smithi131.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138500 files and directories currently installed.) 2024-05-21T01:18:05.792 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-05-21T01:18:05.974 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-05-21T01:18:06.692 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-05-21T01:18:06.747 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-05-21T01:18:06.763 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-05-21T01:18:06.797 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-05-21T01:18:07.041 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libmbim-proxy. 2024-05-21T01:18:07.058 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-05-21T01:18:07.124 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-05-21T01:18:07.444 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-05-21T01:18:07.461 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-05-21T01:18:07.502 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-05-21T01:18:07.724 INFO:teuthology.orchestra.run.smithi131.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-05-21T01:18:07.839 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libndp0:amd64. 2024-05-21T01:18:07.855 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-05-21T01:18:07.897 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-05-21T01:18:08.063 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package flex. 2024-05-21T01:18:08.148 INFO:teuthology.orchestra.run.smithi131.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138500 files and directories currently installed.) 2024-05-21T01:18:08.153 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-05-21T01:18:08.166 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libnm0:amd64. 2024-05-21T01:18:08.183 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-05-21T01:18:08.211 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking flex (2.6.4-8build2) ... 2024-05-21T01:18:08.224 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-05-21T01:18:08.586 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libpq5:amd64. 2024-05-21T01:18:08.603 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-05-21T01:18:08.644 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-05-21T01:18:08.922 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-05-21T01:18:08.972 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-05-21T01:18:08.989 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-05-21T01:18:09.056 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-05-21T01:18:09.151 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-05-21T01:18:09.292 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libqmi-proxy. 2024-05-21T01:18:09.308 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-05-21T01:18:09.350 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-05-21T01:18:09.594 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-05-21T01:18:09.611 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-05-21T01:18:09.625 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-05-21T01:18:09.694 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-05-21T01:18:10.223 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-05-21T01:18:10.240 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-05-21T01:18:10.281 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-05-21T01:18:10.312 INFO:teuthology.orchestra.run.smithi131.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138573 files and directories currently installed.) 2024-05-21T01:18:10.316 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-05-21T01:18:10.451 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-05-21T01:18:10.601 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package modemmanager. 2024-05-21T01:18:10.618 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-05-21T01:18:10.651 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-05-21T01:18:10.963 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-05-21T01:18:11.075 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-05-21T01:18:11.317 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package network-manager. 2024-05-21T01:18:11.333 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-05-21T01:18:11.383 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-05-21T01:18:11.449 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-05-21T01:18:11.868 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package bison. 2024-05-21T01:18:11.958 INFO:teuthology.orchestra.run.smithi131.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138573 files and directories currently installed.) 2024-05-21T01:18:11.963 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-05-21T01:18:12.008 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package ppp. 2024-05-21T01:18:12.024 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-05-21T01:18:12.053 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-05-21T01:18:12.372 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-05-21T01:18:12.562 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-05-21T01:18:12.584 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-05-21T01:18:12.654 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-05-21T01:18:12.671 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package pptp-linux. 2024-05-21T01:18:12.685 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-05-21T01:18:12.729 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-05-21T01:18:13.015 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package network-manager-pptp. 2024-05-21T01:18:13.024 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package dump. 2024-05-21T01:18:13.031 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-05-21T01:18:13.046 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-05-21T01:18:13.074 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-05-21T01:18:13.090 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking dump (0.4b47-3) ... 2024-05-21T01:18:13.393 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package postgresql-client-common. 2024-05-21T01:18:13.409 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-05-21T01:18:13.419 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package indent. 2024-05-21T01:18:13.432 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-05-21T01:18:13.451 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking postgresql-client-common (238) ... 2024-05-21T01:18:13.502 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-05-21T01:18:13.780 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package postgresql-client-14. 2024-05-21T01:18:13.796 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-05-21T01:18:13.797 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-05-21T01:18:13.819 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-05-21T01:18:13.838 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-21T01:18:13.864 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-05-21T01:18:14.226 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-05-21T01:18:14.248 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-05-21T01:18:14.293 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-05-21T01:18:14.544 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package postgresql-common. 2024-05-21T01:18:14.560 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-05-21T01:18:14.579 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-05-21T01:18:14.592 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-05-21T01:18:14.621 INFO:teuthology.orchestra.run.smithi063.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-05-21T01:18:14.651 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking postgresql-common (238) ... 2024-05-21T01:18:14.654 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-05-21T01:18:15.033 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libfl2:amd64. 2024-05-21T01:18:15.055 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-05-21T01:18:15.099 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-05-21T01:18:15.118 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package postgresql-14. 2024-05-21T01:18:15.134 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-05-21T01:18:15.179 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-21T01:18:15.437 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-05-21T01:18:15.459 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-05-21T01:18:15.528 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-05-21T01:18:15.823 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libjson-perl. 2024-05-21T01:18:15.836 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-05-21T01:18:15.873 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-05-21T01:18:16.218 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libllvm14:amd64. 2024-05-21T01:18:16.241 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-05-21T01:18:16.285 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-05-21T01:18:16.296 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package postgresql. 2024-05-21T01:18:16.311 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-05-21T01:18:16.354 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking postgresql (14+238) ... 2024-05-21T01:18:16.581 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package postgresql-client. 2024-05-21T01:18:16.596 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-05-21T01:18:16.640 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking postgresql-client (14+238) ... 2024-05-21T01:18:16.909 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package postgresql-contrib. 2024-05-21T01:18:16.924 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-05-21T01:18:16.967 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking postgresql-contrib (14+238) ... 2024-05-21T01:18:17.261 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package tcl8.6. 2024-05-21T01:18:17.278 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-05-21T01:18:17.337 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-05-21T01:18:17.622 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package tcl. 2024-05-21T01:18:17.639 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-05-21T01:18:17.685 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-05-21T01:18:18.042 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package wpasupplicant. 2024-05-21T01:18:18.059 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-05-21T01:18:18.088 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-05-21T01:18:18.110 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-05-21T01:18:18.125 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-05-21T01:18:18.154 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-05-21T01:18:18.457 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libmbim-proxy. 2024-05-21T01:18:18.463 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-05-21T01:18:18.479 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-05-21T01:18:18.479 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-05-21T01:18:18.521 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-05-21T01:18:18.524 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-05-21T01:18:18.893 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-05-21T01:18:18.899 INFO:teuthology.orchestra.run.smithi063.stdout:Selecting previously unselected package usb-modeswitch. 2024-05-21T01:18:18.915 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-05-21T01:18:18.916 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-05-21T01:18:18.960 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-05-21T01:18:18.966 INFO:teuthology.orchestra.run.smithi063.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-05-21T01:18:19.261 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up postgresql-client-common (238) ... 2024-05-21T01:18:19.371 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libndp0:amd64. 2024-05-21T01:18:19.393 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-05-21T01:18:19.463 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-05-21T01:18:19.480 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up flex (2.6.4-8build2) ... 2024-05-21T01:18:19.606 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-05-21T01:18:19.741 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-05-21T01:18:19.816 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libnm0:amd64. 2024-05-21T01:18:19.838 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-05-21T01:18:19.867 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-05-21T01:18:19.883 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-05-21T01:18:19.993 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-05-21T01:18:20.136 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-21T01:18:20.252 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libpq5:amd64. 2024-05-21T01:18:20.274 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-05-21T01:18:20.470 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-05-21T01:18:21.007 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-05-21T01:18:21.029 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-05-21T01:18:21.096 INFO:teuthology.orchestra.run.smithi063.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-05-21T01:18:21.107 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-05-21T01:18:21.200 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-05-21T01:18:21.443 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libqmi-proxy. 2024-05-21T01:18:21.456 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-05-21T01:18:21.485 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-05-21T01:18:21.627 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-05-21T01:18:21.627 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-05-21T01:18:21.771 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-05-21T01:18:21.793 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-05-21T01:18:21.871 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-05-21T01:18:22.353 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-05-21T01:18:22.483 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-05-21T01:18:22.487 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-05-21T01:18:22.506 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-05-21T01:18:22.550 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-05-21T01:18:22.614 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-05-21T01:18:22.764 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-05-21T01:18:22.890 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-05-21T01:18:22.920 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package modemmanager. 2024-05-21T01:18:22.942 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-05-21T01:18:23.009 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-05-21T01:18:23.018 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-05-21T01:18:23.136 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-05-21T01:18:23.340 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-05-21T01:18:23.718 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package network-manager. 2024-05-21T01:18:23.740 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-05-21T01:18:23.793 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-05-21T01:18:23.992 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-05-21T01:18:24.126 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up dump (0.4b47-3) ... 2024-05-21T01:18:24.222 INFO:teuthology.orchestra.run.smithi063.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-05-21T01:18:24.303 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-05-21T01:18:24.429 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-05-21T01:18:24.518 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ppp. 2024-05-21T01:18:24.540 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-05-21T01:18:24.555 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up tcl (8.6.11+1build2) ... 2024-05-21T01:18:24.689 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libjson-perl (4.04000-1) ... 2024-05-21T01:18:24.790 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-05-21T01:18:24.835 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-05-21T01:18:24.871 INFO:teuthology.orchestra.run.smithi063.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-05-21T01:18:24.950 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-05-21T01:18:25.076 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-05-21T01:18:25.164 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package pptp-linux. 2024-05-21T01:18:25.177 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-05-21T01:18:25.214 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-05-21T01:18:25.277 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-05-21T01:18:25.403 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-05-21T01:18:25.529 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-05-21T01:18:25.568 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package network-manager-pptp. 2024-05-21T01:18:25.589 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-05-21T01:18:25.651 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-05-21T01:18:25.697 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up postgresql-client (14+238) ... 2024-05-21T01:18:25.814 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-05-21T01:18:26.062 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package postgresql-client-common. 2024-05-21T01:18:26.084 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-05-21T01:18:26.137 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking postgresql-client-common (238) ... 2024-05-21T01:18:26.411 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-05-21T01:18:26.412 INFO:teuthology.orchestra.run.smithi063.stdout:The following network interfaces were found in /etc/network/interfaces 2024-05-21T01:18:26.412 INFO:teuthology.orchestra.run.smithi063.stdout:which means they are currently configured by ifupdown: 2024-05-21T01:18:26.412 INFO:teuthology.orchestra.run.smithi063.stdout:- enp3s0f1 2024-05-21T01:18:26.412 INFO:teuthology.orchestra.run.smithi063.stdout:If you want to manage those interfaces with NetworkManager instead 2024-05-21T01:18:26.412 INFO:teuthology.orchestra.run.smithi063.stdout:remove their configuration from /etc/network/interfaces. 2024-05-21T01:18:26.412 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-05-21T01:18:26.533 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package postgresql-client-14. 2024-05-21T01:18:26.551 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-05-21T01:18:26.554 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-05-21T01:18:26.608 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-21T01:18:26.963 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-05-21T01:18:27.263 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package postgresql-common. 2024-05-21T01:18:27.285 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-05-21T01:18:27.347 INFO:teuthology.orchestra.run.smithi131.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-05-21T01:18:27.383 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-05-21T01:18:27.394 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking postgresql-common (238) ... 2024-05-21T01:18:27.896 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package postgresql-14. 2024-05-21T01:18:27.917 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-05-21T01:18:27.990 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-21T01:18:28.167 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-05-21T01:18:28.318 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-05-21T01:18:28.444 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-05-21T01:18:28.595 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up postgresql-common (238) ... 2024-05-21T01:18:29.574 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package postgresql. 2024-05-21T01:18:29.597 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-05-21T01:18:29.611 INFO:teuthology.orchestra.run.smithi063.stdout:Adding user postgres to group ssl-cert 2024-05-21T01:18:29.640 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking postgresql (14+238) ... 2024-05-21T01:18:29.820 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-05-21T01:18:29.820 INFO:teuthology.orchestra.run.smithi063.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-05-21T01:18:29.926 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package postgresql-client. 2024-05-21T01:18:29.948 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-05-21T01:18:30.018 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking postgresql-client (14+238) ... 2024-05-21T01:18:30.064 INFO:teuthology.orchestra.run.smithi063.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-05-21T01:18:30.064 INFO:teuthology.orchestra.run.smithi063.stdout:Removing obsolete dictionary files: 2024-05-21T01:18:30.287 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package postgresql-contrib. 2024-05-21T01:18:30.309 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-05-21T01:18:30.353 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking postgresql-contrib (14+238) ... 2024-05-21T01:18:30.706 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package tcl8.6. 2024-05-21T01:18:30.728 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-05-21T01:18:30.772 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-05-21T01:18:30.795 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-05-21T01:18:31.406 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-21T01:18:31.418 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package tcl. 2024-05-21T01:18:31.441 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-05-21T01:18:31.647 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-05-21T01:18:31.751 INFO:teuthology.orchestra.run.smithi063.stdout:Creating new PostgreSQL cluster 14/main ... 2024-05-21T01:18:31.769 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-05-21T01:18:31.813 INFO:teuthology.orchestra.run.smithi063.stdout:The files belonging to this database system will be owned by user "postgres". 2024-05-21T01:18:31.813 INFO:teuthology.orchestra.run.smithi063.stdout:This user must also own the server process. 2024-05-21T01:18:31.813 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-05-21T01:18:31.813 INFO:teuthology.orchestra.run.smithi063.stdout:The database cluster will be initialized with locale "en_US". 2024-05-21T01:18:31.813 INFO:teuthology.orchestra.run.smithi063.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-05-21T01:18:31.813 INFO:teuthology.orchestra.run.smithi063.stdout:The default text search configuration will be set to "english". 2024-05-21T01:18:31.813 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-05-21T01:18:31.813 INFO:teuthology.orchestra.run.smithi063.stdout:Data page checksums are disabled. 2024-05-21T01:18:31.814 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-05-21T01:18:31.814 INFO:teuthology.orchestra.run.smithi063.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-05-21T01:18:31.814 INFO:teuthology.orchestra.run.smithi063.stdout:creating subdirectories ... ok 2024-05-21T01:18:31.814 INFO:teuthology.orchestra.run.smithi063.stdout:selecting dynamic shared memory implementation ... posix 2024-05-21T01:18:31.839 INFO:teuthology.orchestra.run.smithi063.stdout:selecting default max_connections ... 100 2024-05-21T01:18:31.874 INFO:teuthology.orchestra.run.smithi063.stdout:selecting default shared_buffers ... 128MB 2024-05-21T01:18:31.888 INFO:teuthology.orchestra.run.smithi063.stdout:selecting default time zone ... Etc/UTC 2024-05-21T01:18:31.889 INFO:teuthology.orchestra.run.smithi063.stdout:creating configuration files ... ok 2024-05-21T01:18:32.022 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package wpasupplicant. 2024-05-21T01:18:32.044 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-05-21T01:18:32.064 INFO:teuthology.orchestra.run.smithi063.stdout:running bootstrap script ... ok 2024-05-21T01:18:32.087 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-05-21T01:18:32.525 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-05-21T01:18:32.548 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-05-21T01:18:32.592 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-05-21T01:18:32.779 INFO:teuthology.orchestra.run.smithi063.stdout:performing post-bootstrap initialization ... ok 2024-05-21T01:18:32.995 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package usb-modeswitch. 2024-05-21T01:18:33.017 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-05-21T01:18:33.078 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-05-21T01:18:33.405 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up postgresql-client-common (238) ... 2024-05-21T01:18:33.525 INFO:teuthology.orchestra.run.smithi063.stdout:syncing data to disk ... ok 2024-05-21T01:18:33.660 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up flex (2.6.4-8build2) ... 2024-05-21T01:18:33.786 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-05-21T01:18:33.924 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-05-21T01:18:34.054 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-05-21T01:18:34.074 INFO:teuthology.orchestra.run.smithi063.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-05-21T01:18:34.203 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-05-21T01:18:34.331 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-21T01:18:34.824 INFO:teuthology.orchestra.run.smithi131.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-05-21T01:18:34.912 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-05-21T01:18:35.301 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-05-21T01:18:35.301 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-05-21T01:18:35.823 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-05-21T01:18:35.992 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-05-21T01:18:36.118 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-05-21T01:18:36.269 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-05-21T01:18:36.395 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-05-21T01:18:36.554 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-05-21T01:18:36.655 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-05-21T01:18:37.020 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-05-21T01:18:37.146 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up postgresql-contrib (14+238) ... 2024-05-21T01:18:37.297 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up postgresql (14+238) ... 2024-05-21T01:18:37.379 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-05-21T01:18:37.406 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-05-21T01:18:37.524 INFO:teuthology.orchestra.run.smithi063.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-05-21T01:18:37.792 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-05-21T01:18:37.792 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-05-21T01:18:38.162 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-05-21T01:18:38.280 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up dump (0.4b47-3) ... 2024-05-21T01:18:38.374 INFO:teuthology.orchestra.run.smithi131.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-05-21T01:18:38.473 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-05-21T01:18:38.593 INFO:teuthology.orchestra.run.smithi063.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-05-21T01:18:38.616 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-05-21T01:18:38.693 INFO:teuthology.orchestra.run.smithi063.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-05-21T01:18:38.776 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up tcl (8.6.11+1build2) ... 2024-05-21T01:18:38.902 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libjson-perl (4.04000-1) ... 2024-05-21T01:18:39.012 INFO:teuthology.orchestra.run.smithi063.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-05-21T01:18:39.061 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-05-21T01:18:39.152 INFO:teuthology.orchestra.run.smithi131.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-05-21T01:18:39.197 INFO:teuthology.orchestra.run.smithi063.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-05-21T01:18:39.213 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-05-21T01:18:39.364 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-05-21T01:18:39.540 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-05-21T01:18:39.700 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-05-21T01:18:39.826 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-05-21T01:18:40.028 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up postgresql-client (14+238) ... 2024-05-21T01:18:40.187 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-05-21T01:18:40.616 INFO:teuthology.orchestra.run.smithi063.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-05-21T01:18:40.697 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-21T01:18:40.697 INFO:teuthology.orchestra.run.smithi131.stdout:The following network interfaces were found in /etc/network/interfaces 2024-05-21T01:18:40.697 INFO:teuthology.orchestra.run.smithi131.stdout:which means they are currently configured by ifupdown: 2024-05-21T01:18:40.697 INFO:teuthology.orchestra.run.smithi131.stdout:- enp3s0f1 2024-05-21T01:18:40.697 INFO:teuthology.orchestra.run.smithi131.stdout:If you want to manage those interfaces with NetworkManager instead 2024-05-21T01:18:40.697 INFO:teuthology.orchestra.run.smithi131.stdout:remove their configuration from /etc/network/interfaces. 2024-05-21T01:18:40.697 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-21T01:18:40.707 INFO:teuthology.orchestra.run.smithi063.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-05-21T01:18:40.819 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-05-21T01:18:41.165 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-05-21T01:18:41.248 INFO:teuthology.orchestra.run.smithi063.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-05-21T01:18:41.255 DEBUG:teuthology.parallel:result is None 2024-05-21T01:18:41.516 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-05-21T01:18:42.082 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-05-21T01:18:42.267 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-05-21T01:18:42.393 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-05-21T01:18:42.561 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up postgresql-common (238) ... 2024-05-21T01:18:43.502 INFO:teuthology.orchestra.run.smithi131.stdout:Adding user postgres to group ssl-cert 2024-05-21T01:18:43.680 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-21T01:18:43.680 INFO:teuthology.orchestra.run.smithi131.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-05-21T01:18:43.848 INFO:teuthology.orchestra.run.smithi131.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-05-21T01:18:43.849 INFO:teuthology.orchestra.run.smithi131.stdout:Removing obsolete dictionary files: 2024-05-21T01:18:44.447 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-05-21T01:18:44.896 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-21T01:18:45.231 INFO:teuthology.orchestra.run.smithi131.stdout:Creating new PostgreSQL cluster 14/main ... 2024-05-21T01:18:45.244 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-05-21T01:18:45.282 INFO:teuthology.orchestra.run.smithi131.stdout:The files belonging to this database system will be owned by user "postgres". 2024-05-21T01:18:45.282 INFO:teuthology.orchestra.run.smithi131.stdout:This user must also own the server process. 2024-05-21T01:18:45.282 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-21T01:18:45.282 INFO:teuthology.orchestra.run.smithi131.stdout:The database cluster will be initialized with locale "en_US". 2024-05-21T01:18:45.282 INFO:teuthology.orchestra.run.smithi131.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-05-21T01:18:45.282 INFO:teuthology.orchestra.run.smithi131.stdout:The default text search configuration will be set to "english". 2024-05-21T01:18:45.282 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-21T01:18:45.282 INFO:teuthology.orchestra.run.smithi131.stdout:Data page checksums are disabled. 2024-05-21T01:18:45.283 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-21T01:18:45.283 INFO:teuthology.orchestra.run.smithi131.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-05-21T01:18:45.283 INFO:teuthology.orchestra.run.smithi131.stdout:creating subdirectories ... ok 2024-05-21T01:18:45.283 INFO:teuthology.orchestra.run.smithi131.stdout:selecting dynamic shared memory implementation ... posix 2024-05-21T01:18:45.296 INFO:teuthology.orchestra.run.smithi131.stdout:selecting default max_connections ... 100 2024-05-21T01:18:45.313 INFO:teuthology.orchestra.run.smithi131.stdout:selecting default shared_buffers ... 128MB 2024-05-21T01:18:45.320 INFO:teuthology.orchestra.run.smithi131.stdout:selecting default time zone ... Etc/UTC 2024-05-21T01:18:45.321 INFO:teuthology.orchestra.run.smithi131.stdout:creating configuration files ... ok 2024-05-21T01:18:45.429 INFO:teuthology.orchestra.run.smithi131.stdout:running bootstrap script ... ok 2024-05-21T01:18:46.181 INFO:teuthology.orchestra.run.smithi131.stdout:performing post-bootstrap initialization ... ok 2024-05-21T01:18:47.065 INFO:teuthology.orchestra.run.smithi131.stdout:syncing data to disk ... ok 2024-05-21T01:18:47.474 INFO:teuthology.orchestra.run.smithi131.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-05-21T01:18:50.411 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-05-21T01:18:50.537 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up postgresql-contrib (14+238) ... 2024-05-21T01:18:50.697 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up postgresql (14+238) ... 2024-05-21T01:18:50.823 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-05-21T01:18:50.974 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-05-21T01:18:51.223 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-05-21T01:18:51.223 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-05-21T01:18:51.779 INFO:teuthology.orchestra.run.smithi131.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-05-21T01:18:51.913 INFO:teuthology.orchestra.run.smithi131.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-05-21T01:18:52.232 INFO:teuthology.orchestra.run.smithi131.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-05-21T01:18:52.418 INFO:teuthology.orchestra.run.smithi131.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-05-21T01:18:53.963 INFO:teuthology.orchestra.run.smithi131.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-05-21T01:18:54.063 INFO:teuthology.orchestra.run.smithi131.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-05-21T01:18:54.680 INFO:teuthology.orchestra.run.smithi131.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-05-21T01:18:54.685 DEBUG:teuthology.parallel:result is None 2024-05-21T01:18:54.685 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=0051ea03417a66dbfd5a17ea02c9049bcda16863 2024-05-21T01:18:54.829 DEBUG:teuthology.orchestra.run.smithi063:> dpkg-query -W -f '${Version}' ceph 2024-05-21T01:18:54.854 INFO:teuthology.orchestra.run.smithi063.stdout:19.0.0-3830-g0051ea03-1jammy 2024-05-21T01:18:54.854 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3830-g0051ea03-1jammy 2024-05-21T01:18:54.855 INFO:teuthology.task.install:The correct ceph version 19.0.0-3830-g0051ea03-1jammy is installed. 2024-05-21T01:18:54.856 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=0051ea03417a66dbfd5a17ea02c9049bcda16863 2024-05-21T01:18:54.994 DEBUG:teuthology.orchestra.run.smithi131:> dpkg-query -W -f '${Version}' ceph 2024-05-21T01:18:55.013 INFO:teuthology.orchestra.run.smithi131.stdout:19.0.0-3830-g0051ea03-1jammy 2024-05-21T01:18:55.013 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3830-g0051ea03-1jammy 2024-05-21T01:18:55.013 INFO:teuthology.task.install:The correct ceph version 19.0.0-3830-g0051ea03-1jammy is installed. 2024-05-21T01:18:55.015 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-21T01:18:55.015 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-05-21T01:18:55.015 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-21T01:18:55.038 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-05-21T01:18:55.038 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-21T01:18:55.066 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-21T01:18:55.066 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-05-21T01:18:55.066 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/usr/bin/daemon-helper 2024-05-21T01:18:55.101 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-21T01:18:55.164 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-05-21T01:18:55.165 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/usr/bin/daemon-helper 2024-05-21T01:18:55.178 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-21T01:18:55.233 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-21T01:18:55.233 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-05-21T01:18:55.233 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-21T01:18:55.254 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-21T01:18:55.316 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-05-21T01:18:55.316 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-21T01:18:55.330 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-21T01:18:55.385 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-21T01:18:55.386 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-05-21T01:18:55.386 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/usr/bin/stdin-killer 2024-05-21T01:18:55.407 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-21T01:18:55.469 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-05-21T01:18:55.469 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/usr/bin/stdin-killer 2024-05-21T01:18:55.482 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-21T01:18:55.538 INFO:teuthology.run_tasks:Running task ceph... 2024-05-21T01:18:55.610 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-05-21T01:18:55.611 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 777 /var/log/ceph 2024-05-21T01:18:55.614 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 777 /var/log/ceph 2024-05-21T01:18:55.632 INFO:tasks.ceph:Disabling ceph logrotate... 2024-05-21T01:18:55.632 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-21T01:18:55.678 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-21T01:18:55.696 INFO:tasks.ceph:Creating extra log directories... 2024-05-21T01:18:55.696 DEBUG:teuthology.orchestra.run.smithi063:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-21T01:18:55.743 DEBUG:teuthology.orchestra.run.smithi131:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-21T01:18:55.768 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-05-21T01:18:55.768 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-05-21T01:18:55.768 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-05-21T01:18:55.768 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-05-21T01:18:55.768 DEBUG:teuthology.orchestra.run.smithi063:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-21T01:18:55.816 DEBUG:teuthology.orchestra.run.smithi063:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-21T01:18:55.911 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-05-21T01:18:55.911 DEBUG:teuthology.orchestra.run.smithi131:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-21T01:18:55.916 DEBUG:teuthology.orchestra.run.smithi131:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-21T01:18:55.996 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-05-21T01:18:55.996 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-05-21T01:18:55.996 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/leonidus-2024-05-20_23:57:18-fs-wip-lusov-quiesce-no-remote-ap-distro-default-smithi/7717467', 'branch': 'wip-lusov-quiesce-no-remote-ap', 'description': 'fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/with-quiesce 2-workunit/suites/iozone}}', 'email': None, 'first_in_suite': False, 'job_id': '7717467', 'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'leonidus-2024-05-20_23:57:18-fs-wip-lusov-quiesce-no-remote-ap-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-lusov-quiesce-no-remote-ap'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'sha1': '0051ea03417a66dbfd5a17ea02c9049bcda16863'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'check-counter': {'counters': {'mds': ['mds.exported', 'mds.imported']}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '0051ea03417a66dbfd5a17ea02c9049bcda16863'}}, 'kclient': {'syntax': 'v1'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-lusov-quiesce-no-remote-ap', 'sha1': '0051ea03417a66dbfd5a17ea02c9049bcda16863'}}, 'owner': 'scheduled_leonidus@teuthology', 'priority': 70, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 2958, 'sha1': '0051ea03417a66dbfd5a17ea02c9049bcda16863', 'sleep_before_teardown': 0, 'subset': '419/111111', 'suite': 'fs', 'suite_branch': 'wip-lusov-quiesce-no-remote-ap', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_0051ea03417a66dbfd5a17ea02c9049bcda16863/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '0051ea03417a66dbfd5a17ea02c9049bcda16863', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi063.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ8ev5fIYgOC5H8Ncawz/WAfp1vxLJOOpleLo2T41CWN9fS/2rpsU897z2bQn2ho6sVvc22XgZRkBKTNGWKQDEw=', 'smithi131.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH3WGAfy00T2Xg3OBCTXPer+e4tc6s++Pg42csDCig3wb5RsC8sHNTfeuJyOOX7/CvbQ62vA2nv2nkZa1+KL754='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '0051ea03417a66dbfd5a17ea02c9049bcda16863'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'sha1': '0051ea03417a66dbfd5a17ea02c9049bcda16863', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'quiescer': None}, {'workunit': {'clients': {'all': ['suites/iozone.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'install-fix', 'teuthology_sha1': '4fbe5e8dc899215f216853b8569a107d8be8861d', 'timestamp': '2024-05-20_23:57:18', 'tube': 'smithi', 'user': 'leonidus', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2698841'} 2024-05-21T01:18:55.997 DEBUG:teuthology.orchestra.run.smithi063:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-21T01:18:56.001 DEBUG:teuthology.orchestra.run.smithi131:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-21T01:18:56.039 DEBUG:teuthology.orchestra.run.smithi063:> sudo install -d -m0777 -- /var/run/ceph 2024-05-21T01:18:56.050 DEBUG:teuthology.orchestra.run.smithi131:> sudo install -d -m0777 -- /var/run/ceph 2024-05-21T01:18:56.094 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-05-21T01:18:56.095 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/scratch_devs of=/dev/stdout 2024-05-21T01:18:56.124 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-21T01:18:56.124 DEBUG:teuthology.orchestra.run.smithi063:> stat /dev/vg_nvme/lv_1 2024-05-21T01:18:56.177 INFO:teuthology.orchestra.run.smithi063.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-21T01:18:56.177 INFO:teuthology.orchestra.run.smithi063.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-21T01:18:56.177 INFO:teuthology.orchestra.run.smithi063.stdout:Device: 6h/6d Inode: 899 Links: 1 2024-05-21T01:18:56.177 INFO:teuthology.orchestra.run.smithi063.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-21T01:18:56.177 INFO:teuthology.orchestra.run.smithi063.stdout:Access: 2024-05-21 01:12:15.066106127 +0000 2024-05-21T01:18:56.177 INFO:teuthology.orchestra.run.smithi063.stdout:Modify: 2024-05-21 01:12:14.790108592 +0000 2024-05-21T01:18:56.177 INFO:teuthology.orchestra.run.smithi063.stdout:Change: 2024-05-21 01:12:14.790108592 +0000 2024-05-21T01:18:56.177 INFO:teuthology.orchestra.run.smithi063.stdout: Birth: 2024-05-21 01:12:14.790108592 +0000 2024-05-21T01:18:56.177 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-21T01:18:56.239 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records in 2024-05-21T01:18:56.239 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records out 2024-05-21T01:18:56.239 INFO:teuthology.orchestra.run.smithi063.stderr:512 bytes copied, 0.000660257 s, 775 kB/s 2024-05-21T01:18:56.241 DEBUG:teuthology.orchestra.run.smithi063:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-21T01:18:56.294 DEBUG:teuthology.orchestra.run.smithi063:> stat /dev/vg_nvme/lv_2 2024-05-21T01:18:56.344 INFO:teuthology.orchestra.run.smithi063.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-21T01:18:56.344 INFO:teuthology.orchestra.run.smithi063.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-21T01:18:56.345 INFO:teuthology.orchestra.run.smithi063.stdout:Device: 6h/6d Inode: 918 Links: 1 2024-05-21T01:18:56.345 INFO:teuthology.orchestra.run.smithi063.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-21T01:18:56.345 INFO:teuthology.orchestra.run.smithi063.stdout:Access: 2024-05-21 01:12:15.654100875 +0000 2024-05-21T01:18:56.345 INFO:teuthology.orchestra.run.smithi063.stdout:Modify: 2024-05-21 01:12:15.386103268 +0000 2024-05-21T01:18:56.345 INFO:teuthology.orchestra.run.smithi063.stdout:Change: 2024-05-21 01:12:15.386103268 +0000 2024-05-21T01:18:56.345 INFO:teuthology.orchestra.run.smithi063.stdout: Birth: 2024-05-21 01:12:15.386103268 +0000 2024-05-21T01:18:56.345 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-21T01:18:56.407 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records in 2024-05-21T01:18:56.407 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records out 2024-05-21T01:18:56.407 INFO:teuthology.orchestra.run.smithi063.stderr:512 bytes copied, 0.000367656 s, 1.4 MB/s 2024-05-21T01:18:56.409 DEBUG:teuthology.orchestra.run.smithi063:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-21T01:18:56.462 DEBUG:teuthology.orchestra.run.smithi063:> stat /dev/vg_nvme/lv_3 2024-05-21T01:18:56.512 INFO:teuthology.orchestra.run.smithi063.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-21T01:18:56.513 INFO:teuthology.orchestra.run.smithi063.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-21T01:18:56.513 INFO:teuthology.orchestra.run.smithi063.stdout:Device: 6h/6d Inode: 932 Links: 1 2024-05-21T01:18:56.513 INFO:teuthology.orchestra.run.smithi063.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-21T01:18:56.513 INFO:teuthology.orchestra.run.smithi063.stdout:Access: 2024-05-21 01:12:16.210095908 +0000 2024-05-21T01:18:56.513 INFO:teuthology.orchestra.run.smithi063.stdout:Modify: 2024-05-21 01:12:15.954098194 +0000 2024-05-21T01:18:56.513 INFO:teuthology.orchestra.run.smithi063.stdout:Change: 2024-05-21 01:12:15.954098194 +0000 2024-05-21T01:18:56.513 INFO:teuthology.orchestra.run.smithi063.stdout: Birth: 2024-05-21 01:12:15.954098194 +0000 2024-05-21T01:18:56.513 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-21T01:18:56.576 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records in 2024-05-21T01:18:56.576 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records out 2024-05-21T01:18:56.576 INFO:teuthology.orchestra.run.smithi063.stderr:512 bytes copied, 0.000384628 s, 1.3 MB/s 2024-05-21T01:18:56.578 DEBUG:teuthology.orchestra.run.smithi063:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-21T01:18:56.630 DEBUG:teuthology.orchestra.run.smithi063:> stat /dev/vg_nvme/lv_4 2024-05-21T01:18:56.680 INFO:teuthology.orchestra.run.smithi063.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-21T01:18:56.681 INFO:teuthology.orchestra.run.smithi063.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-21T01:18:56.681 INFO:teuthology.orchestra.run.smithi063.stdout:Device: 6h/6d Inode: 951 Links: 1 2024-05-21T01:18:56.681 INFO:teuthology.orchestra.run.smithi063.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-21T01:18:56.681 INFO:teuthology.orchestra.run.smithi063.stdout:Access: 2024-05-21 01:12:16.770090907 +0000 2024-05-21T01:18:56.681 INFO:teuthology.orchestra.run.smithi063.stdout:Modify: 2024-05-21 01:12:16.506093263 +0000 2024-05-21T01:18:56.681 INFO:teuthology.orchestra.run.smithi063.stdout:Change: 2024-05-21 01:12:16.506093263 +0000 2024-05-21T01:18:56.681 INFO:teuthology.orchestra.run.smithi063.stdout: Birth: 2024-05-21 01:12:16.506093263 +0000 2024-05-21T01:18:56.681 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-21T01:18:56.747 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records in 2024-05-21T01:18:56.747 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records out 2024-05-21T01:18:56.747 INFO:teuthology.orchestra.run.smithi063.stderr:512 bytes copied, 0.000382167 s, 1.3 MB/s 2024-05-21T01:18:56.749 DEBUG:teuthology.orchestra.run.smithi063:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-21T01:18:56.806 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-21T01:18:56.807 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-05-21T01:18:56.807 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/scratch_devs of=/dev/stdout 2024-05-21T01:18:56.813 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-21T01:18:56.813 DEBUG:teuthology.orchestra.run.smithi131:> stat /dev/vg_nvme/lv_1 2024-05-21T01:18:56.859 INFO:teuthology.orchestra.run.smithi131.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-21T01:18:56.859 INFO:teuthology.orchestra.run.smithi131.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-21T01:18:56.859 INFO:teuthology.orchestra.run.smithi131.stdout:Device: 5h/5d Inode: 892 Links: 1 2024-05-21T01:18:56.859 INFO:teuthology.orchestra.run.smithi131.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-21T01:18:56.859 INFO:teuthology.orchestra.run.smithi131.stdout:Access: 2024-05-21 01:12:15.062040029 +0000 2024-05-21T01:18:56.859 INFO:teuthology.orchestra.run.smithi131.stdout:Modify: 2024-05-21 01:12:14.790042460 +0000 2024-05-21T01:18:56.860 INFO:teuthology.orchestra.run.smithi131.stdout:Change: 2024-05-21 01:12:14.790042460 +0000 2024-05-21T01:18:56.860 INFO:teuthology.orchestra.run.smithi131.stdout: Birth: - 2024-05-21T01:18:56.860 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-21T01:18:56.913 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records in 2024-05-21T01:18:56.914 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records out 2024-05-21T01:18:56.914 INFO:teuthology.orchestra.run.smithi131.stderr:512 bytes copied, 0.000586858 s, 872 kB/s 2024-05-21T01:18:56.915 DEBUG:teuthology.orchestra.run.smithi131:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-21T01:18:56.965 DEBUG:teuthology.orchestra.run.smithi131:> stat /dev/vg_nvme/lv_2 2024-05-21T01:18:57.015 INFO:teuthology.orchestra.run.smithi131.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-21T01:18:57.015 INFO:teuthology.orchestra.run.smithi131.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-21T01:18:57.015 INFO:teuthology.orchestra.run.smithi131.stdout:Device: 5h/5d Inode: 912 Links: 1 2024-05-21T01:18:57.015 INFO:teuthology.orchestra.run.smithi131.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-21T01:18:57.015 INFO:teuthology.orchestra.run.smithi131.stdout:Access: 2024-05-21 01:12:15.598035242 +0000 2024-05-21T01:18:57.015 INFO:teuthology.orchestra.run.smithi131.stdout:Modify: 2024-05-21 01:12:15.338037564 +0000 2024-05-21T01:18:57.015 INFO:teuthology.orchestra.run.smithi131.stdout:Change: 2024-05-21 01:12:15.338037564 +0000 2024-05-21T01:18:57.015 INFO:teuthology.orchestra.run.smithi131.stdout: Birth: - 2024-05-21T01:18:57.016 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-21T01:18:57.069 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records in 2024-05-21T01:18:57.069 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records out 2024-05-21T01:18:57.069 INFO:teuthology.orchestra.run.smithi131.stderr:512 bytes copied, 0.00055753 s, 918 kB/s 2024-05-21T01:18:57.071 DEBUG:teuthology.orchestra.run.smithi131:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-21T01:18:57.125 DEBUG:teuthology.orchestra.run.smithi131:> stat /dev/vg_nvme/lv_3 2024-05-21T01:18:57.174 INFO:teuthology.orchestra.run.smithi131.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-21T01:18:57.175 INFO:teuthology.orchestra.run.smithi131.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-21T01:18:57.175 INFO:teuthology.orchestra.run.smithi131.stdout:Device: 5h/5d Inode: 921 Links: 1 2024-05-21T01:18:57.175 INFO:teuthology.orchestra.run.smithi131.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-21T01:18:57.175 INFO:teuthology.orchestra.run.smithi131.stdout:Access: 2024-05-21 01:12:16.134030455 +0000 2024-05-21T01:18:57.175 INFO:teuthology.orchestra.run.smithi131.stdout:Modify: 2024-05-21 01:12:15.842033063 +0000 2024-05-21T01:18:57.175 INFO:teuthology.orchestra.run.smithi131.stdout:Change: 2024-05-21 01:12:15.842033063 +0000 2024-05-21T01:18:57.175 INFO:teuthology.orchestra.run.smithi131.stdout: Birth: - 2024-05-21T01:18:57.175 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-21T01:18:57.229 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records in 2024-05-21T01:18:57.229 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records out 2024-05-21T01:18:57.229 INFO:teuthology.orchestra.run.smithi131.stderr:512 bytes copied, 0.000469727 s, 1.1 MB/s 2024-05-21T01:18:57.230 DEBUG:teuthology.orchestra.run.smithi131:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-21T01:18:57.280 DEBUG:teuthology.orchestra.run.smithi131:> stat /dev/vg_nvme/lv_4 2024-05-21T01:18:57.327 INFO:teuthology.orchestra.run.smithi131.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-21T01:18:57.327 INFO:teuthology.orchestra.run.smithi131.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-21T01:18:57.327 INFO:teuthology.orchestra.run.smithi131.stdout:Device: 5h/5d Inode: 939 Links: 1 2024-05-21T01:18:57.327 INFO:teuthology.orchestra.run.smithi131.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-21T01:18:57.327 INFO:teuthology.orchestra.run.smithi131.stdout:Access: 2024-05-21 01:12:16.614026167 +0000 2024-05-21T01:18:57.327 INFO:teuthology.orchestra.run.smithi131.stdout:Modify: 2024-05-21 01:12:16.382028239 +0000 2024-05-21T01:18:57.327 INFO:teuthology.orchestra.run.smithi131.stdout:Change: 2024-05-21 01:12:16.382028239 +0000 2024-05-21T01:18:57.327 INFO:teuthology.orchestra.run.smithi131.stdout: Birth: - 2024-05-21T01:18:57.328 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-21T01:18:57.380 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records in 2024-05-21T01:18:57.381 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records out 2024-05-21T01:18:57.381 INFO:teuthology.orchestra.run.smithi131.stderr:512 bytes copied, 0.000516004 s, 992 kB/s 2024-05-21T01:18:57.382 DEBUG:teuthology.orchestra.run.smithi131:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-21T01:18:57.432 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-21T01:18:57.432 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi063.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi131.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-21T01:18:57.432 INFO:tasks.ceph:Generating config... 2024-05-21T01:18:57.434 INFO:tasks.ceph:[client] client mount timeout = 600 2024-05-21T01:18:57.434 INFO:tasks.ceph:[client] client_shutdown_timeout = 120 2024-05-21T01:18:57.434 INFO:tasks.ceph:[client] debug client = 20 2024-05-21T01:18:57.434 INFO:tasks.ceph:[client] debug ms = 1 2024-05-21T01:18:57.434 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-05-21T01:18:57.434 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-05-21T01:18:57.434 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-05-21T01:18:57.434 INFO:tasks.ceph:[mds] debug mds = 20 2024-05-21T01:18:57.434 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-05-21T01:18:57.434 INFO:tasks.ceph:[mds] debug ms = 1 2024-05-21T01:18:57.434 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2024-05-21T01:18:57.435 INFO:tasks.ceph:[mds] mds bal merge size = 5 2024-05-21T01:18:57.435 INFO:tasks.ceph:[mds] mds bal split bits = 3 2024-05-21T01:18:57.435 INFO:tasks.ceph:[mds] mds bal split size = 100 2024-05-21T01:18:57.435 INFO:tasks.ceph:[mds] mds debug frag = True 2024-05-21T01:18:57.435 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-05-21T01:18:57.435 INFO:tasks.ceph:[mds] mds oft prefetch dirfrags = True 2024-05-21T01:18:57.435 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-05-21T01:18:57.435 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-05-21T01:18:57.435 INFO:tasks.ceph:[mds] mds_dir_prefetch = True 2024-05-21T01:18:57.435 INFO:tasks.ceph:[mds] mds_sleep_rank_change = 5000000.0 2024-05-21T01:18:57.435 INFO:tasks.ceph:[mds] mon client directed command retry = 5 2024-05-21T01:18:57.435 INFO:tasks.ceph:[mds] ms inject delay max = 1 2024-05-21T01:18:57.435 INFO:tasks.ceph:[mds] ms inject delay probability = 0.005 2024-05-21T01:18:57.435 INFO:tasks.ceph:[mds] ms inject delay type = client mds osd 2024-05-21T01:18:57.436 INFO:tasks.ceph:[mds] ms inject socket failures = 2500 2024-05-21T01:18:57.436 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-05-21T01:18:57.436 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-05-21T01:18:57.436 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-05-21T01:18:57.436 INFO:tasks.ceph:[mgr] debug client = 20 2024-05-21T01:18:57.436 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-05-21T01:18:57.436 INFO:tasks.ceph:[mgr] debug ms = 1 2024-05-21T01:18:57.436 INFO:tasks.ceph:[mon] debug mon = 20 2024-05-21T01:18:57.436 INFO:tasks.ceph:[mon] debug ms = 1 2024-05-21T01:18:57.436 INFO:tasks.ceph:[mon] debug paxos = 20 2024-05-21T01:18:57.436 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-05-21T01:18:57.436 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-05-21T01:18:57.436 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-05-21T01:18:57.436 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-05-21T01:18:57.437 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-05-21T01:18:57.437 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-05-21T01:18:57.437 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-05-21T01:18:57.437 INFO:tasks.ceph:[osd] debug ms = 1 2024-05-21T01:18:57.437 INFO:tasks.ceph:[osd] debug osd = 20 2024-05-21T01:18:57.437 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-05-21T01:18:57.437 INFO:tasks.ceph:[osd] mon client directed command retry = 5 2024-05-21T01:18:57.437 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-05-21T01:18:57.437 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-05-21T01:18:57.437 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-05-21T01:18:57.437 INFO:tasks.ceph:[osd] ms inject delay max = 1 2024-05-21T01:18:57.437 INFO:tasks.ceph:[osd] ms inject delay probability = 0.005 2024-05-21T01:18:57.437 INFO:tasks.ceph:[osd] ms inject delay type = client mds 2024-05-21T01:18:57.438 INFO:tasks.ceph:[osd] ms inject socket failures = 2500 2024-05-21T01:18:57.438 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-05-21T01:18:57.438 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-05-21T01:18:57.438 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-05-21T01:18:57.438 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-05-21T01:18:57.438 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-05-21T01:18:57.438 INFO:tasks.ceph:Setting up mon.a... 2024-05-21T01:18:57.438 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-05-21T01:18:57.486 INFO:teuthology.orchestra.run.smithi063.stdout:creating /etc/ceph/ceph.keyring 2024-05-21T01:18:57.497 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-05-21T01:18:57.547 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-21T01:18:57.567 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.63'), ('mon.b', '172.21.15.131'), ('mon.c', '[v2:172.21.15.131:3301,v1:172.21.15.131:6790]')] 2024-05-21T01:18:57.568 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.63,172.21.15.131,[v2:172.21.15.131:3301,v1:172.21.15.131:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-05-21T01:18:57.569 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-05-21T01:18:57.569 DEBUG:teuthology.orchestra.run.smithi063:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-05-21T01:18:57.616 DEBUG:teuthology.orchestra.run.smithi063:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.63 --add b 172.21.15.131 --addv c '[v2:172.21.15.131:3301,v1:172.21.15.131:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-05-21T01:18:57.703 INFO:teuthology.orchestra.run.smithi063.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-05-21T01:18:57.703 INFO:teuthology.orchestra.run.smithi063.stdout:monmaptool: generated fsid 9a7cbd84-ceb2-41c8-8b6e-ab931f86c51a 2024-05-21T01:18:57.703 INFO:teuthology.orchestra.run.smithi063.stdout:setting min_mon_release = quincy 2024-05-21T01:18:57.703 INFO:teuthology.orchestra.run.smithi063.stdout:epoch 0 2024-05-21T01:18:57.703 INFO:teuthology.orchestra.run.smithi063.stdout:fsid 9a7cbd84-ceb2-41c8-8b6e-ab931f86c51a 2024-05-21T01:18:57.703 INFO:teuthology.orchestra.run.smithi063.stdout:last_changed 2024-05-21T01:18:57.703451+0000 2024-05-21T01:18:57.703 INFO:teuthology.orchestra.run.smithi063.stdout:created 2024-05-21T01:18:57.703451+0000 2024-05-21T01:18:57.703 INFO:teuthology.orchestra.run.smithi063.stdout:min_mon_release 17 (quincy) 2024-05-21T01:18:57.703 INFO:teuthology.orchestra.run.smithi063.stdout:election_strategy: 1 2024-05-21T01:18:57.704 INFO:teuthology.orchestra.run.smithi063.stdout:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2024-05-21T01:18:57.704 INFO:teuthology.orchestra.run.smithi063.stdout:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2024-05-21T01:18:57.704 INFO:teuthology.orchestra.run.smithi063.stdout:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.c 2024-05-21T01:18:57.704 INFO:teuthology.orchestra.run.smithi063.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-05-21T01:18:57.706 DEBUG:teuthology.orchestra.run.smithi063:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-05-21T01:18:57.714 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 9a7cbd84-ceb2-41c8-8b6e-ab931f86c51a... 2024-05-21T01:18:57.715 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-21T01:18:57.762 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-21T01:18:57.793 INFO:teuthology.orchestra.run.smithi131.stdout:[global] 2024-05-21T01:18:57.794 INFO:teuthology.orchestra.run.smithi131.stdout: chdir = "" 2024-05-21T01:18:57.794 INFO:teuthology.orchestra.run.smithi131.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-21T01:18:57.794 INFO:teuthology.orchestra.run.smithi131.stdout: auth supported = cephx 2024-05-21T01:18:57.794 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-21T01:18:57.794 INFO:teuthology.orchestra.run.smithi131.stdout: filestore xattr use omap = true 2024-05-21T01:18:57.794 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-21T01:18:57.794 INFO:teuthology.orchestra.run.smithi131.stdout: mon clock drift allowed = 1.000 2024-05-21T01:18:57.794 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-21T01:18:57.794 INFO:teuthology.orchestra.run.smithi131.stdout: osd crush chooseleaf type = 0 2024-05-21T01:18:57.794 INFO:teuthology.orchestra.run.smithi131.stdout: auth debug = true 2024-05-21T01:18:57.794 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-21T01:18:57.794 INFO:teuthology.orchestra.run.smithi131.stdout: ms die on old message = true 2024-05-21T01:18:57.794 INFO:teuthology.orchestra.run.smithi131.stdout: ms die on bug = true 2024-05-21T01:18:57.795 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-21T01:18:57.795 INFO:teuthology.orchestra.run.smithi131.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-21T01:18:57.795 INFO:teuthology.orchestra.run.smithi131.stdout: mon pg warn max object skew = 0 2024-05-21T01:18:57.795 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-21T01:18:57.795 INFO:teuthology.orchestra.run.smithi131.stdout: # disable pg_autoscaler by default for new pools 2024-05-21T01:18:57.795 INFO:teuthology.orchestra.run.smithi131.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-21T01:18:57.795 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-21T01:18:57.795 INFO:teuthology.orchestra.run.smithi131.stdout: osd pool default size = 2 2024-05-21T01:18:57.795 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-21T01:18:57.795 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd allow primary affinity = true 2024-05-21T01:18:57.795 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd allow pg remap = true 2024-05-21T01:18:57.795 INFO:teuthology.orchestra.run.smithi131.stdout: mon warn on legacy crush tunables = false 2024-05-21T01:18:57.795 INFO:teuthology.orchestra.run.smithi131.stdout: mon warn on crush straw calc version zero = false 2024-05-21T01:18:57.796 INFO:teuthology.orchestra.run.smithi131.stdout: mon warn on no sortbitwise = false 2024-05-21T01:18:57.796 INFO:teuthology.orchestra.run.smithi131.stdout: mon warn on osd down out interval zero = false 2024-05-21T01:18:57.796 INFO:teuthology.orchestra.run.smithi131.stdout: mon warn on too few osds = false 2024-05-21T01:18:57.796 INFO:teuthology.orchestra.run.smithi131.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-21T01:18:57.796 INFO:teuthology.orchestra.run.smithi131.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-21T01:18:57.796 INFO:teuthology.orchestra.run.smithi131.stdout: mon_allow_pool_size_one = true 2024-05-21T01:18:57.796 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-21T01:18:57.796 INFO:teuthology.orchestra.run.smithi131.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-21T01:18:57.796 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-21T01:18:57.796 INFO:teuthology.orchestra.run.smithi131.stdout: osd default data pool replay window = 5 2024-05-21T01:18:57.796 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-21T01:18:57.796 INFO:teuthology.orchestra.run.smithi131.stdout: mon allow pool delete = true 2024-05-21T01:18:57.796 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-21T01:18:57.797 INFO:teuthology.orchestra.run.smithi131.stdout: mon cluster log file level = debug 2024-05-21T01:18:57.797 INFO:teuthology.orchestra.run.smithi131.stdout: debug asserts on shutdown = true 2024-05-21T01:18:57.798 INFO:teuthology.orchestra.run.smithi131.stdout: mon health detail to clog = false 2024-05-21T01:18:57.798 INFO:teuthology.orchestra.run.smithi131.stdout: mon host = "172.21.15.63,172.21.15.131,[v2:172.21.15.131:3301,v1:172.21.15.131:6790]" 2024-05-21T01:18:57.798 INFO:teuthology.orchestra.run.smithi131.stdout: ms die on skipped message = False 2024-05-21T01:18:57.798 INFO:teuthology.orchestra.run.smithi131.stdout: fsid = 9a7cbd84-ceb2-41c8-8b6e-ab931f86c51a 2024-05-21T01:18:57.798 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-21T01:18:57.798 INFO:teuthology.orchestra.run.smithi131.stdout:[osd] 2024-05-21T01:18:57.798 INFO:teuthology.orchestra.run.smithi131.stdout: osd journal size = 100 2024-05-21T01:18:57.798 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-21T01:18:57.798 INFO:teuthology.orchestra.run.smithi131.stdout: osd scrub load threshold = 5.0 2024-05-21T01:18:57.798 INFO:teuthology.orchestra.run.smithi131.stdout: osd scrub max interval = 600 2024-05-21T01:18:57.798 INFO:teuthology.orchestra.run.smithi131.stdout: osd mclock profile = high_recovery_ops 2024-05-21T01:18:57.798 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-21T01:18:57.799 INFO:teuthology.orchestra.run.smithi131.stdout: osd recover clone overlap = true 2024-05-21T01:18:57.799 INFO:teuthology.orchestra.run.smithi131.stdout: osd recovery max chunk = 1048576 2024-05-21T01:18:57.799 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-21T01:18:57.799 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug shutdown = true 2024-05-21T01:18:57.799 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug op order = true 2024-05-21T01:18:57.799 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug verify stray on activate = true 2024-05-21T01:18:57.799 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug trim objects = true 2024-05-21T01:18:57.799 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-21T01:18:57.799 INFO:teuthology.orchestra.run.smithi131.stdout: osd open classes on start = true 2024-05-21T01:18:57.799 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug pg log writeout = true 2024-05-21T01:18:57.800 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-21T01:18:57.800 INFO:teuthology.orchestra.run.smithi131.stdout: osd deep scrub update digest min age = 30 2024-05-21T01:18:57.800 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-21T01:18:57.800 INFO:teuthology.orchestra.run.smithi131.stdout: osd map max advance = 10 2024-05-21T01:18:57.800 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-21T01:18:57.800 INFO:teuthology.orchestra.run.smithi131.stdout: journal zero on create = true 2024-05-21T01:18:57.800 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-21T01:18:57.800 INFO:teuthology.orchestra.run.smithi131.stdout: filestore ondisk finisher threads = 3 2024-05-21T01:18:57.800 INFO:teuthology.orchestra.run.smithi131.stdout: filestore apply finisher threads = 3 2024-05-21T01:18:57.800 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-21T01:18:57.800 INFO:teuthology.orchestra.run.smithi131.stdout: bdev debug aio = true 2024-05-21T01:18:57.800 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug misdirected ops = true 2024-05-21T01:18:57.800 INFO:teuthology.orchestra.run.smithi131.stdout: bluestore block size = 96636764160 2024-05-21T01:18:57.800 INFO:teuthology.orchestra.run.smithi131.stdout: bluestore compression mode = aggressive 2024-05-21T01:18:57.801 INFO:teuthology.orchestra.run.smithi131.stdout: bluestore fsck on mount = True 2024-05-21T01:18:57.801 INFO:teuthology.orchestra.run.smithi131.stdout: debug bluefs = 20 2024-05-21T01:18:57.801 INFO:teuthology.orchestra.run.smithi131.stdout: debug bluestore = 20 2024-05-21T01:18:57.801 INFO:teuthology.orchestra.run.smithi131.stdout: debug ms = 1 2024-05-21T01:18:57.801 INFO:teuthology.orchestra.run.smithi131.stdout: debug osd = 20 2024-05-21T01:18:57.801 INFO:teuthology.orchestra.run.smithi131.stdout: debug rocksdb = 10 2024-05-21T01:18:57.801 INFO:teuthology.orchestra.run.smithi131.stdout: mon client directed command retry = 5 2024-05-21T01:18:57.801 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd backfillfull_ratio = 0.85 2024-05-21T01:18:57.801 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd full ratio = 0.9 2024-05-21T01:18:57.801 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd nearfull ratio = 0.8 2024-05-21T01:18:57.801 INFO:teuthology.orchestra.run.smithi131.stdout: ms inject delay max = 1 2024-05-21T01:18:57.801 INFO:teuthology.orchestra.run.smithi131.stdout: ms inject delay probability = 0.005 2024-05-21T01:18:57.801 INFO:teuthology.orchestra.run.smithi131.stdout: ms inject delay type = client mds 2024-05-21T01:18:57.802 INFO:teuthology.orchestra.run.smithi131.stdout: ms inject socket failures = 2500 2024-05-21T01:18:57.802 INFO:teuthology.orchestra.run.smithi131.stdout: osd blocked scrub grace period = 3600 2024-05-21T01:18:57.802 INFO:teuthology.orchestra.run.smithi131.stdout: osd failsafe full ratio = 0.95 2024-05-21T01:18:57.802 INFO:teuthology.orchestra.run.smithi131.stdout: osd max markdown count = 1000 2024-05-21T01:18:57.802 INFO:teuthology.orchestra.run.smithi131.stdout: osd objectstore = bluestore 2024-05-21T01:18:57.802 INFO:teuthology.orchestra.run.smithi131.stdout: osd op complaint time = 180 2024-05-21T01:18:57.802 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-21T01:18:57.802 INFO:teuthology.orchestra.run.smithi131.stdout:[mgr] 2024-05-21T01:18:57.802 INFO:teuthology.orchestra.run.smithi131.stdout: debug ms = 1 2024-05-21T01:18:57.802 INFO:teuthology.orchestra.run.smithi131.stdout: debug mgr = 20 2024-05-21T01:18:57.802 INFO:teuthology.orchestra.run.smithi131.stdout: debug mon = 20 2024-05-21T01:18:57.802 INFO:teuthology.orchestra.run.smithi131.stdout: debug auth = 20 2024-05-21T01:18:57.803 INFO:teuthology.orchestra.run.smithi131.stdout: mon reweight min pgs per osd = 4 2024-05-21T01:18:57.803 INFO:teuthology.orchestra.run.smithi131.stdout: mon reweight min bytes per osd = 10 2024-05-21T01:18:57.803 INFO:teuthology.orchestra.run.smithi131.stdout: mgr/telemetry/nag = false 2024-05-21T01:18:57.803 INFO:teuthology.orchestra.run.smithi131.stdout: debug client = 20 2024-05-21T01:18:57.803 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-21T01:18:57.803 INFO:teuthology.orchestra.run.smithi131.stdout:[mon] 2024-05-21T01:18:57.803 INFO:teuthology.orchestra.run.smithi131.stdout: debug ms = 1 2024-05-21T01:18:57.803 INFO:teuthology.orchestra.run.smithi131.stdout: debug mon = 20 2024-05-21T01:18:57.803 INFO:teuthology.orchestra.run.smithi131.stdout: debug paxos = 20 2024-05-21T01:18:57.803 INFO:teuthology.orchestra.run.smithi131.stdout: debug auth = 20 2024-05-21T01:18:57.803 INFO:teuthology.orchestra.run.smithi131.stdout: mon data avail warn = 5 2024-05-21T01:18:57.804 INFO:teuthology.orchestra.run.smithi131.stdout: mon mgr mkfs grace = 240 2024-05-21T01:18:57.804 INFO:teuthology.orchestra.run.smithi131.stdout: mon reweight min pgs per osd = 4 2024-05-21T01:18:57.804 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd reporter subtree level = osd 2024-05-21T01:18:57.804 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd prime pg temp = true 2024-05-21T01:18:57.804 INFO:teuthology.orchestra.run.smithi131.stdout: mon reweight min bytes per osd = 10 2024-05-21T01:18:57.804 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-21T01:18:57.804 INFO:teuthology.orchestra.run.smithi131.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-21T01:18:57.804 INFO:teuthology.orchestra.run.smithi131.stdout: auth mon ticket ttl = 660 # 11m 2024-05-21T01:18:57.804 INFO:teuthology.orchestra.run.smithi131.stdout: auth service ticket ttl = 240 # 4m 2024-05-21T01:18:57.804 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-21T01:18:57.804 INFO:teuthology.orchestra.run.smithi131.stdout: # don't complain about insecure global_id in the test suite 2024-05-21T01:18:57.804 INFO:teuthology.orchestra.run.smithi131.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-21T01:18:57.805 INFO:teuthology.orchestra.run.smithi131.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-21T01:18:57.805 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-21T01:18:57.805 INFO:teuthology.orchestra.run.smithi131.stdout: # 1m isn't quite enough 2024-05-21T01:18:57.805 INFO:teuthology.orchestra.run.smithi131.stdout: mon_down_mkfs_grace = 2m 2024-05-21T01:18:57.805 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-21T01:18:57.805 INFO:teuthology.orchestra.run.smithi131.stdout: mon_warn_on_filestore_osds = false 2024-05-21T01:18:57.805 INFO:teuthology.orchestra.run.smithi131.stdout: mon down mkfs grace = 300 2024-05-21T01:18:57.805 INFO:teuthology.orchestra.run.smithi131.stdout: mon op complaint time = 120 2024-05-21T01:18:57.805 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-05-21T01:18:57.805 INFO:teuthology.orchestra.run.smithi131.stdout:[client] 2024-05-21T01:18:57.805 INFO:teuthology.orchestra.run.smithi131.stdout: rgw cache enabled = true 2024-05-21T01:18:57.805 INFO:teuthology.orchestra.run.smithi131.stdout: rgw enable ops log = true 2024-05-21T01:18:57.805 INFO:teuthology.orchestra.run.smithi131.stdout: rgw enable usage log = true 2024-05-21T01:18:57.806 INFO:teuthology.orchestra.run.smithi131.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-21T01:18:57.806 INFO:teuthology.orchestra.run.smithi131.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-21T01:18:57.806 INFO:teuthology.orchestra.run.smithi131.stdout: client mount timeout = 600 2024-05-21T01:18:57.806 INFO:teuthology.orchestra.run.smithi131.stdout: client_shutdown_timeout = 120 2024-05-21T01:18:57.806 INFO:teuthology.orchestra.run.smithi131.stdout: debug client = 20 2024-05-21T01:18:57.806 INFO:teuthology.orchestra.run.smithi131.stdout: debug ms = 1 2024-05-21T01:18:57.806 INFO:teuthology.orchestra.run.smithi131.stdout: rados mon op timeout = 900 2024-05-21T01:18:57.806 INFO:teuthology.orchestra.run.smithi131.stdout: rados osd op timeout = 900 2024-05-21T01:18:57.806 INFO:teuthology.orchestra.run.smithi131.stdout:[mon.a] 2024-05-21T01:18:57.806 INFO:teuthology.orchestra.run.smithi131.stdout:[mon.b] 2024-05-21T01:18:57.806 INFO:teuthology.orchestra.run.smithi131.stdout:[mon.c] 2024-05-21T01:18:57.806 INFO:teuthology.orchestra.run.smithi131.stdout:[mds.a] 2024-05-21T01:18:57.806 INFO:teuthology.orchestra.run.smithi131.stdout:[mds.c] 2024-05-21T01:18:57.807 INFO:teuthology.orchestra.run.smithi131.stdout:[mds.e] 2024-05-21T01:18:57.807 INFO:teuthology.orchestra.run.smithi131.stdout:[mds.b] 2024-05-21T01:18:57.807 INFO:teuthology.orchestra.run.smithi131.stdout:[mds.d] 2024-05-21T01:18:57.807 INFO:teuthology.orchestra.run.smithi131.stdout:[mds.f] 2024-05-21T01:18:57.807 INFO:teuthology.orchestra.run.smithi131.stdout:[mds] 2024-05-21T01:18:57.807 INFO:teuthology.orchestra.run.smithi131.stdout: debug mds = 20 2024-05-21T01:18:57.807 INFO:teuthology.orchestra.run.smithi131.stdout: debug mds balancer = 20 2024-05-21T01:18:57.807 INFO:teuthology.orchestra.run.smithi131.stdout: debug ms = 1 2024-05-21T01:18:57.807 INFO:teuthology.orchestra.run.smithi131.stdout: mds bal fragment size max = 10000 2024-05-21T01:18:57.807 INFO:teuthology.orchestra.run.smithi131.stdout: mds bal merge size = 5 2024-05-21T01:18:57.807 INFO:teuthology.orchestra.run.smithi131.stdout: mds bal split bits = 3 2024-05-21T01:18:57.807 INFO:teuthology.orchestra.run.smithi131.stdout: mds bal split size = 100 2024-05-21T01:18:57.807 INFO:teuthology.orchestra.run.smithi131.stdout: mds debug frag = True 2024-05-21T01:18:57.808 INFO:teuthology.orchestra.run.smithi131.stdout: mds debug scatterstat = True 2024-05-21T01:18:57.808 INFO:teuthology.orchestra.run.smithi131.stdout: mds oft prefetch dirfrags = True 2024-05-21T01:18:57.808 INFO:teuthology.orchestra.run.smithi131.stdout: mds op complaint time = 180 2024-05-21T01:18:57.808 INFO:teuthology.orchestra.run.smithi131.stdout: mds verify scatter = True 2024-05-21T01:18:57.808 INFO:teuthology.orchestra.run.smithi131.stdout: mds_dir_prefetch = True 2024-05-21T01:18:57.808 INFO:teuthology.orchestra.run.smithi131.stdout: mds_sleep_rank_change = 5000000.0 2024-05-21T01:18:57.808 INFO:teuthology.orchestra.run.smithi131.stdout: mon client directed command retry = 5 2024-05-21T01:18:57.808 INFO:teuthology.orchestra.run.smithi131.stdout: ms inject delay max = 1 2024-05-21T01:18:57.808 INFO:teuthology.orchestra.run.smithi131.stdout: ms inject delay probability = 0.005 2024-05-21T01:18:57.808 INFO:teuthology.orchestra.run.smithi131.stdout: ms inject delay type = client mds osd 2024-05-21T01:18:57.808 INFO:teuthology.orchestra.run.smithi131.stdout: ms inject socket failures = 2500 2024-05-21T01:18:57.808 INFO:teuthology.orchestra.run.smithi131.stdout: osd op complaint time = 180 2024-05-21T01:18:57.808 INFO:teuthology.orchestra.run.smithi131.stdout: rados mon op timeout = 900 2024-05-21T01:18:57.808 INFO:teuthology.orchestra.run.smithi131.stdout: rados osd op timeout = 900 2024-05-21T01:18:57.809 INFO:teuthology.orchestra.run.smithi063.stdout:[global] 2024-05-21T01:18:57.809 INFO:teuthology.orchestra.run.smithi063.stdout: chdir = "" 2024-05-21T01:18:57.809 INFO:teuthology.orchestra.run.smithi063.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-21T01:18:57.810 INFO:teuthology.orchestra.run.smithi063.stdout: auth supported = cephx 2024-05-21T01:18:57.810 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-05-21T01:18:57.810 INFO:teuthology.orchestra.run.smithi063.stdout: filestore xattr use omap = true 2024-05-21T01:18:57.810 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-05-21T01:18:57.810 INFO:teuthology.orchestra.run.smithi063.stdout: mon clock drift allowed = 1.000 2024-05-21T01:18:57.810 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-05-21T01:18:57.810 INFO:teuthology.orchestra.run.smithi063.stdout: osd crush chooseleaf type = 0 2024-05-21T01:18:57.810 INFO:teuthology.orchestra.run.smithi063.stdout: auth debug = true 2024-05-21T01:18:57.810 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-05-21T01:18:57.810 INFO:teuthology.orchestra.run.smithi063.stdout: ms die on old message = true 2024-05-21T01:18:57.810 INFO:teuthology.orchestra.run.smithi063.stdout: ms die on bug = true 2024-05-21T01:18:57.810 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-05-21T01:18:57.811 INFO:teuthology.orchestra.run.smithi063.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-21T01:18:57.811 INFO:teuthology.orchestra.run.smithi063.stdout: mon pg warn max object skew = 0 2024-05-21T01:18:57.811 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-05-21T01:18:57.811 INFO:teuthology.orchestra.run.smithi063.stdout: # disable pg_autoscaler by default for new pools 2024-05-21T01:18:57.811 INFO:teuthology.orchestra.run.smithi063.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-21T01:18:57.811 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-05-21T01:18:57.811 INFO:teuthology.orchestra.run.smithi063.stdout: osd pool default size = 2 2024-05-21T01:18:57.811 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-05-21T01:18:57.811 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd allow primary affinity = true 2024-05-21T01:18:57.811 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd allow pg remap = true 2024-05-21T01:18:57.811 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on legacy crush tunables = false 2024-05-21T01:18:57.811 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on crush straw calc version zero = false 2024-05-21T01:18:57.811 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on no sortbitwise = false 2024-05-21T01:18:57.811 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on osd down out interval zero = false 2024-05-21T01:18:57.812 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on too few osds = false 2024-05-21T01:18:57.812 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-21T01:18:57.812 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-21T01:18:57.812 INFO:teuthology.orchestra.run.smithi063.stdout: mon_allow_pool_size_one = true 2024-05-21T01:18:57.812 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-05-21T01:18:57.812 INFO:teuthology.orchestra.run.smithi063.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-21T01:18:57.812 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-05-21T01:18:57.812 INFO:teuthology.orchestra.run.smithi063.stdout: osd default data pool replay window = 5 2024-05-21T01:18:57.812 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-05-21T01:18:57.812 INFO:teuthology.orchestra.run.smithi063.stdout: mon allow pool delete = true 2024-05-21T01:18:57.812 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-05-21T01:18:57.812 INFO:teuthology.orchestra.run.smithi063.stdout: mon cluster log file level = debug 2024-05-21T01:18:57.812 INFO:teuthology.orchestra.run.smithi063.stdout: debug asserts on shutdown = true 2024-05-21T01:18:57.812 INFO:teuthology.orchestra.run.smithi063.stdout: mon health detail to clog = false 2024-05-21T01:18:57.812 INFO:teuthology.orchestra.run.smithi063.stdout: mon host = "172.21.15.63,172.21.15.131,[v2:172.21.15.131:3301,v1:172.21.15.131:6790]" 2024-05-21T01:18:57.813 INFO:teuthology.orchestra.run.smithi063.stdout: ms die on skipped message = False 2024-05-21T01:18:57.813 INFO:teuthology.orchestra.run.smithi063.stdout: fsid = 9a7cbd84-ceb2-41c8-8b6e-ab931f86c51a 2024-05-21T01:18:57.813 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-05-21T01:18:57.813 INFO:teuthology.orchestra.run.smithi063.stdout:[osd] 2024-05-21T01:18:57.813 INFO:teuthology.orchestra.run.smithi063.stdout: osd journal size = 100 2024-05-21T01:18:57.813 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-05-21T01:18:57.813 INFO:teuthology.orchestra.run.smithi063.stdout: osd scrub load threshold = 5.0 2024-05-21T01:18:57.813 INFO:teuthology.orchestra.run.smithi063.stdout: osd scrub max interval = 600 2024-05-21T01:18:57.813 INFO:teuthology.orchestra.run.smithi063.stdout: osd mclock profile = high_recovery_ops 2024-05-21T01:18:57.813 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-05-21T01:18:57.813 INFO:teuthology.orchestra.run.smithi063.stdout: osd recover clone overlap = true 2024-05-21T01:18:57.813 INFO:teuthology.orchestra.run.smithi063.stdout: osd recovery max chunk = 1048576 2024-05-21T01:18:57.813 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-05-21T01:18:57.813 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug shutdown = true 2024-05-21T01:18:57.813 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug op order = true 2024-05-21T01:18:57.813 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug verify stray on activate = true 2024-05-21T01:18:57.814 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug trim objects = true 2024-05-21T01:18:57.814 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-05-21T01:18:57.814 INFO:teuthology.orchestra.run.smithi063.stdout: osd open classes on start = true 2024-05-21T01:18:57.814 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug pg log writeout = true 2024-05-21T01:18:57.814 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-05-21T01:18:57.814 INFO:teuthology.orchestra.run.smithi063.stdout: osd deep scrub update digest min age = 30 2024-05-21T01:18:57.814 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-05-21T01:18:57.814 INFO:teuthology.orchestra.run.smithi063.stdout: osd map max advance = 10 2024-05-21T01:18:57.814 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-05-21T01:18:57.814 INFO:teuthology.orchestra.run.smithi063.stdout: journal zero on create = true 2024-05-21T01:18:57.814 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-05-21T01:18:57.814 INFO:teuthology.orchestra.run.smithi063.stdout: filestore ondisk finisher threads = 3 2024-05-21T01:18:57.814 INFO:teuthology.orchestra.run.smithi063.stdout: filestore apply finisher threads = 3 2024-05-21T01:18:57.815 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-05-21T01:18:57.815 INFO:teuthology.orchestra.run.smithi063.stdout: bdev debug aio = true 2024-05-21T01:18:57.815 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug misdirected ops = true 2024-05-21T01:18:57.815 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore block size = 96636764160 2024-05-21T01:18:57.815 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore compression mode = aggressive 2024-05-21T01:18:57.815 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore fsck on mount = True 2024-05-21T01:18:57.815 INFO:teuthology.orchestra.run.smithi063.stdout: debug bluefs = 20 2024-05-21T01:18:57.815 INFO:teuthology.orchestra.run.smithi063.stdout: debug bluestore = 20 2024-05-21T01:18:57.815 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2024-05-21T01:18:57.815 INFO:teuthology.orchestra.run.smithi063.stdout: debug osd = 20 2024-05-21T01:18:57.815 INFO:teuthology.orchestra.run.smithi063.stdout: debug rocksdb = 10 2024-05-21T01:18:57.815 INFO:teuthology.orchestra.run.smithi063.stdout: mon client directed command retry = 5 2024-05-21T01:18:57.815 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd backfillfull_ratio = 0.85 2024-05-21T01:18:57.815 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd full ratio = 0.9 2024-05-21T01:18:57.816 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd nearfull ratio = 0.8 2024-05-21T01:18:57.816 INFO:teuthology.orchestra.run.smithi063.stdout: ms inject delay max = 1 2024-05-21T01:18:57.816 INFO:teuthology.orchestra.run.smithi063.stdout: ms inject delay probability = 0.005 2024-05-21T01:18:57.816 INFO:teuthology.orchestra.run.smithi063.stdout: ms inject delay type = client mds 2024-05-21T01:18:57.816 INFO:teuthology.orchestra.run.smithi063.stdout: ms inject socket failures = 2500 2024-05-21T01:18:57.816 INFO:teuthology.orchestra.run.smithi063.stdout: osd blocked scrub grace period = 3600 2024-05-21T01:18:57.816 INFO:teuthology.orchestra.run.smithi063.stdout: osd failsafe full ratio = 0.95 2024-05-21T01:18:57.816 INFO:teuthology.orchestra.run.smithi063.stdout: osd max markdown count = 1000 2024-05-21T01:18:57.816 INFO:teuthology.orchestra.run.smithi063.stdout: osd objectstore = bluestore 2024-05-21T01:18:57.816 INFO:teuthology.orchestra.run.smithi063.stdout: osd op complaint time = 180 2024-05-21T01:18:57.816 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-05-21T01:18:57.816 INFO:teuthology.orchestra.run.smithi063.stdout:[mgr] 2024-05-21T01:18:57.816 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2024-05-21T01:18:57.816 INFO:teuthology.orchestra.run.smithi063.stdout: debug mgr = 20 2024-05-21T01:18:57.816 INFO:teuthology.orchestra.run.smithi063.stdout: debug mon = 20 2024-05-21T01:18:57.817 INFO:teuthology.orchestra.run.smithi063.stdout: debug auth = 20 2024-05-21T01:18:57.817 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min pgs per osd = 4 2024-05-21T01:18:57.817 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min bytes per osd = 10 2024-05-21T01:18:57.817 INFO:teuthology.orchestra.run.smithi063.stdout: mgr/telemetry/nag = false 2024-05-21T01:18:57.817 INFO:teuthology.orchestra.run.smithi063.stdout: debug client = 20 2024-05-21T01:18:57.817 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-05-21T01:18:57.817 INFO:teuthology.orchestra.run.smithi063.stdout:[mon] 2024-05-21T01:18:57.817 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2024-05-21T01:18:57.817 INFO:teuthology.orchestra.run.smithi063.stdout: debug mon = 20 2024-05-21T01:18:57.817 INFO:teuthology.orchestra.run.smithi063.stdout: debug paxos = 20 2024-05-21T01:18:57.817 INFO:teuthology.orchestra.run.smithi063.stdout: debug auth = 20 2024-05-21T01:18:57.817 INFO:teuthology.orchestra.run.smithi063.stdout: mon data avail warn = 5 2024-05-21T01:18:57.817 INFO:teuthology.orchestra.run.smithi063.stdout: mon mgr mkfs grace = 240 2024-05-21T01:18:57.817 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min pgs per osd = 4 2024-05-21T01:18:57.817 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd reporter subtree level = osd 2024-05-21T01:18:57.817 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd prime pg temp = true 2024-05-21T01:18:57.818 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min bytes per osd = 10 2024-05-21T01:18:57.818 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-05-21T01:18:57.818 INFO:teuthology.orchestra.run.smithi063.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-21T01:18:57.818 INFO:teuthology.orchestra.run.smithi063.stdout: auth mon ticket ttl = 660 # 11m 2024-05-21T01:18:57.818 INFO:teuthology.orchestra.run.smithi063.stdout: auth service ticket ttl = 240 # 4m 2024-05-21T01:18:57.818 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-05-21T01:18:57.818 INFO:teuthology.orchestra.run.smithi063.stdout: # don't complain about insecure global_id in the test suite 2024-05-21T01:18:57.818 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-21T01:18:57.818 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-21T01:18:57.818 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-05-21T01:18:57.818 INFO:teuthology.orchestra.run.smithi063.stdout: # 1m isn't quite enough 2024-05-21T01:18:57.818 INFO:teuthology.orchestra.run.smithi063.stdout: mon_down_mkfs_grace = 2m 2024-05-21T01:18:57.818 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-05-21T01:18:57.818 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_filestore_osds = false 2024-05-21T01:18:57.819 INFO:teuthology.orchestra.run.smithi063.stdout: mon down mkfs grace = 300 2024-05-21T01:18:57.819 INFO:teuthology.orchestra.run.smithi063.stdout: mon op complaint time = 120 2024-05-21T01:18:57.819 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-05-21T01:18:57.819 INFO:teuthology.orchestra.run.smithi063.stdout:[client] 2024-05-21T01:18:57.819 INFO:teuthology.orchestra.run.smithi063.stdout: rgw cache enabled = true 2024-05-21T01:18:57.819 INFO:teuthology.orchestra.run.smithi063.stdout: rgw enable ops log = true 2024-05-21T01:18:57.819 INFO:teuthology.orchestra.run.smithi063.stdout: rgw enable usage log = true 2024-05-21T01:18:57.819 INFO:teuthology.orchestra.run.smithi063.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-21T01:18:57.819 INFO:teuthology.orchestra.run.smithi063.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-21T01:18:57.819 INFO:teuthology.orchestra.run.smithi063.stdout: client mount timeout = 600 2024-05-21T01:18:57.819 INFO:teuthology.orchestra.run.smithi063.stdout: client_shutdown_timeout = 120 2024-05-21T01:18:57.819 INFO:teuthology.orchestra.run.smithi063.stdout: debug client = 20 2024-05-21T01:18:57.819 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2024-05-21T01:18:57.819 INFO:teuthology.orchestra.run.smithi063.stdout: rados mon op timeout = 900 2024-05-21T01:18:57.819 INFO:teuthology.orchestra.run.smithi063.stdout: rados osd op timeout = 900 2024-05-21T01:18:57.820 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.a] 2024-05-21T01:18:57.820 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.b] 2024-05-21T01:18:57.820 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.c] 2024-05-21T01:18:57.820 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.a] 2024-05-21T01:18:57.820 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.c] 2024-05-21T01:18:57.820 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.e] 2024-05-21T01:18:57.820 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.b] 2024-05-21T01:18:57.820 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.d] 2024-05-21T01:18:57.820 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.f] 2024-05-21T01:18:57.820 INFO:teuthology.orchestra.run.smithi063.stdout:[mds] 2024-05-21T01:18:57.820 INFO:teuthology.orchestra.run.smithi063.stdout: debug mds = 20 2024-05-21T01:18:57.820 INFO:teuthology.orchestra.run.smithi063.stdout: debug mds balancer = 20 2024-05-21T01:18:57.820 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2024-05-21T01:18:57.820 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal fragment size max = 10000 2024-05-21T01:18:57.820 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal merge size = 5 2024-05-21T01:18:57.821 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal split bits = 3 2024-05-21T01:18:57.821 INFO:teuthology.orchestra.run.smithi063.stdout: mds bal split size = 100 2024-05-21T01:18:57.821 INFO:teuthology.orchestra.run.smithi063.stdout: mds debug frag = True 2024-05-21T01:18:57.821 INFO:teuthology.orchestra.run.smithi063.stdout: mds debug scatterstat = True 2024-05-21T01:18:57.821 INFO:teuthology.orchestra.run.smithi063.stdout: mds oft prefetch dirfrags = True 2024-05-21T01:18:57.821 INFO:teuthology.orchestra.run.smithi063.stdout: mds op complaint time = 180 2024-05-21T01:18:57.821 INFO:teuthology.orchestra.run.smithi063.stdout: mds verify scatter = True 2024-05-21T01:18:57.821 INFO:teuthology.orchestra.run.smithi063.stdout: mds_dir_prefetch = True 2024-05-21T01:18:57.821 INFO:teuthology.orchestra.run.smithi063.stdout: mds_sleep_rank_change = 5000000.0 2024-05-21T01:18:57.821 INFO:teuthology.orchestra.run.smithi063.stdout: mon client directed command retry = 5 2024-05-21T01:18:57.821 INFO:teuthology.orchestra.run.smithi063.stdout: ms inject delay max = 1 2024-05-21T01:18:57.821 INFO:teuthology.orchestra.run.smithi063.stdout: ms inject delay probability = 0.005 2024-05-21T01:18:57.821 INFO:teuthology.orchestra.run.smithi063.stdout: ms inject delay type = client mds osd 2024-05-21T01:18:57.821 INFO:teuthology.orchestra.run.smithi063.stdout: ms inject socket failures = 2500 2024-05-21T01:18:57.821 INFO:teuthology.orchestra.run.smithi063.stdout: osd op complaint time = 180 2024-05-21T01:18:57.821 INFO:teuthology.orchestra.run.smithi063.stdout: rados mon op timeout = 900 2024-05-21T01:18:57.822 INFO:teuthology.orchestra.run.smithi063.stdout: rados osd op timeout = 900 2024-05-21T01:18:57.823 INFO:tasks.ceph:Creating admin key on mon.a... 2024-05-21T01:18:57.823 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-05-21T01:18:57.921 INFO:tasks.ceph:Copying monmap to all nodes... 2024-05-21T01:18:57.921 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-05-21T01:18:57.921 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-05-21T01:18:57.930 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-05-21T01:18:57.930 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-05-21T01:18:57.979 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi063.front.sepia.ceph.com 2024-05-21T01:18:57.980 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-05-21T01:18:57.980 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-21T01:18:57.980 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-21T01:18:58.051 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-05-21T01:18:58.051 DEBUG:teuthology.orchestra.run.smithi063:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-21T01:18:58.099 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi131.front.sepia.ceph.com 2024-05-21T01:18:58.100 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-05-21T01:18:58.100 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-21T01:18:58.100 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-21T01:18:58.123 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-05-21T01:18:58.123 DEBUG:teuthology.orchestra.run.smithi131:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-21T01:18:58.175 INFO:tasks.ceph:Setting up mon nodes... 2024-05-21T01:18:58.175 INFO:tasks.ceph:Setting up mgr nodes... 2024-05-21T01:18:58.175 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-05-21T01:18:58.231 INFO:teuthology.orchestra.run.smithi063.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-05-21T01:18:58.237 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-05-21T01:18:58.280 INFO:teuthology.orchestra.run.smithi131.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-05-21T01:18:58.292 INFO:tasks.ceph:Setting up mds nodes... 2024-05-21T01:18:58.293 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-05-21T01:18:58.348 INFO:teuthology.orchestra.run.smithi063.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-05-21T01:18:58.353 DEBUG:teuthology.orchestra.run.smithi063:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-05-21T01:18:58.373 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-05-21T01:18:58.471 INFO:teuthology.orchestra.run.smithi063.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-05-21T01:18:58.476 DEBUG:teuthology.orchestra.run.smithi063:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-05-21T01:18:58.495 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2024-05-21T01:18:58.594 INFO:teuthology.orchestra.run.smithi063.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2024-05-21T01:18:58.599 DEBUG:teuthology.orchestra.run.smithi063:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2024-05-21T01:18:58.618 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-05-21T01:18:58.662 INFO:teuthology.orchestra.run.smithi131.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-05-21T01:18:58.665 DEBUG:teuthology.orchestra.run.smithi131:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-05-21T01:18:58.719 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-05-21T01:18:58.808 INFO:teuthology.orchestra.run.smithi131.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-05-21T01:18:58.811 DEBUG:teuthology.orchestra.run.smithi131:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-05-21T01:18:58.867 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2024-05-21T01:18:58.950 INFO:teuthology.orchestra.run.smithi131.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2024-05-21T01:18:58.953 DEBUG:teuthology.orchestra.run.smithi131:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2024-05-21T01:18:59.006 INFO:tasks.ceph_client:Setting up client nodes... 2024-05-21T01:18:59.006 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-21T01:18:59.050 INFO:teuthology.orchestra.run.smithi063.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-05-21T01:18:59.067 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-05-21T01:18:59.067 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi063.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi131.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-21T01:18:59.067 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-05-21T01:18:59.127 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-21T01:18:59.127 INFO:tasks.ceph:role: osd.0 2024-05-21T01:18:59.127 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi063.front.sepia.ceph.com 2024-05-21T01:18:59.127 DEBUG:teuthology.orchestra.run.smithi063:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-21T01:18:59.194 INFO:teuthology.orchestra.run.smithi063.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-21T01:18:59.194 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-21T01:18:59.194 INFO:teuthology.orchestra.run.smithi063.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-21T01:18:59.194 INFO:teuthology.orchestra.run.smithi063.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-21T01:18:59.195 INFO:teuthology.orchestra.run.smithi063.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-21T01:18:59.195 INFO:teuthology.orchestra.run.smithi063.stdout: = sunit=0 swidth=0 blks 2024-05-21T01:18:59.195 INFO:teuthology.orchestra.run.smithi063.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-21T01:18:59.195 INFO:teuthology.orchestra.run.smithi063.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-21T01:18:59.195 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-21T01:18:59.195 INFO:teuthology.orchestra.run.smithi063.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-21T01:18:59.593 INFO:teuthology.orchestra.run.smithi063.stdout:Discarding blocks...Done. 2024-05-21T01:18:59.596 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi063.front.sepia.ceph.com -o noatime 2024-05-21T01:18:59.596 DEBUG:teuthology.orchestra.run.smithi063:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-05-21T01:18:59.701 DEBUG:teuthology.orchestra.run.smithi063:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-05-21T01:18:59.718 INFO:teuthology.orchestra.run.smithi063.stderr:sudo: /sbin/restorecon: command not found 2024-05-21T01:18:59.719 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-21T01:18:59.719 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-05-21T01:18:59.779 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-21T01:18:59.779 INFO:tasks.ceph:role: osd.1 2024-05-21T01:18:59.779 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi063.front.sepia.ceph.com 2024-05-21T01:18:59.779 DEBUG:teuthology.orchestra.run.smithi063:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-21T01:18:59.846 INFO:teuthology.orchestra.run.smithi063.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-21T01:18:59.846 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-21T01:18:59.847 INFO:teuthology.orchestra.run.smithi063.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-21T01:18:59.847 INFO:teuthology.orchestra.run.smithi063.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-21T01:18:59.847 INFO:teuthology.orchestra.run.smithi063.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-21T01:18:59.847 INFO:teuthology.orchestra.run.smithi063.stdout: = sunit=0 swidth=0 blks 2024-05-21T01:18:59.847 INFO:teuthology.orchestra.run.smithi063.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-21T01:18:59.847 INFO:teuthology.orchestra.run.smithi063.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-21T01:18:59.847 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-21T01:18:59.847 INFO:teuthology.orchestra.run.smithi063.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-21T01:19:00.250 INFO:teuthology.orchestra.run.smithi063.stdout:Discarding blocks...Done. 2024-05-21T01:19:00.253 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi063.front.sepia.ceph.com -o noatime 2024-05-21T01:19:00.253 DEBUG:teuthology.orchestra.run.smithi063:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-05-21T01:19:00.382 DEBUG:teuthology.orchestra.run.smithi063:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-05-21T01:19:00.399 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-21T01:19:00.399 INFO:teuthology.orchestra.run.smithi063.stderr:sudo: /sbin/restorecon: command not found 2024-05-21T01:19:00.399 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-05-21T01:19:00.459 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-21T01:19:00.459 INFO:tasks.ceph:role: osd.2 2024-05-21T01:19:00.459 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi063.front.sepia.ceph.com 2024-05-21T01:19:00.460 DEBUG:teuthology.orchestra.run.smithi063:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-21T01:19:00.526 INFO:teuthology.orchestra.run.smithi063.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-21T01:19:00.527 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-21T01:19:00.527 INFO:teuthology.orchestra.run.smithi063.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-21T01:19:00.527 INFO:teuthology.orchestra.run.smithi063.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-21T01:19:00.527 INFO:teuthology.orchestra.run.smithi063.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-21T01:19:00.527 INFO:teuthology.orchestra.run.smithi063.stdout: = sunit=0 swidth=0 blks 2024-05-21T01:19:00.527 INFO:teuthology.orchestra.run.smithi063.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-21T01:19:00.527 INFO:teuthology.orchestra.run.smithi063.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-21T01:19:00.527 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-21T01:19:00.527 INFO:teuthology.orchestra.run.smithi063.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-21T01:19:00.945 INFO:teuthology.orchestra.run.smithi063.stdout:Discarding blocks...Done. 2024-05-21T01:19:00.948 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi063.front.sepia.ceph.com -o noatime 2024-05-21T01:19:00.949 DEBUG:teuthology.orchestra.run.smithi063:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-05-21T01:19:01.076 DEBUG:teuthology.orchestra.run.smithi063:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-05-21T01:19:01.094 INFO:teuthology.orchestra.run.smithi063.stderr:sudo: /sbin/restorecon: command not found 2024-05-21T01:19:01.095 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-21T01:19:01.095 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-05-21T01:19:01.156 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-21T01:19:01.156 INFO:tasks.ceph:role: osd.3 2024-05-21T01:19:01.157 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi063.front.sepia.ceph.com 2024-05-21T01:19:01.157 DEBUG:teuthology.orchestra.run.smithi063:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-21T01:19:01.228 INFO:teuthology.orchestra.run.smithi063.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-21T01:19:01.228 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-21T01:19:01.228 INFO:teuthology.orchestra.run.smithi063.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-21T01:19:01.228 INFO:teuthology.orchestra.run.smithi063.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-21T01:19:01.228 INFO:teuthology.orchestra.run.smithi063.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-21T01:19:01.228 INFO:teuthology.orchestra.run.smithi063.stdout: = sunit=0 swidth=0 blks 2024-05-21T01:19:01.229 INFO:teuthology.orchestra.run.smithi063.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-21T01:19:01.229 INFO:teuthology.orchestra.run.smithi063.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-21T01:19:01.229 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-21T01:19:01.229 INFO:teuthology.orchestra.run.smithi063.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-21T01:19:01.596 INFO:teuthology.orchestra.run.smithi063.stdout:Discarding blocks...Done. 2024-05-21T01:19:01.599 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi063.front.sepia.ceph.com -o noatime 2024-05-21T01:19:01.599 DEBUG:teuthology.orchestra.run.smithi063:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-05-21T01:19:01.673 DEBUG:teuthology.orchestra.run.smithi063:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-05-21T01:19:01.732 INFO:teuthology.orchestra.run.smithi063.stderr:sudo: /sbin/restorecon: command not found 2024-05-21T01:19:01.733 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-21T01:19:01.734 DEBUG:teuthology.orchestra.run.smithi063:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-21T01:19:01.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:01.850+0000 7fe755e2b7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-05-21T01:19:01.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:01.854+0000 7fe755e2b7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-05-21T01:19:01.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:01.854+0000 7fe755e2b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-21T01:19:01.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:01.854+0000 7fe755e2b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-21T01:19:01.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:01.854+0000 7fe755e2b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-21T01:19:01.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:01.862+0000 7fe755e2b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-05-21T01:19:04.931 DEBUG:teuthology.orchestra.run.smithi063:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-21T01:19:04.953 DEBUG:teuthology.orchestra.run.smithi063:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-21T01:19:05.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:05.050+0000 7f6b627887c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-05-21T01:19:05.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:05.050+0000 7f6b627887c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-05-21T01:19:05.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:05.050+0000 7f6b627887c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-21T01:19:05.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:05.050+0000 7f6b627887c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-21T01:19:05.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:05.050+0000 7f6b627887c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-21T01:19:05.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:05.054+0000 7f6b627887c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-05-21T01:19:08.087 DEBUG:teuthology.orchestra.run.smithi063:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-05-21T01:19:08.109 DEBUG:teuthology.orchestra.run.smithi063:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-21T01:19:08.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:08.202+0000 7fcb51c2b7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-05-21T01:19:08.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:08.206+0000 7fcb51c2b7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-05-21T01:19:08.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:08.206+0000 7fcb51c2b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-21T01:19:08.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:08.206+0000 7fcb51c2b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-21T01:19:08.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:08.206+0000 7fcb51c2b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-21T01:19:08.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:08.206+0000 7fcb51c2b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-05-21T01:19:11.251 DEBUG:teuthology.orchestra.run.smithi063:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-05-21T01:19:11.272 DEBUG:teuthology.orchestra.run.smithi063:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-21T01:19:11.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:11.366+0000 7f8a598c17c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-05-21T01:19:11.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:11.366+0000 7f8a598c17c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-05-21T01:19:11.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:11.366+0000 7f8a598c17c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-21T01:19:11.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:11.366+0000 7f8a598c17c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-21T01:19:11.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:11.366+0000 7f8a598c17c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-21T01:19:11.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:11.366+0000 7f8a598c17c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-05-21T01:19:14.400 DEBUG:teuthology.orchestra.run.smithi063:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-05-21T01:19:14.422 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-05-21T01:19:14.436 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-21T01:19:14.436 INFO:tasks.ceph:role: osd.4 2024-05-21T01:19:14.436 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi131.front.sepia.ceph.com 2024-05-21T01:19:14.436 DEBUG:teuthology.orchestra.run.smithi131:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-21T01:19:14.497 INFO:teuthology.orchestra.run.smithi131.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-21T01:19:14.497 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-21T01:19:14.497 INFO:teuthology.orchestra.run.smithi131.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-21T01:19:14.497 INFO:teuthology.orchestra.run.smithi131.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-21T01:19:14.498 INFO:teuthology.orchestra.run.smithi131.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-21T01:19:14.498 INFO:teuthology.orchestra.run.smithi131.stdout: = sunit=0 swidth=0 blks 2024-05-21T01:19:14.498 INFO:teuthology.orchestra.run.smithi131.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-21T01:19:14.498 INFO:teuthology.orchestra.run.smithi131.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-21T01:19:14.498 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-21T01:19:14.498 INFO:teuthology.orchestra.run.smithi131.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-21T01:19:14.967 INFO:teuthology.orchestra.run.smithi131.stdout:Discarding blocks...Done. 2024-05-21T01:19:14.969 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi131.front.sepia.ceph.com -o noatime 2024-05-21T01:19:14.969 DEBUG:teuthology.orchestra.run.smithi131:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-05-21T01:19:15.108 DEBUG:teuthology.orchestra.run.smithi131:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-05-21T01:19:15.119 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-21T01:19:15.120 INFO:teuthology.orchestra.run.smithi131.stderr:sudo: /sbin/restorecon: command not found 2024-05-21T01:19:15.120 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-05-21T01:19:15.174 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-21T01:19:15.174 INFO:tasks.ceph:role: osd.5 2024-05-21T01:19:15.174 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi131.front.sepia.ceph.com 2024-05-21T01:19:15.174 DEBUG:teuthology.orchestra.run.smithi131:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-21T01:19:15.237 INFO:teuthology.orchestra.run.smithi131.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-21T01:19:15.237 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-21T01:19:15.237 INFO:teuthology.orchestra.run.smithi131.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-21T01:19:15.237 INFO:teuthology.orchestra.run.smithi131.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-21T01:19:15.237 INFO:teuthology.orchestra.run.smithi131.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-21T01:19:15.237 INFO:teuthology.orchestra.run.smithi131.stdout: = sunit=0 swidth=0 blks 2024-05-21T01:19:15.237 INFO:teuthology.orchestra.run.smithi131.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-21T01:19:15.237 INFO:teuthology.orchestra.run.smithi131.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-21T01:19:15.238 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-21T01:19:15.238 INFO:teuthology.orchestra.run.smithi131.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-21T01:19:15.662 INFO:teuthology.orchestra.run.smithi131.stdout:Discarding blocks...Done. 2024-05-21T01:19:15.664 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi131.front.sepia.ceph.com -o noatime 2024-05-21T01:19:15.665 DEBUG:teuthology.orchestra.run.smithi131:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-05-21T01:19:15.727 DEBUG:teuthology.orchestra.run.smithi131:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-05-21T01:19:15.780 INFO:teuthology.orchestra.run.smithi131.stderr:sudo: /sbin/restorecon: command not found 2024-05-21T01:19:15.780 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-21T01:19:15.781 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-05-21T01:19:15.834 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-21T01:19:15.834 INFO:tasks.ceph:role: osd.6 2024-05-21T01:19:15.834 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi131.front.sepia.ceph.com 2024-05-21T01:19:15.834 DEBUG:teuthology.orchestra.run.smithi131:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-21T01:19:15.898 INFO:teuthology.orchestra.run.smithi131.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-21T01:19:15.898 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-21T01:19:15.898 INFO:teuthology.orchestra.run.smithi131.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-21T01:19:15.898 INFO:teuthology.orchestra.run.smithi131.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-21T01:19:15.898 INFO:teuthology.orchestra.run.smithi131.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-21T01:19:15.898 INFO:teuthology.orchestra.run.smithi131.stdout: = sunit=0 swidth=0 blks 2024-05-21T01:19:15.899 INFO:teuthology.orchestra.run.smithi131.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-21T01:19:15.899 INFO:teuthology.orchestra.run.smithi131.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-21T01:19:15.899 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-21T01:19:15.899 INFO:teuthology.orchestra.run.smithi131.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-21T01:19:16.356 INFO:teuthology.orchestra.run.smithi131.stdout:Discarding blocks...Done. 2024-05-21T01:19:16.358 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi131.front.sepia.ceph.com -o noatime 2024-05-21T01:19:16.358 DEBUG:teuthology.orchestra.run.smithi131:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-05-21T01:19:16.456 DEBUG:teuthology.orchestra.run.smithi131:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-05-21T01:19:16.467 INFO:teuthology.orchestra.run.smithi131.stderr:sudo: /sbin/restorecon: command not found 2024-05-21T01:19:16.467 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-21T01:19:16.468 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-05-21T01:19:16.522 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-21T01:19:16.522 INFO:tasks.ceph:role: osd.7 2024-05-21T01:19:16.522 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi131.front.sepia.ceph.com 2024-05-21T01:19:16.522 DEBUG:teuthology.orchestra.run.smithi131:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-21T01:19:16.588 INFO:teuthology.orchestra.run.smithi131.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-21T01:19:16.588 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-21T01:19:16.588 INFO:teuthology.orchestra.run.smithi131.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-21T01:19:16.588 INFO:teuthology.orchestra.run.smithi131.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-21T01:19:16.588 INFO:teuthology.orchestra.run.smithi131.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-21T01:19:16.588 INFO:teuthology.orchestra.run.smithi131.stdout: = sunit=0 swidth=0 blks 2024-05-21T01:19:16.588 INFO:teuthology.orchestra.run.smithi131.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-21T01:19:16.588 INFO:teuthology.orchestra.run.smithi131.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-21T01:19:16.588 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-21T01:19:16.588 INFO:teuthology.orchestra.run.smithi131.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-21T01:19:17.043 INFO:teuthology.orchestra.run.smithi131.stdout:Discarding blocks...Done. 2024-05-21T01:19:17.045 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi131.front.sepia.ceph.com -o noatime 2024-05-21T01:19:17.045 DEBUG:teuthology.orchestra.run.smithi131:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-05-21T01:19:17.183 DEBUG:teuthology.orchestra.run.smithi131:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-05-21T01:19:17.194 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-21T01:19:17.195 INFO:teuthology.orchestra.run.smithi131.stderr:sudo: /sbin/restorecon: command not found 2024-05-21T01:19:17.195 DEBUG:teuthology.orchestra.run.smithi131:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-21T01:19:17.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:17.303+0000 7fb09c4757c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-05-21T01:19:17.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:17.303+0000 7fb09c4757c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-05-21T01:19:17.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:17.303+0000 7fb09c4757c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-21T01:19:17.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:17.303+0000 7fb09c4757c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-21T01:19:17.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:17.303+0000 7fb09c4757c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-21T01:19:17.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:17.311+0000 7fb09c4757c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-05-21T01:19:20.274 DEBUG:teuthology.orchestra.run.smithi131:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-05-21T01:19:20.289 DEBUG:teuthology.orchestra.run.smithi131:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-21T01:19:20.369 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:20.366+0000 7f2286c3d7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-05-21T01:19:20.369 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:20.366+0000 7f2286c3d7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-05-21T01:19:20.370 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:20.366+0000 7f2286c3d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-21T01:19:20.370 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:20.366+0000 7f2286c3d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-21T01:19:20.370 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:20.366+0000 7f2286c3d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-21T01:19:20.370 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:20.370+0000 7f2286c3d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-05-21T01:19:23.342 DEBUG:teuthology.orchestra.run.smithi131:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-05-21T01:19:23.400 DEBUG:teuthology.orchestra.run.smithi131:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-21T01:19:23.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:23.478+0000 7f81df6067c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-05-21T01:19:23.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:23.478+0000 7f81df6067c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-05-21T01:19:23.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:23.478+0000 7f81df6067c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-21T01:19:23.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:23.478+0000 7f81df6067c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-21T01:19:23.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:23.478+0000 7f81df6067c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-21T01:19:23.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:23.478+0000 7f81df6067c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-05-21T01:19:25.998 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-21T01:19:26.002 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-21T01:19:26.442 DEBUG:teuthology.orchestra.run.smithi131:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-05-21T01:19:26.454 DEBUG:teuthology.orchestra.run.smithi131:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-21T01:19:26.539 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:26.538+0000 7fecf53a07c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-05-21T01:19:26.540 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:26.538+0000 7fecf53a07c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-05-21T01:19:26.540 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:26.538+0000 7fecf53a07c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-21T01:19:26.540 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:26.538+0000 7fecf53a07c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-21T01:19:26.540 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:26.538+0000 7fecf53a07c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-21T01:19:26.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:26.538+0000 7fecf53a07c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-05-21T01:19:29.542 DEBUG:teuthology.orchestra.run.smithi131:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-05-21T01:19:29.599 INFO:tasks.ceph:Reading keys from all nodes... 2024-05-21T01:19:29.599 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-05-21T01:19:29.599 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-05-21T01:19:29.622 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-05-21T01:19:29.622 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-05-21T01:19:29.685 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-05-21T01:19:29.685 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-05-21T01:19:29.749 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-05-21T01:19:29.749 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2024-05-21T01:19:29.812 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-05-21T01:19:29.813 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-05-21T01:19:29.877 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-05-21T01:19:29.877 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-05-21T01:19:29.941 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-05-21T01:19:29.941 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-05-21T01:19:30.009 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-05-21T01:19:30.009 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-05-21T01:19:30.077 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-05-21T01:19:30.077 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-05-21T01:19:30.091 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-05-21T01:19:30.091 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-05-21T01:19:30.146 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-05-21T01:19:30.146 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-05-21T01:19:30.197 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-05-21T01:19:30.197 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2024-05-21T01:19:30.250 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-05-21T01:19:30.250 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-05-21T01:19:30.306 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-05-21T01:19:30.306 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-05-21T01:19:30.362 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-05-21T01:19:30.362 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-05-21T01:19:30.418 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-05-21T01:19:30.418 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-05-21T01:19:30.475 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-05-21T01:19:30.475 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-05-21T01:19:30.484 INFO:tasks.ceph:Adding keys to all mons... 2024-05-21T01:19:30.484 DEBUG:teuthology.orchestra.run.smithi063:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-21T01:19:30.530 DEBUG:teuthology.orchestra.run.smithi131:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-21T01:19:30.542 INFO:teuthology.orchestra.run.smithi131.stdout:[mgr.y] 2024-05-21T01:19:30.542 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQCC9ktmY1jWDRAAxJc5i/jyQWD+5r0vI3OFEQ== 2024-05-21T01:19:30.542 INFO:teuthology.orchestra.run.smithi131.stdout:[mds.a] 2024-05-21T01:19:30.542 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQCC9ktmOYXPFBAAGsHkgqtX6Gx+nD3i67044Q== 2024-05-21T01:19:30.542 INFO:teuthology.orchestra.run.smithi131.stdout:[mds.c] 2024-05-21T01:19:30.542 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQCC9ktmH7kkHBAAucgktjuN4xpJa4n0MNXRDw== 2024-05-21T01:19:30.542 INFO:teuthology.orchestra.run.smithi131.stdout:[mds.e] 2024-05-21T01:19:30.542 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQCC9ktm3Wh1IxAAARBOxFM2TDvOM74Ct1w+gg== 2024-05-21T01:19:30.542 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.0] 2024-05-21T01:19:30.543 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQCF9ktm28kCMxAA9pHSgMZuQPKxrDFs1WlGXQ== 2024-05-21T01:19:30.543 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.1] 2024-05-21T01:19:30.543 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQCJ9ktmNoU5AxAA/hLZeotyvXVnmT/AGelrbQ== 2024-05-21T01:19:30.543 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.2] 2024-05-21T01:19:30.543 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQCM9ktmbCpjDBAAh/1zNhU4J4uxYIhqfJmE5A== 2024-05-21T01:19:30.543 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.3] 2024-05-21T01:19:30.543 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQCP9ktm0JsGFhAA0Y7W7fA5Mi3j9sDbhA0Blw== 2024-05-21T01:19:30.543 INFO:teuthology.orchestra.run.smithi131.stdout:[mgr.x] 2024-05-21T01:19:30.543 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQCC9ktmW4XUEBAAy/f/uoI3qnP0Yz8LoYG4xw== 2024-05-21T01:19:30.543 INFO:teuthology.orchestra.run.smithi131.stdout:[mds.b] 2024-05-21T01:19:30.543 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQCC9ktmGNaeJxAAXSTfl30FCJ35/Q9uhsYkMg== 2024-05-21T01:19:30.543 INFO:teuthology.orchestra.run.smithi131.stdout:[mds.d] 2024-05-21T01:19:30.543 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQCC9ktmnXRQMBAA/U0iHbP3DbC/EaGl4CJwEg== 2024-05-21T01:19:30.543 INFO:teuthology.orchestra.run.smithi131.stdout:[mds.f] 2024-05-21T01:19:30.543 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQCC9ktmKGHMOBAATVwDDSrE+c1X65zX3/Oqmw== 2024-05-21T01:19:30.544 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.4] 2024-05-21T01:19:30.544 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQCV9ktmhp8rEhAAisWuB6C0+qBijC2Zv5Pxiw== 2024-05-21T01:19:30.544 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.5] 2024-05-21T01:19:30.544 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQCY9ktmnI8kFhAA8eEtd37bixCUZHJjyfa9ww== 2024-05-21T01:19:30.544 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.6] 2024-05-21T01:19:30.544 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQCb9ktmkMjEHBAAkBMregWZlGoZwmvgRaAXww== 2024-05-21T01:19:30.544 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.7] 2024-05-21T01:19:30.544 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQCe9ktmA25KIBAASF8DX0Cydryn+9us5oKWpg== 2024-05-21T01:19:30.544 INFO:teuthology.orchestra.run.smithi131.stdout:[client.0] 2024-05-21T01:19:30.544 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQCD9ktmjFIKAxAA7tvph+EzGz6AkVzzFp4Ihg== 2024-05-21T01:19:30.547 INFO:teuthology.orchestra.run.smithi063.stdout:[mgr.y] 2024-05-21T01:19:30.547 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQCC9ktmY1jWDRAAxJc5i/jyQWD+5r0vI3OFEQ== 2024-05-21T01:19:30.547 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.a] 2024-05-21T01:19:30.548 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQCC9ktmOYXPFBAAGsHkgqtX6Gx+nD3i67044Q== 2024-05-21T01:19:30.548 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.c] 2024-05-21T01:19:30.548 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQCC9ktmH7kkHBAAucgktjuN4xpJa4n0MNXRDw== 2024-05-21T01:19:30.548 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.e] 2024-05-21T01:19:30.548 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQCC9ktm3Wh1IxAAARBOxFM2TDvOM74Ct1w+gg== 2024-05-21T01:19:30.548 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.0] 2024-05-21T01:19:30.548 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQCF9ktm28kCMxAA9pHSgMZuQPKxrDFs1WlGXQ== 2024-05-21T01:19:30.548 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.1] 2024-05-21T01:19:30.548 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQCJ9ktmNoU5AxAA/hLZeotyvXVnmT/AGelrbQ== 2024-05-21T01:19:30.548 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.2] 2024-05-21T01:19:30.548 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQCM9ktmbCpjDBAAh/1zNhU4J4uxYIhqfJmE5A== 2024-05-21T01:19:30.548 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.3] 2024-05-21T01:19:30.548 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQCP9ktm0JsGFhAA0Y7W7fA5Mi3j9sDbhA0Blw== 2024-05-21T01:19:30.548 INFO:teuthology.orchestra.run.smithi063.stdout:[mgr.x] 2024-05-21T01:19:30.548 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQCC9ktmW4XUEBAAy/f/uoI3qnP0Yz8LoYG4xw== 2024-05-21T01:19:30.549 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.b] 2024-05-21T01:19:30.549 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQCC9ktmGNaeJxAAXSTfl30FCJ35/Q9uhsYkMg== 2024-05-21T01:19:30.549 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.d] 2024-05-21T01:19:30.549 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQCC9ktmnXRQMBAA/U0iHbP3DbC/EaGl4CJwEg== 2024-05-21T01:19:30.549 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.f] 2024-05-21T01:19:30.549 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQCC9ktmKGHMOBAATVwDDSrE+c1X65zX3/Oqmw== 2024-05-21T01:19:30.549 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.4] 2024-05-21T01:19:30.549 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQCV9ktmhp8rEhAAisWuB6C0+qBijC2Zv5Pxiw== 2024-05-21T01:19:30.549 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.5] 2024-05-21T01:19:30.549 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQCY9ktmnI8kFhAA8eEtd37bixCUZHJjyfa9ww== 2024-05-21T01:19:30.549 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.6] 2024-05-21T01:19:30.549 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQCb9ktmkMjEHBAAkBMregWZlGoZwmvgRaAXww== 2024-05-21T01:19:30.549 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.7] 2024-05-21T01:19:30.550 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQCe9ktmA25KIBAASF8DX0Cydryn+9us5oKWpg== 2024-05-21T01:19:30.550 INFO:teuthology.orchestra.run.smithi063.stdout:[client.0] 2024-05-21T01:19:30.550 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQCD9ktmjFIKAxAA7tvph+EzGz6AkVzzFp4Ihg== 2024-05-21T01:19:30.551 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-21T01:19:30.595 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-21T01:19:30.651 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-21T01:19:30.654 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-21T01:19:30.712 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-21T01:19:30.716 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-21T01:19:30.770 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-21T01:19:30.774 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-21T01:19:30.847 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-21T01:19:30.850 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-21T01:19:30.902 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-21T01:19:30.907 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-21T01:19:30.969 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-21T01:19:30.972 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-21T01:19:31.050 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-21T01:19:31.053 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-21T01:19:31.138 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-21T01:19:31.141 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-21T01:19:31.227 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-21T01:19:31.229 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-21T01:19:31.317 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-21T01:19:31.320 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-21T01:19:31.376 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-21T01:19:31.379 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-21T01:19:31.459 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-21T01:19:31.462 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-21T01:19:31.515 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-21T01:19:31.518 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-21T01:19:31.582 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-21T01:19:31.585 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-21T01:19:31.670 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-21T01:19:31.673 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-21T01:19:31.760 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-21T01:19:31.763 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-21T01:19:31.818 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-05-21T01:19:31.818 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-05-21T01:19:31.838 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-21T01:19:31.953 DEBUG:teuthology.orchestra.run.smithi063:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-05-21T01:19:31.974 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-05-21T01:19:31.988 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-21T01:19:32.085 DEBUG:teuthology.orchestra.run.smithi131:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-05-21T01:19:32.096 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-05-21T01:19:32.148 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-21T01:19:32.236 DEBUG:teuthology.orchestra.run.smithi131:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-05-21T01:19:32.247 DEBUG:teuthology.orchestra.run.smithi063:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-21T01:19:32.249 DEBUG:teuthology.orchestra.run.smithi131:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-21T01:19:32.294 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-05-21T01:19:32.294 INFO:tasks.ceph.mon.a:Restarting daemon 2024-05-21T01:19:32.295 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-05-21T01:19:32.298 INFO:tasks.ceph.mon.a:Started 2024-05-21T01:19:32.298 INFO:tasks.ceph.mon.b:Restarting daemon 2024-05-21T01:19:32.299 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-05-21T01:19:32.340 INFO:tasks.ceph.mon.b:Started 2024-05-21T01:19:32.340 INFO:tasks.ceph.mon.c:Restarting daemon 2024-05-21T01:19:32.341 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-05-21T01:19:32.343 INFO:tasks.ceph.mon.c:Started 2024-05-21T01:19:32.343 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-05-21T01:19:32.344 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-05-21T01:19:32.344 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-05-21T01:19:32.347 INFO:tasks.ceph.mgr.y:Started 2024-05-21T01:19:32.347 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-05-21T01:19:32.347 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-05-21T01:19:32.351 INFO:tasks.ceph.mgr.x:Started 2024-05-21T01:19:32.351 INFO:tasks.ceph:Setting crush tunables to default 2024-05-21T01:19:32.351 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --cluster ceph osd crush tunables default 2024-05-21T01:19:32.492 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:32.485+0000 7f50e2200640 1 Processor -- start 2024-05-21T01:19:32.492 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:32.485+0000 7f50e2200640 1 -- start start 2024-05-21T01:19:32.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:32.489+0000 7f50e2200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f50dc153d70 0x7f50dc15a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:32.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:32.489+0000 7f50e2200640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f50dc0cb6e0 0x7f50dc0c6910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:32.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:32.489+0000 7f50e2200640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f50dc0cbb20 0x7f50dc0c6e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:32.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:32.489+0000 7f50e2200640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f50dc0cb450 con 0x7f50dc0cbb20 2024-05-21T01:19:32.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:32.489+0000 7f50e2200640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f50dc0ca5f0 con 0x7f50dc0cb6e0 2024-05-21T01:19:32.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:32.489+0000 7f50e2200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f50dc0ca8d0 con 0x7f50dc153d70 2024-05-21T01:19:32.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:32.489+0000 7f50dbe00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f50dc0cbb20 0x7f50dc0c6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:32.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:32.489+0000 7f50db400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f50dc153d70 0x7f50dc15a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:32.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:32.489+0000 7f50dbe00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f50dc0cbb20 0x7f50dc0c6e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:54584/0 (socket says 172.21.15.63:54584) 2024-05-21T01:19:32.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:32.489+0000 7f50dbe00640 1 -- 172.21.15.63:0/4272195332 learned_addr learned my addr 172.21.15.63:0/4272195332 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:19:32.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:32.489+0000 7f50d3e00640 1 --2- 172.21.15.63:0/4272195332 >> v2:172.21.15.131:3300/0 conn(0x7f50dc0cb6e0 0x7f50dc0c6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:32.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:32.489+0000 7f50dbe00640 1 -- 172.21.15.63:0/4272195332 >> v2:172.21.15.63:3300/0 conn(0x7f50dc0cbb20 msgr2=0x7f50dc0c6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-05-21T01:19:32.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:32.489+0000 7f50dbe00640 1 -- 172.21.15.63:0/4272195332 >> v2:172.21.15.63:3300/0 conn(0x7f50dc0cbb20 msgr2=0x7f50dc0c6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-21T01:19:32.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:32.489+0000 7f50db400640 1 -- 172.21.15.63:0/4272195332 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f50dc153d70 msgr2=0x7f50dc15a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-21T01:19:32.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:32.489+0000 7f50dbe00640 1 --2- 172.21.15.63:0/4272195332 >> v2:172.21.15.63:3300/0 conn(0x7f50dc0cbb20 0x7f50dc0c6e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-21T01:19:32.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:32.489+0000 7f50db400640 1 -- 172.21.15.63:0/4272195332 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f50dc153d70 msgr2=0x7f50dc15a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-21T01:19:32.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:32.489+0000 7f50db400640 1 --2- 172.21.15.63:0/4272195332 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f50dc153d70 0x7f50dc15a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-21T01:19:32.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:32.489+0000 7f50db400640 1 --2- 172.21.15.63:0/4272195332 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f50dc153d70 0x7f50dc15a5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-21T01:19:32.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:32.489+0000 7f50d3e00640 1 -- 172.21.15.63:0/4272195332 >> v2:172.21.15.131:3300/0 conn(0x7f50dc0cb6e0 msgr2=0x7f50dc0c6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-21T01:19:32.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:32.489+0000 7f50d3e00640 1 -- 172.21.15.63:0/4272195332 >> v2:172.21.15.131:3300/0 conn(0x7f50dc0cb6e0 msgr2=0x7f50dc0c6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-21T01:19:32.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:32.489+0000 7f50d3e00640 1 --2- 172.21.15.63:0/4272195332 >> v2:172.21.15.131:3300/0 conn(0x7f50dc0cb6e0 0x7f50dc0c6910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-21T01:19:32.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:32.489+0000 7f50dbe00640 1 --2- 172.21.15.63:0/4272195332 >> v2:172.21.15.63:3300/0 conn(0x7f50dc0cbb20 0x7f50dc0c6e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-21T01:19:32.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:32.489+0000 7f50d3e00640 1 --2- 172.21.15.63:0/4272195332 >> v2:172.21.15.131:3300/0 conn(0x7f50dc0cb6e0 0x7f50dc0c6910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-21T01:19:32.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:32.693+0000 7f50dbe00640 1 --2- 172.21.15.63:0/4272195332 >> v2:172.21.15.63:3300/0 conn(0x7f50dc0cbb20 0x7f50dc0c6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:32.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:32.693+0000 7f50dbe00640 1 -- 172.21.15.63:0/4272195332 >> v2:172.21.15.63:3300/0 conn(0x7f50dc0cbb20 msgr2=0x7f50dc0c6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-21T01:19:32.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:32.693+0000 7f50dbe00640 1 -- 172.21.15.63:0/4272195332 >> v2:172.21.15.63:3300/0 conn(0x7f50dc0cbb20 msgr2=0x7f50dc0c6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-21T01:19:32.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:32.693+0000 7f50db400640 1 --2- 172.21.15.63:0/4272195332 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f50dc153d70 0x7f50dc15a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:32.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:32.693+0000 7f50dbe00640 1 --2- 172.21.15.63:0/4272195332 >> v2:172.21.15.63:3300/0 conn(0x7f50dc0cbb20 0x7f50dc0c6e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-21T01:19:32.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:32.693+0000 7f50dbe00640 1 --2- 172.21.15.63:0/4272195332 >> v2:172.21.15.63:3300/0 conn(0x7f50dc0cbb20 0x7f50dc0c6e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-21T01:19:32.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:32.693+0000 7f50d3e00640 1 --2- 172.21.15.63:0/4272195332 >> v2:172.21.15.131:3300/0 conn(0x7f50dc0cb6e0 0x7f50dc0c6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:32.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:32.693+0000 7f50db400640 1 -- 172.21.15.63:0/4272195332 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f50dc153d70 msgr2=0x7f50dc15a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-05-21T01:19:32.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:32.693+0000 7f50db400640 1 -- 172.21.15.63:0/4272195332 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f50dc153d70 msgr2=0x7f50dc15a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-21T01:19:32.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:32.693+0000 7f50db400640 1 --2- 172.21.15.63:0/4272195332 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f50dc153d70 0x7f50dc15a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-21T01:19:32.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:32.693+0000 7f50db400640 1 --2- 172.21.15.63:0/4272195332 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f50dc153d70 0x7f50dc15a5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-21T01:19:32.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:32.693+0000 7f50d3e00640 1 -- 172.21.15.63:0/4272195332 >> v2:172.21.15.131:3300/0 conn(0x7f50dc0cb6e0 msgr2=0x7f50dc0c6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-21T01:19:32.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:32.693+0000 7f50d3e00640 1 -- 172.21.15.63:0/4272195332 >> v2:172.21.15.131:3300/0 conn(0x7f50dc0cb6e0 msgr2=0x7f50dc0c6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-21T01:19:32.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:32.693+0000 7f50d3e00640 1 --2- 172.21.15.63:0/4272195332 >> v2:172.21.15.131:3300/0 conn(0x7f50dc0cb6e0 0x7f50dc0c6910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-21T01:19:32.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:32.693+0000 7f50d3e00640 1 --2- 172.21.15.63:0/4272195332 >> v2:172.21.15.131:3300/0 conn(0x7f50dc0cb6e0 0x7f50dc0c6910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-21T01:19:33.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:33.097+0000 7f50dbe00640 1 --2- 172.21.15.63:0/4272195332 >> v2:172.21.15.63:3300/0 conn(0x7f50dc0cbb20 0x7f50dc0c6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:33.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:33.097+0000 7f50dbe00640 1 -- 172.21.15.63:0/4272195332 >> v2:172.21.15.63:3300/0 conn(0x7f50dc0cbb20 msgr2=0x7f50dc0c6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-21T01:19:33.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:33.097+0000 7f50dbe00640 1 -- 172.21.15.63:0/4272195332 >> v2:172.21.15.63:3300/0 conn(0x7f50dc0cbb20 msgr2=0x7f50dc0c6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-21T01:19:33.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:33.097+0000 7f50dbe00640 1 --2- 172.21.15.63:0/4272195332 >> v2:172.21.15.63:3300/0 conn(0x7f50dc0cbb20 0x7f50dc0c6e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-21T01:19:33.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:33.097+0000 7f50d3e00640 1 --2- 172.21.15.63:0/4272195332 >> v2:172.21.15.131:3300/0 conn(0x7f50dc0cb6e0 0x7f50dc0c6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:33.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:33.097+0000 7f50dbe00640 1 --2- 172.21.15.63:0/4272195332 >> v2:172.21.15.63:3300/0 conn(0x7f50dc0cbb20 0x7f50dc0c6e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-21T01:19:33.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:33.097+0000 7f50db400640 1 --2- 172.21.15.63:0/4272195332 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f50dc153d70 0x7f50dc15a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:33.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:33.097+0000 7f50db400640 1 -- 172.21.15.63:0/4272195332 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f50dc153d70 msgr2=0x7f50dc15a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-21T01:19:33.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:33.097+0000 7f50db400640 1 -- 172.21.15.63:0/4272195332 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f50dc153d70 msgr2=0x7f50dc15a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-21T01:19:33.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:33.097+0000 7f50db400640 1 --2- 172.21.15.63:0/4272195332 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f50dc153d70 0x7f50dc15a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-21T01:19:33.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:33.097+0000 7f50d3e00640 1 -- 172.21.15.63:0/4272195332 >> v2:172.21.15.131:3300/0 conn(0x7f50dc0cb6e0 msgr2=0x7f50dc0c6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-05-21T01:19:33.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:33.097+0000 7f50d3e00640 1 -- 172.21.15.63:0/4272195332 >> v2:172.21.15.131:3300/0 conn(0x7f50dc0cb6e0 msgr2=0x7f50dc0c6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-21T01:19:33.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:33.097+0000 7f50db400640 1 --2- 172.21.15.63:0/4272195332 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f50dc153d70 0x7f50dc15a5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-21T01:19:33.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:33.097+0000 7f50d3e00640 1 --2- 172.21.15.63:0/4272195332 >> v2:172.21.15.131:3300/0 conn(0x7f50dc0cb6e0 0x7f50dc0c6910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-21T01:19:33.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:33.097+0000 7f50d3e00640 1 --2- 172.21.15.63:0/4272195332 >> v2:172.21.15.131:3300/0 conn(0x7f50dc0cb6e0 0x7f50dc0c6910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-21T01:19:33.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:33.901+0000 7f50dbe00640 1 --2- 172.21.15.63:0/4272195332 >> v2:172.21.15.63:3300/0 conn(0x7f50dc0cbb20 0x7f50dc0c6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:33.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:33.901+0000 7f50dbe00640 1 -- 172.21.15.63:0/4272195332 >> v2:172.21.15.63:3300/0 conn(0x7f50dc0cbb20 msgr2=0x7f50dc0c6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-21T01:19:33.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:33.901+0000 7f50dbe00640 1 -- 172.21.15.63:0/4272195332 >> v2:172.21.15.63:3300/0 conn(0x7f50dc0cbb20 msgr2=0x7f50dc0c6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-21T01:19:33.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:33.901+0000 7f50db400640 1 --2- 172.21.15.63:0/4272195332 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f50dc153d70 0x7f50dc15a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:33.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:33.901+0000 7f50dbe00640 1 --2- 172.21.15.63:0/4272195332 >> v2:172.21.15.63:3300/0 conn(0x7f50dc0cbb20 0x7f50dc0c6e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-21T01:19:33.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:33.901+0000 7f50d3e00640 1 --2- 172.21.15.63:0/4272195332 >> v2:172.21.15.131:3300/0 conn(0x7f50dc0cb6e0 0x7f50dc0c6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:33.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:33.901+0000 7f50dbe00640 1 --2- 172.21.15.63:0/4272195332 >> v2:172.21.15.63:3300/0 conn(0x7f50dc0cbb20 0x7f50dc0c6e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-21T01:19:33.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:33.901+0000 7f50db400640 1 -- 172.21.15.63:0/4272195332 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f50dc153d70 msgr2=0x7f50dc15a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-05-21T01:19:33.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:33.901+0000 7f50db400640 1 -- 172.21.15.63:0/4272195332 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f50dc153d70 msgr2=0x7f50dc15a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-21T01:19:33.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:33.901+0000 7f50db400640 1 --2- 172.21.15.63:0/4272195332 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f50dc153d70 0x7f50dc15a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-21T01:19:33.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:33.901+0000 7f50d3e00640 1 -- 172.21.15.63:0/4272195332 >> v2:172.21.15.131:3300/0 conn(0x7f50dc0cb6e0 msgr2=0x7f50dc0c6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-05-21T01:19:33.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:33.901+0000 7f50d3e00640 1 -- 172.21.15.63:0/4272195332 >> v2:172.21.15.131:3300/0 conn(0x7f50dc0cb6e0 msgr2=0x7f50dc0c6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-21T01:19:33.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:33.901+0000 7f50d3e00640 1 --2- 172.21.15.63:0/4272195332 >> v2:172.21.15.131:3300/0 conn(0x7f50dc0cb6e0 0x7f50dc0c6910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-21T01:19:33.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:33.901+0000 7f50db400640 1 --2- 172.21.15.63:0/4272195332 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f50dc153d70 0x7f50dc15a5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-21T01:19:33.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:33.901+0000 7f50d3e00640 1 --2- 172.21.15.63:0/4272195332 >> v2:172.21.15.131:3300/0 conn(0x7f50dc0cb6e0 0x7f50dc0c6910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-21T01:19:35.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:35.489+0000 7f50d9600640 1 -- 172.21.15.63:0/4272195332 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f50dc153d70 msgr2=0x7f50dc15a5b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-21T01:19:35.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:35.489+0000 7f50d9600640 1 --2- 172.21.15.63:0/4272195332 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f50dc153d70 0x7f50dc15a5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:35.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:35.489+0000 7f50d9600640 1 -- 172.21.15.63:0/4272195332 >> v2:172.21.15.131:3300/0 conn(0x7f50dc0cb6e0 msgr2=0x7f50dc0c6910 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-21T01:19:35.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:35.489+0000 7f50d9600640 1 --2- 172.21.15.63:0/4272195332 >> v2:172.21.15.131:3300/0 conn(0x7f50dc0cb6e0 0x7f50dc0c6910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:35.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:35.489+0000 7f50d9600640 1 -- 172.21.15.63:0/4272195332 >> v2:172.21.15.63:3300/0 conn(0x7f50dc0cbb20 msgr2=0x7f50dc0c6e50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-21T01:19:35.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:35.489+0000 7f50d9600640 1 --2- 172.21.15.63:0/4272195332 >> v2:172.21.15.63:3300/0 conn(0x7f50dc0cbb20 0x7f50dc0c6e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:35.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:35.489+0000 7f50d9600640 1 -- 172.21.15.63:0/4272195332 --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50dc0cabb0 con 0x7f50c0007310 2024-05-21T01:19:35.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:35.489+0000 7f50d9600640 1 -- 172.21.15.63:0/4272195332 --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50c000c050 con 0x7f50c0003680 2024-05-21T01:19:37.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:37.709+0000 7f50daa00640 1 -- 172.21.15.63:0/4272195332 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1463098416 0 0) 0x7f50dc0cabb0 con 0x7f50c0007310 2024-05-21T01:19:37.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:37.709+0000 7f50daa00640 1 -- 172.21.15.63:0/4272195332 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f50b8003530 con 0x7f50c0007310 2024-05-21T01:19:37.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:37.713+0000 7f50daa00640 1 -- 172.21.15.63:0/4272195332 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3737052648 0 0) 0x7f50c000c050 con 0x7f50c0003680 2024-05-21T01:19:37.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:37.713+0000 7f50daa00640 1 -- 172.21.15.63:0/4272195332 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f50dc0cabb0 con 0x7f50c0003680 2024-05-21T01:19:37.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:37.713+0000 7f50daa00640 1 -- 172.21.15.63:0/4272195332 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2462942343 0 0) 0x7f50b8003530 con 0x7f50c0007310 2024-05-21T01:19:37.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:37.713+0000 7f50daa00640 1 -- 172.21.15.63:0/4272195332 >> v1:172.21.15.131:6789/0 conn(0x7f50c0003680 legacy=0x7f50c0005ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:37.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:37.713+0000 7f50daa00640 1 -- 172.21.15.63:0/4272195332 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50c000d2b0 con 0x7f50c0007310 2024-05-21T01:19:37.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:37.713+0000 7f50daa00640 1 -- 172.21.15.63:0/4272195332 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 466403955 0 0) 0x7f50c400f040 con 0x7f50c0007310 2024-05-21T01:19:37.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:37.713+0000 7f50daa00640 1 -- 172.21.15.63:0/4272195332 >> v1:172.21.15.63:6789/0 conn(0x7f50c0007310 legacy=0x7f50c00097d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:37.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:37.713+0000 7f50dbe00640 1 -- 172.21.15.63:0/4272195332 reap_dead start 2024-05-21T01:19:37.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:37.713+0000 7f50daa00640 1 --2- 172.21.15.63:0/4272195332 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f50b8003cc0 0x7f50b80040a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:37.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:37.713+0000 7f50daa00640 1 --2- 172.21.15.63:0/4272195332 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50b8004810 0x7f50b8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:37.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:37.713+0000 7f50daa00640 1 --2- 172.21.15.63:0/4272195332 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f50b80099c0 0x7f50b800bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:37.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:37.713+0000 7f50daa00640 1 -- 172.21.15.63:0/4272195332 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f50b800c480 con 0x7f50b8004810 2024-05-21T01:19:37.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:37.713+0000 7f50daa00640 1 -- 172.21.15.63:0/4272195332 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f50b800c630 con 0x7f50b80099c0 2024-05-21T01:19:37.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:37.713+0000 7f50daa00640 1 -- 172.21.15.63:0/4272195332 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f50b800c830 con 0x7f50b8003cc0 2024-05-21T01:19:37.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:37.713+0000 7f50d3e00640 1 --2- 172.21.15.63:0/4272195332 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50b8004810 0x7f50b8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:37.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:37.713+0000 7f50db400640 1 --2- 172.21.15.63:0/4272195332 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f50b8003cc0 0x7f50b80040a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:37.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:37.713+0000 7f50dbe00640 1 --2- 172.21.15.63:0/4272195332 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f50b80099c0 0x7f50b800bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:37.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:37.713+0000 7f50d3e00640 1 -- 172.21.15.63:0/4272195332 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f50b8003cc0 msgr2=0x7f50b80040a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:19:37.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:37.713+0000 7f50d3e00640 1 --2- 172.21.15.63:0/4272195332 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f50b8003cc0 0x7f50b80040a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:37.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:37.713+0000 7f50d3e00640 1 -- 172.21.15.63:0/4272195332 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f50b80099c0 msgr2=0x7f50b800bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:19:37.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:37.713+0000 7f50d3e00640 1 --2- 172.21.15.63:0/4272195332 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f50b80099c0 0x7f50b800bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:37.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:37.713+0000 7f50d3e00640 1 -- 172.21.15.63:0/4272195332 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50b8003530 con 0x7f50b8004810 2024-05-21T01:19:37.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:37.717+0000 7f50d3e00640 1 --2- 172.21.15.63:0/4272195332 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50b8004810 0x7f50b8004c90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f50c400efb0 tx=0x7f50c401d7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1b756fa1083c556 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:19:37.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:37.717+0000 7f50daa00640 1 -- 172.21.15.63:0/4272195332 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50c400ec00 con 0x7f50b8004810 2024-05-21T01:19:37.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:37.717+0000 7f50daa00640 1 -- 172.21.15.63:0/4272195332 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50c40a76d0 con 0x7f50b8004810 2024-05-21T01:19:37.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:37.717+0000 7f50daa00640 1 -- 172.21.15.63:0/4272195332 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50c40a7ac0 con 0x7f50b8004810 2024-05-21T01:19:37.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:37.717+0000 7f50e2200640 1 -- 172.21.15.63:0/4272195332 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50b8004810 msgr2=0x7f50b8004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:37.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:37.717+0000 7f50e2200640 1 --2- 172.21.15.63:0/4272195332 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50b8004810 0x7f50b8004c90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f50c400efb0 tx=0x7f50c401d7d0 comp rx=0 tx=0).stop 2024-05-21T01:19:37.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:37.717+0000 7f50e2200640 1 -- 172.21.15.63:0/4272195332 shutdown_connections 2024-05-21T01:19:37.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:37.717+0000 7f50e2200640 1 --2- 172.21.15.63:0/4272195332 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f50b80099c0 0x7f50b800bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:37.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:37.717+0000 7f50e2200640 1 --2- 172.21.15.63:0/4272195332 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50b8004810 0x7f50b8004c90 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:37.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:37.717+0000 7f50e2200640 1 --2- 172.21.15.63:0/4272195332 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f50b8003cc0 0x7f50b80040a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:37.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:37.717+0000 7f50e2200640 1 -- 172.21.15.63:0/4272195332 >> 172.21.15.63:0/4272195332 conn(0x7f50dc0cbf10 msgr2=0x7f50dc0cc320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:19:37.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:37.717+0000 7f50e2200640 1 -- 172.21.15.63:0/4272195332 shutdown_connections 2024-05-21T01:19:37.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:37.717+0000 7f50e2200640 1 -- 172.21.15.63:0/4272195332 wait complete. 2024-05-21T01:19:37.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:37.721+0000 7f50e2200640 1 Processor -- start 2024-05-21T01:19:37.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:37.721+0000 7f50e2200640 1 -- start start 2024-05-21T01:19:37.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:37.721+0000 7f50e2200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f50b8003cc0 0x7f50dc159a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:37.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:37.721+0000 7f50e2200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f50b8004810 0x7f50dc1e66d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:37.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:37.721+0000 7f50e2200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50b80099c0 0x7f50dc146db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:37.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:37.721+0000 7f50e2200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f50dc0737f0 con 0x7f50b80099c0 2024-05-21T01:19:37.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:37.721+0000 7f50e2200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f50dc154150 con 0x7f50b8003cc0 2024-05-21T01:19:37.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:37.721+0000 7f50e2200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f50dc073970 con 0x7f50b8004810 2024-05-21T01:19:37.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:37.721+0000 7f50db400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f50b8003cc0 0x7f50dc159a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:37.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:37.721+0000 7f50d3e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f50b8004810 0x7f50dc1e66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:37.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:37.721+0000 7f50db400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f50b8003cc0 0x7f50dc159a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.63:42364/0 (socket says 172.21.15.63:42364) 2024-05-21T01:19:37.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:37.721+0000 7f50db400640 1 -- 172.21.15.63:0/630405981 learned_addr learned my addr 172.21.15.63:0/630405981 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:19:37.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:37.721+0000 7f50dbe00640 1 --2- 172.21.15.63:0/630405981 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50b80099c0 0x7f50dc146db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:37.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:37.721+0000 7f50dbe00640 1 -- 172.21.15.63:0/630405981 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f50b8004810 msgr2=0x7f50dc1e66d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:37.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:37.721+0000 7f50dbe00640 1 --2- 172.21.15.63:0/630405981 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f50b8004810 0x7f50dc1e66d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:37.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:37.721+0000 7f50dbe00640 1 -- 172.21.15.63:0/630405981 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f50b8003cc0 msgr2=0x7f50dc159a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:37.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:37.721+0000 7f50dbe00640 1 --2- 172.21.15.63:0/630405981 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f50b8003cc0 0x7f50dc159a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:37.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:37.721+0000 7f50dbe00640 1 -- 172.21.15.63:0/630405981 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50dc073e90 con 0x7f50b80099c0 2024-05-21T01:19:37.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:37.725+0000 7f50dbe00640 1 --2- 172.21.15.63:0/630405981 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50b80099c0 0x7f50dc146db0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f50dc072da0 tx=0x7f50d4015d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:19:37.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:37.725+0000 7f50d3400640 1 -- 172.21.15.63:0/630405981 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50d4003bb0 con 0x7f50b80099c0 2024-05-21T01:19:37.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:37.725+0000 7f50d3400640 1 -- 172.21.15.63:0/630405981 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50d401f070 con 0x7f50b80099c0 2024-05-21T01:19:37.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:37.725+0000 7f50e2200640 1 -- 172.21.15.63:0/630405981 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50dc1f35e0 con 0x7f50b80099c0 2024-05-21T01:19:37.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:37.725+0000 7f50d3400640 1 -- 172.21.15.63:0/630405981 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50d40137e0 con 0x7f50b80099c0 2024-05-21T01:19:37.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:37.725+0000 7f50e2200640 1 -- 172.21.15.63:0/630405981 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50dc0cd990 con 0x7f50b80099c0 2024-05-21T01:19:37.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:37.725+0000 7f50d3400640 1 -- 172.21.15.63:0/630405981 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f50d4013d10 con 0x7f50b80099c0 2024-05-21T01:19:37.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:37.725+0000 7f50d3400640 1 -- 172.21.15.63:0/630405981 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f50d4018810 con 0x7f50b80099c0 2024-05-21T01:19:37.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:37.725+0000 7f50e2200640 1 -- 172.21.15.63:0/630405981 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50dc0507f0 con 0x7f50b80099c0 2024-05-21T01:19:37.733 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:37.729+0000 7f50d3400640 1 -- 172.21.15.63:0/630405981 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f50d4018a10 con 0x7f50b80099c0 2024-05-21T01:19:37.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:37.793+0000 7f50e2200640 1 -- 172.21.15.63:0/630405981 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f50dc0c63a0 con 0x7f50b80099c0 2024-05-21T01:19:37.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:37.797+0000 7f50d3400640 1 -- 172.21.15.63:0/630405981 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f50d4018bf0 con 0x7f50b80099c0 2024-05-21T01:19:37.802 INFO:teuthology.orchestra.run.smithi063.stderr:adjusted tunables profile to default 2024-05-21T01:19:37.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:37.797+0000 7f50e2200640 1 -- 172.21.15.63:0/630405981 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50b80099c0 msgr2=0x7f50dc146db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:37.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:37.797+0000 7f50e2200640 1 --2- 172.21.15.63:0/630405981 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50b80099c0 0x7f50dc146db0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f50dc072da0 tx=0x7f50d4015d90 comp rx=0 tx=0).stop 2024-05-21T01:19:37.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:37.797+0000 7f50e2200640 1 -- 172.21.15.63:0/630405981 shutdown_connections 2024-05-21T01:19:37.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:37.797+0000 7f50e2200640 1 --2- 172.21.15.63:0/630405981 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50b80099c0 0x7f50dc146db0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:37.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:37.797+0000 7f50e2200640 1 --2- 172.21.15.63:0/630405981 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f50b8004810 0x7f50dc1e66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:37.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:37.797+0000 7f50e2200640 1 --2- 172.21.15.63:0/630405981 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f50b8003cc0 0x7f50dc159a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:37.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:37.797+0000 7f50e2200640 1 -- 172.21.15.63:0/630405981 >> 172.21.15.63:0/630405981 conn(0x7f50dc0cbf10 msgr2=0x7f50dc14f9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:19:37.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:37.797+0000 7f50e2200640 1 -- 172.21.15.63:0/630405981 shutdown_connections 2024-05-21T01:19:37.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:37.797+0000 7f50e2200640 1 -- 172.21.15.63:0/630405981 wait complete. 2024-05-21T01:19:37.822 INFO:tasks.ceph:check_enable_crimson: False 2024-05-21T01:19:37.823 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-05-21T01:19:37.823 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-05-21T01:19:37.823 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-05-21T01:19:37.842 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-05-21T01:19:37.843 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-05-21T01:19:37.902 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-05-21T01:19:37.902 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-05-21T01:19:37.962 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-05-21T01:19:37.963 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-05-21T01:19:37.983 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-05-21T01:19:37.981+0000 7ffb7b08b180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-21T01:19:38.023 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-05-21T01:19:38.023 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-05-21T01:19:38.036 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-05-21T01:19:38.036 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-05-21T01:19:38.090 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-05-21T01:19:38.090 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-05-21T01:19:38.142 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-05-21T01:19:38.142 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-05-21T01:19:38.199 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph --cluster ceph osd new cda28135-00bb-4194-adcb-e0abf3ae43f3 0 2024-05-21T01:19:38.362 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.357+0000 7faa6dc0d640 1 Processor -- start 2024-05-21T01:19:38.362 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.357+0000 7faa6dc0d640 1 -- start start 2024-05-21T01:19:38.364 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.361+0000 7faa6dc0d640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa680c8e00 0x7faa680c7b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:38.364 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.361+0000 7faa6dc0d640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7faa68070a20 0x7faa680c8050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:38.364 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.361+0000 7faa6dc0d640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa680c92f0 con 0x7faa68153c40 2024-05-21T01:19:38.364 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.361+0000 7faa6dc0d640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7faa680cac90 con 0x7faa68070a20 2024-05-21T01:19:38.364 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.361+0000 7faa6dc0d640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7faa680c95d0 con 0x7faa680c8e00 2024-05-21T01:19:38.364 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.361+0000 7faa66ffd640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa680c8e00 0x7faa680c7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:38.364 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.361+0000 7faa66ffd640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa680c8e00 0x7faa680c7b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.131:59154/0 (socket says 172.21.15.131:59154) 2024-05-21T01:19:38.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.361+0000 7faa66ffd640 1 -- 172.21.15.131:0/538012811 learned_addr learned my addr 172.21.15.131:0/538012811 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-21T01:19:38.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.361+0000 7faa67fff640 1 --2- 172.21.15.131:0/538012811 >> v2:172.21.15.131:3300/0 conn(0x7faa68070a20 0x7faa680c8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:38.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.361+0000 7faa66ffd640 1 -- 172.21.15.131:0/538012811 >> v2:172.21.15.131:3300/0 conn(0x7faa68070a20 msgr2=0x7faa680c8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:19:38.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.361+0000 7faa66ffd640 1 --2- 172.21.15.131:0/538012811 >> v2:172.21.15.131:3300/0 conn(0x7faa68070a20 0x7faa680c8050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:38.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.361+0000 7faa66ffd640 1 -- 172.21.15.131:0/538012811 >> v1:172.21.15.63:6789/0 conn(0x7faa68153c40 legacy=0x7faa6806c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:19:38.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.361+0000 7faa66ffd640 1 -- 172.21.15.131:0/538012811 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa680ca360 con 0x7faa680c8e00 2024-05-21T01:19:38.366 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.361+0000 7faa66ffd640 1 --2- 172.21.15.131:0/538012811 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa680c8e00 0x7faa680c7b10 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7faa50009870 tx=0x7faa5001c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15a964627155c3d8 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:19:38.366 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.361+0000 7faa667fc640 1 -- 172.21.15.131:0/538012811 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa500b1070 con 0x7faa680c8e00 2024-05-21T01:19:38.366 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.361+0000 7faa667fc640 1 -- 172.21.15.131:0/538012811 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa500ac630 con 0x7faa680c8e00 2024-05-21T01:19:38.367 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.361+0000 7faa667fc640 1 -- 172.21.15.131:0/538012811 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa500a8050 con 0x7faa680c8e00 2024-05-21T01:19:38.367 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.365+0000 7faa6dc0d640 1 -- 172.21.15.131:0/538012811 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa680c8e00 msgr2=0x7faa680c7b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:38.367 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.365+0000 7faa6dc0d640 1 --2- 172.21.15.131:0/538012811 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa680c8e00 0x7faa680c7b10 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7faa50009870 tx=0x7faa5001c560 comp rx=0 tx=0).stop 2024-05-21T01:19:38.367 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.365+0000 7faa6dc0d640 1 -- 172.21.15.131:0/538012811 shutdown_connections 2024-05-21T01:19:38.368 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.365+0000 7faa6dc0d640 1 --2- 172.21.15.131:0/538012811 >> v2:172.21.15.131:3300/0 conn(0x7faa68070a20 0x7faa680c8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:38.368 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.365+0000 7faa6dc0d640 1 --2- 172.21.15.131:0/538012811 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa680c8e00 0x7faa680c7b10 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:38.368 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.365+0000 7faa6dc0d640 1 -- 172.21.15.131:0/538012811 >> 172.21.15.131:0/538012811 conn(0x7faa680caf00 msgr2=0x7faa680cb310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:19:38.368 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.365+0000 7faa6dc0d640 1 -- 172.21.15.131:0/538012811 shutdown_connections 2024-05-21T01:19:38.368 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.365+0000 7faa6dc0d640 1 -- 172.21.15.131:0/538012811 wait complete. 2024-05-21T01:19:38.368 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.365+0000 7faa6dc0d640 1 Processor -- start 2024-05-21T01:19:38.368 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.365+0000 7faa6dc0d640 1 -- start start 2024-05-21T01:19:38.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.365+0000 7faa6dc0d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faa68070a20 0x7faa68146c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:38.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.365+0000 7faa6dc0d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa680c8e00 0x7faa6815c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:38.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.365+0000 7faa6dc0d640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa68153c40 0x7faa68142bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:38.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.365+0000 7faa6dc0d640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7faa681663d0 con 0x7faa68070a20 2024-05-21T01:19:38.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.365+0000 7faa6dc0d640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7faa68154230 con 0x7faa680c8e00 2024-05-21T01:19:38.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.365+0000 7faa6dc0d640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7faa68166550 con 0x7faa68153c40 2024-05-21T01:19:38.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.365+0000 7faa66ffd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa680c8e00 0x7faa6815c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:38.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.365+0000 7faa66ffd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa680c8e00 0x7faa6815c1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:47200/0 (socket says 172.21.15.131:47200) 2024-05-21T01:19:38.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.365+0000 7faa67fff640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa68153c40 0x7faa68142bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:38.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.365+0000 7faa66ffd640 1 -- 172.21.15.131:0/1910186432 learned_addr learned my addr 172.21.15.131:0/1910186432 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-21T01:19:38.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.365+0000 7faa677fe640 1 --2- 172.21.15.131:0/1910186432 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faa68070a20 0x7faa68146c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:38.371 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.365+0000 7faa66ffd640 1 -- 172.21.15.131:0/1910186432 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa68153c40 msgr2=0x7faa68142bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:38.372 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.365+0000 7faa66ffd640 1 --2- 172.21.15.131:0/1910186432 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa68153c40 0x7faa68142bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:38.372 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.365+0000 7faa66ffd640 1 -- 172.21.15.131:0/1910186432 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faa68070a20 msgr2=0x7faa68146c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:38.372 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.365+0000 7faa66ffd640 1 --2- 172.21.15.131:0/1910186432 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faa68070a20 0x7faa68146c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:38.372 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.365+0000 7faa66ffd640 1 -- 172.21.15.131:0/1910186432 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa6814f190 con 0x7faa680c8e00 2024-05-21T01:19:38.372 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.365+0000 7faa67fff640 1 --2- 172.21.15.131:0/1910186432 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa68153c40 0x7faa68142bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-21T01:19:38.372 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.365+0000 7faa66ffd640 1 --2- 172.21.15.131:0/1910186432 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa680c8e00 0x7faa6815c1f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7faa500af040 tx=0x7faa50019300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:19:38.372 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.365+0000 7faa5ffff640 1 -- 172.21.15.131:0/1910186432 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa500b1040 con 0x7faa680c8e00 2024-05-21T01:19:38.372 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.365+0000 7faa5ffff640 1 -- 172.21.15.131:0/1910186432 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa500ba070 con 0x7faa680c8e00 2024-05-21T01:19:38.372 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.365+0000 7faa6dc0d640 1 -- 172.21.15.131:0/1910186432 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa6814f470 con 0x7faa680c8e00 2024-05-21T01:19:38.372 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.365+0000 7faa5ffff640 1 -- 172.21.15.131:0/1910186432 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa500a8040 con 0x7faa680c8e00 2024-05-21T01:19:38.372 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.365+0000 7faa5ffff640 1 -- 172.21.15.131:0/1910186432 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7faa500b5660 con 0x7faa680c8e00 2024-05-21T01:19:38.372 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.369+0000 7faa6dc0d640 1 -- 172.21.15.131:0/1910186432 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa6814fa30 con 0x7faa680c8e00 2024-05-21T01:19:38.372 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.369+0000 7faa5ffff640 1 -- 172.21.15.131:0/1910186432 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7faa500bf460 con 0x7faa680c8e00 2024-05-21T01:19:38.373 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.369+0000 7faa6dc0d640 1 -- 172.21.15.131:0/1910186432 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa680507f0 con 0x7faa680c8e00 2024-05-21T01:19:38.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.369+0000 7faa5ffff640 1 -- 172.21.15.131:0/1910186432 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7faa50016150 con 0x7faa680c8e00 2024-05-21T01:19:38.442 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.437+0000 7faa6dc0d640 1 -- 172.21.15.131:0/1910186432 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd new", "uuid": "cda28135-00bb-4194-adcb-e0abf3ae43f3", "id": 0} v 0) -- 0x7faa680c8a90 con 0x7faa680c8e00 2024-05-21T01:19:38.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.441+0000 7faa5ffff640 1 -- 172.21.15.131:0/1910186432 <== mon.1 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cda28135-00bb-4194-adcb-e0abf3ae43f3", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7faa500b5b30 con 0x7faa680c8e00 2024-05-21T01:19:38.447 INFO:teuthology.orchestra.run.smithi131.stdout:0 2024-05-21T01:19:38.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.445+0000 7faa6dc0d640 1 -- 172.21.15.131:0/1910186432 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa680c8e00 msgr2=0x7faa6815c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:38.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.445+0000 7faa6dc0d640 1 --2- 172.21.15.131:0/1910186432 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa680c8e00 0x7faa6815c1f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7faa500af040 tx=0x7faa50019300 comp rx=0 tx=0).stop 2024-05-21T01:19:38.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.445+0000 7faa6dc0d640 1 -- 172.21.15.131:0/1910186432 shutdown_connections 2024-05-21T01:19:38.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.445+0000 7faa6dc0d640 1 --2- 172.21.15.131:0/1910186432 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa68153c40 0x7faa68142bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:38.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.445+0000 7faa6dc0d640 1 --2- 172.21.15.131:0/1910186432 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa680c8e00 0x7faa6815c1f0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:38.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.445+0000 7faa6dc0d640 1 --2- 172.21.15.131:0/1910186432 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7faa68070a20 0x7faa68146c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:38.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.445+0000 7faa6dc0d640 1 -- 172.21.15.131:0/1910186432 >> 172.21.15.131:0/1910186432 conn(0x7faa680caf00 msgr2=0x7faa680cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:19:38.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.445+0000 7faa6dc0d640 1 -- 172.21.15.131:0/1910186432 shutdown_connections 2024-05-21T01:19:38.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.445+0000 7faa6dc0d640 1 -- 172.21.15.131:0/1910186432 wait complete. 2024-05-21T01:19:38.465 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph --cluster ceph osd new 4aeb370d-ec2f-4a91-b17b-035fd72bdaea 1 2024-05-21T01:19:38.493 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-05-21T01:19:38.489+0000 7ffb7b08b180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-21T01:19:38.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.577+0000 7fb4beab6640 1 Processor -- start 2024-05-21T01:19:38.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.577+0000 7fb4beab6640 1 -- start start 2024-05-21T01:19:38.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.577+0000 7fb4beab6640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb4b80cd7f0 0x7fb4b80cdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:38.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.577+0000 7fb4beab6640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fb4b80724e0 0x7fb4b815c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:38.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.577+0000 7fb4beab6640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb4b815f3c0 0x7fb4b815f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:38.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.577+0000 7fb4beab6640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7fb4b80cd450 con 0x7fb4b815f3c0 2024-05-21T01:19:38.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.577+0000 7fb4beab6640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fb4b815c310 con 0x7fb4b80724e0 2024-05-21T01:19:38.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.577+0000 7fb4beab6640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fb4b815bfe0 con 0x7fb4b80cd7f0 2024-05-21T01:19:38.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.577+0000 7fb4b7fff640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fb4b80724e0 0x7fb4b815c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:38.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.577+0000 7fb4bc852640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb4b80cd7f0 0x7fb4b80cdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:38.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.577+0000 7fb4b7fff640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fb4b80724e0 0x7fb4b815c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:47204/0 (socket says 172.21.15.131:47204) 2024-05-21T01:19:38.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.577+0000 7fb4b7fff640 1 -- 172.21.15.131:0/1519850536 learned_addr learned my addr 172.21.15.131:0/1519850536 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-21T01:19:38.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.577+0000 7fb4bd053640 1 --2- 172.21.15.131:0/1519850536 >> v2:172.21.15.63:3300/0 conn(0x7fb4b815f3c0 0x7fb4b815f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:38.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.577+0000 7fb4bc852640 1 -- 172.21.15.131:0/1519850536 >> v2:172.21.15.131:3300/0 conn(0x7fb4b80724e0 msgr2=0x7fb4b815c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:19:38.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.577+0000 7fb4bc852640 1 --2- 172.21.15.131:0/1519850536 >> v2:172.21.15.131:3300/0 conn(0x7fb4b80724e0 0x7fb4b815c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:38.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.577+0000 7fb4bc852640 1 -- 172.21.15.131:0/1519850536 >> v2:172.21.15.63:3300/0 conn(0x7fb4b815f3c0 msgr2=0x7fb4b815f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:19:38.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.577+0000 7fb4bc852640 1 --2- 172.21.15.131:0/1519850536 >> v2:172.21.15.63:3300/0 conn(0x7fb4b815f3c0 0x7fb4b815f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:38.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.577+0000 7fb4bc852640 1 -- 172.21.15.131:0/1519850536 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4b815cce0 con 0x7fb4b80cd7f0 2024-05-21T01:19:38.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.577+0000 7fb4b7fff640 1 --2- 172.21.15.131:0/1519850536 >> v2:172.21.15.131:3300/0 conn(0x7fb4b80724e0 0x7fb4b815c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-21T01:19:38.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.581+0000 7fb4bc852640 1 --2- 172.21.15.131:0/1519850536 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb4b80cd7f0 0x7fb4b80cdbd0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb4b8073f80 tx=0x7fb4a801ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb412e29fb7aaa00 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:19:38.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.581+0000 7fb4b77fe640 1 -- 172.21.15.131:0/1519850536 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4a80b5070 con 0x7fb4b80cd7f0 2024-05-21T01:19:38.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.581+0000 7fb4b77fe640 1 -- 172.21.15.131:0/1519850536 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4a80a8930 con 0x7fb4b80cd7f0 2024-05-21T01:19:38.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.581+0000 7fb4b77fe640 1 -- 172.21.15.131:0/1519850536 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4a80a8d00 con 0x7fb4b80cd7f0 2024-05-21T01:19:38.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.581+0000 7fb4beab6640 1 -- 172.21.15.131:0/1519850536 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb4b80cd7f0 msgr2=0x7fb4b80cdbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:38.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.581+0000 7fb4beab6640 1 --2- 172.21.15.131:0/1519850536 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb4b80cd7f0 0x7fb4b80cdbd0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb4b8073f80 tx=0x7fb4a801ec70 comp rx=0 tx=0).stop 2024-05-21T01:19:38.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.581+0000 7fb4beab6640 1 -- 172.21.15.131:0/1519850536 shutdown_connections 2024-05-21T01:19:38.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.581+0000 7fb4beab6640 1 --2- 172.21.15.131:0/1519850536 >> v2:172.21.15.63:3300/0 conn(0x7fb4b815f3c0 0x7fb4b815f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:38.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.581+0000 7fb4beab6640 1 --2- 172.21.15.131:0/1519850536 >> v2:172.21.15.131:3300/0 conn(0x7fb4b80724e0 0x7fb4b815c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:38.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.581+0000 7fb4beab6640 1 --2- 172.21.15.131:0/1519850536 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb4b80cd7f0 0x7fb4b80cdbd0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:38.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.581+0000 7fb4beab6640 1 -- 172.21.15.131:0/1519850536 >> 172.21.15.131:0/1519850536 conn(0x7fb4b80cae90 msgr2=0x7fb4b80cb2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:19:38.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.581+0000 7fb4beab6640 1 -- 172.21.15.131:0/1519850536 shutdown_connections 2024-05-21T01:19:38.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.581+0000 7fb4beab6640 1 -- 172.21.15.131:0/1519850536 wait complete. 2024-05-21T01:19:38.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.585+0000 7fb4beab6640 1 Processor -- start 2024-05-21T01:19:38.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.585+0000 7fb4beab6640 1 -- start start 2024-05-21T01:19:38.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.585+0000 7fb4beab6640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb4b80724e0 0x7fb4b814ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:38.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.585+0000 7fb4beab6640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb4b80cd7f0 0x7fb4b8157be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:38.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.585+0000 7fb4beab6640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb4b815f3c0 0x7fb4b8157200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:38.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.585+0000 7fb4beab6640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fb4b806ef60 con 0x7fb4b815f3c0 2024-05-21T01:19:38.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.585+0000 7fb4beab6640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fb4b80cd170 con 0x7fb4b80724e0 2024-05-21T01:19:38.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.585+0000 7fb4beab6640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fb4b8156400 con 0x7fb4b80cd7f0 2024-05-21T01:19:38.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.585+0000 7fb4bc852640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb4b80724e0 0x7fb4b814ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:38.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.585+0000 7fb4b7fff640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb4b80cd7f0 0x7fb4b8157be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:38.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.585+0000 7fb4bc852640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb4b80724e0 0x7fb4b814ff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:47206/0 (socket says 172.21.15.131:47206) 2024-05-21T01:19:38.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.585+0000 7fb4bc852640 1 -- 172.21.15.131:0/1306731173 learned_addr learned my addr 172.21.15.131:0/1306731173 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-21T01:19:38.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.585+0000 7fb4bd053640 1 --2- 172.21.15.131:0/1306731173 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb4b815f3c0 0x7fb4b8157200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:38.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.585+0000 7fb4bc852640 1 -- 172.21.15.131:0/1306731173 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb4b80cd7f0 msgr2=0x7fb4b8157be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:38.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.585+0000 7fb4bc852640 1 --2- 172.21.15.131:0/1306731173 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb4b80cd7f0 0x7fb4b8157be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:38.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.585+0000 7fb4bc852640 1 -- 172.21.15.131:0/1306731173 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb4b815f3c0 msgr2=0x7fb4b8157200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:38.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.585+0000 7fb4bc852640 1 --2- 172.21.15.131:0/1306731173 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb4b815f3c0 0x7fb4b8157200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:38.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.585+0000 7fb4bc852640 1 -- 172.21.15.131:0/1306731173 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4b80739d0 con 0x7fb4b80724e0 2024-05-21T01:19:38.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.585+0000 7fb4bd053640 1 --2- 172.21.15.131:0/1306731173 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb4b815f3c0 0x7fb4b8157200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T01:19:38.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.585+0000 7fb4bc852640 1 --2- 172.21.15.131:0/1306731173 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb4b80724e0 0x7fb4b814ff30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb4a801f510 tx=0x7fb4a801ba10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:19:38.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.585+0000 7fb4b57fa640 1 -- 172.21.15.131:0/1306731173 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4a80bf070 con 0x7fb4b80724e0 2024-05-21T01:19:38.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.585+0000 7fb4b57fa640 1 -- 172.21.15.131:0/1306731173 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4a80b0660 con 0x7fb4b80724e0 2024-05-21T01:19:38.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.585+0000 7fb4beab6640 1 -- 172.21.15.131:0/1306731173 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4b81f29e0 con 0x7fb4b80724e0 2024-05-21T01:19:38.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.585+0000 7fb4b57fa640 1 -- 172.21.15.131:0/1306731173 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4a80b5040 con 0x7fb4b80724e0 2024-05-21T01:19:38.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.585+0000 7fb4beab6640 1 -- 172.21.15.131:0/1306731173 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4b80c7220 con 0x7fb4b80724e0 2024-05-21T01:19:38.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.585+0000 7fb4b57fa640 1 -- 172.21.15.131:0/1306731173 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb4a80c2070 con 0x7fb4b80724e0 2024-05-21T01:19:38.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.585+0000 7fb4b57fa640 1 -- 172.21.15.131:0/1306731173 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7fb4a80c4bb0 con 0x7fb4b80724e0 2024-05-21T01:19:38.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.585+0000 7fb4beab6640 1 -- 172.21.15.131:0/1306731173 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4b80507f0 con 0x7fb4b80724e0 2024-05-21T01:19:38.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.589+0000 7fb4b57fa640 1 -- 172.21.15.131:0/1306731173 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fb4a80187d0 con 0x7fb4b80724e0 2024-05-21T01:19:38.660 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.657+0000 7fb4beab6640 1 -- 172.21.15.131:0/1306731173 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4aeb370d-ec2f-4a91-b17b-035fd72bdaea", "id": 1} v 0) -- 0x7fb4b80cca90 con 0x7fb4b80724e0 2024-05-21T01:19:38.660 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-05-21T01:19:38.657+0000 7f9e33777180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-21T01:19:38.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.661+0000 7fb4b57fa640 1 -- 172.21.15.131:0/1306731173 <== mon.1 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4aeb370d-ec2f-4a91-b17b-035fd72bdaea", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7fb4a80b0a50 con 0x7fb4b80724e0 2024-05-21T01:19:38.665 INFO:teuthology.orchestra.run.smithi131.stdout:1 2024-05-21T01:19:38.667 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.661+0000 7fb4beab6640 1 -- 172.21.15.131:0/1306731173 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb4b80724e0 msgr2=0x7fb4b814ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:38.667 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.661+0000 7fb4beab6640 1 --2- 172.21.15.131:0/1306731173 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb4b80724e0 0x7fb4b814ff30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb4a801f510 tx=0x7fb4a801ba10 comp rx=0 tx=0).stop 2024-05-21T01:19:38.667 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.661+0000 7fb4beab6640 1 -- 172.21.15.131:0/1306731173 shutdown_connections 2024-05-21T01:19:38.667 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.661+0000 7fb4beab6640 1 --2- 172.21.15.131:0/1306731173 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb4b815f3c0 0x7fb4b8157200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:38.667 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.661+0000 7fb4beab6640 1 --2- 172.21.15.131:0/1306731173 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb4b80cd7f0 0x7fb4b8157be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:38.667 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.661+0000 7fb4beab6640 1 --2- 172.21.15.131:0/1306731173 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb4b80724e0 0x7fb4b814ff30 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:38.667 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.661+0000 7fb4beab6640 1 -- 172.21.15.131:0/1306731173 >> 172.21.15.131:0/1306731173 conn(0x7fb4b80cae90 msgr2=0x7fb4b815f870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:19:38.667 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.661+0000 7fb4beab6640 1 -- 172.21.15.131:0/1306731173 shutdown_connections 2024-05-21T01:19:38.667 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.661+0000 7fb4beab6640 1 -- 172.21.15.131:0/1306731173 wait complete. 2024-05-21T01:19:38.682 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph --cluster ceph osd new 8368b112-35a3-43cf-ad1c-803f05708091 2 2024-05-21T01:19:38.706 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-05-21T01:19:38.701+0000 7ffb7b08b180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-21T01:19:38.825 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.821+0000 7f84a36e4640 1 Processor -- start 2024-05-21T01:19:38.825 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.821+0000 7f84a36e4640 1 -- start start 2024-05-21T01:19:38.826 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.821+0000 7f84a36e4640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f849c153e30 0x7f849c0c94a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:38.826 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.821+0000 7f84a36e4640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f849c074270 0x7f849c0c6980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:38.826 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.821+0000 7f84a36e4640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f849c15d390 con 0x7f849c0c6ec0 2024-05-21T01:19:38.826 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.821+0000 7f84a36e4640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f849c15e1f0 con 0x7f849c074270 2024-05-21T01:19:38.827 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.821+0000 7f84a36e4640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f849c15d670 con 0x7f849c153e30 2024-05-21T01:19:38.827 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.821+0000 7f84a1480640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f849c153e30 0x7f849c0c94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:38.827 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.821+0000 7f84a1480640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f849c153e30 0x7f849c0c94a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:47214/0 (socket says 172.21.15.131:47214) 2024-05-21T01:19:38.827 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.821+0000 7f84a0c7f640 1 --2- 172.21.15.131:0/59223402 >> v2:172.21.15.63:3300/0 conn(0x7f849c074270 0x7f849c0c6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:38.827 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.821+0000 7f84a1c81640 1 --1- 172.21.15.131:0/59223402 >> v1:172.21.15.63:6789/0 conn(0x7f849c0c6ec0 0x7f849c15a050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.131:50388/0 (socket says 172.21.15.131:50388) 2024-05-21T01:19:38.827 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.821+0000 7f84a1480640 1 -- 172.21.15.131:0/59223402 learned_addr learned my addr 172.21.15.131:0/59223402 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-21T01:19:38.827 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.825+0000 7f8493fff640 1 -- 172.21.15.131:0/59223402 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 819333454 0 0) 0x7f849c15d390 con 0x7f849c0c6ec0 2024-05-21T01:19:38.827 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.825+0000 7f84a1480640 1 -- 172.21.15.131:0/59223402 >> v2:172.21.15.63:3300/0 conn(0x7f849c074270 msgr2=0x7f849c0c6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:19:38.828 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.825+0000 7f84a1480640 1 --2- 172.21.15.131:0/59223402 >> v2:172.21.15.63:3300/0 conn(0x7f849c074270 0x7f849c0c6980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:38.828 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.825+0000 7f84a1480640 1 -- 172.21.15.131:0/59223402 >> v1:172.21.15.63:6789/0 conn(0x7f849c0c6ec0 legacy=0x7f849c15a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:38.828 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.825+0000 7f84a1480640 1 -- 172.21.15.131:0/59223402 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f849c15d950 con 0x7f849c153e30 2024-05-21T01:19:38.829 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.825+0000 7f84a1480640 1 --2- 172.21.15.131:0/59223402 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f849c153e30 0x7f849c0c94a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f849c074b70 tx=0x7f848c01c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c278ff49a19fbfb7 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:19:38.829 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.825+0000 7f8493fff640 1 -- 172.21.15.131:0/59223402 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f848c0b1070 con 0x7f849c153e30 2024-05-21T01:19:38.829 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.825+0000 7f8493fff640 1 -- 172.21.15.131:0/59223402 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f848c0ac600 con 0x7f849c153e30 2024-05-21T01:19:38.829 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.825+0000 7f8493fff640 1 -- 172.21.15.131:0/59223402 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f848c0ac9d0 con 0x7f849c153e30 2024-05-21T01:19:38.830 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.825+0000 7f84a36e4640 1 -- 172.21.15.131:0/59223402 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f849c153e30 msgr2=0x7f849c0c94a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:38.830 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.825+0000 7f84a36e4640 1 --2- 172.21.15.131:0/59223402 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f849c153e30 0x7f849c0c94a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f849c074b70 tx=0x7f848c01c490 comp rx=0 tx=0).stop 2024-05-21T01:19:38.830 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.825+0000 7f84a36e4640 1 -- 172.21.15.131:0/59223402 shutdown_connections 2024-05-21T01:19:38.830 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.825+0000 7f84a36e4640 1 --2- 172.21.15.131:0/59223402 >> v2:172.21.15.63:3300/0 conn(0x7f849c074270 0x7f849c0c6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:38.830 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.825+0000 7f84a36e4640 1 --2- 172.21.15.131:0/59223402 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f849c153e30 0x7f849c0c94a0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:38.830 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.825+0000 7f84a36e4640 1 -- 172.21.15.131:0/59223402 >> 172.21.15.131:0/59223402 conn(0x7f849c071130 msgr2=0x7f849c071540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:19:38.830 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.825+0000 7f84a36e4640 1 -- 172.21.15.131:0/59223402 shutdown_connections 2024-05-21T01:19:38.830 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.825+0000 7f84a36e4640 1 -- 172.21.15.131:0/59223402 wait complete. 2024-05-21T01:19:38.831 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.829+0000 7f84a36e4640 1 Processor -- start 2024-05-21T01:19:38.831 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.829+0000 7f84a36e4640 1 -- start start 2024-05-21T01:19:38.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.829+0000 7f84a36e4640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f849c074270 0x7f849c158fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:38.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.829+0000 7f84a36e4640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f849c0c6ec0 0x7f849c159500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:38.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.829+0000 7f84a36e4640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f849c153e30 0x7f849c150b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:38.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.829+0000 7f84a36e4640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f849c073e40 con 0x7f849c153e30 2024-05-21T01:19:38.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.829+0000 7f84a36e4640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f849c154420 con 0x7f849c074270 2024-05-21T01:19:38.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.829+0000 7f84a36e4640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f849c073fc0 con 0x7f849c0c6ec0 2024-05-21T01:19:38.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.829+0000 7f84a1480640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f849c074270 0x7f849c158fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:38.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.829+0000 7f84a1480640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f849c074270 0x7f849c158fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:47222/0 (socket says 172.21.15.131:47222) 2024-05-21T01:19:38.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.829+0000 7f84a1480640 1 -- 172.21.15.131:0/3040012527 learned_addr learned my addr 172.21.15.131:0/3040012527 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-21T01:19:38.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.829+0000 7f84a0c7f640 1 --2- 172.21.15.131:0/3040012527 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f849c0c6ec0 0x7f849c159500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:38.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.829+0000 7f84a1c81640 1 --2- 172.21.15.131:0/3040012527 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f849c153e30 0x7f849c150b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:38.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.829+0000 7f84a1480640 1 -- 172.21.15.131:0/3040012527 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f849c0c6ec0 msgr2=0x7f849c159500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:38.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.829+0000 7f84a1480640 1 --2- 172.21.15.131:0/3040012527 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f849c0c6ec0 0x7f849c159500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:38.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.829+0000 7f84a1480640 1 -- 172.21.15.131:0/3040012527 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f849c153e30 msgr2=0x7f849c150b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:38.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.829+0000 7f84a1480640 1 --2- 172.21.15.131:0/3040012527 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f849c153e30 0x7f849c150b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:38.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.829+0000 7f84a1480640 1 -- 172.21.15.131:0/3040012527 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f849c1f59c0 con 0x7f849c074270 2024-05-21T01:19:38.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.829+0000 7f84a1c81640 1 --2- 172.21.15.131:0/3040012527 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f849c153e30 0x7f849c150b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T01:19:38.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.829+0000 7f84a1480640 1 --2- 172.21.15.131:0/3040012527 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f849c074270 0x7f849c158fc0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f848c0190a0 tx=0x7f848c01acd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:19:38.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.829+0000 7f8491ffb640 1 -- 172.21.15.131:0/3040012527 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f848c0b1040 con 0x7f849c074270 2024-05-21T01:19:38.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.829+0000 7f8491ffb640 1 -- 172.21.15.131:0/3040012527 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f848c0bc070 con 0x7f849c074270 2024-05-21T01:19:38.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.829+0000 7f84a36e4640 1 -- 172.21.15.131:0/3040012527 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f849c1f5c80 con 0x7f849c074270 2024-05-21T01:19:38.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.829+0000 7f8491ffb640 1 -- 172.21.15.131:0/3040012527 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f848c0b7650 con 0x7f849c074270 2024-05-21T01:19:38.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.829+0000 7f84a36e4640 1 -- 172.21.15.131:0/3040012527 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f849c14f970 con 0x7f849c074270 2024-05-21T01:19:38.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.829+0000 7f84a36e4640 1 -- 172.21.15.131:0/3040012527 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f849c0507f0 con 0x7f849c074270 2024-05-21T01:19:38.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.829+0000 7f8491ffb640 1 -- 172.21.15.131:0/3040012527 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f848c0b7b80 con 0x7f849c074270 2024-05-21T01:19:38.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.829+0000 7f8491ffb640 1 -- 172.21.15.131:0/3040012527 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f848c0b63b0 con 0x7f849c074270 2024-05-21T01:19:38.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.833+0000 7f8491ffb640 1 -- 172.21.15.131:0/3040012527 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f848c0c5020 con 0x7f849c074270 2024-05-21T01:19:38.903 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.901+0000 7f84a36e4640 1 -- 172.21.15.131:0/3040012527 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8368b112-35a3-43cf-ad1c-803f05708091", "id": 2} v 0) -- 0x7f849c0c7410 con 0x7f849c074270 2024-05-21T01:19:38.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.905+0000 7f8491ffb640 1 -- 172.21.15.131:0/3040012527 <== mon.1 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8368b112-35a3-43cf-ad1c-803f05708091", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f848c016110 con 0x7f849c074270 2024-05-21T01:19:38.909 INFO:teuthology.orchestra.run.smithi131.stdout:2 2024-05-21T01:19:38.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.905+0000 7f84a36e4640 1 -- 172.21.15.131:0/3040012527 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f849c074270 msgr2=0x7f849c158fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:38.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.905+0000 7f84a36e4640 1 --2- 172.21.15.131:0/3040012527 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f849c074270 0x7f849c158fc0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f848c0190a0 tx=0x7f848c01acd0 comp rx=0 tx=0).stop 2024-05-21T01:19:38.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.905+0000 7f84a36e4640 1 -- 172.21.15.131:0/3040012527 shutdown_connections 2024-05-21T01:19:38.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.905+0000 7f84a36e4640 1 --2- 172.21.15.131:0/3040012527 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f849c153e30 0x7f849c150b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:38.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.905+0000 7f84a36e4640 1 --2- 172.21.15.131:0/3040012527 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f849c0c6ec0 0x7f849c159500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:38.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.905+0000 7f84a36e4640 1 --2- 172.21.15.131:0/3040012527 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f849c074270 0x7f849c158fc0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:38.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.905+0000 7f84a36e4640 1 -- 172.21.15.131:0/3040012527 >> 172.21.15.131:0/3040012527 conn(0x7f849c071130 msgr2=0x7f849c068b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:19:38.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.905+0000 7f84a36e4640 1 -- 172.21.15.131:0/3040012527 shutdown_connections 2024-05-21T01:19:38.911 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:38.909+0000 7f84a36e4640 1 -- 172.21.15.131:0/3040012527 wait complete. 2024-05-21T01:19:38.926 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph --cluster ceph osd new 26208950-e3ca-4b9a-94cd-c159453a5dfa 3 2024-05-21T01:19:39.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.037+0000 7f6f65c79640 1 Processor -- start 2024-05-21T01:19:39.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.037+0000 7f6f65c79640 1 -- start start 2024-05-21T01:19:39.042 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.037+0000 7f6f65c79640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f6f60153cc0 0x7f6f6006c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:39.042 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.037+0000 7f6f65c79640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6f601540a0 0x7f6f600cb9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:39.043 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.037+0000 7f6f65c79640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6f600ccdf0 0x7f6f600c7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:39.043 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.037+0000 7f6f65c79640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f6f600cd2d0 con 0x7f6f601540a0 2024-05-21T01:19:39.043 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.037+0000 7f6f65c79640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f6f6006e250 con 0x7f6f60153cc0 2024-05-21T01:19:39.043 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.037+0000 7f6f65c79640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f6f6006e530 con 0x7f6f600ccdf0 2024-05-21T01:19:39.043 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.037+0000 7f6f5f7fe640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f6f60153cc0 0x7f6f6006c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:39.043 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.037+0000 7f6f5ffff640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6f600ccdf0 0x7f6f600c7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:39.043 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.037+0000 7f6f5f7fe640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f6f60153cc0 0x7f6f6006c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:47238/0 (socket says 172.21.15.131:47238) 2024-05-21T01:19:39.043 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.037+0000 7f6f5f7fe640 1 -- 172.21.15.131:0/2886975873 learned_addr learned my addr 172.21.15.131:0/2886975873 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-21T01:19:39.043 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.037+0000 7f6f5ffff640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6f600ccdf0 0x7f6f600c7aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.131:59202/0 (socket says 172.21.15.131:59202) 2024-05-21T01:19:39.043 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.037+0000 7f6f5effd640 1 --2- 172.21.15.131:0/2886975873 >> v2:172.21.15.63:3300/0 conn(0x7f6f601540a0 0x7f6f600cb9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:39.043 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.037+0000 7f6f5f7fe640 1 -- 172.21.15.131:0/2886975873 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6f600ccdf0 msgr2=0x7f6f600c7aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:19:39.043 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.037+0000 7f6f5f7fe640 1 --2- 172.21.15.131:0/2886975873 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6f600ccdf0 0x7f6f600c7aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:39.043 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.037+0000 7f6f5f7fe640 1 -- 172.21.15.131:0/2886975873 >> v2:172.21.15.63:3300/0 conn(0x7f6f601540a0 msgr2=0x7f6f600cb9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:19:39.043 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.037+0000 7f6f5f7fe640 1 --2- 172.21.15.131:0/2886975873 >> v2:172.21.15.63:3300/0 conn(0x7f6f601540a0 0x7f6f600cb9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:39.044 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.037+0000 7f6f5f7fe640 1 -- 172.21.15.131:0/2886975873 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f6006e810 con 0x7f6f60153cc0 2024-05-21T01:19:39.044 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.037+0000 7f6f5effd640 1 --2- 172.21.15.131:0/2886975873 >> v2:172.21.15.63:3300/0 conn(0x7f6f601540a0 0x7f6f600cb9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T01:19:39.044 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.041+0000 7f6f5f7fe640 1 --2- 172.21.15.131:0/2886975873 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6f60153cc0 0x7f6f6006c4a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6f60072140 tx=0x7f6f5001c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d761bdd1c666c21f server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:19:39.044 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.041+0000 7f6f5e7fc640 1 -- 172.21.15.131:0/2886975873 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f500b0070 con 0x7f6f60153cc0 2024-05-21T01:19:39.044 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.041+0000 7f6f5e7fc640 1 -- 172.21.15.131:0/2886975873 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f500ab600 con 0x7f6f60153cc0 2024-05-21T01:19:39.044 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.041+0000 7f6f5e7fc640 1 -- 172.21.15.131:0/2886975873 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f500ab9d0 con 0x7f6f60153cc0 2024-05-21T01:19:39.045 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.041+0000 7f6f65c79640 1 -- 172.21.15.131:0/2886975873 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6f60153cc0 msgr2=0x7f6f6006c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:39.045 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.041+0000 7f6f65c79640 1 --2- 172.21.15.131:0/2886975873 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6f60153cc0 0x7f6f6006c4a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f6f60072140 tx=0x7f6f5001c490 comp rx=0 tx=0).stop 2024-05-21T01:19:39.045 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.041+0000 7f6f65c79640 1 -- 172.21.15.131:0/2886975873 shutdown_connections 2024-05-21T01:19:39.045 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.041+0000 7f6f65c79640 1 --2- 172.21.15.131:0/2886975873 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6f600ccdf0 0x7f6f600c7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:39.045 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.041+0000 7f6f65c79640 1 --2- 172.21.15.131:0/2886975873 >> v2:172.21.15.63:3300/0 conn(0x7f6f601540a0 0x7f6f600cb9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:39.046 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.041+0000 7f6f65c79640 1 --2- 172.21.15.131:0/2886975873 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6f60153cc0 0x7f6f6006c4a0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:39.046 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.041+0000 7f6f65c79640 1 -- 172.21.15.131:0/2886975873 >> 172.21.15.131:0/2886975873 conn(0x7f6f600cae90 msgr2=0x7f6f600cb2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:19:39.046 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.041+0000 7f6f65c79640 1 -- 172.21.15.131:0/2886975873 shutdown_connections 2024-05-21T01:19:39.046 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.041+0000 7f6f65c79640 1 -- 172.21.15.131:0/2886975873 wait complete. 2024-05-21T01:19:39.046 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.041+0000 7f6f65c79640 1 Processor -- start 2024-05-21T01:19:39.046 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.041+0000 7f6f65c79640 1 -- start start 2024-05-21T01:19:39.048 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.045+0000 7f6f65c79640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6f600ccdf0 0x7f6f601569c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:39.048 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.045+0000 7f6f65c79640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f60153cc0 0x7f6f60143a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:39.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.045+0000 7f6f65c79640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6f601540a0 0x7f6f60152200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:39.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.045+0000 7f6f65c79640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f6f60159f00 con 0x7f6f60153cc0 2024-05-21T01:19:39.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.045+0000 7f6f65c79640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f6f60159d80 con 0x7f6f600ccdf0 2024-05-21T01:19:39.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.045+0000 7f6f65c79640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f6f6015a080 con 0x7f6f601540a0 2024-05-21T01:19:39.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.045+0000 7f6f5f7fe640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6f600ccdf0 0x7f6f601569c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:39.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.045+0000 7f6f5f7fe640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6f600ccdf0 0x7f6f601569c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:47246/0 (socket says 172.21.15.131:47246) 2024-05-21T01:19:39.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.045+0000 7f6f5f7fe640 1 -- 172.21.15.131:0/2906345307 learned_addr learned my addr 172.21.15.131:0/2906345307 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-21T01:19:39.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.045+0000 7f6f5ffff640 1 --2- 172.21.15.131:0/2906345307 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6f601540a0 0x7f6f60152200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:39.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.045+0000 7f6f5effd640 1 --2- 172.21.15.131:0/2906345307 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f60153cc0 0x7f6f60143a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:39.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.045+0000 7f6f5f7fe640 1 -- 172.21.15.131:0/2906345307 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6f601540a0 msgr2=0x7f6f60152200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:39.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.045+0000 7f6f5f7fe640 1 --2- 172.21.15.131:0/2906345307 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6f601540a0 0x7f6f60152200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:39.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.045+0000 7f6f5f7fe640 1 -- 172.21.15.131:0/2906345307 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f60153cc0 msgr2=0x7f6f60143a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:39.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.045+0000 7f6f5f7fe640 1 --2- 172.21.15.131:0/2906345307 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f60153cc0 0x7f6f60143a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:39.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.045+0000 7f6f5f7fe640 1 -- 172.21.15.131:0/2906345307 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f60143f50 con 0x7f6f600ccdf0 2024-05-21T01:19:39.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.045+0000 7f6f5f7fe640 1 --2- 172.21.15.131:0/2906345307 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6f600ccdf0 0x7f6f601569c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f6f5001cd30 tx=0x7f6f50019230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:19:39.050 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.045+0000 7f6f57fff640 1 -- 172.21.15.131:0/2906345307 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f500b0040 con 0x7f6f600ccdf0 2024-05-21T01:19:39.050 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.045+0000 7f6f57fff640 1 -- 172.21.15.131:0/2906345307 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f500b4420 con 0x7f6f600ccdf0 2024-05-21T01:19:39.050 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.045+0000 7f6f65c79640 1 -- 172.21.15.131:0/2906345307 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f60154f90 con 0x7f6f600ccdf0 2024-05-21T01:19:39.050 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.045+0000 7f6f57fff640 1 -- 172.21.15.131:0/2906345307 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f500b4810 con 0x7f6f600ccdf0 2024-05-21T01:19:39.050 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.045+0000 7f6f65c79640 1 -- 172.21.15.131:0/2906345307 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f60155230 con 0x7f6f600ccdf0 2024-05-21T01:19:39.050 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.045+0000 7f6f57fff640 1 -- 172.21.15.131:0/2906345307 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6f500b49b0 con 0x7f6f600ccdf0 2024-05-21T01:19:39.050 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.045+0000 7f6f57fff640 1 -- 172.21.15.131:0/2906345307 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f6f500b33c0 con 0x7f6f600ccdf0 2024-05-21T01:19:39.050 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.045+0000 7f6f65c79640 1 -- 172.21.15.131:0/2906345307 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f600507f0 con 0x7f6f600ccdf0 2024-05-21T01:19:39.051 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.049+0000 7f6f57fff640 1 -- 172.21.15.131:0/2906345307 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f6f50016110 con 0x7f6f600ccdf0 2024-05-21T01:19:39.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.117+0000 7f6f65c79640 1 -- 172.21.15.131:0/2906345307 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd new", "uuid": "26208950-e3ca-4b9a-94cd-c159453a5dfa", "id": 3} v 0) -- 0x7f6f60072ca0 con 0x7f6f600ccdf0 2024-05-21T01:19:39.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.121+0000 7f6f57fff640 1 -- 172.21.15.131:0/2906345307 <== mon.1 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "26208950-e3ca-4b9a-94cd-c159453a5dfa", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f6f500bd400 con 0x7f6f600ccdf0 2024-05-21T01:19:39.127 INFO:teuthology.orchestra.run.smithi131.stdout:3 2024-05-21T01:19:39.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.125+0000 7f6f65c79640 1 -- 172.21.15.131:0/2906345307 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6f600ccdf0 msgr2=0x7f6f601569c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:39.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.125+0000 7f6f65c79640 1 --2- 172.21.15.131:0/2906345307 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6f600ccdf0 0x7f6f601569c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f6f5001cd30 tx=0x7f6f50019230 comp rx=0 tx=0).stop 2024-05-21T01:19:39.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.125+0000 7f6f65c79640 1 -- 172.21.15.131:0/2906345307 shutdown_connections 2024-05-21T01:19:39.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.125+0000 7f6f65c79640 1 --2- 172.21.15.131:0/2906345307 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6f601540a0 0x7f6f60152200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:39.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.125+0000 7f6f65c79640 1 --2- 172.21.15.131:0/2906345307 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f60153cc0 0x7f6f60143a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:39.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.125+0000 7f6f65c79640 1 --2- 172.21.15.131:0/2906345307 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6f600ccdf0 0x7f6f601569c0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:39.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.125+0000 7f6f65c79640 1 -- 172.21.15.131:0/2906345307 >> 172.21.15.131:0/2906345307 conn(0x7f6f600cae90 msgr2=0x7f6f600cc1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:19:39.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.125+0000 7f6f65c79640 1 -- 172.21.15.131:0/2906345307 shutdown_connections 2024-05-21T01:19:39.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.125+0000 7f6f65c79640 1 -- 172.21.15.131:0/2906345307 wait complete. 2024-05-21T01:19:39.143 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph --cluster ceph osd new d8c93283-1e10-4419-9934-d5048c5d0ad1 4 2024-05-21T01:19:39.190 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-05-21T01:19:39.185+0000 7f9e33777180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-21T01:19:39.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.253+0000 7fd782182640 1 Processor -- start 2024-05-21T01:19:39.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.253+0000 7fd782182640 1 -- start start 2024-05-21T01:19:39.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.257+0000 7fd782182640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd77c153e30 0x7fd77c0c94a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:39.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.257+0000 7fd782182640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd77c15a050 0x7fd77c15a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:39.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.257+0000 7fd782182640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd77c15aa00 con 0x7fd77c074270 2024-05-21T01:19:39.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.257+0000 7fd782182640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7fd77c15e1f0 con 0x7fd77c153e30 2024-05-21T01:19:39.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.257+0000 7fd782182640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fd77c15d390 con 0x7fd77c15a050 2024-05-21T01:19:39.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.257+0000 7fd77bfff640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd77c15a050 0x7fd77c15a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:39.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.257+0000 7fd77bfff640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd77c15a050 0x7fd77c15a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:47252/0 (socket says 172.21.15.131:47252) 2024-05-21T01:19:39.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.257+0000 7fd77bfff640 1 -- 172.21.15.131:0/2662889214 learned_addr learned my addr 172.21.15.131:0/2662889214 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-21T01:19:39.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.257+0000 7fd77b7fe640 1 --2- 172.21.15.131:0/2662889214 >> v2:172.21.15.63:3300/0 conn(0x7fd77c153e30 0x7fd77c0c94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:39.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.257+0000 7fd77bfff640 1 -- 172.21.15.131:0/2662889214 >> v2:172.21.15.63:3300/0 conn(0x7fd77c153e30 msgr2=0x7fd77c0c94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:19:39.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.257+0000 7fd77bfff640 1 --2- 172.21.15.131:0/2662889214 >> v2:172.21.15.63:3300/0 conn(0x7fd77c153e30 0x7fd77c0c94a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:39.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.257+0000 7fd77bfff640 1 -- 172.21.15.131:0/2662889214 >> v1:172.21.15.63:6789/0 conn(0x7fd77c074270 legacy=0x7fd77c0c6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:19:39.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.257+0000 7fd77bfff640 1 -- 172.21.15.131:0/2662889214 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd77c15d670 con 0x7fd77c15a050 2024-05-21T01:19:39.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.257+0000 7fd77bfff640 1 --2- 172.21.15.131:0/2662889214 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd77c15a050 0x7fd77c15a4c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd77c0cc9e0 tx=0x7fd77401c960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8bb193343fdc021 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:19:39.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.257+0000 7fd77affd640 1 -- 172.21.15.131:0/2662889214 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7740a56d0 con 0x7fd77c15a050 2024-05-21T01:19:39.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.257+0000 7fd77affd640 1 -- 172.21.15.131:0/2662889214 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7740a5870 con 0x7fd77c15a050 2024-05-21T01:19:39.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.257+0000 7fd77affd640 1 -- 172.21.15.131:0/2662889214 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7740a5c40 con 0x7fd77c15a050 2024-05-21T01:19:39.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.257+0000 7fd782182640 1 -- 172.21.15.131:0/2662889214 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd77c15a050 msgr2=0x7fd77c15a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:39.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.257+0000 7fd782182640 1 --2- 172.21.15.131:0/2662889214 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd77c15a050 0x7fd77c15a4c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd77c0cc9e0 tx=0x7fd77401c960 comp rx=0 tx=0).stop 2024-05-21T01:19:39.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.257+0000 7fd782182640 1 -- 172.21.15.131:0/2662889214 shutdown_connections 2024-05-21T01:19:39.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.257+0000 7fd782182640 1 --2- 172.21.15.131:0/2662889214 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd77c15a050 0x7fd77c15a4c0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:39.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.257+0000 7fd782182640 1 --2- 172.21.15.131:0/2662889214 >> v2:172.21.15.63:3300/0 conn(0x7fd77c153e30 0x7fd77c0c94a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:39.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.257+0000 7fd782182640 1 -- 172.21.15.131:0/2662889214 >> 172.21.15.131:0/2662889214 conn(0x7fd77c071130 msgr2=0x7fd77c071540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:19:39.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.257+0000 7fd782182640 1 -- 172.21.15.131:0/2662889214 shutdown_connections 2024-05-21T01:19:39.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.257+0000 7fd782182640 1 -- 172.21.15.131:0/2662889214 wait complete. 2024-05-21T01:19:39.265 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.261+0000 7fd782182640 1 Processor -- start 2024-05-21T01:19:39.265 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.261+0000 7fd782182640 1 -- start start 2024-05-21T01:19:39.265 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.261+0000 7fd782182640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd77c074270 0x7fd77c15c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:39.265 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.261+0000 7fd782182640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd77c153e30 0x7fd77c0cd280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:39.265 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.261+0000 7fd782182640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd77c15a050 0x7fd77c0caba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:39.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.261+0000 7fd782182640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fd77c0c7210 con 0x7fd77c15a050 2024-05-21T01:19:39.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.261+0000 7fd782182640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd77c0c7090 con 0x7fd77c153e30 2024-05-21T01:19:39.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.261+0000 7fd782182640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fd77c154210 con 0x7fd77c074270 2024-05-21T01:19:39.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.261+0000 7fd773fff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd77c153e30 0x7fd77c0cd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:39.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.261+0000 7fd77b7fe640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd77c074270 0x7fd77c15c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:39.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.261+0000 7fd773fff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd77c153e30 0x7fd77c0cd280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:47262/0 (socket says 172.21.15.131:47262) 2024-05-21T01:19:39.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.261+0000 7fd773fff640 1 -- 172.21.15.131:0/3335400502 learned_addr learned my addr 172.21.15.131:0/3335400502 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-21T01:19:39.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.261+0000 7fd77bfff640 1 --2- 172.21.15.131:0/3335400502 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd77c15a050 0x7fd77c0caba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:39.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.261+0000 7fd773fff640 1 -- 172.21.15.131:0/3335400502 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd77c074270 msgr2=0x7fd77c15c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:39.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.261+0000 7fd773fff640 1 --2- 172.21.15.131:0/3335400502 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd77c074270 0x7fd77c15c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:39.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.261+0000 7fd773fff640 1 -- 172.21.15.131:0/3335400502 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd77c15a050 msgr2=0x7fd77c0caba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:39.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.261+0000 7fd773fff640 1 --2- 172.21.15.131:0/3335400502 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd77c15a050 0x7fd77c0caba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:39.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.261+0000 7fd773fff640 1 -- 172.21.15.131:0/3335400502 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd77c1583b0 con 0x7fd77c153e30 2024-05-21T01:19:39.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.261+0000 7fd77bfff640 1 --2- 172.21.15.131:0/3335400502 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd77c15a050 0x7fd77c0caba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T01:19:39.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.261+0000 7fd773fff640 1 --2- 172.21.15.131:0/3335400502 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd77c153e30 0x7fd77c0cd280 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd76c00b410 tx=0x7fd76c00b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:19:39.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.261+0000 7fd778ff9640 1 -- 172.21.15.131:0/3335400502 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd76c015030 con 0x7fd77c153e30 2024-05-21T01:19:39.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.261+0000 7fd778ff9640 1 -- 172.21.15.131:0/3335400502 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd76c004020 con 0x7fd77c153e30 2024-05-21T01:19:39.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.261+0000 7fd782182640 1 -- 172.21.15.131:0/3335400502 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd77c158690 con 0x7fd77c153e30 2024-05-21T01:19:39.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.261+0000 7fd778ff9640 1 -- 172.21.15.131:0/3335400502 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd76c004450 con 0x7fd77c153e30 2024-05-21T01:19:39.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.261+0000 7fd782182640 1 -- 172.21.15.131:0/3335400502 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd77c1f6290 con 0x7fd77c153e30 2024-05-21T01:19:39.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.261+0000 7fd778ff9640 1 -- 172.21.15.131:0/3335400502 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd76c018070 con 0x7fd77c153e30 2024-05-21T01:19:39.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.261+0000 7fd778ff9640 1 -- 172.21.15.131:0/3335400502 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fd76c01a410 con 0x7fd77c153e30 2024-05-21T01:19:39.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.261+0000 7fd782182640 1 -- 172.21.15.131:0/3335400502 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd77c1f6a60 con 0x7fd77c153e30 2024-05-21T01:19:39.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.265+0000 7fd778ff9640 1 -- 172.21.15.131:0/3335400502 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fd76c003680 con 0x7fd77c153e30 2024-05-21T01:19:39.296 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-05-21T01:19:39.293+0000 7ffb7b08b180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-21T01:19:39.336 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.333+0000 7fd782182640 1 -- 172.21.15.131:0/3335400502 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d8c93283-1e10-4419-9934-d5048c5d0ad1", "id": 4} v 0) -- 0x7fd77c0507f0 con 0x7fd77c153e30 2024-05-21T01:19:39.340 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.337+0000 7fd778ff9640 1 -- 172.21.15.131:0/3335400502 <== mon.1 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d8c93283-1e10-4419-9934-d5048c5d0ad1", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7fd76c003c00 con 0x7fd77c153e30 2024-05-21T01:19:39.340 INFO:teuthology.orchestra.run.smithi131.stdout:4 2024-05-21T01:19:39.341 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.337+0000 7fd782182640 1 -- 172.21.15.131:0/3335400502 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd77c153e30 msgr2=0x7fd77c0cd280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:39.341 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.337+0000 7fd782182640 1 --2- 172.21.15.131:0/3335400502 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd77c153e30 0x7fd77c0cd280 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd76c00b410 tx=0x7fd76c00b8d0 comp rx=0 tx=0).stop 2024-05-21T01:19:39.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.337+0000 7fd782182640 1 -- 172.21.15.131:0/3335400502 shutdown_connections 2024-05-21T01:19:39.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.337+0000 7fd782182640 1 --2- 172.21.15.131:0/3335400502 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd77c15a050 0x7fd77c0caba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:39.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.337+0000 7fd782182640 1 --2- 172.21.15.131:0/3335400502 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd77c153e30 0x7fd77c0cd280 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:39.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.337+0000 7fd782182640 1 --2- 172.21.15.131:0/3335400502 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd77c074270 0x7fd77c15c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:39.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.337+0000 7fd782182640 1 -- 172.21.15.131:0/3335400502 >> 172.21.15.131:0/3335400502 conn(0x7fd77c071130 msgr2=0x7fd77c14f040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:19:39.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.337+0000 7fd782182640 1 -- 172.21.15.131:0/3335400502 shutdown_connections 2024-05-21T01:19:39.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.337+0000 7fd782182640 1 -- 172.21.15.131:0/3335400502 wait complete. 2024-05-21T01:19:39.352 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-05-21T01:19:39.349+0000 7ffb7b08b180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-21T01:19:39.357 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph --cluster ceph osd new 93a6fe9b-eaa6-4474-bf9b-ae0571feacf7 5 2024-05-21T01:19:39.407 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-05-21T01:19:39.405+0000 7ffb7b08b180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-21T01:19:39.419 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-05-21T01:19:39.413+0000 7f9e33777180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-21T01:19:39.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.465+0000 7f30ca3ff640 1 Processor -- start 2024-05-21T01:19:39.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.465+0000 7f30ca3ff640 1 -- start start 2024-05-21T01:19:39.470 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.465+0000 7f30ca3ff640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f30c41560d0 0x7f30c40c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:39.470 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.465+0000 7f30ca3ff640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f30c40724e0 0x7f30c415c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:39.471 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.465+0000 7f30ca3ff640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30c40c9340 con 0x7f30c40ca380 2024-05-21T01:19:39.471 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.465+0000 7f30ca3ff640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f30c40c9840 con 0x7f30c41560d0 2024-05-21T01:19:39.471 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.465+0000 7f30ca3ff640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f30c415cdf0 con 0x7f30c40724e0 2024-05-21T01:19:39.471 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.465+0000 7f30c37fe640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f30c40724e0 0x7f30c415c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:39.471 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.465+0000 7f30c899c640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f30c40ca380 0x7f30c415f4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:37320/0 (socket says 172.21.15.131:37320) 2024-05-21T01:19:39.471 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.465+0000 7f30c899c640 1 -- 172.21.15.131:0/4090299764 learned_addr learned my addr 172.21.15.131:0/4090299764 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-05-21T01:19:39.471 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.465+0000 7f30c37fe640 1 --2- 172.21.15.131:0/4090299764 >> v2:172.21.15.131:3300/0 conn(0x7f30c40724e0 0x7f30c415c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:47276/0 (socket says 172.21.15.131:47276) 2024-05-21T01:19:39.471 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.465+0000 7f30c3fff640 1 --2- 172.21.15.131:0/4090299764 >> v2:172.21.15.63:3300/0 conn(0x7f30c41560d0 0x7f30c40c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:39.471 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.465+0000 7f30c37fe640 1 -- 172.21.15.131:0/4090299764 >> v2:172.21.15.63:3300/0 conn(0x7f30c41560d0 msgr2=0x7f30c40c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:19:39.471 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.465+0000 7f30c37fe640 1 --2- 172.21.15.131:0/4090299764 >> v2:172.21.15.63:3300/0 conn(0x7f30c41560d0 0x7f30c40c8e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:39.471 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.465+0000 7f30c37fe640 1 -- 172.21.15.131:0/4090299764 >> v1:172.21.15.131:6789/0 conn(0x7f30c40ca380 legacy=0x7f30c415f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:39.471 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.465+0000 7f30c37fe640 1 -- 172.21.15.131:0/4090299764 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30c40c9a90 con 0x7f30c40724e0 2024-05-21T01:19:39.471 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.465+0000 7f30c2ffd640 1 -- 172.21.15.131:0/4090299764 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4244413910 0 0) 0x7f30c40c9340 con 0x7f30c40ca380 2024-05-21T01:19:39.473 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.469+0000 7f30c37fe640 1 --2- 172.21.15.131:0/4090299764 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f30c40724e0 0x7f30c415c8b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f30c4074c00 tx=0x7f30b401c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2867da8e52dc83ca server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:19:39.473 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.469+0000 7f30c2ffd640 1 -- 172.21.15.131:0/4090299764 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30b40b0070 con 0x7f30c40724e0 2024-05-21T01:19:39.473 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.469+0000 7f30c2ffd640 1 -- 172.21.15.131:0/4090299764 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30b40ab400 con 0x7f30c40724e0 2024-05-21T01:19:39.473 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.469+0000 7f30c2ffd640 1 -- 172.21.15.131:0/4090299764 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30b40ab7d0 con 0x7f30c40724e0 2024-05-21T01:19:39.474 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.469+0000 7f30ca3ff640 1 -- 172.21.15.131:0/4090299764 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f30c40724e0 msgr2=0x7f30c415c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:39.474 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.469+0000 7f30ca3ff640 1 --2- 172.21.15.131:0/4090299764 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f30c40724e0 0x7f30c415c8b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f30c4074c00 tx=0x7f30b401c480 comp rx=0 tx=0).stop 2024-05-21T01:19:39.474 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.469+0000 7f30ca3ff640 1 -- 172.21.15.131:0/4090299764 shutdown_connections 2024-05-21T01:19:39.474 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.469+0000 7f30ca3ff640 1 --2- 172.21.15.131:0/4090299764 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f30c40724e0 0x7f30c415c8b0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:39.474 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.469+0000 7f30ca3ff640 1 --2- 172.21.15.131:0/4090299764 >> v2:172.21.15.63:3300/0 conn(0x7f30c41560d0 0x7f30c40c8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:39.474 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.469+0000 7f30ca3ff640 1 -- 172.21.15.131:0/4090299764 >> 172.21.15.131:0/4090299764 conn(0x7f30c40caf00 msgr2=0x7f30c40cb310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:19:39.474 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.469+0000 7f30ca3ff640 1 -- 172.21.15.131:0/4090299764 shutdown_connections 2024-05-21T01:19:39.474 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.469+0000 7f30ca3ff640 1 -- 172.21.15.131:0/4090299764 wait complete. 2024-05-21T01:19:39.475 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.473+0000 7f30ca3ff640 1 Processor -- start 2024-05-21T01:19:39.475 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.473+0000 7f30ca3ff640 1 -- start start 2024-05-21T01:19:39.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.473+0000 7f30ca3ff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f30c40724e0 0x7f30c40bf780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:39.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.473+0000 7f30ca3ff640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f30c40ca380 0x7f30c41580c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:39.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.473+0000 7f30ca3ff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f30c41560d0 0x7f30c40ccd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:39.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.473+0000 7f30ca3ff640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f30c4070d40 con 0x7f30c41560d0 2024-05-21T01:19:39.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.473+0000 7f30ca3ff640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f30c40caba0 con 0x7f30c40724e0 2024-05-21T01:19:39.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.473+0000 7f30ca3ff640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f30c4070ec0 con 0x7f30c40ca380 2024-05-21T01:19:39.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.473+0000 7f30c3fff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f30c40724e0 0x7f30c40bf780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:39.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.473+0000 7f30c37fe640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f30c40ca380 0x7f30c41580c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:39.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.473+0000 7f30c3fff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f30c40724e0 0x7f30c40bf780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:47278/0 (socket says 172.21.15.131:47278) 2024-05-21T01:19:39.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.473+0000 7f30c3fff640 1 -- 172.21.15.131:0/1540623105 learned_addr learned my addr 172.21.15.131:0/1540623105 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-21T01:19:39.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.473+0000 7f30c899c640 1 --2- 172.21.15.131:0/1540623105 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f30c41560d0 0x7f30c40ccd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:39.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.473+0000 7f30c3fff640 1 -- 172.21.15.131:0/1540623105 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f30c40ca380 msgr2=0x7f30c41580c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:39.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.473+0000 7f30c3fff640 1 --2- 172.21.15.131:0/1540623105 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f30c40ca380 0x7f30c41580c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:39.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.473+0000 7f30c3fff640 1 -- 172.21.15.131:0/1540623105 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f30c41560d0 msgr2=0x7f30c40ccd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:39.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.473+0000 7f30c3fff640 1 --2- 172.21.15.131:0/1540623105 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f30c41560d0 0x7f30c40ccd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:39.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.473+0000 7f30c3fff640 1 -- 172.21.15.131:0/1540623105 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30c40c6f20 con 0x7f30c40724e0 2024-05-21T01:19:39.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.473+0000 7f30c37fe640 1 --2- 172.21.15.131:0/1540623105 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f30c40ca380 0x7f30c41580c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-21T01:19:39.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.473+0000 7f30c899c640 1 --2- 172.21.15.131:0/1540623105 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f30c41560d0 0x7f30c40ccd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T01:19:39.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.473+0000 7f30c3fff640 1 --2- 172.21.15.131:0/1540623105 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f30c40724e0 0x7f30c40bf780 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f30b800d650 tx=0x7f30b800db10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:19:39.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.473+0000 7f30c0ff9640 1 -- 172.21.15.131:0/1540623105 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30b800b6c0 con 0x7f30c40724e0 2024-05-21T01:19:39.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.473+0000 7f30c0ff9640 1 -- 172.21.15.131:0/1540623105 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30b8019070 con 0x7f30c40724e0 2024-05-21T01:19:39.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.473+0000 7f30c0ff9640 1 -- 172.21.15.131:0/1540623105 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30b800ba80 con 0x7f30c40724e0 2024-05-21T01:19:39.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.473+0000 7f30ca3ff640 1 -- 172.21.15.131:0/1540623105 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30c41f9660 con 0x7f30c40724e0 2024-05-21T01:19:39.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.473+0000 7f30ca3ff640 1 -- 172.21.15.131:0/1540623105 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30c4157830 con 0x7f30c40724e0 2024-05-21T01:19:39.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.473+0000 7f30c0ff9640 1 -- 172.21.15.131:0/1540623105 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f30b800bc20 con 0x7f30c40724e0 2024-05-21T01:19:39.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.473+0000 7f30c0ff9640 1 -- 172.21.15.131:0/1540623105 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f30b80149b0 con 0x7f30c40724e0 2024-05-21T01:19:39.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.473+0000 7f30ca3ff640 1 -- 172.21.15.131:0/1540623105 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30c40507f0 con 0x7f30c40724e0 2024-05-21T01:19:39.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.477+0000 7f30c0ff9640 1 -- 172.21.15.131:0/1540623105 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f30b8014c50 con 0x7f30c40724e0 2024-05-21T01:19:39.488 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-05-21T01:19:39.485+0000 7ffb7b08b180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-21T01:19:39.541 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-05-21T01:19:39.537+0000 7ffb7b08b180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-21T01:19:39.545 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.541+0000 7f30ca3ff640 1 -- 172.21.15.131:0/1540623105 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd new", "uuid": "93a6fe9b-eaa6-4474-bf9b-ae0571feacf7", "id": 5} v 0) -- 0x7f30c406dc40 con 0x7f30c40724e0 2024-05-21T01:19:39.552 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.549+0000 7f30c0ff9640 1 -- 172.21.15.131:0/1540623105 <== mon.1 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "93a6fe9b-eaa6-4474-bf9b-ae0571feacf7", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f30b8014430 con 0x7f30c40724e0 2024-05-21T01:19:39.552 INFO:teuthology.orchestra.run.smithi131.stdout:5 2024-05-21T01:19:39.554 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.549+0000 7f30ca3ff640 1 -- 172.21.15.131:0/1540623105 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f30c40724e0 msgr2=0x7f30c40bf780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:39.554 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.549+0000 7f30ca3ff640 1 --2- 172.21.15.131:0/1540623105 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f30c40724e0 0x7f30c40bf780 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f30b800d650 tx=0x7f30b800db10 comp rx=0 tx=0).stop 2024-05-21T01:19:39.554 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.549+0000 7f30ca3ff640 1 -- 172.21.15.131:0/1540623105 shutdown_connections 2024-05-21T01:19:39.554 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.549+0000 7f30ca3ff640 1 --2- 172.21.15.131:0/1540623105 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f30c41560d0 0x7f30c40ccd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:39.554 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.549+0000 7f30ca3ff640 1 --2- 172.21.15.131:0/1540623105 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f30c40ca380 0x7f30c41580c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:39.554 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.549+0000 7f30ca3ff640 1 --2- 172.21.15.131:0/1540623105 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f30c40724e0 0x7f30c40bf780 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:39.554 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.549+0000 7f30ca3ff640 1 -- 172.21.15.131:0/1540623105 >> 172.21.15.131:0/1540623105 conn(0x7f30c40caf00 msgr2=0x7f30c41550b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:19:39.555 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.549+0000 7f30ca3ff640 1 -- 172.21.15.131:0/1540623105 shutdown_connections 2024-05-21T01:19:39.555 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.549+0000 7f30ca3ff640 1 -- 172.21.15.131:0/1540623105 wait complete. 2024-05-21T01:19:39.569 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph --cluster ceph osd new e05e6c8c-2dda-49ab-8116-5ea9038d0f0f 6 2024-05-21T01:19:39.623 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-05-21T01:19:39.621+0000 7ffb7b08b180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-21T01:19:39.678 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-05-21T01:19:39.673+0000 7ffb7b08b180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-21T01:19:39.678 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.673+0000 7f04d6f6d640 1 Processor -- start 2024-05-21T01:19:39.678 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.673+0000 7f04d6f6d640 1 -- start start 2024-05-21T01:19:39.680 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.677+0000 7f04d6f6d640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f04d0153e30 0x7f04d00c94a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:39.680 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.677+0000 7f04d6f6d640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f04d0074270 0x7f04d00c6980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:39.680 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.677+0000 7f04d6f6d640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04d015d390 con 0x7f04d00c6ec0 2024-05-21T01:19:39.680 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.677+0000 7f04d6f6d640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f04d015e1f0 con 0x7f04d0153e30 2024-05-21T01:19:39.680 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.677+0000 7f04d6f6d640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f04d015d670 con 0x7f04d0074270 2024-05-21T01:19:39.681 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.677+0000 7f04cffff640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f04d0074270 0x7f04d00c6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:39.681 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.677+0000 7f04cffff640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f04d0074270 0x7f04d00c6980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.131:59238/0 (socket says 172.21.15.131:59238) 2024-05-21T01:19:39.681 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.677+0000 7f04cffff640 1 -- 172.21.15.131:0/385752259 learned_addr learned my addr 172.21.15.131:0/385752259 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-21T01:19:39.681 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.677+0000 7f04d4d09640 1 --2- 172.21.15.131:0/385752259 >> v2:172.21.15.63:3300/0 conn(0x7f04d0153e30 0x7f04d00c94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:39.681 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.677+0000 7f04cffff640 1 -- 172.21.15.131:0/385752259 >> v2:172.21.15.63:3300/0 conn(0x7f04d0153e30 msgr2=0x7f04d00c94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:19:39.681 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.677+0000 7f04cffff640 1 --2- 172.21.15.131:0/385752259 >> v2:172.21.15.63:3300/0 conn(0x7f04d0153e30 0x7f04d00c94a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:39.681 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.677+0000 7f04cffff640 1 -- 172.21.15.131:0/385752259 >> v1:172.21.15.131:6789/0 conn(0x7f04d00c6ec0 legacy=0x7f04d015a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:39.681 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.677+0000 7f04cf7fe640 1 -- 172.21.15.131:0/385752259 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 174804440 0 0) 0x7f04d015d390 con 0x7f04d00c6ec0 2024-05-21T01:19:39.681 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.677+0000 7f04cffff640 1 -- 172.21.15.131:0/385752259 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04d015d950 con 0x7f04d0074270 2024-05-21T01:19:39.682 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.677+0000 7f04cffff640 1 --2- 172.21.15.131:0/385752259 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f04d0074270 0x7f04d00c6980 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f04c0009870 tx=0x7f04c001c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=30603a4439a25893 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:19:39.682 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.677+0000 7f04cf7fe640 1 -- 172.21.15.131:0/385752259 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04c00a7070 con 0x7f04d0074270 2024-05-21T01:19:39.682 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.677+0000 7f04cf7fe640 1 -- 172.21.15.131:0/385752259 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04c00b0070 con 0x7f04d0074270 2024-05-21T01:19:39.683 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.677+0000 7f04cf7fe640 1 -- 172.21.15.131:0/385752259 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04c00ab890 con 0x7f04d0074270 2024-05-21T01:19:39.683 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.681+0000 7f04d6f6d640 1 -- 172.21.15.131:0/385752259 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f04d0074270 msgr2=0x7f04d00c6980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:39.683 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.681+0000 7f04d6f6d640 1 --2- 172.21.15.131:0/385752259 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f04d0074270 0x7f04d00c6980 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f04c0009870 tx=0x7f04c001c560 comp rx=0 tx=0).stop 2024-05-21T01:19:39.683 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.681+0000 7f04d6f6d640 1 -- 172.21.15.131:0/385752259 shutdown_connections 2024-05-21T01:19:39.684 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.681+0000 7f04d6f6d640 1 --2- 172.21.15.131:0/385752259 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f04d0074270 0x7f04d00c6980 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:39.684 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.681+0000 7f04d6f6d640 1 --2- 172.21.15.131:0/385752259 >> v2:172.21.15.63:3300/0 conn(0x7f04d0153e30 0x7f04d00c94a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:39.684 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.681+0000 7f04d6f6d640 1 -- 172.21.15.131:0/385752259 >> 172.21.15.131:0/385752259 conn(0x7f04d0071130 msgr2=0x7f04d0071540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:19:39.684 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.681+0000 7f04d6f6d640 1 -- 172.21.15.131:0/385752259 shutdown_connections 2024-05-21T01:19:39.684 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.681+0000 7f04d6f6d640 1 -- 172.21.15.131:0/385752259 wait complete. 2024-05-21T01:19:39.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.681+0000 7f04d6f6d640 1 Processor -- start 2024-05-21T01:19:39.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.681+0000 7f04d6f6d640 1 -- start start 2024-05-21T01:19:39.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.681+0000 7f04d6f6d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f04d0074270 0x7f04d0149910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:39.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.681+0000 7f04d6f6d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f04d00c6ec0 0x7f04d0158c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:39.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.681+0000 7f04d6f6d640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f04d0153e30 0x7f04d0159140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:39.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.681+0000 7f04d6f6d640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f04d0073e40 con 0x7f04d00c6ec0 2024-05-21T01:19:39.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.681+0000 7f04d6f6d640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f04d0154420 con 0x7f04d0074270 2024-05-21T01:19:39.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.681+0000 7f04d6f6d640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f04d0073fc0 con 0x7f04d0153e30 2024-05-21T01:19:39.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.681+0000 7f04d4d09640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f04d0074270 0x7f04d0149910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:39.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.681+0000 7f04d550a640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f04d0153e30 0x7f04d0159140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:39.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.681+0000 7f04d4d09640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f04d0074270 0x7f04d0149910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:47290/0 (socket says 172.21.15.131:47290) 2024-05-21T01:19:39.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.681+0000 7f04d4d09640 1 -- 172.21.15.131:0/617184912 learned_addr learned my addr 172.21.15.131:0/617184912 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-21T01:19:39.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.681+0000 7f04d550a640 1 --2- 172.21.15.131:0/617184912 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f04d0153e30 0x7f04d0159140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.131:59242/0 (socket says 172.21.15.131:59242) 2024-05-21T01:19:39.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.681+0000 7f04cffff640 1 --2- 172.21.15.131:0/617184912 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f04d00c6ec0 0x7f04d0158c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:39.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.681+0000 7f04d4d09640 1 -- 172.21.15.131:0/617184912 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f04d0153e30 msgr2=0x7f04d0159140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:39.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.681+0000 7f04d4d09640 1 --2- 172.21.15.131:0/617184912 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f04d0153e30 0x7f04d0159140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:39.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.681+0000 7f04d4d09640 1 -- 172.21.15.131:0/617184912 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f04d00c6ec0 msgr2=0x7f04d0158c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:39.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.681+0000 7f04d4d09640 1 --2- 172.21.15.131:0/617184912 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f04d00c6ec0 0x7f04d0158c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:39.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.681+0000 7f04d4d09640 1 -- 172.21.15.131:0/617184912 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04d014a030 con 0x7f04d0074270 2024-05-21T01:19:39.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.681+0000 7f04d550a640 1 --2- 172.21.15.131:0/617184912 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f04d0153e30 0x7f04d0159140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-21T01:19:39.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.685+0000 7f04d4d09640 1 --2- 172.21.15.131:0/617184912 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f04d0074270 0x7f04d0149910 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f04b8007f20 tx=0x7f04b800e570 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:19:39.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.685+0000 7f04cd7fa640 1 -- 172.21.15.131:0/617184912 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04b8014620 con 0x7f04d0074270 2024-05-21T01:19:39.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.685+0000 7f04cd7fa640 1 -- 172.21.15.131:0/617184912 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04b8019070 con 0x7f04d0074270 2024-05-21T01:19:39.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.685+0000 7f04d6f6d640 1 -- 172.21.15.131:0/617184912 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04d01f2eb0 con 0x7f04d0074270 2024-05-21T01:19:39.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.685+0000 7f04cd7fa640 1 -- 172.21.15.131:0/617184912 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04b8014a00 con 0x7f04d0074270 2024-05-21T01:19:39.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.685+0000 7f04d6f6d640 1 -- 172.21.15.131:0/617184912 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04d01f3470 con 0x7f04d0074270 2024-05-21T01:19:39.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.685+0000 7f04cd7fa640 1 -- 172.21.15.131:0/617184912 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f04b8014ba0 con 0x7f04d0074270 2024-05-21T01:19:39.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.685+0000 7f04cd7fa640 1 -- 172.21.15.131:0/617184912 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f04b801d9b0 con 0x7f04d0074270 2024-05-21T01:19:39.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.685+0000 7f04d6f6d640 1 -- 172.21.15.131:0/617184912 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04d00507f0 con 0x7f04d0074270 2024-05-21T01:19:39.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.689+0000 7f04cd7fa640 1 -- 172.21.15.131:0/617184912 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f04b801dbb0 con 0x7f04d0074270 2024-05-21T01:19:39.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.753+0000 7f04d6f6d640 1 -- 172.21.15.131:0/617184912 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e05e6c8c-2dda-49ab-8116-5ea9038d0f0f", "id": 6} v 0) -- 0x7f04d014e360 con 0x7f04d0074270 2024-05-21T01:19:39.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.761+0000 7f04cd7fa640 1 -- 172.21.15.131:0/617184912 <== mon.1 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e05e6c8c-2dda-49ab-8116-5ea9038d0f0f", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f04b801dd90 con 0x7f04d0074270 2024-05-21T01:19:39.766 INFO:teuthology.orchestra.run.smithi131.stdout:6 2024-05-21T01:19:39.767 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.761+0000 7f04d6f6d640 1 -- 172.21.15.131:0/617184912 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f04d0074270 msgr2=0x7f04d0149910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:39.767 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.761+0000 7f04d6f6d640 1 --2- 172.21.15.131:0/617184912 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f04d0074270 0x7f04d0149910 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f04b8007f20 tx=0x7f04b800e570 comp rx=0 tx=0).stop 2024-05-21T01:19:39.767 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.765+0000 7f04d6f6d640 1 -- 172.21.15.131:0/617184912 shutdown_connections 2024-05-21T01:19:39.767 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.765+0000 7f04d6f6d640 1 --2- 172.21.15.131:0/617184912 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f04d0153e30 0x7f04d0159140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:39.767 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.765+0000 7f04d6f6d640 1 --2- 172.21.15.131:0/617184912 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f04d00c6ec0 0x7f04d0158c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:39.767 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.765+0000 7f04d6f6d640 1 --2- 172.21.15.131:0/617184912 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f04d0074270 0x7f04d0149910 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:39.767 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.765+0000 7f04d6f6d640 1 -- 172.21.15.131:0/617184912 >> 172.21.15.131:0/617184912 conn(0x7f04d0071130 msgr2=0x7f04d0151c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:19:39.767 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.765+0000 7f04d6f6d640 1 -- 172.21.15.131:0/617184912 shutdown_connections 2024-05-21T01:19:39.767 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.765+0000 7f04d6f6d640 1 -- 172.21.15.131:0/617184912 wait complete. 2024-05-21T01:19:39.782 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph --cluster ceph osd new 0b393e5e-eeef-4e32-b23a-d405a8b0e7b5 7 2024-05-21T01:19:39.837 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-05-21T01:19:39.833+0000 7ffb7b08b180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-21T01:19:39.898 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.893+0000 7fcb6fdfc640 1 Processor -- start 2024-05-21T01:19:39.898 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.893+0000 7fcb6fdfc640 1 -- start start 2024-05-21T01:19:39.899 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.897+0000 7fcb6fdfc640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcb68153e30 0x7fcb680c94a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:39.899 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.897+0000 7fcb6fdfc640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb6815d390 con 0x7fcb6815a050 2024-05-21T01:19:39.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.897+0000 7fcb6fdfc640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb6815d670 con 0x7fcb68074270 2024-05-21T01:19:39.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.897+0000 7fcb6fdfc640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fcb6815e1f0 con 0x7fcb68153e30 2024-05-21T01:19:39.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.897+0000 7fcb6db98640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcb68153e30 0x7fcb680c94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:39.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.897+0000 7fcb6db98640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcb68153e30 0x7fcb680c94a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.131:59250/0 (socket says 172.21.15.131:59250) 2024-05-21T01:19:39.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.897+0000 7fcb6db98640 1 -- 172.21.15.131:0/2914641622 learned_addr learned my addr 172.21.15.131:0/2914641622 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-21T01:19:39.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.897+0000 7fcb6d397640 1 --1- 172.21.15.131:0/2914641622 >> v1:172.21.15.131:6789/0 conn(0x7fcb68074270 0x7fcb680c6980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:37346/0 (socket says 172.21.15.131:37346) 2024-05-21T01:19:39.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.897+0000 7fcb6db98640 1 -- 172.21.15.131:0/2914641622 >> v1:172.21.15.131:6789/0 conn(0x7fcb68074270 legacy=0x7fcb680c6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:39.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.897+0000 7fcb6cb96640 1 -- 172.21.15.131:0/2914641622 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2855226887 0 0) 0x7fcb6815d670 con 0x7fcb68074270 2024-05-21T01:19:39.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.897+0000 7fcb6db98640 1 -- 172.21.15.131:0/2914641622 >> v1:172.21.15.63:6789/0 conn(0x7fcb6815a050 legacy=0x7fcb6815a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:19:39.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.897+0000 7fcb6db98640 1 -- 172.21.15.131:0/2914641622 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb6815d950 con 0x7fcb68153e30 2024-05-21T01:19:39.900 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-05-21T01:19:39.897+0000 7ffb7b08b180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-21T01:19:39.901 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.897+0000 7fcb6db98640 1 --2- 172.21.15.131:0/2914641622 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcb68153e30 0x7fcb680c94a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fcb600098a0 tx=0x7fcb6001c580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9056a2470e179d1f server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:19:39.902 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.897+0000 7fcb6cb96640 1 -- 172.21.15.131:0/2914641622 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb600ab430 con 0x7fcb68153e30 2024-05-21T01:19:39.902 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.897+0000 7fcb6cb96640 1 -- 172.21.15.131:0/2914641622 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb600b0070 con 0x7fcb68153e30 2024-05-21T01:19:39.902 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.897+0000 7fcb6cb96640 1 -- 172.21.15.131:0/2914641622 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb600ab7f0 con 0x7fcb68153e30 2024-05-21T01:19:39.902 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.897+0000 7fcb6fdfc640 1 -- 172.21.15.131:0/2914641622 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcb68153e30 msgr2=0x7fcb680c94a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:39.902 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.897+0000 7fcb6fdfc640 1 --2- 172.21.15.131:0/2914641622 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcb68153e30 0x7fcb680c94a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fcb600098a0 tx=0x7fcb6001c580 comp rx=0 tx=0).stop 2024-05-21T01:19:39.903 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.897+0000 7fcb6fdfc640 1 -- 172.21.15.131:0/2914641622 shutdown_connections 2024-05-21T01:19:39.903 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.897+0000 7fcb6fdfc640 1 --2- 172.21.15.131:0/2914641622 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcb68153e30 0x7fcb680c94a0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:39.903 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.897+0000 7fcb6fdfc640 1 -- 172.21.15.131:0/2914641622 >> 172.21.15.131:0/2914641622 conn(0x7fcb68071130 msgr2=0x7fcb68071540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:19:39.903 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.897+0000 7fcb6fdfc640 1 -- 172.21.15.131:0/2914641622 shutdown_connections 2024-05-21T01:19:39.903 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.897+0000 7fcb6fdfc640 1 -- 172.21.15.131:0/2914641622 wait complete. 2024-05-21T01:19:39.903 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.901+0000 7fcb6fdfc640 1 Processor -- start 2024-05-21T01:19:39.903 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.901+0000 7fcb6fdfc640 1 -- start start 2024-05-21T01:19:39.905 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.901+0000 7fcb6fdfc640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcb68074270 0x7fcb681f58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:39.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.901+0000 7fcb6fdfc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb68153e30 0x7fcb68152ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:39.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.901+0000 7fcb6fdfc640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcb6815a050 0x7fcb68155bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:39.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.901+0000 7fcb6fdfc640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fcb68154390 con 0x7fcb68153e30 2024-05-21T01:19:39.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.901+0000 7fcb6fdfc640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fcb68154210 con 0x7fcb68074270 2024-05-21T01:19:39.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.901+0000 7fcb6fdfc640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fcb68073e40 con 0x7fcb6815a050 2024-05-21T01:19:39.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.901+0000 7fcb6db98640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcb68074270 0x7fcb681f58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:39.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.901+0000 7fcb6db98640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcb68074270 0x7fcb681f58b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:47302/0 (socket says 172.21.15.131:47302) 2024-05-21T01:19:39.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.901+0000 7fcb6e399640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcb6815a050 0x7fcb68155bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:39.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.901+0000 7fcb6db98640 1 -- 172.21.15.131:0/1781384224 learned_addr learned my addr 172.21.15.131:0/1781384224 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-05-21T01:19:39.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.901+0000 7fcb6d397640 1 --2- 172.21.15.131:0/1781384224 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb68153e30 0x7fcb68152ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:39.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.901+0000 7fcb6e399640 1 -- 172.21.15.131:0/1781384224 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcb68074270 msgr2=0x7fcb681f58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:39.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.901+0000 7fcb6e399640 1 --2- 172.21.15.131:0/1781384224 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcb68074270 0x7fcb681f58b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:39.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.901+0000 7fcb6e399640 1 -- 172.21.15.131:0/1781384224 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb68153e30 msgr2=0x7fcb68152ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:39.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.901+0000 7fcb6e399640 1 --2- 172.21.15.131:0/1781384224 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb68153e30 0x7fcb68152ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:39.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.901+0000 7fcb6e399640 1 -- 172.21.15.131:0/1781384224 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb681569d0 con 0x7fcb6815a050 2024-05-21T01:19:39.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.901+0000 7fcb6e399640 1 --2- 172.21.15.131:0/1781384224 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcb6815a050 0x7fcb68155bb0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fcb6400be30 tx=0x7fcb6400bf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:19:39.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.901+0000 7fcb5e7fc640 1 -- 172.21.15.131:0/1781384224 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb64019070 con 0x7fcb6815a050 2024-05-21T01:19:39.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.901+0000 7fcb5e7fc640 1 -- 172.21.15.131:0/1781384224 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb64014440 con 0x7fcb6815a050 2024-05-21T01:19:39.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.901+0000 7fcb6fdfc640 1 -- 172.21.15.131:0/1781384224 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb68165120 con 0x7fcb6815a050 2024-05-21T01:19:39.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.901+0000 7fcb5e7fc640 1 -- 172.21.15.131:0/1781384224 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb64014830 con 0x7fcb6815a050 2024-05-21T01:19:39.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.901+0000 7fcb6fdfc640 1 -- 172.21.15.131:0/1781384224 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb68156f80 con 0x7fcb6815a050 2024-05-21T01:19:39.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.901+0000 7fcb5e7fc640 1 -- 172.21.15.131:0/1781384224 <== mon.2 v2:172.21.15.131:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fcb6401c070 con 0x7fcb6815a050 2024-05-21T01:19:39.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.901+0000 7fcb5e7fc640 1 -- 172.21.15.131:0/1781384224 <== mon.2 v2:172.21.15.131:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7fcb64004770 con 0x7fcb6815a050 2024-05-21T01:19:39.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.901+0000 7fcb6fdfc640 1 -- 172.21.15.131:0/1781384224 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb680507f0 con 0x7fcb6815a050 2024-05-21T01:19:39.908 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.905+0000 7fcb5e7fc640 1 -- 172.21.15.131:0/1781384224 <== mon.2 v2:172.21.15.131:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fcb64003980 con 0x7fcb6815a050 2024-05-21T01:19:39.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.969+0000 7fcb6fdfc640 1 -- 172.21.15.131:0/1781384224 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "osd new", "uuid": "0b393e5e-eeef-4e32-b23a-d405a8b0e7b5", "id": 7} v 0) -- 0x7fcb680c7410 con 0x7fcb6815a050 2024-05-21T01:19:39.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.985+0000 7fcb5e7fc640 1 -- 172.21.15.131:0/1781384224 <== mon.2 v2:172.21.15.131:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0b393e5e-eeef-4e32-b23a-d405a8b0e7b5", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7fcb64003c90 con 0x7fcb6815a050 2024-05-21T01:19:39.988 INFO:teuthology.orchestra.run.smithi131.stdout:7 2024-05-21T01:19:39.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.985+0000 7fcb6fdfc640 1 -- 172.21.15.131:0/1781384224 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcb6815a050 msgr2=0x7fcb68155bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:39.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.985+0000 7fcb6fdfc640 1 --2- 172.21.15.131:0/1781384224 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcb6815a050 0x7fcb68155bb0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fcb6400be30 tx=0x7fcb6400bf20 comp rx=0 tx=0).stop 2024-05-21T01:19:39.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.985+0000 7fcb6fdfc640 1 -- 172.21.15.131:0/1781384224 shutdown_connections 2024-05-21T01:19:39.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.985+0000 7fcb6fdfc640 1 --2- 172.21.15.131:0/1781384224 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcb6815a050 0x7fcb68155bb0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:39.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.985+0000 7fcb6fdfc640 1 --2- 172.21.15.131:0/1781384224 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb68153e30 0x7fcb68152ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:39.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.985+0000 7fcb6fdfc640 1 --2- 172.21.15.131:0/1781384224 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcb68074270 0x7fcb681f58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:39.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.985+0000 7fcb6fdfc640 1 -- 172.21.15.131:0/1781384224 >> 172.21.15.131:0/1781384224 conn(0x7fcb68071130 msgr2=0x7fcb6814a090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:19:39.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.985+0000 7fcb6fdfc640 1 -- 172.21.15.131:0/1781384224 shutdown_connections 2024-05-21T01:19:39.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-05-21T01:19:39.985+0000 7fcb6fdfc640 1 -- 172.21.15.131:0/1781384224 wait complete. 2024-05-21T01:19:40.004 INFO:tasks.ceph.osd.0:Restarting daemon 2024-05-21T01:19:40.004 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-05-21T01:19:40.007 INFO:tasks.ceph.osd.0:Started 2024-05-21T01:19:40.007 INFO:tasks.ceph.osd.1:Restarting daemon 2024-05-21T01:19:40.007 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-05-21T01:19:40.010 INFO:tasks.ceph.osd.1:Started 2024-05-21T01:19:40.010 INFO:tasks.ceph.osd.2:Restarting daemon 2024-05-21T01:19:40.010 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-05-21T01:19:40.013 INFO:tasks.ceph.osd.2:Started 2024-05-21T01:19:40.013 INFO:tasks.ceph.osd.3:Restarting daemon 2024-05-21T01:19:40.013 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-05-21T01:19:40.017 INFO:tasks.ceph.osd.3:Started 2024-05-21T01:19:40.018 INFO:tasks.ceph.osd.4:Restarting daemon 2024-05-21T01:19:40.018 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-05-21T01:19:40.020 INFO:tasks.ceph.osd.4:Started 2024-05-21T01:19:40.020 INFO:tasks.ceph.osd.5:Restarting daemon 2024-05-21T01:19:40.020 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-05-21T01:19:40.022 INFO:tasks.ceph.osd.5:Started 2024-05-21T01:19:40.022 INFO:tasks.ceph.osd.6:Restarting daemon 2024-05-21T01:19:40.022 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-05-21T01:19:40.024 INFO:tasks.ceph.osd.6:Started 2024-05-21T01:19:40.024 INFO:tasks.ceph.osd.7:Restarting daemon 2024-05-21T01:19:40.024 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-05-21T01:19:40.026 INFO:tasks.ceph.osd.7:Started 2024-05-21T01:19:40.027 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-21T01:19:40.080 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-05-21T01:19:40.073+0000 7f9e33777180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-21T01:19:40.163 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-05-21T01:19:40.157+0000 7f9e33777180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-21T01:19:40.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:40.205+0000 7f2105400640 1 Processor -- start 2024-05-21T01:19:40.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:40.209+0000 7f2105400640 1 -- start start 2024-05-21T01:19:40.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:40.209+0000 7f2105400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f210006c510 0x7f210006d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:40.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:40.209+0000 7f2105400640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f210006eea0 con 0x7f210006def0 2024-05-21T01:19:40.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:40.209+0000 7f2105400640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f210006ec00 con 0x7f2100153e00 2024-05-21T01:19:40.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:40.209+0000 7f2105400640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f2100159ec0 con 0x7f210006c510 2024-05-21T01:19:40.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:40.209+0000 7f20ff200640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f210006def0 0x7f21000c7650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:43904/0 (socket says 172.21.15.63:43904) 2024-05-21T01:19:40.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:40.209+0000 7f20ff200640 1 -- 172.21.15.63:0/1276902396 learned_addr learned my addr 172.21.15.63:0/1276902396 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-05-21T01:19:40.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:40.209+0000 7f20fde00640 1 --2- 172.21.15.63:0/1276902396 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f210006c510 0x7f210006d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:40.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:40.209+0000 7f20fd400640 1 -- 172.21.15.63:0/1276902396 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2875394204 0 0) 0x7f210006eea0 con 0x7f210006def0 2024-05-21T01:19:40.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:40.209+0000 7f20fd400640 1 -- 172.21.15.63:0/1276902396 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f20e4003530 con 0x7f210006def0 2024-05-21T01:19:40.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:40.209+0000 7f20fd400640 1 -- 172.21.15.63:0/1276902396 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1016877224 0 0) 0x7f210006ec00 con 0x7f2100153e00 2024-05-21T01:19:40.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:40.209+0000 7f20fd400640 1 -- 172.21.15.63:0/1276902396 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f210006eea0 con 0x7f2100153e00 2024-05-21T01:19:40.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:40.209+0000 7f20fde00640 1 -- 172.21.15.63:0/1276902396 >> v1:172.21.15.131:6789/0 conn(0x7f2100153e00 legacy=0x7f210006e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:40.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:40.209+0000 7f20fde00640 1 -- 172.21.15.63:0/1276902396 >> v1:172.21.15.63:6789/0 conn(0x7f210006def0 legacy=0x7f21000c7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:40.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:40.209+0000 7f20fde00640 1 -- 172.21.15.63:0/1276902396 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f210015a1a0 con 0x7f210006c510 2024-05-21T01:19:40.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:40.213+0000 7f20fde00640 1 --2- 172.21.15.63:0/1276902396 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f210006c510 0x7f210006d9b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f20ec0097f0 tx=0x7f20ec01ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8507875e4e748f2b server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:19:40.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:40.213+0000 7f20fd400640 1 -- 172.21.15.63:0/1276902396 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20ec0b5070 con 0x7f210006c510 2024-05-21T01:19:40.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:40.213+0000 7f20fd400640 1 -- 172.21.15.63:0/1276902396 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20ec0a89d0 con 0x7f210006c510 2024-05-21T01:19:40.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:40.213+0000 7f20fd400640 1 -- 172.21.15.63:0/1276902396 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20ec0a8da0 con 0x7f210006c510 2024-05-21T01:19:40.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:40.213+0000 7f2105400640 1 -- 172.21.15.63:0/1276902396 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f210006c510 msgr2=0x7f210006d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:40.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:40.213+0000 7f2105400640 1 --2- 172.21.15.63:0/1276902396 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f210006c510 0x7f210006d9b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f20ec0097f0 tx=0x7f20ec01ecd0 comp rx=0 tx=0).stop 2024-05-21T01:19:40.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:40.213+0000 7f2105400640 1 -- 172.21.15.63:0/1276902396 shutdown_connections 2024-05-21T01:19:40.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:40.213+0000 7f2105400640 1 --2- 172.21.15.63:0/1276902396 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f210006c510 0x7f210006d9b0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:40.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:40.213+0000 7f2105400640 1 -- 172.21.15.63:0/1276902396 >> 172.21.15.63:0/1276902396 conn(0x7f21000cae00 msgr2=0x7f21000cb210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:19:40.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:40.213+0000 7f2105400640 1 -- 172.21.15.63:0/1276902396 shutdown_connections 2024-05-21T01:19:40.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:40.213+0000 7f2105400640 1 -- 172.21.15.63:0/1276902396 wait complete. 2024-05-21T01:19:40.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:40.217+0000 7f2105400640 1 Processor -- start 2024-05-21T01:19:40.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:40.217+0000 7f2105400640 1 -- start start 2024-05-21T01:19:40.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:40.217+0000 7f2105400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f210006c510 0x7f210015ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:40.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:40.217+0000 7f2105400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f210006def0 0x7f2100073dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:40.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:40.217+0000 7f2105400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2100153e00 0x7f21001f4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:40.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:40.217+0000 7f2105400640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f2100159bb0 con 0x7f2100153e00 2024-05-21T01:19:40.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:40.217+0000 7f2105400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f210015a760 con 0x7f210006c510 2024-05-21T01:19:40.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:40.217+0000 7f2105400640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f210006c930 con 0x7f210006def0 2024-05-21T01:19:40.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:40.217+0000 7f20fe800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f210006c510 0x7f210015ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:40.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:40.217+0000 7f20ff200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2100153e00 0x7f21001f4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:40.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:40.217+0000 7f20fe800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f210006c510 0x7f210015ad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.63:53908/0 (socket says 172.21.15.63:53908) 2024-05-21T01:19:40.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:40.217+0000 7f20fe800640 1 -- 172.21.15.63:0/15268781 learned_addr learned my addr 172.21.15.63:0/15268781 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:19:40.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:40.217+0000 7f20fde00640 1 --2- 172.21.15.63:0/15268781 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f210006def0 0x7f2100073dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:40.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:40.217+0000 7f20ff200640 1 -- 172.21.15.63:0/15268781 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f210006def0 msgr2=0x7f2100073dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:40.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:40.217+0000 7f20ff200640 1 --2- 172.21.15.63:0/15268781 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f210006def0 0x7f2100073dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:40.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:40.217+0000 7f20ff200640 1 -- 172.21.15.63:0/15268781 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f210006c510 msgr2=0x7f210015ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:40.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:40.217+0000 7f20ff200640 1 --2- 172.21.15.63:0/15268781 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f210006c510 0x7f210015ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:40.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:40.217+0000 7f20ff200640 1 -- 172.21.15.63:0/15268781 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2100073390 con 0x7f2100153e00 2024-05-21T01:19:40.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:40.217+0000 7f20fe800640 1 --2- 172.21.15.63:0/15268781 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f210006c510 0x7f210015ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-21T01:19:40.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:40.217+0000 7f20ff200640 1 --2- 172.21.15.63:0/15268781 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2100153e00 0x7f21001f4da0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f20f800caa0 tx=0x7f20f800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:19:40.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:40.217+0000 7f20f6a00640 1 -- 172.21.15.63:0/15268781 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20f800ac00 con 0x7f2100153e00 2024-05-21T01:19:40.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:40.217+0000 7f20f6a00640 1 -- 172.21.15.63:0/15268781 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20f800ada0 con 0x7f2100153e00 2024-05-21T01:19:40.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:40.217+0000 7f20f6a00640 1 -- 172.21.15.63:0/15268781 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20f8012600 con 0x7f2100153e00 2024-05-21T01:19:40.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:40.217+0000 7f2105400640 1 -- 172.21.15.63:0/15268781 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2100073600 con 0x7f2100153e00 2024-05-21T01:19:40.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:40.221+0000 7f2105400640 1 -- 172.21.15.63:0/15268781 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2100072e10 con 0x7f2100153e00 2024-05-21T01:19:40.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:40.221+0000 7f20f6a00640 1 -- 172.21.15.63:0/15268781 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f20f80127a0 con 0x7f2100153e00 2024-05-21T01:19:40.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:40.221+0000 7f20f6a00640 1 -- 172.21.15.63:0/15268781 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f20f801b400 con 0x7f2100153e00 2024-05-21T01:19:40.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:40.221+0000 7f2105400640 1 -- 172.21.15.63:0/15268781 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21000507f0 con 0x7f2100153e00 2024-05-21T01:19:40.227 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:40.221+0000 7f20f6a00640 1 -- 172.21.15.63:0/15268781 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f20f801b6d0 con 0x7f2100153e00 2024-05-21T01:19:40.230 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-05-21T01:19:40.225+0000 7f9e33777180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-21T01:19:40.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:40.281+0000 7f2105400640 1 -- 172.21.15.63:0/15268781 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f210006cc50 con 0x7f2100153e00 2024-05-21T01:19:40.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:40.281+0000 7f20f6a00640 1 -- 172.21.15.63:0/15268781 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f20f8012a90 con 0x7f2100153e00 2024-05-21T01:19:40.287 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-05-21T01:19:40.287 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":10,"fsid":"9a7cbd84-ceb2-41c8-8b6e-ab931f86c51a","created":"2024-05-21T01:19:37.688082+0000","modified":"2024-05-21T01:19:39.973975+0000","last_up_change":"0.000000","last_in_change":"2024-05-21T01:19:39.973975+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"cda28135-00bb-4194-adcb-e0abf3ae43f3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"4aeb370d-ec2f-4a91-b17b-035fd72bdaea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"8368b112-35a3-43cf-ad1c-803f05708091","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"26208950-e3ca-4b9a-94cd-c159453a5dfa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"d8c93283-1e10-4419-9934-d5048c5d0ad1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"93a6fe9b-eaa6-4474-bf9b-ae0571feacf7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e05e6c8c-2dda-49ab-8116-5ea9038d0f0f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"0b393e5e-eeef-4e32-b23a-d405a8b0e7b5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-21T01:19:40.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:40.281+0000 7f2105400640 1 -- 172.21.15.63:0/15268781 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2100153e00 msgr2=0x7f21001f4da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:40.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:40.281+0000 7f2105400640 1 --2- 172.21.15.63:0/15268781 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2100153e00 0x7f21001f4da0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f20f800caa0 tx=0x7f20f800cf60 comp rx=0 tx=0).stop 2024-05-21T01:19:40.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:40.285+0000 7f2105400640 1 -- 172.21.15.63:0/15268781 shutdown_connections 2024-05-21T01:19:40.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:40.285+0000 7f2105400640 1 --2- 172.21.15.63:0/15268781 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2100153e00 0x7f21001f4da0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:40.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:40.285+0000 7f2105400640 1 --2- 172.21.15.63:0/15268781 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f210006def0 0x7f2100073dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:40.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:40.285+0000 7f2105400640 1 --2- 172.21.15.63:0/15268781 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f210006c510 0x7f210015ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:40.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:40.285+0000 7f2105400640 1 -- 172.21.15.63:0/15268781 >> 172.21.15.63:0/15268781 conn(0x7f21000cae00 msgr2=0x7f21000c7430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:19:40.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:40.285+0000 7f2105400640 1 -- 172.21.15.63:0/15268781 shutdown_connections 2024-05-21T01:19:40.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:40.285+0000 7f2105400640 1 -- 172.21.15.63:0/15268781 wait complete. 2024-05-21T01:19:40.307 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-05-21T01:19:40.307 INFO:tasks.ceph:Waiting for OSDs to come up 2024-05-21T01:19:40.325 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-05-21T01:19:40.321+0000 7f9e33777180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-21T01:19:40.390 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-05-21T01:19:40.385+0000 7f9e33777180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-21T01:19:40.483 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-05-21T01:19:40.477+0000 7f9e33777180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-21T01:19:40.549 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-05-21T01:19:40.545+0000 7f9e33777180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-21T01:19:40.558 INFO:tasks.ceph.mgr.x.smithi131.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-05-21T01:19:40.558 INFO:tasks.ceph.mgr.x.smithi131.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-05-21T01:19:40.558 INFO:tasks.ceph.mgr.x.smithi131.stderr: from numpy import show_config as show_numpy_config 2024-05-21T01:19:40.587 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-05-21T01:19:40.585+0000 7ffb7b08b180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-21T01:19:40.636 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-05-21T01:19:40.633+0000 7f71635f17c0 -1 Falling back to public interface 2024-05-21T01:19:40.637 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-05-21T01:19:40.633+0000 7f68a11cb7c0 -1 Falling back to public interface 2024-05-21T01:19:40.637 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-05-21T01:19:40.633+0000 7f14f548c7c0 -1 Falling back to public interface 2024-05-21T01:19:40.644 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-05-21T01:19:40.641+0000 7f58b7f1f7c0 -1 Falling back to public interface 2024-05-21T01:19:40.709 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-05-21T01:19:40.705+0000 7fa3b04577c0 -1 Falling back to public interface 2024-05-21T01:19:40.710 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-05-21T01:19:40.705+0000 7fa5474727c0 -1 Falling back to public interface 2024-05-21T01:19:40.714 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-05-21T01:19:40.709+0000 7fafa18e67c0 -1 Falling back to public interface 2024-05-21T01:19:40.725 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-05-21T01:19:40.721+0000 7fdebb58f7c0 -1 Falling back to public interface 2024-05-21T01:19:40.728 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-05-21T01:19:40.725+0000 7f9e33777180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-21T01:19:40.735 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-05-21T01:19:40.733+0000 7ffb7b08b180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-21T01:19:40.804 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-05-21T01:19:40.801+0000 7f9e33777180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-21T01:19:40.896 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-05-21T01:19:40.893+0000 7ffb7b08b180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-21T01:19:40.960 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-05-21T01:19:40.957+0000 7ffb7b08b180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-21T01:19:41.093 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-05-21T01:19:41.089+0000 7ffb7b08b180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-21T01:19:41.162 DEBUG:teuthology.orchestra.run.smithi063:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-21T01:19:41.298 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:41.293+0000 7fd3e0c00640 1 Processor -- start 2024-05-21T01:19:41.298 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:41.293+0000 7fd3e0c00640 1 -- start start 2024-05-21T01:19:41.299 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:41.293+0000 7fd3e0c00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd3dc154030 0x7fd3dc0736b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:41.300 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:41.293+0000 7fd3e0c00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd3dc073bf0 0x7fd3dc0c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:41.300 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:41.293+0000 7fd3e0c00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd3dc0c7000 0x7fd3dc070d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:41.300 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:41.293+0000 7fd3e0c00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7fd3dc154410 con 0x7fd3dc0c7000 2024-05-21T01:19:41.300 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:41.293+0000 7fd3e0c00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fd3dc0c9580 con 0x7fd3dc154030 2024-05-21T01:19:41.300 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:41.293+0000 7fd3e0c00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fd3dc0c9a10 con 0x7fd3dc073bf0 2024-05-21T01:19:41.300 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:41.293+0000 7fd3da800640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd3dc0c7000 0x7fd3dc070d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:41.300 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:41.293+0000 7fd3d1400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd3dc073bf0 0x7fd3dc0c6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:41.300 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:41.293+0000 7fd3da800640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd3dc0c7000 0x7fd3dc070d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:49478/0 (socket says 172.21.15.63:49478) 2024-05-21T01:19:41.300 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:41.293+0000 7fd3da800640 1 -- 172.21.15.63:0/3620943854 learned_addr learned my addr 172.21.15.63:0/3620943854 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:19:41.300 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:41.293+0000 7fd3d9e00640 1 --2- 172.21.15.63:0/3620943854 >> v2:172.21.15.131:3300/0 conn(0x7fd3dc154030 0x7fd3dc0736b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:41.301 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:41.293+0000 7fd3da800640 1 -- 172.21.15.63:0/3620943854 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd3dc073bf0 msgr2=0x7fd3dc0c6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:19:41.301 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:41.293+0000 7fd3da800640 1 --2- 172.21.15.63:0/3620943854 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd3dc073bf0 0x7fd3dc0c6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:41.301 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:41.293+0000 7fd3da800640 1 -- 172.21.15.63:0/3620943854 >> v2:172.21.15.131:3300/0 conn(0x7fd3dc154030 msgr2=0x7fd3dc0736b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:19:41.301 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:41.293+0000 7fd3da800640 1 --2- 172.21.15.63:0/3620943854 >> v2:172.21.15.131:3300/0 conn(0x7fd3dc154030 0x7fd3dc0736b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:41.301 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:41.293+0000 7fd3da800640 1 -- 172.21.15.63:0/3620943854 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3dc071a70 con 0x7fd3dc0c7000 2024-05-21T01:19:41.302 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:41.297+0000 7fd3da800640 1 --2- 172.21.15.63:0/3620943854 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd3dc0c7000 0x7fd3dc070d70 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc0cc020 tx=0x7fd3d401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=121936672220c2fd server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:19:41.303 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:41.297+0000 7fd3d9400640 1 -- 172.21.15.63:0/3620943854 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3d40a5780 con 0x7fd3dc0c7000 2024-05-21T01:19:41.303 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:41.297+0000 7fd3d9400640 1 -- 172.21.15.63:0/3620943854 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3d40a5920 con 0x7fd3dc0c7000 2024-05-21T01:19:41.303 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:41.297+0000 7fd3d9400640 1 -- 172.21.15.63:0/3620943854 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3d40a5cf0 con 0x7fd3dc0c7000 2024-05-21T01:19:41.304 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:41.297+0000 7fd3e0c00640 1 -- 172.21.15.63:0/3620943854 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd3dc0c7000 msgr2=0x7fd3dc070d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:41.304 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:41.297+0000 7fd3e0c00640 1 --2- 172.21.15.63:0/3620943854 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd3dc0c7000 0x7fd3dc070d70 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc0cc020 tx=0x7fd3d401c9f0 comp rx=0 tx=0).stop 2024-05-21T01:19:41.304 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:41.297+0000 7fd3e0c00640 1 -- 172.21.15.63:0/3620943854 shutdown_connections 2024-05-21T01:19:41.304 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:41.297+0000 7fd3e0c00640 1 --2- 172.21.15.63:0/3620943854 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd3dc0c7000 0x7fd3dc070d70 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:41.304 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:41.297+0000 7fd3e0c00640 1 --2- 172.21.15.63:0/3620943854 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd3dc073bf0 0x7fd3dc0c6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:41.304 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:41.297+0000 7fd3e0c00640 1 --2- 172.21.15.63:0/3620943854 >> v2:172.21.15.131:3300/0 conn(0x7fd3dc154030 0x7fd3dc0736b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:41.304 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:41.297+0000 7fd3e0c00640 1 -- 172.21.15.63:0/3620943854 >> 172.21.15.63:0/3620943854 conn(0x7fd3dc0cf5c0 msgr2=0x7fd3dc0cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:19:41.304 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:41.297+0000 7fd3e0c00640 1 -- 172.21.15.63:0/3620943854 shutdown_connections 2024-05-21T01:19:41.305 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:41.297+0000 7fd3e0c00640 1 -- 172.21.15.63:0/3620943854 wait complete. 2024-05-21T01:19:41.305 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:41.301+0000 7fd3e0c00640 1 Processor -- start 2024-05-21T01:19:41.305 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:41.301+0000 7fd3e0c00640 1 -- start start 2024-05-21T01:19:41.308 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:41.301+0000 7fd3e0c00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd3dc073bf0 0x7fd3dc1f2e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:41.308 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:41.301+0000 7fd3e0c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd3dc0c7000 0x7fd3dc15b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:41.308 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:41.301+0000 7fd3e0c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd3dc154030 0x7fd3dc1581b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:41.308 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:41.301+0000 7fd3e0c00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fd3dc0716c0 con 0x7fd3dc154030 2024-05-21T01:19:41.308 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:41.301+0000 7fd3e0c00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd3dc159df0 con 0x7fd3dc0c7000 2024-05-21T01:19:41.308 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:41.301+0000 7fd3e0c00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fd3dc157a20 con 0x7fd3dc073bf0 2024-05-21T01:19:41.309 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:41.301+0000 7fd3da800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd3dc154030 0x7fd3dc1581b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:41.309 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:41.301+0000 7fd3d9e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd3dc073bf0 0x7fd3dc1f2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:41.309 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:41.301+0000 7fd3da800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd3dc154030 0x7fd3dc1581b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:49492/0 (socket says 172.21.15.63:49492) 2024-05-21T01:19:41.309 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:41.301+0000 7fd3da800640 1 -- 172.21.15.63:0/300941520 learned_addr learned my addr 172.21.15.63:0/300941520 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:19:41.309 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:41.301+0000 7fd3d1400640 1 --2- 172.21.15.63:0/300941520 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd3dc0c7000 0x7fd3dc15b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:41.309 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:41.301+0000 7fd3da800640 1 -- 172.21.15.63:0/300941520 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd3dc073bf0 msgr2=0x7fd3dc1f2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:41.309 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:41.301+0000 7fd3da800640 1 --2- 172.21.15.63:0/300941520 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd3dc073bf0 0x7fd3dc1f2e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:41.309 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:41.301+0000 7fd3da800640 1 -- 172.21.15.63:0/300941520 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd3dc0c7000 msgr2=0x7fd3dc15b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:41.309 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:41.301+0000 7fd3da800640 1 --2- 172.21.15.63:0/300941520 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd3dc0c7000 0x7fd3dc15b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:41.309 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:41.301+0000 7fd3da800640 1 -- 172.21.15.63:0/300941520 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3dc159000 con 0x7fd3dc154030 2024-05-21T01:19:41.309 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:41.301+0000 7fd3da800640 1 --2- 172.21.15.63:0/300941520 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd3dc154030 0x7fd3dc1581b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd3d40af040 tx=0x7fd3d4019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:19:41.309 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:41.301+0000 7fd3d2a00640 1 -- 172.21.15.63:0/300941520 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3d4009510 con 0x7fd3dc154030 2024-05-21T01:19:41.309 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:41.301+0000 7fd3d2a00640 1 -- 172.21.15.63:0/300941520 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3d40be070 con 0x7fd3dc154030 2024-05-21T01:19:41.309 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:41.301+0000 7fd3e0c00640 1 -- 172.21.15.63:0/300941520 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3dc1592a0 con 0x7fd3dc154030 2024-05-21T01:19:41.309 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:41.301+0000 7fd3d2a00640 1 -- 172.21.15.63:0/300941520 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3d40b88b0 con 0x7fd3dc154030 2024-05-21T01:19:41.310 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:41.301+0000 7fd3e0c00640 1 -- 172.21.15.63:0/300941520 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3dc159860 con 0x7fd3dc154030 2024-05-21T01:19:41.310 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:41.301+0000 7fd3d2a00640 1 -- 172.21.15.63:0/300941520 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd3d40b8a50 con 0x7fd3dc154030 2024-05-21T01:19:41.310 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:41.301+0000 7fd3d2a00640 1 -- 172.21.15.63:0/300941520 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fd3d40b8d40 con 0x7fd3dc154030 2024-05-21T01:19:41.310 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:41.305+0000 7fd3e0c00640 1 -- 172.21.15.63:0/300941520 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3dc1f3360 con 0x7fd3dc154030 2024-05-21T01:19:41.311 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:41.305+0000 7fd3d2a00640 1 -- 172.21.15.63:0/300941520 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fd3d40165e0 con 0x7fd3dc154030 2024-05-21T01:19:41.370 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:41.365+0000 7fd3e0c00640 1 -- 172.21.15.63:0/300941520 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd3dc06bfd0 con 0x7fd3dc154030 2024-05-21T01:19:41.371 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:41.365+0000 7fd3d2a00640 1 -- 172.21.15.63:0/300941520 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fd3d40c3460 con 0x7fd3dc154030 2024-05-21T01:19:41.371 INFO:teuthology.misc.health.smithi063.stdout: 2024-05-21T01:19:41.371 INFO:teuthology.misc.health.smithi063.stdout:{"epoch":10,"fsid":"9a7cbd84-ceb2-41c8-8b6e-ab931f86c51a","created":"2024-05-21T01:19:37.688082+0000","modified":"2024-05-21T01:19:39.973975+0000","last_up_change":"0.000000","last_in_change":"2024-05-21T01:19:39.973975+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"cda28135-00bb-4194-adcb-e0abf3ae43f3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"4aeb370d-ec2f-4a91-b17b-035fd72bdaea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"8368b112-35a3-43cf-ad1c-803f05708091","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"26208950-e3ca-4b9a-94cd-c159453a5dfa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"d8c93283-1e10-4419-9934-d5048c5d0ad1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"93a6fe9b-eaa6-4474-bf9b-ae0571feacf7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e05e6c8c-2dda-49ab-8116-5ea9038d0f0f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"0b393e5e-eeef-4e32-b23a-d405a8b0e7b5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-21T01:19:41.372 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:41.365+0000 7fd3e0c00640 1 -- 172.21.15.63:0/300941520 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd3dc154030 msgr2=0x7fd3dc1581b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:41.372 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:41.365+0000 7fd3e0c00640 1 --2- 172.21.15.63:0/300941520 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd3dc154030 0x7fd3dc1581b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd3d40af040 tx=0x7fd3d4019790 comp rx=0 tx=0).stop 2024-05-21T01:19:41.373 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:41.365+0000 7fd3e0c00640 1 -- 172.21.15.63:0/300941520 shutdown_connections 2024-05-21T01:19:41.373 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:41.365+0000 7fd3e0c00640 1 --2- 172.21.15.63:0/300941520 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd3dc154030 0x7fd3dc1581b0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:41.373 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:41.365+0000 7fd3e0c00640 1 --2- 172.21.15.63:0/300941520 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd3dc0c7000 0x7fd3dc15b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:41.373 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:41.365+0000 7fd3e0c00640 1 --2- 172.21.15.63:0/300941520 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd3dc073bf0 0x7fd3dc1f2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:41.373 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:41.365+0000 7fd3e0c00640 1 -- 172.21.15.63:0/300941520 >> 172.21.15.63:0/300941520 conn(0x7fd3dc0cf5c0 msgr2=0x7fd3dc0c7cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:19:41.373 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:41.369+0000 7fd3e0c00640 1 -- 172.21.15.63:0/300941520 shutdown_connections 2024-05-21T01:19:41.373 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:41.369+0000 7fd3e0c00640 1 -- 172.21.15.63:0/300941520 wait complete. 2024-05-21T01:19:41.388 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-05-21T01:19:41.440 INFO:tasks.ceph.mgr.y.smithi063.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-05-21T01:19:41.440 INFO:tasks.ceph.mgr.y.smithi063.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-05-21T01:19:41.440 INFO:tasks.ceph.mgr.y.smithi063.stderr: from numpy import show_config as show_numpy_config 2024-05-21T01:19:41.510 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-05-21T01:19:41.505+0000 7f9e33777180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-21T01:19:41.666 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-05-21T01:19:41.661+0000 7f9e33777180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-21T01:19:41.712 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-05-21T01:19:41.709+0000 7ffb7b08b180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-21T01:19:41.788 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-05-21T01:19:41.785+0000 7ffb7b08b180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-21T01:19:41.857 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-05-21T01:19:41.853+0000 7f9e33777180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-21T01:19:41.937 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-05-21T01:19:41.929+0000 7f9e33777180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-21T01:19:41.969 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-05-21T01:19:41.965+0000 7ffb7b08b180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-21T01:19:42.041 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-05-21T01:19:42.037+0000 7ffb7b08b180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-21T01:19:42.093 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-05-21T01:19:42.089+0000 7f9e33777180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-21T01:19:42.330 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-05-21T01:19:42.325+0000 7ffb7b08b180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-21T01:19:42.391 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-05-21T01:19:42.389+0000 7ffb7b08b180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-21T01:19:42.830 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-05-21T01:19:42.825+0000 7f9e33777180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-21T01:19:42.921 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-05-21T01:19:42.917+0000 7f9e33777180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-21T01:19:43.134 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-05-21T01:19:43.129+0000 7f9e33777180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-21T01:19:43.223 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-05-21T01:19:43.217+0000 7f9e33777180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-21T01:19:43.427 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-05-21T01:19:43.425+0000 7ffb21bd0640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-05-21T01:19:43.427 INFO:tasks.ceph.mgr.x.smithi131.stderr:2024-05-21T01:19:43.425+0000 7ffb21bd0640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-05-21T01:19:43.577 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-05-21T01:19:43.573+0000 7f9e33777180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-21T01:19:43.652 INFO:tasks.ceph.mgr.y.smithi063.stderr:2024-05-21T01:19:43.645+0000 7f9e33777180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-21T01:19:44.301 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-05-21T01:19:44.297+0000 7f58b7f1f7c0 -1 osd.7 0 log_to_monitors true 2024-05-21T01:19:44.399 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-05-21T01:19:44.397+0000 7f71635f17c0 -1 osd.4 0 log_to_monitors true 2024-05-21T01:19:44.523 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-05-21T01:19:44.521+0000 7f68a11cb7c0 -1 osd.5 0 log_to_monitors true 2024-05-21T01:19:44.527 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-05-21T01:19:44.525+0000 7f14f548c7c0 -1 osd.6 0 log_to_monitors true 2024-05-21T01:19:44.641 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-05-21T01:19:44.637+0000 7fa3b04577c0 -1 osd.0 0 log_to_monitors true 2024-05-21T01:19:44.727 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-05-21T01:19:44.721+0000 7fafa18e67c0 -1 osd.2 0 log_to_monitors true 2024-05-21T01:19:44.878 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-05-21T01:19:44.873+0000 7fa5474727c0 -1 osd.1 0 log_to_monitors true 2024-05-21T01:19:44.931 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-05-21T01:19:44.925+0000 7fdebb58f7c0 -1 osd.3 0 log_to_monitors true 2024-05-21T01:19:46.245 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-05-21T01:19:46.241+0000 7f58b3ec8640 -1 osd.7 0 waiting for initial osdmap 2024-05-21T01:19:46.268 INFO:tasks.ceph.osd.7.smithi131.stderr:2024-05-21T01:19:46.265+0000 7f58abcfc640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-21T01:19:46.288 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-05-21T01:19:46.285+0000 7f715f59a640 -1 osd.4 0 waiting for initial osdmap 2024-05-21T01:19:46.332 INFO:tasks.ceph.osd.4.smithi131.stderr:2024-05-21T01:19:46.329+0000 7f71573ce640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-21T01:19:47.283 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-05-21T01:19:47.277+0000 7f14f1435640 -1 osd.6 0 waiting for initial osdmap 2024-05-21T01:19:47.283 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-05-21T01:19:47.281+0000 7f689d986640 -1 osd.5 0 waiting for initial osdmap 2024-05-21T01:19:47.300 INFO:tasks.ceph.osd.5.smithi131.stderr:2024-05-21T01:19:47.297+0000 7f6894fa8640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-21T01:19:47.303 INFO:tasks.ceph.osd.6.smithi131.stderr:2024-05-21T01:19:47.301+0000 7f14e9269640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-21T01:19:47.890 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-05-21T01:19:47.885+0000 7faf9c800640 -1 osd.2 0 waiting for initial osdmap 2024-05-21T01:19:47.921 INFO:tasks.ceph.osd.2.smithi063.stderr:2024-05-21T01:19:47.917+0000 7faf92800640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-21T01:19:47.938 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-05-21T01:19:47.933+0000 7fa3ab400640 -1 osd.0 0 waiting for initial osdmap 2024-05-21T01:19:47.942 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-05-21T01:19:47.937+0000 7fa542400640 -1 osd.1 0 waiting for initial osdmap 2024-05-21T01:19:47.943 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-05-21T01:19:47.937+0000 7fa3ab400640 -1 osd.0 0 waiting for initial osdmap 2024-05-21T01:19:47.949 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-05-21T01:19:47.945+0000 7fdeb6400640 -1 osd.3 0 waiting for initial osdmap 2024-05-21T01:19:47.978 INFO:tasks.ceph.osd.1.smithi063.stderr:2024-05-21T01:19:47.973+0000 7fa538400640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-21T01:19:47.989 INFO:tasks.ceph.osd.3.smithi063.stderr:2024-05-21T01:19:47.985+0000 7fdeac400640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-21T01:19:47.989 INFO:tasks.ceph.osd.0.smithi063.stderr:2024-05-21T01:19:47.985+0000 7fa3a1400640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-21T01:19:48.194 DEBUG:teuthology.orchestra.run.smithi063:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-21T01:19:48.325 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:48.321+0000 7fd052200640 1 Processor -- start 2024-05-21T01:19:48.325 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:48.321+0000 7fd052200640 1 -- start start 2024-05-21T01:19:48.326 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:48.321+0000 7fd052200640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd04c153d50 0x7fd04c159a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:48.327 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:48.321+0000 7fd052200640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd04c0cb100 0x7fd04c0c9050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:48.327 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:48.321+0000 7fd052200640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd04c0ca3d0 con 0x7fd04c0cf300 2024-05-21T01:19:48.327 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:48.321+0000 7fd052200640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7fd04c0caed0 con 0x7fd04c153d50 2024-05-21T01:19:48.327 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:48.321+0000 7fd052200640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fd04c0c8bc0 con 0x7fd04c0cb100 2024-05-21T01:19:48.327 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:48.321+0000 7fd050e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd04c153d50 0x7fd04c159a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:48.327 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:48.321+0000 7fd050e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd04c153d50 0x7fd04c159a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45956/0 (socket says 172.21.15.63:45956) 2024-05-21T01:19:48.327 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:48.321+0000 7fd050e00640 1 -- 172.21.15.63:0/4214524513 learned_addr learned my addr 172.21.15.63:0/4214524513 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:19:48.327 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:48.321+0000 7fd04be00640 1 --2- 172.21.15.63:0/4214524513 >> v2:172.21.15.131:3300/0 conn(0x7fd04c0cb100 0x7fd04c0c9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:48.327 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:48.321+0000 7fd050e00640 1 -- 172.21.15.63:0/4214524513 >> v2:172.21.15.131:3300/0 conn(0x7fd04c0cb100 msgr2=0x7fd04c0c9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:19:48.327 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:48.321+0000 7fd050e00640 1 --2- 172.21.15.63:0/4214524513 >> v2:172.21.15.131:3300/0 conn(0x7fd04c0cb100 0x7fd04c0c9050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:48.327 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:48.321+0000 7fd050e00640 1 -- 172.21.15.63:0/4214524513 >> v1:172.21.15.131:6789/0 conn(0x7fd04c0cf300 legacy=0x7fd04c0c6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:19:48.328 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:48.321+0000 7fd050e00640 1 -- 172.21.15.63:0/4214524513 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd04c0ca670 con 0x7fd04c153d50 2024-05-21T01:19:48.329 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:48.325+0000 7fd050e00640 1 --2- 172.21.15.63:0/4214524513 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd04c153d50 0x7fd04c159a20 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd04c0c8d40 tx=0x7fd04001ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f0a0dacbde8f381 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:19:48.330 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:48.325+0000 7fd04b400640 1 -- 172.21.15.63:0/4214524513 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0400b5070 con 0x7fd04c153d50 2024-05-21T01:19:48.330 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:48.325+0000 7fd04b400640 1 -- 172.21.15.63:0/4214524513 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0400a8a10 con 0x7fd04c153d50 2024-05-21T01:19:48.330 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:48.325+0000 7fd04b400640 1 -- 172.21.15.63:0/4214524513 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0400a8de0 con 0x7fd04c153d50 2024-05-21T01:19:48.331 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:48.325+0000 7fd052200640 1 -- 172.21.15.63:0/4214524513 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd04c153d50 msgr2=0x7fd04c159a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:48.331 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:48.325+0000 7fd052200640 1 --2- 172.21.15.63:0/4214524513 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd04c153d50 0x7fd04c159a20 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd04c0c8d40 tx=0x7fd04001ed10 comp rx=0 tx=0).stop 2024-05-21T01:19:48.331 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:48.325+0000 7fd052200640 1 -- 172.21.15.63:0/4214524513 shutdown_connections 2024-05-21T01:19:48.331 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:48.325+0000 7fd052200640 1 --2- 172.21.15.63:0/4214524513 >> v2:172.21.15.131:3300/0 conn(0x7fd04c0cb100 0x7fd04c0c9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:48.331 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:48.325+0000 7fd052200640 1 --2- 172.21.15.63:0/4214524513 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd04c153d50 0x7fd04c159a20 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:48.331 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:48.325+0000 7fd052200640 1 -- 172.21.15.63:0/4214524513 >> 172.21.15.63:0/4214524513 conn(0x7fd04c0683b0 msgr2=0x7fd04c0687c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:19:48.331 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:48.325+0000 7fd052200640 1 -- 172.21.15.63:0/4214524513 shutdown_connections 2024-05-21T01:19:48.331 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:48.325+0000 7fd052200640 1 -- 172.21.15.63:0/4214524513 wait complete. 2024-05-21T01:19:48.332 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:48.325+0000 7fd052200640 1 Processor -- start 2024-05-21T01:19:48.332 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:48.329+0000 7fd052200640 1 -- start start 2024-05-21T01:19:48.334 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:48.329+0000 7fd052200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd04c0cb100 0x7fd04c1f2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:48.335 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:48.329+0000 7fd052200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd04c0cf300 0x7fd04c1508b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:48.335 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:48.329+0000 7fd052200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd04c153d50 0x7fd04c1526b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:48.335 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:48.329+0000 7fd052200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fd04c0ca910 con 0x7fd04c153d50 2024-05-21T01:19:48.335 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:48.329+0000 7fd052200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd04c0c8890 con 0x7fd04c0cf300 2024-05-21T01:19:48.335 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:48.329+0000 7fd052200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fd04c0cabf0 con 0x7fd04c0cb100 2024-05-21T01:19:48.335 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:48.329+0000 7fd051800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd04c153d50 0x7fd04c1526b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:48.335 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:48.329+0000 7fd04be00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd04c0cf300 0x7fd04c1508b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:48.335 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:48.329+0000 7fd051800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd04c153d50 0x7fd04c1526b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45966/0 (socket says 172.21.15.63:45966) 2024-05-21T01:19:48.335 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:48.329+0000 7fd051800640 1 -- 172.21.15.63:0/3123612351 learned_addr learned my addr 172.21.15.63:0/3123612351 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:19:48.335 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:48.329+0000 7fd050e00640 1 --2- 172.21.15.63:0/3123612351 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd04c0cb100 0x7fd04c1f2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:48.335 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:48.329+0000 7fd051800640 1 -- 172.21.15.63:0/3123612351 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd04c0cb100 msgr2=0x7fd04c1f2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:48.335 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:48.329+0000 7fd051800640 1 --2- 172.21.15.63:0/3123612351 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd04c0cb100 0x7fd04c1f2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:48.335 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:48.329+0000 7fd051800640 1 -- 172.21.15.63:0/3123612351 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd04c0cf300 msgr2=0x7fd04c1508b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:48.336 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:48.329+0000 7fd051800640 1 --2- 172.21.15.63:0/3123612351 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd04c0cf300 0x7fd04c1508b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:48.336 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:48.329+0000 7fd051800640 1 -- 172.21.15.63:0/3123612351 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd04c14fe10 con 0x7fd04c153d50 2024-05-21T01:19:48.336 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:48.329+0000 7fd051800640 1 --2- 172.21.15.63:0/3123612351 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd04c153d50 0x7fd04c1526b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd04400c7c0 tx=0x7fd04400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:19:48.336 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:48.329+0000 7fd048c00640 1 -- 172.21.15.63:0/3123612351 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd044003b80 con 0x7fd04c153d50 2024-05-21T01:19:48.336 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:48.329+0000 7fd048c00640 1 -- 172.21.15.63:0/3123612351 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd044003d20 con 0x7fd04c153d50 2024-05-21T01:19:48.336 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:48.329+0000 7fd052200640 1 -- 172.21.15.63:0/3123612351 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd04c150df0 con 0x7fd04c153d50 2024-05-21T01:19:48.336 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:48.329+0000 7fd048c00640 1 -- 172.21.15.63:0/3123612351 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd04400aa90 con 0x7fd04c153d50 2024-05-21T01:19:48.336 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:48.329+0000 7fd052200640 1 -- 172.21.15.63:0/3123612351 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd04c06d910 con 0x7fd04c153d50 2024-05-21T01:19:48.337 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:48.329+0000 7fd052200640 1 -- 172.21.15.63:0/3123612351 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd04c0507f0 con 0x7fd04c153d50 2024-05-21T01:19:48.337 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:48.333+0000 7fd048c00640 1 -- 172.21.15.63:0/3123612351 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 93151+0+0 (secure 0 0 0) 0x7fd04400ac30 con 0x7fd04c153d50 2024-05-21T01:19:48.338 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:48.333+0000 7fd048c00640 1 --2- 172.21.15.63:0/3123612351 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fd02c06f3a0 0x7fd02c071860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:48.338 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:48.333+0000 7fd048c00640 1 -- 172.21.15.63:0/3123612351 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 3726+0+0 (secure 0 0 0) 0x7fd04408e8a0 con 0x7fd04c153d50 2024-05-21T01:19:48.339 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:48.333+0000 7fd050e00640 1 --2- 172.21.15.63:0/3123612351 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fd02c06f3a0 0x7fd02c071860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:48.339 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:48.333+0000 7fd050e00640 1 --2- 172.21.15.63:0/3123612351 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fd02c06f3a0 0x7fd02c071860 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd0400b2000 tx=0x7fd040009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:19:48.343 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:48.337+0000 7fd048c00640 1 -- 172.21.15.63:0/3123612351 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fd04405b940 con 0x7fd04c153d50 2024-05-21T01:19:48.534 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:48.529+0000 7fd052200640 1 -- 172.21.15.63:0/3123612351 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd04c0d0070 con 0x7fd04c153d50 2024-05-21T01:19:48.535 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:48.529+0000 7fd048c00640 1 -- 172.21.15.63:0/3123612351 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) ==== 74+0+12769 (secure 0 0 0) 0x7fd04405fc40 con 0x7fd04c153d50 2024-05-21T01:19:48.535 INFO:teuthology.misc.health.smithi063.stdout: 2024-05-21T01:19:48.536 INFO:teuthology.misc.health.smithi063.stdout:{"epoch":15,"fsid":"9a7cbd84-ceb2-41c8-8b6e-ab931f86c51a","created":"2024-05-21T01:19:37.688082+0000","modified":"2024-05-21T01:19:48.472107+0000","last_up_change":"2024-05-21T01:19:48.472107+0000","last_in_change":"2024-05-21T01:19:39.973975+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-21T01:19:46.485266+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cda28135-00bb-4194-adcb-e0abf3ae43f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":3740454920},{"type":"v1","addr":"172.21.15.63:6801","nonce":3740454920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":3740454920},{"type":"v1","addr":"172.21.15.63:6804","nonce":3740454920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":3740454920},{"type":"v1","addr":"172.21.15.63:6812","nonce":3740454920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":3740454920},{"type":"v1","addr":"172.21.15.63:6808","nonce":3740454920}]},"public_addr":"172.21.15.63:6801/3740454920","cluster_addr":"172.21.15.63:6804/3740454920","heartbeat_back_addr":"172.21.15.63:6812/3740454920","heartbeat_front_addr":"172.21.15.63:6808/3740454920","state":["exists","up"]},{"osd":1,"uuid":"4aeb370d-ec2f-4a91-b17b-035fd72bdaea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6803","nonce":896993303},{"type":"v1","addr":"172.21.15.63:6805","nonce":896993303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6807","nonce":896993303},{"type":"v1","addr":"172.21.15.63:6809","nonce":896993303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":896993303},{"type":"v1","addr":"172.21.15.63:6816","nonce":896993303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6811","nonce":896993303},{"type":"v1","addr":"172.21.15.63:6813","nonce":896993303}]},"public_addr":"172.21.15.63:6805/896993303","cluster_addr":"172.21.15.63:6809/896993303","heartbeat_back_addr":"172.21.15.63:6816/896993303","heartbeat_front_addr":"172.21.15.63:6813/896993303","state":["exists","up"]},{"osd":2,"uuid":"8368b112-35a3-43cf-ad1c-803f05708091","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":845807419},{"type":"v1","addr":"172.21.15.63:6817","nonce":845807419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":845807419},{"type":"v1","addr":"172.21.15.63:6819","nonce":845807419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":845807419},{"type":"v1","addr":"172.21.15.63:6823","nonce":845807419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":845807419},{"type":"v1","addr":"172.21.15.63:6821","nonce":845807419}]},"public_addr":"172.21.15.63:6817/845807419","cluster_addr":"172.21.15.63:6819/845807419","heartbeat_back_addr":"172.21.15.63:6823/845807419","heartbeat_front_addr":"172.21.15.63:6821/845807419","state":["exists","up"]},{"osd":3,"uuid":"26208950-e3ca-4b9a-94cd-c159453a5dfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":521563809},{"type":"v1","addr":"172.21.15.63:6825","nonce":521563809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":521563809},{"type":"v1","addr":"172.21.15.63:6827","nonce":521563809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":521563809},{"type":"v1","addr":"172.21.15.63:6831","nonce":521563809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":521563809},{"type":"v1","addr":"172.21.15.63:6829","nonce":521563809}]},"public_addr":"172.21.15.63:6825/521563809","cluster_addr":"172.21.15.63:6827/521563809","heartbeat_back_addr":"172.21.15.63:6831/521563809","heartbeat_front_addr":"172.21.15.63:6829/521563809","state":["exists","up"]},{"osd":4,"uuid":"d8c93283-1e10-4419-9934-d5048c5d0ad1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":2660673588},{"type":"v1","addr":"172.21.15.131:6801","nonce":2660673588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":2660673588},{"type":"v1","addr":"172.21.15.131:6803","nonce":2660673588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":2660673588},{"type":"v1","addr":"172.21.15.131:6807","nonce":2660673588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":2660673588},{"type":"v1","addr":"172.21.15.131:6805","nonce":2660673588}]},"public_addr":"172.21.15.131:6801/2660673588","cluster_addr":"172.21.15.131:6803/2660673588","heartbeat_back_addr":"172.21.15.131:6807/2660673588","heartbeat_front_addr":"172.21.15.131:6805/2660673588","state":["exists","up"]},{"osd":5,"uuid":"93a6fe9b-eaa6-4474-bf9b-ae0571feacf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6809","nonce":2508702891},{"type":"v1","addr":"172.21.15.131:6811","nonce":2508702891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6813","nonce":2508702891},{"type":"v1","addr":"172.21.15.131:6815","nonce":2508702891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6821","nonce":2508702891},{"type":"v1","addr":"172.21.15.131:6823","nonce":2508702891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6817","nonce":2508702891},{"type":"v1","addr":"172.21.15.131:6819","nonce":2508702891}]},"public_addr":"172.21.15.131:6811/2508702891","cluster_addr":"172.21.15.131:6815/2508702891","heartbeat_back_addr":"172.21.15.131:6823/2508702891","heartbeat_front_addr":"172.21.15.131:6819/2508702891","state":["exists","up"]},{"osd":6,"uuid":"e05e6c8c-2dda-49ab-8116-5ea9038d0f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":614380392},{"type":"v1","addr":"172.21.15.131:6810","nonce":614380392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":614380392},{"type":"v1","addr":"172.21.15.131:6814","nonce":614380392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":614380392},{"type":"v1","addr":"172.21.15.131:6822","nonce":614380392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":614380392},{"type":"v1","addr":"172.21.15.131:6818","nonce":614380392}]},"public_addr":"172.21.15.131:6810/614380392","cluster_addr":"172.21.15.131:6814/614380392","heartbeat_back_addr":"172.21.15.131:6822/614380392","heartbeat_front_addr":"172.21.15.131:6818/614380392","state":["exists","up"]},{"osd":7,"uuid":"0b393e5e-eeef-4e32-b23a-d405a8b0e7b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":4219797450},{"type":"v1","addr":"172.21.15.131:6825","nonce":4219797450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":4219797450},{"type":"v1","addr":"172.21.15.131:6827","nonce":4219797450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":4219797450},{"type":"v1","addr":"172.21.15.131:6831","nonce":4219797450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":4219797450},{"type":"v1","addr":"172.21.15.131:6829","nonce":4219797450}]},"public_addr":"172.21.15.131:6825/4219797450","cluster_addr":"172.21.15.131:6827/4219797450","heartbeat_back_addr":"172.21.15.131:6831/4219797450","heartbeat_front_addr":"172.21.15.131:6829/4219797450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.380500+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.553497+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.517866+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.310320+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-21T01:19:48.538 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:48.533+0000 7fd052200640 1 -- 172.21.15.63:0/3123612351 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fd02c06f3a0 msgr2=0x7fd02c071860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:48.538 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:48.533+0000 7fd052200640 1 --2- 172.21.15.63:0/3123612351 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fd02c06f3a0 0x7fd02c071860 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd0400b2000 tx=0x7fd040009040 comp rx=0 tx=0).stop 2024-05-21T01:19:48.538 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:48.533+0000 7fd052200640 1 -- 172.21.15.63:0/3123612351 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd04c153d50 msgr2=0x7fd04c1526b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:48.538 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:48.533+0000 7fd052200640 1 --2- 172.21.15.63:0/3123612351 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd04c153d50 0x7fd04c1526b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd04400c7c0 tx=0x7fd04400cc80 comp rx=0 tx=0).stop 2024-05-21T01:19:48.538 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:48.533+0000 7fd052200640 1 -- 172.21.15.63:0/3123612351 shutdown_connections 2024-05-21T01:19:48.538 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:48.533+0000 7fd052200640 1 --2- 172.21.15.63:0/3123612351 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fd02c06f3a0 0x7fd02c071860 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:48.538 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:48.533+0000 7fd052200640 1 --2- 172.21.15.63:0/3123612351 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd04c153d50 0x7fd04c1526b0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:48.538 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:48.533+0000 7fd052200640 1 --2- 172.21.15.63:0/3123612351 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd04c0cf300 0x7fd04c1508b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:48.538 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:48.533+0000 7fd052200640 1 --2- 172.21.15.63:0/3123612351 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd04c0cb100 0x7fd04c1f2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:48.538 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:48.533+0000 7fd052200640 1 -- 172.21.15.63:0/3123612351 >> 172.21.15.63:0/3123612351 conn(0x7fd04c0683b0 msgr2=0x7fd04c0cf960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:19:48.538 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:48.533+0000 7fd052200640 1 -- 172.21.15.63:0/3123612351 shutdown_connections 2024-05-21T01:19:48.539 INFO:teuthology.misc.health.smithi063.stderr:2024-05-21T01:19:48.533+0000 7fd052200640 1 -- 172.21.15.63:0/3123612351 wait complete. 2024-05-21T01:19:48.554 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-05-21T01:19:48.554 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-05-21T01:19:48.555 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-21T01:19:48.555 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-21T01:19:48.558 INFO:tasks.ceph.mds.a:Started 2024-05-21T01:19:48.558 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-21T01:19:48.558 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-21T01:19:48.561 INFO:tasks.ceph.mds.c:Started 2024-05-21T01:19:48.561 INFO:tasks.ceph.mds.e:Restarting daemon 2024-05-21T01:19:48.561 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i e 2024-05-21T01:19:48.564 INFO:tasks.ceph.mds.e:Started 2024-05-21T01:19:48.564 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-21T01:19:48.564 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-21T01:19:48.567 INFO:tasks.ceph.mds.b:Started 2024-05-21T01:19:48.567 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-21T01:19:48.567 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-21T01:19:48.569 INFO:tasks.ceph.mds.d:Started 2024-05-21T01:19:48.569 INFO:tasks.ceph.mds.f:Restarting daemon 2024-05-21T01:19:48.569 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i f 2024-05-21T01:19:48.571 INFO:tasks.ceph.mds.f:Started 2024-05-21T01:19:48.571 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-05-21T01:19:48.572 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-21T01:19:48.650 INFO:tasks.ceph.mds.b.smithi131.stdout:starting mds.b at 2024-05-21T01:19:48.656 INFO:tasks.ceph.mds.e.smithi063.stdout:starting mds.e at 2024-05-21T01:19:48.657 INFO:tasks.ceph.mds.c.smithi063.stdout:starting mds.c at 2024-05-21T01:19:48.657 INFO:tasks.ceph.mds.a.smithi063.stdout:starting mds.a at 2024-05-21T01:19:48.659 INFO:tasks.ceph.mds.f.smithi131.stdout:starting mds.f at 2024-05-21T01:19:48.659 INFO:tasks.ceph.mds.d.smithi131.stdout:starting mds.d at 2024-05-21T01:19:48.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:48.721+0000 7fe52be00640 1 Processor -- start 2024-05-21T01:19:48.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:48.721+0000 7fe52be00640 1 -- start start 2024-05-21T01:19:48.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:48.721+0000 7fe52be00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe52c06f2c0 0x7fe52c073310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:48.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:48.721+0000 7fe52be00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe52c15c7a0 con 0x7fe52c155e10 2024-05-21T01:19:48.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:48.721+0000 7fe52be00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe52c06d5b0 con 0x7fe52c0c9a90 2024-05-21T01:19:48.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:48.721+0000 7fe52be00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fe52c071720 con 0x7fe52c06f2c0 2024-05-21T01:19:48.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:48.721+0000 7fe52aa00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fe52c155e10 0x7fe52c15d070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:32996/0 (socket says 172.21.15.63:32996) 2024-05-21T01:19:48.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:48.721+0000 7fe52aa00640 1 -- 172.21.15.63:0/3829652377 learned_addr learned my addr 172.21.15.63:0/3829652377 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-05-21T01:19:48.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:48.721+0000 7fe52a000640 1 --2- 172.21.15.63:0/3829652377 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe52c06f2c0 0x7fe52c073310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:48.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:48.721+0000 7fe529600640 1 -- 172.21.15.63:0/3829652377 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3062571665 0 0) 0x7fe52c15c7a0 con 0x7fe52c155e10 2024-05-21T01:19:48.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:48.721+0000 7fe529600640 1 -- 172.21.15.63:0/3829652377 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe510003530 con 0x7fe52c155e10 2024-05-21T01:19:48.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:48.721+0000 7fe529600640 1 -- 172.21.15.63:0/3829652377 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2659177600 0 0) 0x7fe52c06d5b0 con 0x7fe52c0c9a90 2024-05-21T01:19:48.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:48.721+0000 7fe529600640 1 -- 172.21.15.63:0/3829652377 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe52c15c7a0 con 0x7fe52c0c9a90 2024-05-21T01:19:48.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:48.721+0000 7fe52a000640 1 -- 172.21.15.63:0/3829652377 >> v1:172.21.15.131:6789/0 conn(0x7fe52c0c9a90 legacy=0x7fe52c073850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:48.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:48.721+0000 7fe52a000640 1 -- 172.21.15.63:0/3829652377 >> v1:172.21.15.63:6789/0 conn(0x7fe52c155e10 legacy=0x7fe52c15d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:48.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:48.721+0000 7fe52a000640 1 -- 172.21.15.63:0/3829652377 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe52c071440 con 0x7fe52c06f2c0 2024-05-21T01:19:48.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:48.725+0000 7fe52a000640 1 --2- 172.21.15.63:0/3829652377 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe52c06f2c0 0x7fe52c073310 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe5180097f0 tx=0x7fe51801c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=316de3318509890 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:19:48.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:48.725+0000 7fe529600640 1 -- 172.21.15.63:0/3829652377 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5180b1070 con 0x7fe52c06f2c0 2024-05-21T01:19:48.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:48.725+0000 7fe529600640 1 -- 172.21.15.63:0/3829652377 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5180ac5f0 con 0x7fe52c06f2c0 2024-05-21T01:19:48.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:48.725+0000 7fe529600640 1 -- 172.21.15.63:0/3829652377 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5180ac9c0 con 0x7fe52c06f2c0 2024-05-21T01:19:48.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:48.725+0000 7fe52be00640 1 -- 172.21.15.63:0/3829652377 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe52c06f2c0 msgr2=0x7fe52c073310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:48.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:48.725+0000 7fe52be00640 1 --2- 172.21.15.63:0/3829652377 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe52c06f2c0 0x7fe52c073310 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe5180097f0 tx=0x7fe51801c4e0 comp rx=0 tx=0).stop 2024-05-21T01:19:48.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:48.725+0000 7fe52be00640 1 -- 172.21.15.63:0/3829652377 shutdown_connections 2024-05-21T01:19:48.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:48.725+0000 7fe52be00640 1 --2- 172.21.15.63:0/3829652377 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe52c06f2c0 0x7fe52c073310 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:48.732 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:48.725+0000 7fe52be00640 1 -- 172.21.15.63:0/3829652377 >> 172.21.15.63:0/3829652377 conn(0x7fe52c06caa0 msgr2=0x7fe52c068290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:19:48.732 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:48.725+0000 7fe52be00640 1 -- 172.21.15.63:0/3829652377 shutdown_connections 2024-05-21T01:19:48.732 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:48.725+0000 7fe52be00640 1 -- 172.21.15.63:0/3829652377 wait complete. 2024-05-21T01:19:48.733 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:48.729+0000 7fe52be00640 1 Processor -- start 2024-05-21T01:19:48.733 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:48.729+0000 7fe52be00640 1 -- start start 2024-05-21T01:19:48.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:48.729+0000 7fe52be00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe52c06f2c0 0x7fe52c1f8b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:48.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:48.729+0000 7fe52be00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe52c0c9a90 0x7fe52c152450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:48.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:48.729+0000 7fe52be00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe52c155e10 0x7fe52c152ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:48.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:48.729+0000 7fe52be00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe52c06dab0 con 0x7fe52c155e10 2024-05-21T01:19:48.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:48.729+0000 7fe52be00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fe52c073f60 con 0x7fe52c0c9a90 2024-05-21T01:19:48.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:48.729+0000 7fe52be00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fe52c06dc30 con 0x7fe52c06f2c0 2024-05-21T01:19:48.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:48.729+0000 7fe52b400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe52c155e10 0x7fe52c152ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:48.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:48.729+0000 7fe52b400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe52c155e10 0x7fe52c152ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46012/0 (socket says 172.21.15.63:46012) 2024-05-21T01:19:48.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:48.729+0000 7fe52b400640 1 -- 172.21.15.63:0/2471315584 learned_addr learned my addr 172.21.15.63:0/2471315584 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:19:48.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:48.729+0000 7fe52aa00640 1 --2- 172.21.15.63:0/2471315584 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe52c06f2c0 0x7fe52c1f8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:48.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:48.729+0000 7fe52a000640 1 --2- 172.21.15.63:0/2471315584 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe52c0c9a90 0x7fe52c152450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:48.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:48.729+0000 7fe52b400640 1 -- 172.21.15.63:0/2471315584 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe52c06f2c0 msgr2=0x7fe52c1f8b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:48.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:48.729+0000 7fe52b400640 1 --2- 172.21.15.63:0/2471315584 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe52c06f2c0 0x7fe52c1f8b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:48.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:48.729+0000 7fe52b400640 1 -- 172.21.15.63:0/2471315584 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe52c0c9a90 msgr2=0x7fe52c152450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:48.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:48.729+0000 7fe52b400640 1 --2- 172.21.15.63:0/2471315584 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe52c0c9a90 0x7fe52c152450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:48.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:48.729+0000 7fe52b400640 1 -- 172.21.15.63:0/2471315584 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe52c1f9080 con 0x7fe52c155e10 2024-05-21T01:19:48.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:48.729+0000 7fe52b400640 1 --2- 172.21.15.63:0/2471315584 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe52c155e10 0x7fe52c152ff0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe52400c730 tx=0x7fe52400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:19:48.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:48.729+0000 7fe522a00640 1 -- 172.21.15.63:0/2471315584 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe524003b80 con 0x7fe52c155e10 2024-05-21T01:19:48.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:48.729+0000 7fe522a00640 1 -- 172.21.15.63:0/2471315584 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe524003d40 con 0x7fe52c155e10 2024-05-21T01:19:48.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:48.729+0000 7fe52be00640 1 -- 172.21.15.63:0/2471315584 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe52c1f5ae0 con 0x7fe52c155e10 2024-05-21T01:19:48.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:48.729+0000 7fe522a00640 1 -- 172.21.15.63:0/2471315584 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe524005310 con 0x7fe52c155e10 2024-05-21T01:19:48.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:48.729+0000 7fe52be00640 1 -- 172.21.15.63:0/2471315584 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe52c0bf7e0 con 0x7fe52c155e10 2024-05-21T01:19:48.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:48.729+0000 7fe52be00640 1 -- 172.21.15.63:0/2471315584 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe52c06c0c0 con 0x7fe52c155e10 2024-05-21T01:19:48.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:48.733+0000 7fe522a00640 1 -- 172.21.15.63:0/2471315584 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 93151+0+0 (secure 0 0 0) 0x7fe5240056c0 con 0x7fe52c155e10 2024-05-21T01:19:48.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:48.733+0000 7fe522a00640 1 --2- 172.21.15.63:0/2471315584 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fe50c06f370 0x7fe50c071830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:48.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:48.733+0000 7fe522a00640 1 -- 172.21.15.63:0/2471315584 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 4857+0+0 (secure 0 0 0) 0x7fe52408ef20 con 0x7fe52c155e10 2024-05-21T01:19:48.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:48.733+0000 7fe52aa00640 1 --2- 172.21.15.63:0/2471315584 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fe50c06f370 0x7fe50c071830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:48.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:48.733+0000 7fe52aa00640 1 --2- 172.21.15.63:0/2471315584 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fe50c06f370 0x7fe50c071830 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe51c000c10 tx=0x7fe51c007ef0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:19:48.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:48.737+0000 7fe522a00640 1 -- 172.21.15.63:0/2471315584 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fe52405c2c0 con 0x7fe52c155e10 2024-05-21T01:19:48.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:48.941+0000 7fe52be00640 1 -- 172.21.15.63:0/2471315584 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe52c0c9280 con 0x7fe52c155e10 2024-05-21T01:19:48.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:48.941+0000 7fe522a00640 1 -- 172.21.15.63:0/2471315584 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1389 (secure 0 0 0) 0x7fe52405bbc0 con 0x7fe52c155e10 2024-05-21T01:19:48.946 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-05-21T01:19:48.946 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4267,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6833/574189772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":574189772},{"type":"v1","addr":"172.21.15.63:6833","nonce":574189772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-05-21T01:19:48.946 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 2 2024-05-21T01:19:48.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:48.941+0000 7fe52be00640 1 -- 172.21.15.63:0/2471315584 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fe50c06f370 msgr2=0x7fe50c071830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:48.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:48.941+0000 7fe52be00640 1 --2- 172.21.15.63:0/2471315584 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fe50c06f370 0x7fe50c071830 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe51c000c10 tx=0x7fe51c007ef0 comp rx=0 tx=0).stop 2024-05-21T01:19:48.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:48.941+0000 7fe52be00640 1 -- 172.21.15.63:0/2471315584 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe52c155e10 msgr2=0x7fe52c152ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:48.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:48.941+0000 7fe52be00640 1 --2- 172.21.15.63:0/2471315584 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe52c155e10 0x7fe52c152ff0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe52400c730 tx=0x7fe52400cbf0 comp rx=0 tx=0).stop 2024-05-21T01:19:48.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:48.941+0000 7fe52be00640 1 -- 172.21.15.63:0/2471315584 shutdown_connections 2024-05-21T01:19:48.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:48.941+0000 7fe52be00640 1 --2- 172.21.15.63:0/2471315584 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fe50c06f370 0x7fe50c071830 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:48.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:48.941+0000 7fe52be00640 1 --2- 172.21.15.63:0/2471315584 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe52c155e10 0x7fe52c152ff0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:48.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:48.941+0000 7fe52be00640 1 --2- 172.21.15.63:0/2471315584 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe52c0c9a90 0x7fe52c152450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:48.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:48.941+0000 7fe52be00640 1 --2- 172.21.15.63:0/2471315584 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe52c06f2c0 0x7fe52c1f8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:48.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:48.941+0000 7fe52be00640 1 -- 172.21.15.63:0/2471315584 >> 172.21.15.63:0/2471315584 conn(0x7fe52c06caa0 msgr2=0x7fe52c15aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:19:48.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:48.941+0000 7fe52be00640 1 -- 172.21.15.63:0/2471315584 shutdown_connections 2024-05-21T01:19:48.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:48.941+0000 7fe52be00640 1 -- 172.21.15.63:0/2471315584 wait complete. 2024-05-21T01:19:50.967 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-21T01:19:51.109 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.105+0000 7fd6e9c00640 1 Processor -- start 2024-05-21T01:19:51.109 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.105+0000 7fd6e9c00640 1 -- start start 2024-05-21T01:19:51.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.105+0000 7fd6e9c00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd6e4156070 0x7fd6e4071640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:51.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.105+0000 7fd6e9c00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd6e406f080 0x7fd6e415d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:51.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.105+0000 7fd6e9c00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6e415bf20 con 0x7fd6e4071b80 2024-05-21T01:19:51.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.105+0000 7fd6e9c00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7fd6e415c1e0 con 0x7fd6e4156070 2024-05-21T01:19:51.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.105+0000 7fd6e9c00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fd6e415c4c0 con 0x7fd6e406f080 2024-05-21T01:19:51.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.105+0000 7fd6e2a00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd6e4156070 0x7fd6e4071640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:51.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.105+0000 7fd6e2000640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fd6e4071b80 0x7fd6e40cf530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:33000/0 (socket says 172.21.15.63:33000) 2024-05-21T01:19:51.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.105+0000 7fd6e2a00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd6e4156070 0x7fd6e4071640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46028/0 (socket says 172.21.15.63:46028) 2024-05-21T01:19:51.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.105+0000 7fd6e2000640 1 -- 172.21.15.63:0/2194353410 learned_addr learned my addr 172.21.15.63:0/2194353410 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-05-21T01:19:51.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.105+0000 7fd6e3400640 1 --2- 172.21.15.63:0/2194353410 >> v2:172.21.15.131:3300/0 conn(0x7fd6e406f080 0x7fd6e415d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:51.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.105+0000 7fd6e2a00640 1 -- 172.21.15.63:0/2194353410 >> v2:172.21.15.131:3300/0 conn(0x7fd6e406f080 msgr2=0x7fd6e415d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:19:51.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.105+0000 7fd6e2a00640 1 --2- 172.21.15.63:0/2194353410 >> v2:172.21.15.131:3300/0 conn(0x7fd6e406f080 0x7fd6e415d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:51.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.105+0000 7fd6e2a00640 1 -- 172.21.15.63:0/2194353410 >> v1:172.21.15.63:6789/0 conn(0x7fd6e4071b80 legacy=0x7fd6e40cf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:51.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.105+0000 7fd6e1600640 1 -- 172.21.15.63:0/2194353410 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2035190079 0 0) 0x7fd6e415bf20 con 0x7fd6e4071b80 2024-05-21T01:19:51.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.105+0000 7fd6e2a00640 1 -- 172.21.15.63:0/2194353410 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6e415c7a0 con 0x7fd6e4156070 2024-05-21T01:19:51.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.109+0000 7fd6e2a00640 1 --2- 172.21.15.63:0/2194353410 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd6e4156070 0x7fd6e4071640 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd6e40ca290 tx=0x7fd6d401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b10fe72251f9905 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:19:51.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.109+0000 7fd6e1600640 1 -- 172.21.15.63:0/2194353410 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6d40b0070 con 0x7fd6e4156070 2024-05-21T01:19:51.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.109+0000 7fd6e1600640 1 -- 172.21.15.63:0/2194353410 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6d40ab600 con 0x7fd6e4156070 2024-05-21T01:19:51.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.109+0000 7fd6e1600640 1 -- 172.21.15.63:0/2194353410 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6d40ab9d0 con 0x7fd6e4156070 2024-05-21T01:19:51.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.109+0000 7fd6e9c00640 1 -- 172.21.15.63:0/2194353410 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd6e4156070 msgr2=0x7fd6e4071640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:51.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.109+0000 7fd6e9c00640 1 --2- 172.21.15.63:0/2194353410 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd6e4156070 0x7fd6e4071640 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd6e40ca290 tx=0x7fd6d401c480 comp rx=0 tx=0).stop 2024-05-21T01:19:51.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.109+0000 7fd6e9c00640 1 -- 172.21.15.63:0/2194353410 shutdown_connections 2024-05-21T01:19:51.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.109+0000 7fd6e9c00640 1 --2- 172.21.15.63:0/2194353410 >> v2:172.21.15.131:3300/0 conn(0x7fd6e406f080 0x7fd6e415d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:51.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.109+0000 7fd6e9c00640 1 --2- 172.21.15.63:0/2194353410 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd6e4156070 0x7fd6e4071640 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:51.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.109+0000 7fd6e9c00640 1 -- 172.21.15.63:0/2194353410 >> 172.21.15.63:0/2194353410 conn(0x7fd6e40735f0 msgr2=0x7fd6e4073a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:19:51.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.109+0000 7fd6e9c00640 1 -- 172.21.15.63:0/2194353410 shutdown_connections 2024-05-21T01:19:51.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.109+0000 7fd6e9c00640 1 -- 172.21.15.63:0/2194353410 wait complete. 2024-05-21T01:19:51.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.109+0000 7fd6e9c00640 1 Processor -- start 2024-05-21T01:19:51.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.113+0000 7fd6e9c00640 1 -- start start 2024-05-21T01:19:51.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.113+0000 7fd6e9c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6e406f080 0x7fd6e4158460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:51.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.113+0000 7fd6e9c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd6e4071b80 0x7fd6e41589a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:51.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.113+0000 7fd6e9c00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd6e4156070 0x7fd6e40cc420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:51.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.113+0000 7fd6e9c00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fd6e406e140 con 0x7fd6e4071b80 2024-05-21T01:19:51.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.113+0000 7fd6e9c00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd6e406dfc0 con 0x7fd6e406f080 2024-05-21T01:19:51.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.113+0000 7fd6e9c00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fd6e40cfc40 con 0x7fd6e4156070 2024-05-21T01:19:51.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.113+0000 7fd6e2000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd6e4071b80 0x7fd6e41589a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:51.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.113+0000 7fd6e2000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd6e4071b80 0x7fd6e41589a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46032/0 (socket says 172.21.15.63:46032) 2024-05-21T01:19:51.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.113+0000 7fd6e2000640 1 -- 172.21.15.63:0/3949625972 learned_addr learned my addr 172.21.15.63:0/3949625972 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:19:51.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.113+0000 7fd6e3400640 1 --2- 172.21.15.63:0/3949625972 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd6e4156070 0x7fd6e40cc420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:51.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.113+0000 7fd6e2a00640 1 --2- 172.21.15.63:0/3949625972 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6e406f080 0x7fd6e4158460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:51.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.113+0000 7fd6e2000640 1 -- 172.21.15.63:0/3949625972 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd6e4156070 msgr2=0x7fd6e40cc420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:51.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.113+0000 7fd6e2000640 1 --2- 172.21.15.63:0/3949625972 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd6e4156070 0x7fd6e40cc420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:51.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.113+0000 7fd6e2000640 1 -- 172.21.15.63:0/3949625972 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6e406f080 msgr2=0x7fd6e4158460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:51.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.113+0000 7fd6e2000640 1 --2- 172.21.15.63:0/3949625972 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6e406f080 0x7fd6e4158460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:51.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.113+0000 7fd6e2000640 1 -- 172.21.15.63:0/3949625972 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6e41591e0 con 0x7fd6e4071b80 2024-05-21T01:19:51.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.113+0000 7fd6e2000640 1 --2- 172.21.15.63:0/3949625972 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd6e4071b80 0x7fd6e41589a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd6d000c490 tx=0x7fd6d000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:19:51.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.113+0000 7fd6daa00640 1 -- 172.21.15.63:0/3949625972 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6d00074e0 con 0x7fd6e4071b80 2024-05-21T01:19:51.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.113+0000 7fd6daa00640 1 -- 172.21.15.63:0/3949625972 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6d00047f0 con 0x7fd6e4071b80 2024-05-21T01:19:51.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.113+0000 7fd6e9c00640 1 -- 172.21.15.63:0/3949625972 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6e41594c0 con 0x7fd6e4071b80 2024-05-21T01:19:51.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.113+0000 7fd6daa00640 1 -- 172.21.15.63:0/3949625972 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6d0004be0 con 0x7fd6e4071b80 2024-05-21T01:19:51.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.113+0000 7fd6e9c00640 1 -- 172.21.15.63:0/3949625972 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6e40cbf00 con 0x7fd6e4071b80 2024-05-21T01:19:51.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.113+0000 7fd6e9c00640 1 -- 172.21.15.63:0/3949625972 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6e40507f0 con 0x7fd6e4071b80 2024-05-21T01:19:51.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.117+0000 7fd6daa00640 1 -- 172.21.15.63:0/3949625972 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) ==== 93151+0+0 (secure 0 0 0) 0x7fd6d0011070 con 0x7fd6e4071b80 2024-05-21T01:19:51.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.117+0000 7fd6daa00640 1 --2- 172.21.15.63:0/3949625972 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fd6c406f370 0x7fd6c4071830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:51.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.117+0000 7fd6daa00640 1 -- 172.21.15.63:0/3949625972 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fd6d008f080 con 0x7fd6e4071b80 2024-05-21T01:19:51.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.117+0000 7fd6e2a00640 1 --2- 172.21.15.63:0/3949625972 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fd6c406f370 0x7fd6c4071830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:51.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.117+0000 7fd6e2a00640 1 --2- 172.21.15.63:0/3949625972 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fd6c406f370 0x7fd6c4071830 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd6d40ad000 tx=0x7fd6d4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:19:51.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.121+0000 7fd6daa00640 1 -- 172.21.15.63:0/3949625972 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fd6d005c4a0 con 0x7fd6e4071b80 2024-05-21T01:19:51.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.305+0000 7fd6daa00640 1 -- 172.21.15.63:0/3949625972 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7fd6d0058030 con 0x7fd6e4071b80 2024-05-21T01:19:51.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.325+0000 7fd6e9c00640 1 -- 172.21.15.63:0/3949625972 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd6e414d8b0 con 0x7fd6e4071b80 2024-05-21T01:19:51.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.325+0000 7fd6daa00640 1 -- 172.21.15.63:0/3949625972 <== mon.0 v2:172.21.15.63:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+5518 (secure 0 0 0) 0x7fd6d007ee20 con 0x7fd6e4071b80 2024-05-21T01:19:51.329 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-05-21T01:19:51.330 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6839/3045714273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6837","nonce":3045714273},{"type":"v1","addr":"172.21.15.131:6839","nonce":3045714273}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/2978367338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":2978367338},{"type":"v1","addr":"172.21.15.131:6835","nonce":2978367338}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/3005995321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6835","nonce":3005995321},{"type":"v1","addr":"172.21.15.63:6837","nonce":3005995321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4267,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6833/574189772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":574189772},{"type":"v1","addr":"172.21.15.63:6833","nonce":574189772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4270,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6838/3071941741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":3071941741},{"type":"v1","addr":"172.21.15.131:6838","nonce":3071941741}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6836/2892727989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":2892727989},{"type":"v1","addr":"172.21.15.63:6836","nonce":2892727989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-05-21T01:19:51.330 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 3 2024-05-21T01:19:51.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.325+0000 7fd6e9c00640 1 -- 172.21.15.63:0/3949625972 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fd6c406f370 msgr2=0x7fd6c4071830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:51.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.325+0000 7fd6e9c00640 1 --2- 172.21.15.63:0/3949625972 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fd6c406f370 0x7fd6c4071830 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd6d40ad000 tx=0x7fd6d4008040 comp rx=0 tx=0).stop 2024-05-21T01:19:51.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.325+0000 7fd6e9c00640 1 -- 172.21.15.63:0/3949625972 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd6e4071b80 msgr2=0x7fd6e41589a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:51.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.325+0000 7fd6e9c00640 1 --2- 172.21.15.63:0/3949625972 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd6e4071b80 0x7fd6e41589a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd6d000c490 tx=0x7fd6d000c950 comp rx=0 tx=0).stop 2024-05-21T01:19:51.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.325+0000 7fd6e9c00640 1 -- 172.21.15.63:0/3949625972 shutdown_connections 2024-05-21T01:19:51.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.325+0000 7fd6e9c00640 1 --2- 172.21.15.63:0/3949625972 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fd6c406f370 0x7fd6c4071830 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:51.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.325+0000 7fd6e9c00640 1 --2- 172.21.15.63:0/3949625972 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd6e4156070 0x7fd6e40cc420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:51.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.325+0000 7fd6e9c00640 1 --2- 172.21.15.63:0/3949625972 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd6e4071b80 0x7fd6e41589a0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:51.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.325+0000 7fd6e9c00640 1 --2- 172.21.15.63:0/3949625972 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6e406f080 0x7fd6e4158460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:51.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.325+0000 7fd6e9c00640 1 -- 172.21.15.63:0/3949625972 >> 172.21.15.63:0/3949625972 conn(0x7fd6e40735f0 msgr2=0x7fd6e40cd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:19:51.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.325+0000 7fd6e9c00640 1 -- 172.21.15.63:0/3949625972 shutdown_connections 2024-05-21T01:19:51.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.325+0000 7fd6e9c00640 1 -- 172.21.15.63:0/3949625972 wait complete. 2024-05-21T01:19:51.351 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-21T01:19:51.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.485+0000 7f08b8a00640 1 Processor -- start 2024-05-21T01:19:51.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.485+0000 7f08b8a00640 1 -- start start 2024-05-21T01:19:51.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.489+0000 7f08b8a00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f08b4159960 0x7f08b4070d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:51.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.489+0000 7f08b8a00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f08b40c9a90 0x7f08b40c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:51.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.489+0000 7f08b8a00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08b415d0d0 con 0x7f08b4153ce0 2024-05-21T01:19:51.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.489+0000 7f08b8a00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f08b41540c0 con 0x7f08b40c9a90 2024-05-21T01:19:51.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.489+0000 7f08b8a00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f08b40c6590 con 0x7f08b4159960 2024-05-21T01:19:51.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.489+0000 7f08b2a00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f08b4159960 0x7f08b4070d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:51.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.489+0000 7f08b3e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f08b40c9a90 0x7f08b40c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:51.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.489+0000 7f08b3400640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f08b4153ce0 0x7f08b415d8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.63:36182/0 (socket says 172.21.15.63:36182) 2024-05-21T01:19:51.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.489+0000 7f08b3400640 1 -- 172.21.15.63:0/2872655192 learned_addr learned my addr 172.21.15.63:0/2872655192 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-05-21T01:19:51.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.489+0000 7f08b2a00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f08b4159960 0x7f08b4070d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.63:34988/0 (socket says 172.21.15.63:34988) 2024-05-21T01:19:51.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.489+0000 7f08b2a00640 1 -- 172.21.15.63:0/2872655192 >> v2:172.21.15.131:3300/0 conn(0x7f08b40c9a90 msgr2=0x7f08b40c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:19:51.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.489+0000 7f08b2a00640 1 --2- 172.21.15.63:0/2872655192 >> v2:172.21.15.131:3300/0 conn(0x7f08b40c9a90 0x7f08b40c82a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:51.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.489+0000 7f08b2a00640 1 -- 172.21.15.63:0/2872655192 >> v1:172.21.15.131:6789/0 conn(0x7f08b4153ce0 legacy=0x7f08b415d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:51.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.489+0000 7f08b2a00640 1 -- 172.21.15.63:0/2872655192 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08b40c67e0 con 0x7f08b4159960 2024-05-21T01:19:51.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.489+0000 7f08b3e00640 1 --2- 172.21.15.63:0/2872655192 >> v2:172.21.15.131:3300/0 conn(0x7f08b40c9a90 0x7f08b40c82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-21T01:19:51.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.493+0000 7f08b2a00640 1 --2- 172.21.15.63:0/2872655192 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f08b4159960 0x7f08b4070d60 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f08a00097c0 tx=0x7f08a001c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a1fd22795bebb6e server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:19:51.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.493+0000 7f08b2000640 1 -- 172.21.15.63:0/2872655192 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08a00b0070 con 0x7f08b4159960 2024-05-21T01:19:51.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.493+0000 7f08b2000640 1 -- 172.21.15.63:0/2872655192 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08a00ab600 con 0x7f08b4159960 2024-05-21T01:19:51.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.493+0000 7f08b2000640 1 -- 172.21.15.63:0/2872655192 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08a00ab9d0 con 0x7f08b4159960 2024-05-21T01:19:51.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.493+0000 7f08b8a00640 1 -- 172.21.15.63:0/2872655192 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f08b4159960 msgr2=0x7f08b4070d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:51.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.493+0000 7f08b8a00640 1 --2- 172.21.15.63:0/2872655192 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f08b4159960 0x7f08b4070d60 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f08a00097c0 tx=0x7f08a001c4a0 comp rx=0 tx=0).stop 2024-05-21T01:19:51.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.493+0000 7f08b8a00640 1 -- 172.21.15.63:0/2872655192 shutdown_connections 2024-05-21T01:19:51.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.493+0000 7f08b8a00640 1 --2- 172.21.15.63:0/2872655192 >> v2:172.21.15.131:3300/0 conn(0x7f08b40c9a90 0x7f08b40c82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:51.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.493+0000 7f08b8a00640 1 --2- 172.21.15.63:0/2872655192 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f08b4159960 0x7f08b4070d60 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:51.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.493+0000 7f08b8a00640 1 -- 172.21.15.63:0/2872655192 >> 172.21.15.63:0/2872655192 conn(0x7f08b406caa0 msgr2=0x7f08b4068290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:19:51.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.493+0000 7f08b8a00640 1 -- 172.21.15.63:0/2872655192 shutdown_connections 2024-05-21T01:19:51.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.493+0000 7f08b8a00640 1 -- 172.21.15.63:0/2872655192 wait complete. 2024-05-21T01:19:51.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.493+0000 7f08b8a00640 1 Processor -- start 2024-05-21T01:19:51.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.493+0000 7f08b8a00640 1 -- start start 2024-05-21T01:19:51.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.497+0000 7f08b8a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f08b40c9a90 0x7f08b406e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:51.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.497+0000 7f08b8a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f08b4153ce0 0x7f08b41429e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:51.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.497+0000 7f08b8a00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f08b4159960 0x7f08b4142f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:51.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.497+0000 7f08b8a00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f08b40712a0 con 0x7f08b40c9a90 2024-05-21T01:19:51.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.497+0000 7f08b8a00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f08b415d420 con 0x7f08b4153ce0 2024-05-21T01:19:51.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.497+0000 7f08b8a00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f08b40c6da0 con 0x7f08b4159960 2024-05-21T01:19:51.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.497+0000 7f08b3400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f08b40c9a90 0x7f08b406e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:51.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.497+0000 7f08b3400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f08b40c9a90 0x7f08b406e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46042/0 (socket says 172.21.15.63:46042) 2024-05-21T01:19:51.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.497+0000 7f08b3400640 1 -- 172.21.15.63:0/3424670545 learned_addr learned my addr 172.21.15.63:0/3424670545 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:19:51.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.497+0000 7f08b2a00640 1 --2- 172.21.15.63:0/3424670545 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f08b4153ce0 0x7f08b41429e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:51.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.497+0000 7f08b3e00640 1 --2- 172.21.15.63:0/3424670545 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f08b4159960 0x7f08b4142f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:51.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.497+0000 7f08b3400640 1 -- 172.21.15.63:0/3424670545 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f08b4159960 msgr2=0x7f08b4142f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:51.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.497+0000 7f08b3400640 1 --2- 172.21.15.63:0/3424670545 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f08b4159960 0x7f08b4142f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:51.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.497+0000 7f08b3400640 1 -- 172.21.15.63:0/3424670545 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f08b4153ce0 msgr2=0x7f08b41429e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:51.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.497+0000 7f08b3400640 1 --2- 172.21.15.63:0/3424670545 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f08b4153ce0 0x7f08b41429e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:51.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.497+0000 7f08b3400640 1 -- 172.21.15.63:0/3424670545 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08b4146f60 con 0x7f08b40c9a90 2024-05-21T01:19:51.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.497+0000 7f08b3400640 1 --2- 172.21.15.63:0/3424670545 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f08b40c9a90 0x7f08b406e860 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f08a400c500 tx=0x7f08a400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:19:51.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.497+0000 7f08ab400640 1 -- 172.21.15.63:0/3424670545 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08a4017070 con 0x7f08b40c9a90 2024-05-21T01:19:51.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.497+0000 7f08ab400640 1 -- 172.21.15.63:0/3424670545 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08a4005cf0 con 0x7f08b40c9a90 2024-05-21T01:19:51.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.497+0000 7f08ab400640 1 -- 172.21.15.63:0/3424670545 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08a4007270 con 0x7f08b40c9a90 2024-05-21T01:19:51.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.497+0000 7f08b8a00640 1 -- 172.21.15.63:0/3424670545 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08b4158c80 con 0x7f08b40c9a90 2024-05-21T01:19:51.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.497+0000 7f08b8a00640 1 -- 172.21.15.63:0/3424670545 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08b4159240 con 0x7f08b40c9a90 2024-05-21T01:19:51.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.497+0000 7f08b8a00640 1 -- 172.21.15.63:0/3424670545 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08b4146cd0 con 0x7f08b40c9a90 2024-05-21T01:19:51.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.501+0000 7f08ab400640 1 -- 172.21.15.63:0/3424670545 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7f08a401a070 con 0x7f08b40c9a90 2024-05-21T01:19:51.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.501+0000 7f08ab400640 1 --2- 172.21.15.63:0/3424670545 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f089406f430 0x7f08940718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:51.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.501+0000 7f08ab400640 1 -- 172.21.15.63:0/3424670545 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f08a408e0c0 con 0x7f08b40c9a90 2024-05-21T01:19:51.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.501+0000 7f08b2a00640 1 --2- 172.21.15.63:0/3424670545 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f089406f430 0x7f08940718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:51.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.501+0000 7f08b2a00640 1 --2- 172.21.15.63:0/3424670545 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f089406f430 0x7f08940718f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f08a00ad000 tx=0x7f08a0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:19:51.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.505+0000 7f08ab400640 1 -- 172.21.15.63:0/3424670545 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f08a405ad40 con 0x7f08b40c9a90 2024-05-21T01:19:51.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.673+0000 7f08b8a00640 1 -- 172.21.15.63:0/3424670545 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f08b406c0c0 con 0x7f08b40c9a90 2024-05-21T01:19:51.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.673+0000 7f08ab400640 1 -- 172.21.15.63:0/3424670545 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) ==== 84+0+65 (secure 0 0 0) 0x7f08a405f040 con 0x7f08b40c9a90 2024-05-21T01:19:51.678 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-05-21T01:19:51.678 INFO:teuthology.orchestra.run.smithi063.stdout:[ 2024-05-21T01:19:51.678 INFO:teuthology.orchestra.run.smithi063.stdout: { 2024-05-21T01:19:51.678 INFO:teuthology.orchestra.run.smithi063.stdout: "poolnum": 1, 2024-05-21T01:19:51.678 INFO:teuthology.orchestra.run.smithi063.stdout: "poolname": ".mgr" 2024-05-21T01:19:51.678 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-05-21T01:19:51.678 INFO:teuthology.orchestra.run.smithi063.stdout:] 2024-05-21T01:19:51.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.673+0000 7f08b8a00640 1 -- 172.21.15.63:0/3424670545 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f089406f430 msgr2=0x7f08940718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:51.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.673+0000 7f08b8a00640 1 --2- 172.21.15.63:0/3424670545 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f089406f430 0x7f08940718f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f08a00ad000 tx=0x7f08a0008040 comp rx=0 tx=0).stop 2024-05-21T01:19:51.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.673+0000 7f08b8a00640 1 -- 172.21.15.63:0/3424670545 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f08b40c9a90 msgr2=0x7f08b406e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:51.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.673+0000 7f08b8a00640 1 --2- 172.21.15.63:0/3424670545 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f08b40c9a90 0x7f08b406e860 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f08a400c500 tx=0x7f08a400c900 comp rx=0 tx=0).stop 2024-05-21T01:19:51.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.673+0000 7f08b8a00640 1 -- 172.21.15.63:0/3424670545 shutdown_connections 2024-05-21T01:19:51.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.673+0000 7f08b8a00640 1 --2- 172.21.15.63:0/3424670545 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f089406f430 0x7f08940718f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:51.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.673+0000 7f08b8a00640 1 --2- 172.21.15.63:0/3424670545 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f08b4159960 0x7f08b4142f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:51.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.673+0000 7f08b8a00640 1 --2- 172.21.15.63:0/3424670545 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f08b4153ce0 0x7f08b41429e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:51.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.673+0000 7f08b8a00640 1 --2- 172.21.15.63:0/3424670545 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f08b40c9a90 0x7f08b406e860 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:51.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.673+0000 7f08b8a00640 1 -- 172.21.15.63:0/3424670545 >> 172.21.15.63:0/3424670545 conn(0x7f08b406caa0 msgr2=0x7f08b4159e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:19:51.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.673+0000 7f08b8a00640 1 -- 172.21.15.63:0/3424670545 shutdown_connections 2024-05-21T01:19:51.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.673+0000 7f08b8a00640 1 -- 172.21.15.63:0/3424670545 wait complete. 2024-05-21T01:19:51.699 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-21T01:19:51.699 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-21T01:19:51.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.837+0000 7f468a800640 1 Processor -- start 2024-05-21T01:19:51.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.837+0000 7f468a800640 1 -- start start 2024-05-21T01:19:51.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.837+0000 7f468a800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4684154000 0x7f468415da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:51.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.837+0000 7f468a800640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4684159cb0 0x7f468406d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:51.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.837+0000 7f468a800640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46841543e0 con 0x7f468415df50 2024-05-21T01:19:51.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.837+0000 7f468a800640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f468415d2a0 con 0x7f4684159cb0 2024-05-21T01:19:51.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.837+0000 7f468a800640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f468415b1a0 con 0x7f4684154000 2024-05-21T01:19:51.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.837+0000 7f4683e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4684159cb0 0x7f468406d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:51.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.837+0000 7f467aa00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f468415df50 0x7f46840735e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:33006/0 (socket says 172.21.15.63:33006) 2024-05-21T01:19:51.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.837+0000 7f467aa00640 1 -- 172.21.15.63:0/4144990320 learned_addr learned my addr 172.21.15.63:0/4144990320 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-05-21T01:19:51.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.837+0000 7f4683400640 1 --2- 172.21.15.63:0/4144990320 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4684154000 0x7f468415da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:51.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.841+0000 7f4683e00640 1 -- 172.21.15.63:0/4144990320 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4684154000 msgr2=0x7f468415da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:19:51.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.841+0000 7f4683e00640 1 --2- 172.21.15.63:0/4144990320 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4684154000 0x7f468415da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:51.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.841+0000 7f4683e00640 1 -- 172.21.15.63:0/4144990320 >> v1:172.21.15.63:6789/0 conn(0x7f468415df50 legacy=0x7f46840735e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:51.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.841+0000 7f4683e00640 1 -- 172.21.15.63:0/4144990320 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f468415a1f0 con 0x7f4684159cb0 2024-05-21T01:19:51.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.841+0000 7f4683e00640 1 --2- 172.21.15.63:0/4144990320 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4684159cb0 0x7f468406d240 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f467c009d90 tx=0x7f467c01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85309742dd7514e2 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:19:51.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.841+0000 7f4682a00640 1 -- 172.21.15.63:0/4144990320 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f467c0b2070 con 0x7f4684159cb0 2024-05-21T01:19:51.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.841+0000 7f4682a00640 1 -- 172.21.15.63:0/4144990320 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f467c0a5a50 con 0x7f4684159cb0 2024-05-21T01:19:51.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.841+0000 7f4682a00640 1 -- 172.21.15.63:0/4144990320 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f467c0a5e20 con 0x7f4684159cb0 2024-05-21T01:19:51.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.841+0000 7f468a800640 1 -- 172.21.15.63:0/4144990320 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4684159cb0 msgr2=0x7f468406d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:51.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.841+0000 7f468a800640 1 --2- 172.21.15.63:0/4144990320 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4684159cb0 0x7f468406d240 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f467c009d90 tx=0x7f467c01c970 comp rx=0 tx=0).stop 2024-05-21T01:19:51.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.841+0000 7f468a800640 1 -- 172.21.15.63:0/4144990320 shutdown_connections 2024-05-21T01:19:51.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.841+0000 7f468a800640 1 --2- 172.21.15.63:0/4144990320 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4684159cb0 0x7f468406d240 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:51.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.841+0000 7f468a800640 1 --2- 172.21.15.63:0/4144990320 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4684154000 0x7f468415da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:51.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.841+0000 7f468a800640 1 -- 172.21.15.63:0/4144990320 >> 172.21.15.63:0/4144990320 conn(0x7f468406efc0 msgr2=0x7f468406f3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:19:51.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.841+0000 7f468a800640 1 -- 172.21.15.63:0/4144990320 shutdown_connections 2024-05-21T01:19:51.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.845+0000 7f468a800640 1 -- 172.21.15.63:0/4144990320 wait complete. 2024-05-21T01:19:51.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.845+0000 7f468a800640 1 Processor -- start 2024-05-21T01:19:51.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.845+0000 7f468a800640 1 -- start start 2024-05-21T01:19:51.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.845+0000 7f468a800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4684154000 0x7f4684155960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:51.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.845+0000 7f468a800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4684159cb0 0x7f46841524f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:51.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.845+0000 7f468a800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f468415df50 0x7f46840cca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:51.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.845+0000 7f468a800640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f468415d4f0 con 0x7f4684154000 2024-05-21T01:19:51.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.845+0000 7f468a800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f468415aa90 con 0x7f468415df50 2024-05-21T01:19:51.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.845+0000 7f468a800640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f4684073cf0 con 0x7f4684159cb0 2024-05-21T01:19:51.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.845+0000 7f4683400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4684154000 0x7f4684155960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:51.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.845+0000 7f4683400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4684154000 0x7f4684155960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46056/0 (socket says 172.21.15.63:46056) 2024-05-21T01:19:51.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.845+0000 7f4683400640 1 -- 172.21.15.63:0/4235005070 learned_addr learned my addr 172.21.15.63:0/4235005070 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:19:51.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.845+0000 7f4683e00640 1 --2- 172.21.15.63:0/4235005070 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f468415df50 0x7f46840cca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:51.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.845+0000 7f467aa00640 1 --2- 172.21.15.63:0/4235005070 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4684159cb0 0x7f46841524f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:51.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.845+0000 7f4683400640 1 -- 172.21.15.63:0/4235005070 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4684159cb0 msgr2=0x7f46841524f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:51.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.845+0000 7f4683400640 1 --2- 172.21.15.63:0/4235005070 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4684159cb0 0x7f46841524f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:51.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.845+0000 7f4683400640 1 -- 172.21.15.63:0/4235005070 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f468415df50 msgr2=0x7f46840cca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:51.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.845+0000 7f4683400640 1 --2- 172.21.15.63:0/4235005070 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f468415df50 0x7f46840cca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:51.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.845+0000 7f4683400640 1 -- 172.21.15.63:0/4235005070 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4684150d40 con 0x7f4684154000 2024-05-21T01:19:51.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.845+0000 7f4683e00640 1 --2- 172.21.15.63:0/4235005070 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f468415df50 0x7f46840cca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T01:19:51.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.845+0000 7f4683400640 1 --2- 172.21.15.63:0/4235005070 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4684154000 0x7f4684155960 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f467400d5f0 tx=0x7f467400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:19:51.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.845+0000 7f467be00640 1 -- 172.21.15.63:0/4235005070 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46740125f0 con 0x7f4684154000 2024-05-21T01:19:51.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.845+0000 7f467be00640 1 -- 172.21.15.63:0/4235005070 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4674019070 con 0x7f4684154000 2024-05-21T01:19:51.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.845+0000 7f467be00640 1 -- 172.21.15.63:0/4235005070 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46740129b0 con 0x7f4684154000 2024-05-21T01:19:51.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.845+0000 7f468a800640 1 -- 172.21.15.63:0/4235005070 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4684156720 con 0x7f4684154000 2024-05-21T01:19:51.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.845+0000 7f468a800640 1 -- 172.21.15.63:0/4235005070 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4684156ce0 con 0x7f4684154000 2024-05-21T01:19:51.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.849+0000 7f468a800640 1 -- 172.21.15.63:0/4235005070 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f468406c1a0 con 0x7f4684154000 2024-05-21T01:19:51.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.849+0000 7f467be00640 1 -- 172.21.15.63:0/4235005070 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7f4674012b50 con 0x7f4684154000 2024-05-21T01:19:51.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.849+0000 7f467be00640 1 --2- 172.21.15.63:0/4235005070 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f466006f400 0x7f46600718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:51.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.849+0000 7f467be00640 1 -- 172.21.15.63:0/4235005070 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f467408f400 con 0x7f4684154000 2024-05-21T01:19:51.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.849+0000 7f467aa00640 1 --2- 172.21.15.63:0/4235005070 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f466006f400 0x7f46600718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:51.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.853+0000 7f467aa00640 1 --2- 172.21.15.63:0/4235005070 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f466006f400 0x7f46600718c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f466c007fd0 tx=0x7f466c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:19:51.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:51.853+0000 7f467be00640 1 -- 172.21.15.63:0/4235005070 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f467405c630 con 0x7f4684154000 2024-05-21T01:19:52.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.017+0000 7f468a800640 1 -- 172.21.15.63:0/4235005070 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f468406dda0 con 0x7f4684154000 2024-05-21T01:19:52.497 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.493+0000 7f467be00640 1 -- 172.21.15.63:0/4235005070 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) ==== 138+0+0 (secure 0 0 0) 0x7f467405bf30 con 0x7f4684154000 2024-05-21T01:19:52.497 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_metadata' created 2024-05-21T01:19:52.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.493+0000 7f468a800640 1 -- 172.21.15.63:0/4235005070 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f466006f400 msgr2=0x7f46600718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:52.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.493+0000 7f468a800640 1 --2- 172.21.15.63:0/4235005070 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f466006f400 0x7f46600718c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f466c007fd0 tx=0x7f466c009040 comp rx=0 tx=0).stop 2024-05-21T01:19:52.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.493+0000 7f468a800640 1 -- 172.21.15.63:0/4235005070 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4684154000 msgr2=0x7f4684155960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:52.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.493+0000 7f468a800640 1 --2- 172.21.15.63:0/4235005070 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4684154000 0x7f4684155960 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f467400d5f0 tx=0x7f467400dab0 comp rx=0 tx=0).stop 2024-05-21T01:19:52.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.493+0000 7f468a800640 1 -- 172.21.15.63:0/4235005070 shutdown_connections 2024-05-21T01:19:52.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.493+0000 7f468a800640 1 --2- 172.21.15.63:0/4235005070 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f466006f400 0x7f46600718c0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:52.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.493+0000 7f468a800640 1 --2- 172.21.15.63:0/4235005070 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f468415df50 0x7f46840cca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:52.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.493+0000 7f468a800640 1 --2- 172.21.15.63:0/4235005070 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4684159cb0 0x7f46841524f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:52.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.493+0000 7f468a800640 1 --2- 172.21.15.63:0/4235005070 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4684154000 0x7f4684155960 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:52.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.493+0000 7f468a800640 1 -- 172.21.15.63:0/4235005070 >> 172.21.15.63:0/4235005070 conn(0x7f468406efc0 msgr2=0x7f468406f3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:19:52.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.493+0000 7f468a800640 1 -- 172.21.15.63:0/4235005070 shutdown_connections 2024-05-21T01:19:52.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.493+0000 7f468a800640 1 -- 172.21.15.63:0/4235005070 wait complete. 2024-05-21T01:19:52.526 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-05-21T01:19:52.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.669+0000 7f6dea000640 1 Processor -- start 2024-05-21T01:19:52.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.669+0000 7f6dea000640 1 -- start start 2024-05-21T01:19:52.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.669+0000 7f6dea000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6de406f9b0 0x7f6de4152a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:52.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.669+0000 7f6dea000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f6de415ce40 0x7f6de4152f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:52.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.669+0000 7f6dea000640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6de4072550 con 0x7f6de406f5d0 2024-05-21T01:19:52.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.669+0000 7f6dea000640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f6de4159100 con 0x7f6de415ce40 2024-05-21T01:19:52.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.669+0000 7f6dea000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f6de41593e0 con 0x7f6de406f9b0 2024-05-21T01:19:52.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.669+0000 7f6de3400640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f6de406f5d0 0x7f6de40c8a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:33018/0 (socket says 172.21.15.63:33018) 2024-05-21T01:19:52.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.669+0000 7f6de3400640 1 -- 172.21.15.63:0/259869782 learned_addr learned my addr 172.21.15.63:0/259869782 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-05-21T01:19:52.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.669+0000 7f6de3e00640 1 --2- 172.21.15.63:0/259869782 >> v2:172.21.15.131:3300/0 conn(0x7f6de415ce40 0x7f6de4152f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:52.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.669+0000 7f6ddaa00640 1 --2- 172.21.15.63:0/259869782 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6de406f9b0 0x7f6de4152a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:52.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.669+0000 7f6de2a00640 1 -- 172.21.15.63:0/259869782 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3174206493 0 0) 0x7f6de4072550 con 0x7f6de406f5d0 2024-05-21T01:19:52.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.669+0000 7f6de2a00640 1 -- 172.21.15.63:0/259869782 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6dc8003530 con 0x7f6de406f5d0 2024-05-21T01:19:52.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.669+0000 7f6de2a00640 1 -- 172.21.15.63:0/259869782 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3163978463 0 0) 0x7f6dc8003530 con 0x7f6de406f5d0 2024-05-21T01:19:52.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.669+0000 7f6de2a00640 1 -- 172.21.15.63:0/259869782 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6de406f9b0 msgr2=0x7f6de4152a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:19:52.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.669+0000 7f6de2a00640 1 --2- 172.21.15.63:0/259869782 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6de406f9b0 0x7f6de4152a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:52.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.669+0000 7f6de2a00640 1 -- 172.21.15.63:0/259869782 >> v2:172.21.15.131:3300/0 conn(0x7f6de415ce40 msgr2=0x7f6de4152f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:19:52.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.669+0000 7f6de2a00640 1 --2- 172.21.15.63:0/259869782 >> v2:172.21.15.131:3300/0 conn(0x7f6de415ce40 0x7f6de4152f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:52.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.669+0000 7f6de2a00640 1 -- 172.21.15.63:0/259869782 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6de41596c0 con 0x7f6de406f5d0 2024-05-21T01:19:52.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.669+0000 7f6de2a00640 1 -- 172.21.15.63:0/259869782 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 466403955 0 0) 0x7f6dd4001a80 con 0x7f6de406f5d0 2024-05-21T01:19:52.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.669+0000 7f6de2a00640 1 -- 172.21.15.63:0/259869782 >> v1:172.21.15.63:6789/0 conn(0x7f6de406f5d0 legacy=0x7f6de40c8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:52.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.669+0000 7f6de2a00640 1 --2- 172.21.15.63:0/259869782 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6de406f9b0 0x7f6dc8003a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:52.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.673+0000 7f6de2a00640 1 --2- 172.21.15.63:0/259869782 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6dc8003fe0 0x7f6dc8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:52.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.673+0000 7f6de2a00640 1 --2- 172.21.15.63:0/259869782 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6dc8004d50 0x7f6dc80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:52.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.673+0000 7f6de2a00640 1 -- 172.21.15.63:0/259869782 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f6de4159100 con 0x7f6dc8003fe0 2024-05-21T01:19:52.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.673+0000 7f6de2a00640 1 -- 172.21.15.63:0/259869782 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f6de41593e0 con 0x7f6dc8004d50 2024-05-21T01:19:52.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.673+0000 7f6de2a00640 1 -- 172.21.15.63:0/259869782 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f6dc800dc30 con 0x7f6de406f9b0 2024-05-21T01:19:52.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.673+0000 7f6ddaa00640 1 --2- 172.21.15.63:0/259869782 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6dc8003fe0 0x7f6dc8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:52.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.673+0000 7f6de3400640 1 --2- 172.21.15.63:0/259869782 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6de406f9b0 0x7f6dc8003a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:52.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.673+0000 7f6de3e00640 1 --2- 172.21.15.63:0/259869782 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6dc8004d50 0x7f6dc80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:52.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.673+0000 7f6ddaa00640 1 -- 172.21.15.63:0/259869782 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6de406f9b0 msgr2=0x7f6dc8003a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:19:52.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.673+0000 7f6ddaa00640 1 --2- 172.21.15.63:0/259869782 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6de406f9b0 0x7f6dc8003a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:52.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.673+0000 7f6ddaa00640 1 -- 172.21.15.63:0/259869782 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6dc8004d50 msgr2=0x7f6dc80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:19:52.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.673+0000 7f6ddaa00640 1 --2- 172.21.15.63:0/259869782 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6dc8004d50 0x7f6dc80051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:52.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.673+0000 7f6ddaa00640 1 -- 172.21.15.63:0/259869782 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dc8003530 con 0x7f6dc8003fe0 2024-05-21T01:19:52.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.673+0000 7f6de3e00640 1 --2- 172.21.15.63:0/259869782 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6dc8004d50 0x7f6dc80051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T01:19:52.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.673+0000 7f6ddaa00640 1 --2- 172.21.15.63:0/259869782 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6dc8003fe0 0x7f6dc8004810 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc009b10 tx=0x7f6dcc01ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e79453c5d7d607e server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:19:52.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.673+0000 7f6de2a00640 1 -- 172.21.15.63:0/259869782 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dcc0b2070 con 0x7f6dc8003fe0 2024-05-21T01:19:52.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.673+0000 7f6de2a00640 1 -- 172.21.15.63:0/259869782 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dcc0a5660 con 0x7f6dc8003fe0 2024-05-21T01:19:52.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.673+0000 7f6de2a00640 1 -- 172.21.15.63:0/259869782 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dcc0096b0 con 0x7f6dc8003fe0 2024-05-21T01:19:52.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.677+0000 7f6dea000640 1 -- 172.21.15.63:0/259869782 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6dc8003fe0 msgr2=0x7f6dc8004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:52.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.677+0000 7f6dea000640 1 --2- 172.21.15.63:0/259869782 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6dc8003fe0 0x7f6dc8004810 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc009b10 tx=0x7f6dcc01ca70 comp rx=0 tx=0).stop 2024-05-21T01:19:52.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.677+0000 7f6de3e00640 1 -- 172.21.15.63:0/259869782 reap_dead start 2024-05-21T01:19:52.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.677+0000 7f6dea000640 1 -- 172.21.15.63:0/259869782 shutdown_connections 2024-05-21T01:19:52.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.677+0000 7f6dea000640 1 -- 172.21.15.63:0/259869782 >> 172.21.15.63:0/259869782 conn(0x7f6de4068460 msgr2=0x7f6de4068870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:19:52.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.677+0000 7f6dea000640 1 -- 172.21.15.63:0/259869782 shutdown_connections 2024-05-21T01:19:52.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.677+0000 7f6dea000640 1 -- 172.21.15.63:0/259869782 wait complete. 2024-05-21T01:19:52.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.677+0000 7f6dea000640 1 Processor -- start 2024-05-21T01:19:52.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.677+0000 7f6dea000640 1 -- start start 2024-05-21T01:19:52.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.677+0000 7f6dea000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6dc8003fe0 0x7f6de414e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:52.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.677+0000 7f6dea000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6de414d9d0 0x7f6de4157ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:52.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.677+0000 7f6dea000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6de41f4b10 0x7f6de41f4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:52.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.677+0000 7f6dea000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f6de4158b50 con 0x7f6dc8003fe0 2024-05-21T01:19:52.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.677+0000 7f6dea000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f6de4072800 con 0x7f6de414d9d0 2024-05-21T01:19:52.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.677+0000 7f6dea000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f6de4158cd0 con 0x7f6de41f4b10 2024-05-21T01:19:52.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.677+0000 7f6de3400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6dc8003fe0 0x7f6de414e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:52.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.677+0000 7f6de3400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6dc8003fe0 0x7f6de414e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46062/0 (socket says 172.21.15.63:46062) 2024-05-21T01:19:52.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.677+0000 7f6de3400640 1 -- 172.21.15.63:0/1388217700 learned_addr learned my addr 172.21.15.63:0/1388217700 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:19:52.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.677+0000 7f6ddaa00640 1 --2- 172.21.15.63:0/1388217700 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6de414d9d0 0x7f6de4157ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:52.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.677+0000 7f6de3e00640 1 --2- 172.21.15.63:0/1388217700 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6de41f4b10 0x7f6de41f4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:52.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.677+0000 7f6de3400640 1 -- 172.21.15.63:0/1388217700 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6de41f4b10 msgr2=0x7f6de41f4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:52.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.677+0000 7f6de3400640 1 --2- 172.21.15.63:0/1388217700 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6de41f4b10 0x7f6de41f4fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:52.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.677+0000 7f6de3400640 1 -- 172.21.15.63:0/1388217700 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6de414d9d0 msgr2=0x7f6de4157ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:52.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.677+0000 7f6de3400640 1 --2- 172.21.15.63:0/1388217700 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6de414d9d0 0x7f6de4157ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:52.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.677+0000 7f6de3400640 1 -- 172.21.15.63:0/1388217700 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6de4150cb0 con 0x7f6dc8003fe0 2024-05-21T01:19:52.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.677+0000 7f6ddaa00640 1 --2- 172.21.15.63:0/1388217700 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6de414d9d0 0x7f6de4157ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T01:19:52.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.681+0000 7f6de3400640 1 --2- 172.21.15.63:0/1388217700 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6dc8003fe0 0x7f6de414e120 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6dd4007bf0 tx=0x7f6dd40126f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:19:52.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.681+0000 7f6ddbe00640 1 -- 172.21.15.63:0/1388217700 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dd4012e60 con 0x7f6dc8003fe0 2024-05-21T01:19:52.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.681+0000 7f6ddbe00640 1 -- 172.21.15.63:0/1388217700 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dd4016440 con 0x7f6dc8003fe0 2024-05-21T01:19:52.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.681+0000 7f6ddbe00640 1 -- 172.21.15.63:0/1388217700 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dd4016810 con 0x7f6dc8003fe0 2024-05-21T01:19:52.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.681+0000 7f6dea000640 1 -- 172.21.15.63:0/1388217700 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6de40c9430 con 0x7f6dc8003fe0 2024-05-21T01:19:52.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.681+0000 7f6dea000640 1 -- 172.21.15.63:0/1388217700 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6de414c2e0 con 0x7f6dc8003fe0 2024-05-21T01:19:52.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.681+0000 7f6dea000640 1 -- 172.21.15.63:0/1388217700 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6de40507f0 con 0x7f6dc8003fe0 2024-05-21T01:19:52.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.681+0000 7f6ddbe00640 1 -- 172.21.15.63:0/1388217700 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7f6dd401e020 con 0x7f6dc8003fe0 2024-05-21T01:19:52.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.681+0000 7f6ddbe00640 1 --2- 172.21.15.63:0/1388217700 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f6dc006f430 0x7f6dc00718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:52.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.681+0000 7f6ddbe00640 1 -- 172.21.15.63:0/1388217700 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5227+0+0 (secure 0 0 0) 0x7f6dd4092ca0 con 0x7f6dc8003fe0 2024-05-21T01:19:52.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.685+0000 7f6ddaa00640 1 --2- 172.21.15.63:0/1388217700 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f6dc006f430 0x7f6dc00718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:52.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.685+0000 7f6ddaa00640 1 --2- 172.21.15.63:0/1388217700 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f6dc006f430 0x7f6dc00718f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc0af000 tx=0x7f6dcc0046d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:19:52.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.689+0000 7f6ddbe00640 1 -- 172.21.15.63:0/1388217700 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f6dd405fd60 con 0x7f6dc8003fe0 2024-05-21T01:19:52.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:52.853+0000 7f6dea000640 1 -- 172.21.15.63:0/1388217700 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f6de41f4730 con 0x7f6dc8003fe0 2024-05-21T01:19:53.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:53.497+0000 7f6ddbe00640 1 -- 172.21.15.63:0/1388217700 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v19) ==== 171+0+0 (secure 0 0 0) 0x7f6dd405f660 con 0x7f6dc8003fe0 2024-05-21T01:19:53.501 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_data' created 2024-05-21T01:19:53.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:53.497+0000 7f6dea000640 1 -- 172.21.15.63:0/1388217700 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f6dc006f430 msgr2=0x7f6dc00718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:53.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:53.497+0000 7f6dea000640 1 --2- 172.21.15.63:0/1388217700 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f6dc006f430 0x7f6dc00718f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc0af000 tx=0x7f6dcc0046d0 comp rx=0 tx=0).stop 2024-05-21T01:19:53.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:53.497+0000 7f6dea000640 1 -- 172.21.15.63:0/1388217700 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6dc8003fe0 msgr2=0x7f6de414e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:53.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:53.497+0000 7f6dea000640 1 --2- 172.21.15.63:0/1388217700 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6dc8003fe0 0x7f6de414e120 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6dd4007bf0 tx=0x7f6dd40126f0 comp rx=0 tx=0).stop 2024-05-21T01:19:53.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:53.497+0000 7f6dea000640 1 -- 172.21.15.63:0/1388217700 shutdown_connections 2024-05-21T01:19:53.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:53.497+0000 7f6dea000640 1 --2- 172.21.15.63:0/1388217700 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f6dc006f430 0x7f6dc00718f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:53.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:53.497+0000 7f6dea000640 1 --2- 172.21.15.63:0/1388217700 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6de41f4b10 0x7f6de41f4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:53.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:53.497+0000 7f6dea000640 1 --2- 172.21.15.63:0/1388217700 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6de414d9d0 0x7f6de4157ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:53.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:53.497+0000 7f6dea000640 1 --2- 172.21.15.63:0/1388217700 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6dc8003fe0 0x7f6de414e120 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:53.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:53.497+0000 7f6dea000640 1 -- 172.21.15.63:0/1388217700 >> 172.21.15.63:0/1388217700 conn(0x7f6de4068460 msgr2=0x7f6de40714b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:19:53.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:53.501+0000 7f6dea000640 1 -- 172.21.15.63:0/1388217700 shutdown_connections 2024-05-21T01:19:53.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:53.501+0000 7f6dea000640 1 -- 172.21.15.63:0/1388217700 wait complete. 2024-05-21T01:19:53.545 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-21T01:19:53.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:53.689+0000 7f8630400640 1 Processor -- start 2024-05-21T01:19:53.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:53.689+0000 7f8630400640 1 -- start start 2024-05-21T01:19:53.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:53.689+0000 7f8630400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f862806f5d0 0x7f86280c8a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:53.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:53.689+0000 7f8630400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f862815ce40 0x7f8628072d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:53.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:53.689+0000 7f8630400640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8628072550 con 0x7f862806f9b0 2024-05-21T01:19:53.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:53.689+0000 7f8630400640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f8628159100 con 0x7f862806f5d0 2024-05-21T01:19:53.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:53.689+0000 7f8630400640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f86281593e0 con 0x7f862815ce40 2024-05-21T01:19:53.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:53.689+0000 7f862da00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f862806f5d0 0x7f86280c8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:53.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:53.689+0000 7f862e400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f862815ce40 0x7f8628072d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:53.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:53.689+0000 7f862d000640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f862806f9b0 0x7f8628152a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.63:36186/0 (socket says 172.21.15.63:36186) 2024-05-21T01:19:53.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:53.689+0000 7f862e400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f862815ce40 0x7f8628072d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.63:35058/0 (socket says 172.21.15.63:35058) 2024-05-21T01:19:53.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:53.689+0000 7f862da00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f862806f5d0 0x7f86280c8a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.63:49616/0 (socket says 172.21.15.63:49616) 2024-05-21T01:19:53.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:53.689+0000 7f862d000640 1 -- 172.21.15.63:0/3249114994 learned_addr learned my addr 172.21.15.63:0/3249114994 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-05-21T01:19:53.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:53.689+0000 7f862e400640 1 -- 172.21.15.63:0/3249114994 >> v2:172.21.15.131:3300/0 conn(0x7f862806f5d0 msgr2=0x7f86280c8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:19:53.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:53.689+0000 7f862e400640 1 --2- 172.21.15.63:0/3249114994 >> v2:172.21.15.131:3300/0 conn(0x7f862806f5d0 0x7f86280c8a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:53.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:53.689+0000 7f862e400640 1 -- 172.21.15.63:0/3249114994 >> v1:172.21.15.131:6789/0 conn(0x7f862806f9b0 legacy=0x7f8628152a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:53.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:53.689+0000 7f862e400640 1 -- 172.21.15.63:0/3249114994 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86281596c0 con 0x7f862815ce40 2024-05-21T01:19:53.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:53.689+0000 7f862da00640 1 --2- 172.21.15.63:0/3249114994 >> v2:172.21.15.131:3300/0 conn(0x7f862806f5d0 0x7f86280c8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-21T01:19:53.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:53.693+0000 7f862e400640 1 --2- 172.21.15.63:0/3249114994 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f862815ce40 0x7f8628072d20 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8620009d90 tx=0x7f862001c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1a8ce0f3c404268 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:19:53.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:53.693+0000 7f8627e00640 1 -- 172.21.15.63:0/3249114994 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86200b2070 con 0x7f862815ce40 2024-05-21T01:19:53.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:53.693+0000 7f8627e00640 1 -- 172.21.15.63:0/3249114994 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86200a5920 con 0x7f862815ce40 2024-05-21T01:19:53.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:53.693+0000 7f8627e00640 1 -- 172.21.15.63:0/3249114994 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86200a5cf0 con 0x7f862815ce40 2024-05-21T01:19:53.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:53.693+0000 7f8630400640 1 -- 172.21.15.63:0/3249114994 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f862815ce40 msgr2=0x7f8628072d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:53.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:53.693+0000 7f8630400640 1 --2- 172.21.15.63:0/3249114994 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f862815ce40 0x7f8628072d20 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8620009d90 tx=0x7f862001c970 comp rx=0 tx=0).stop 2024-05-21T01:19:53.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:53.693+0000 7f8630400640 1 -- 172.21.15.63:0/3249114994 shutdown_connections 2024-05-21T01:19:53.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:53.693+0000 7f8630400640 1 --2- 172.21.15.63:0/3249114994 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f862815ce40 0x7f8628072d20 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:53.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:53.693+0000 7f8630400640 1 --2- 172.21.15.63:0/3249114994 >> v2:172.21.15.131:3300/0 conn(0x7f862806f5d0 0x7f86280c8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:53.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:53.693+0000 7f8630400640 1 -- 172.21.15.63:0/3249114994 >> 172.21.15.63:0/3249114994 conn(0x7f8628068460 msgr2=0x7f8628068870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:19:53.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:53.693+0000 7f8630400640 1 -- 172.21.15.63:0/3249114994 shutdown_connections 2024-05-21T01:19:53.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:53.693+0000 7f8630400640 1 -- 172.21.15.63:0/3249114994 wait complete. 2024-05-21T01:19:53.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:53.697+0000 7f8630400640 1 Processor -- start 2024-05-21T01:19:53.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:53.697+0000 7f8630400640 1 -- start start 2024-05-21T01:19:53.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:53.697+0000 7f8630400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f862806f5d0 0x7f862814cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:53.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:53.697+0000 7f8630400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f862806f9b0 0x7f8628159d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:53.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:53.697+0000 7f8630400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f862815ce40 0x7f862806c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:53.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:53.697+0000 7f8630400640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f8628153150 con 0x7f862815ce40 2024-05-21T01:19:53.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:53.697+0000 7f8630400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f8628073670 con 0x7f862806f5d0 2024-05-21T01:19:53.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:53.697+0000 7f8630400640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f86281532d0 con 0x7f862806f9b0 2024-05-21T01:19:53.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:53.697+0000 7f862e400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f862815ce40 0x7f862806c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:53.704 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:53.697+0000 7f862e400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f862815ce40 0x7f862806c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46070/0 (socket says 172.21.15.63:46070) 2024-05-21T01:19:53.704 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:53.697+0000 7f862e400640 1 -- 172.21.15.63:0/3914475257 learned_addr learned my addr 172.21.15.63:0/3914475257 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:19:53.704 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:53.697+0000 7f862d000640 1 --2- 172.21.15.63:0/3914475257 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f862806f9b0 0x7f8628159d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:53.704 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:53.697+0000 7f862da00640 1 --2- 172.21.15.63:0/3914475257 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f862806f5d0 0x7f862814cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:53.704 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:53.697+0000 7f862e400640 1 -- 172.21.15.63:0/3914475257 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f862806f9b0 msgr2=0x7f8628159d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:53.704 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:53.697+0000 7f862e400640 1 --2- 172.21.15.63:0/3914475257 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f862806f9b0 0x7f8628159d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:53.704 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:53.697+0000 7f862e400640 1 -- 172.21.15.63:0/3914475257 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f862806f5d0 msgr2=0x7f862814cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:53.704 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:53.697+0000 7f862e400640 1 --2- 172.21.15.63:0/3914475257 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f862806f5d0 0x7f862814cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:53.704 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:53.697+0000 7f862e400640 1 -- 172.21.15.63:0/3914475257 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f862814d840 con 0x7f862815ce40 2024-05-21T01:19:53.704 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:53.697+0000 7f862e400640 1 --2- 172.21.15.63:0/3914475257 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f862815ce40 0x7f862806c4a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8620009d90 tx=0x7f8620019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:19:53.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:53.697+0000 7f8625600640 1 -- 172.21.15.63:0/3914475257 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86200b2050 con 0x7f862815ce40 2024-05-21T01:19:53.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:53.697+0000 7f8625600640 1 -- 172.21.15.63:0/3914475257 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86200be070 con 0x7f862815ce40 2024-05-21T01:19:53.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:53.697+0000 7f8630400640 1 -- 172.21.15.63:0/3914475257 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f862814c050 con 0x7f862815ce40 2024-05-21T01:19:53.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:53.697+0000 7f8625600640 1 -- 172.21.15.63:0/3914475257 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86200ada90 con 0x7f862815ce40 2024-05-21T01:19:53.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:53.697+0000 7f8630400640 1 -- 172.21.15.63:0/3914475257 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86281f6d50 con 0x7f862815ce40 2024-05-21T01:19:53.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:53.701+0000 7f8630400640 1 -- 172.21.15.63:0/3914475257 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86280507f0 con 0x7f862815ce40 2024-05-21T01:19:53.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:53.701+0000 7f8625600640 1 -- 172.21.15.63:0/3914475257 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7f86200adc30 con 0x7f862815ce40 2024-05-21T01:19:53.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:53.701+0000 7f8625600640 1 --2- 172.21.15.63:0/3914475257 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f860806f400 0x7f86080718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:53.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:53.701+0000 7f8625600640 1 -- 172.21.15.63:0/3914475257 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5609+0+0 (secure 0 0 0) 0x7f862012a280 con 0x7f862815ce40 2024-05-21T01:19:53.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:53.701+0000 7f862da00640 1 --2- 172.21.15.63:0/3914475257 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f860806f400 0x7f86080718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:53.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:53.701+0000 7f862da00640 1 --2- 172.21.15.63:0/3914475257 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f860806f400 0x7f86080718c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f861c009580 tx=0x7f861c009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:19:53.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:53.705+0000 7f8625600640 1 -- 172.21.15.63:0/3914475257 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f8620016560 con 0x7f862815ce40 2024-05-21T01:19:53.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:53.909+0000 7f8630400640 1 -- 172.21.15.63:0/3914475257 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f86280cd480 con 0x7f862815ce40 2024-05-21T01:19:54.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:54.537+0000 7f8625600640 1 -- 172.21.15.63:0/3914475257 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f86200f6b90 con 0x7f862815ce40 2024-05-21T01:19:54.546 INFO:teuthology.orchestra.run.smithi063.stderr:new fs with metadata pool 2 and data pool 3 2024-05-21T01:19:54.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:54.557+0000 7f8630400640 1 -- 172.21.15.63:0/3914475257 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f860806f400 msgr2=0x7f86080718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:54.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:54.557+0000 7f8630400640 1 --2- 172.21.15.63:0/3914475257 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f860806f400 0x7f86080718c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f861c009580 tx=0x7f861c009190 comp rx=0 tx=0).stop 2024-05-21T01:19:54.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:54.557+0000 7f8630400640 1 -- 172.21.15.63:0/3914475257 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f862815ce40 msgr2=0x7f862806c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:54.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:54.557+0000 7f8630400640 1 --2- 172.21.15.63:0/3914475257 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f862815ce40 0x7f862806c4a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8620009d90 tx=0x7f8620019710 comp rx=0 tx=0).stop 2024-05-21T01:19:54.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:54.557+0000 7f8630400640 1 -- 172.21.15.63:0/3914475257 shutdown_connections 2024-05-21T01:19:54.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:54.557+0000 7f8630400640 1 --2- 172.21.15.63:0/3914475257 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f860806f400 0x7f86080718c0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:54.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:54.557+0000 7f8630400640 1 --2- 172.21.15.63:0/3914475257 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f862815ce40 0x7f862806c4a0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:54.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:54.557+0000 7f8630400640 1 --2- 172.21.15.63:0/3914475257 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f862806f9b0 0x7f8628159d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:54.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:54.557+0000 7f8630400640 1 --2- 172.21.15.63:0/3914475257 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f862806f5d0 0x7f862814cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:54.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:54.557+0000 7f8630400640 1 -- 172.21.15.63:0/3914475257 >> 172.21.15.63:0/3914475257 conn(0x7f8628068460 msgr2=0x7f86280c91a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:19:54.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:54.557+0000 7f8630400640 1 -- 172.21.15.63:0/3914475257 shutdown_connections 2024-05-21T01:19:54.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:54.557+0000 7f8630400640 1 -- 172.21.15.63:0/3914475257 wait complete. 2024-05-21T01:19:54.588 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-05-21T01:19:54.589 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-05-21T01:19:54.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:54.729+0000 7fe2f2200640 1 Processor -- start 2024-05-21T01:19:54.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:54.729+0000 7fe2f2200640 1 -- start start 2024-05-21T01:19:54.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:54.733+0000 7fe2f2200640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fe2ec1540c0 0x7fe2ec15d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:54.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:54.733+0000 7fe2f2200640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe2ec0c8700 0x7fe2ec073e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:54.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:54.733+0000 7fe2f2200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe2ec159bc0 0x7fe2ec15a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:54.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:54.733+0000 7fe2f2200640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7fe2ec15d6b0 con 0x7fe2ec0c8700 2024-05-21T01:19:54.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:54.733+0000 7fe2f2200640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fe2ec15d8d0 con 0x7fe2ec1540c0 2024-05-21T01:19:54.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:54.733+0000 7fe2f2200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fe2ec15dbb0 con 0x7fe2ec159bc0 2024-05-21T01:19:54.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:54.733+0000 7fe2e2a00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe2ec0c8700 0x7fe2ec073e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:54.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:54.733+0000 7fe2e2a00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe2ec0c8700 0x7fe2ec073e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46086/0 (socket says 172.21.15.63:46086) 2024-05-21T01:19:54.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:54.733+0000 7fe2e2a00640 1 -- 172.21.15.63:0/1230452363 learned_addr learned my addr 172.21.15.63:0/1230452363 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:19:54.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:54.733+0000 7fe2eb400640 1 --2- 172.21.15.63:0/1230452363 >> v2:172.21.15.131:3300/0 conn(0x7fe2ec1540c0 0x7fe2ec15d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:54.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:54.733+0000 7fe2ebe00640 1 --2- 172.21.15.63:0/1230452363 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe2ec159bc0 0x7fe2ec15a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:54.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:54.733+0000 7fe2e2a00640 1 -- 172.21.15.63:0/1230452363 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe2ec159bc0 msgr2=0x7fe2ec15a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:19:54.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:54.733+0000 7fe2e2a00640 1 --2- 172.21.15.63:0/1230452363 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe2ec159bc0 0x7fe2ec15a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:54.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:54.733+0000 7fe2e2a00640 1 -- 172.21.15.63:0/1230452363 >> v2:172.21.15.131:3300/0 conn(0x7fe2ec1540c0 msgr2=0x7fe2ec15d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:19:54.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:54.733+0000 7fe2e2a00640 1 --2- 172.21.15.63:0/1230452363 >> v2:172.21.15.131:3300/0 conn(0x7fe2ec1540c0 0x7fe2ec15d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:54.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:54.733+0000 7fe2e2a00640 1 -- 172.21.15.63:0/1230452363 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2ec15de90 con 0x7fe2ec0c8700 2024-05-21T01:19:54.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:54.733+0000 7fe2e2a00640 1 --2- 172.21.15.63:0/1230452363 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2ec0c8700 0x7fe2ec073e20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec0c99f0 tx=0x7fe2d401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feeea325ce7dc18 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:19:54.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:54.737+0000 7fe2eaa00640 1 -- 172.21.15.63:0/1230452363 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2d40b0070 con 0x7fe2ec0c8700 2024-05-21T01:19:54.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:54.737+0000 7fe2eaa00640 1 -- 172.21.15.63:0/1230452363 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2d40ab600 con 0x7fe2ec0c8700 2024-05-21T01:19:54.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:54.737+0000 7fe2eaa00640 1 -- 172.21.15.63:0/1230452363 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2d40ab9d0 con 0x7fe2ec0c8700 2024-05-21T01:19:54.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:54.737+0000 7fe2f2200640 1 -- 172.21.15.63:0/1230452363 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2ec0c8700 msgr2=0x7fe2ec073e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:54.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:54.737+0000 7fe2f2200640 1 --2- 172.21.15.63:0/1230452363 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2ec0c8700 0x7fe2ec073e20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec0c99f0 tx=0x7fe2d401c490 comp rx=0 tx=0).stop 2024-05-21T01:19:54.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:54.737+0000 7fe2f2200640 1 -- 172.21.15.63:0/1230452363 shutdown_connections 2024-05-21T01:19:54.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:54.737+0000 7fe2f2200640 1 --2- 172.21.15.63:0/1230452363 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe2ec159bc0 0x7fe2ec15a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:54.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:54.737+0000 7fe2f2200640 1 --2- 172.21.15.63:0/1230452363 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2ec0c8700 0x7fe2ec073e20 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:54.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:54.737+0000 7fe2f2200640 1 --2- 172.21.15.63:0/1230452363 >> v2:172.21.15.131:3300/0 conn(0x7fe2ec1540c0 0x7fe2ec15d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:54.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:54.737+0000 7fe2f2200640 1 -- 172.21.15.63:0/1230452363 >> 172.21.15.63:0/1230452363 conn(0x7fe2ec0cf480 msgr2=0x7fe2ec0cf890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:19:54.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:54.737+0000 7fe2f2200640 1 -- 172.21.15.63:0/1230452363 shutdown_connections 2024-05-21T01:19:54.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:54.737+0000 7fe2f2200640 1 -- 172.21.15.63:0/1230452363 wait complete. 2024-05-21T01:19:54.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:54.737+0000 7fe2f2200640 1 Processor -- start 2024-05-21T01:19:54.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:54.737+0000 7fe2f2200640 1 -- start start 2024-05-21T01:19:54.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:54.737+0000 7fe2f2200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe2ec0c8700 0x7fe2ec14a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:54.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:54.737+0000 7fe2f2200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2ec1540c0 0x7fe2ec06d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:54.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:54.737+0000 7fe2f2200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe2ec159bc0 0x7fe2ec06de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:54.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:54.737+0000 7fe2f2200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe2ec071230 con 0x7fe2ec1540c0 2024-05-21T01:19:54.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:54.737+0000 7fe2f2200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fe2ec071d70 con 0x7fe2ec159bc0 2024-05-21T01:19:54.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:54.737+0000 7fe2f2200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fe2ec0713b0 con 0x7fe2ec0c8700 2024-05-21T01:19:54.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:54.737+0000 7fe2e2a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2ec1540c0 0x7fe2ec06d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:54.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:54.737+0000 7fe2e2a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2ec1540c0 0x7fe2ec06d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46088/0 (socket says 172.21.15.63:46088) 2024-05-21T01:19:54.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:54.737+0000 7fe2e2a00640 1 -- 172.21.15.63:0/1361937913 learned_addr learned my addr 172.21.15.63:0/1361937913 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:19:54.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:54.737+0000 7fe2eb400640 1 --2- 172.21.15.63:0/1361937913 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe2ec0c8700 0x7fe2ec14a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:54.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:54.737+0000 7fe2ebe00640 1 --2- 172.21.15.63:0/1361937913 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe2ec159bc0 0x7fe2ec06de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:54.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:54.741+0000 7fe2e2a00640 1 -- 172.21.15.63:0/1361937913 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe2ec0c8700 msgr2=0x7fe2ec14a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:54.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:54.741+0000 7fe2e2a00640 1 --2- 172.21.15.63:0/1361937913 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe2ec0c8700 0x7fe2ec14a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:54.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:54.741+0000 7fe2e2a00640 1 -- 172.21.15.63:0/1361937913 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe2ec159bc0 msgr2=0x7fe2ec06de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:54.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:54.741+0000 7fe2e2a00640 1 --2- 172.21.15.63:0/1361937913 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe2ec159bc0 0x7fe2ec06de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:54.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:54.741+0000 7fe2e2a00640 1 -- 172.21.15.63:0/1361937913 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2ec14ac00 con 0x7fe2ec1540c0 2024-05-21T01:19:54.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:54.741+0000 7fe2e2a00640 1 --2- 172.21.15.63:0/1361937913 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2ec1540c0 0x7fe2ec06d950 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe2d401ab40 tx=0x7fe2d4019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:19:54.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:54.741+0000 7fe2e3e00640 1 -- 172.21.15.63:0/1361937913 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2d40b9070 con 0x7fe2ec1540c0 2024-05-21T01:19:54.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:54.741+0000 7fe2e3e00640 1 -- 172.21.15.63:0/1361937913 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2d40b4400 con 0x7fe2ec1540c0 2024-05-21T01:19:54.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:54.741+0000 7fe2e3e00640 1 -- 172.21.15.63:0/1361937913 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2d40b0040 con 0x7fe2ec1540c0 2024-05-21T01:19:54.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:54.741+0000 7fe2f2200640 1 -- 172.21.15.63:0/1361937913 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2ec15cb10 con 0x7fe2ec1540c0 2024-05-21T01:19:54.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:54.741+0000 7fe2f2200640 1 -- 172.21.15.63:0/1361937913 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2ec15d0d0 con 0x7fe2ec1540c0 2024-05-21T01:19:54.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:54.741+0000 7fe2f2200640 1 -- 172.21.15.63:0/1361937913 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2ec06c1a0 con 0x7fe2ec1540c0 2024-05-21T01:19:54.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:54.741+0000 7fe2e3e00640 1 -- 172.21.15.63:0/1361937913 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7fe2d40bc070 con 0x7fe2ec1540c0 2024-05-21T01:19:54.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:54.741+0000 7fe2e3e00640 1 --2- 172.21.15.63:0/1361937913 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fe2c806f400 0x7fe2c80718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:54.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:54.741+0000 7fe2e3e00640 1 -- 172.21.15.63:0/1361937913 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe2d41282e0 con 0x7fe2ec1540c0 2024-05-21T01:19:54.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:54.745+0000 7fe2eb400640 1 --2- 172.21.15.63:0/1361937913 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fe2c806f400 0x7fe2c80718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:54.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:54.745+0000 7fe2eb400640 1 --2- 172.21.15.63:0/1361937913 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fe2c806f400 0x7fe2c80718c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc00ba30 tx=0x7fe2dc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:19:54.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:54.745+0000 7fe2e3e00640 1 -- 172.21.15.63:0/1361937913 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fe2d4016110 con 0x7fe2ec1540c0 2024-05-21T01:19:54.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:54.917+0000 7fe2f2200640 1 -- 172.21.15.63:0/1361937913 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7fe2ec069cc0 con 0x7fe2ec1540c0 2024-05-21T01:19:55.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:55.517+0000 7fe2e3e00640 1 -- 172.21.15.63:0/1361937913 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v21) ==== 157+0+0 (secure 0 0 0) 0x7fe2d40f52e0 con 0x7fe2ec1540c0 2024-05-21T01:19:55.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:55.521+0000 7fe2f2200640 1 -- 172.21.15.63:0/1361937913 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fe2c806f400 msgr2=0x7fe2c80718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:55.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:55.521+0000 7fe2f2200640 1 --2- 172.21.15.63:0/1361937913 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fe2c806f400 0x7fe2c80718c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc00ba30 tx=0x7fe2dc008040 comp rx=0 tx=0).stop 2024-05-21T01:19:55.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:55.521+0000 7fe2f2200640 1 -- 172.21.15.63:0/1361937913 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2ec1540c0 msgr2=0x7fe2ec06d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:55.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:55.521+0000 7fe2f2200640 1 --2- 172.21.15.63:0/1361937913 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2ec1540c0 0x7fe2ec06d950 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe2d401ab40 tx=0x7fe2d4019230 comp rx=0 tx=0).stop 2024-05-21T01:19:55.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:55.521+0000 7fe2f2200640 1 -- 172.21.15.63:0/1361937913 shutdown_connections 2024-05-21T01:19:55.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:55.521+0000 7fe2f2200640 1 --2- 172.21.15.63:0/1361937913 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fe2c806f400 0x7fe2c80718c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:55.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:55.521+0000 7fe2f2200640 1 --2- 172.21.15.63:0/1361937913 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe2ec159bc0 0x7fe2ec06de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:55.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:55.521+0000 7fe2f2200640 1 --2- 172.21.15.63:0/1361937913 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe2ec1540c0 0x7fe2ec06d950 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:55.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:55.521+0000 7fe2f2200640 1 --2- 172.21.15.63:0/1361937913 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe2ec0c8700 0x7fe2ec14a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:55.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:55.521+0000 7fe2f2200640 1 -- 172.21.15.63:0/1361937913 >> 172.21.15.63:0/1361937913 conn(0x7fe2ec0cf480 msgr2=0x7fe2ec0cf860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:19:55.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:55.521+0000 7fe2f2200640 1 -- 172.21.15.63:0/1361937913 shutdown_connections 2024-05-21T01:19:55.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:55.521+0000 7fe2f2200640 1 -- 172.21.15.63:0/1361937913 wait complete. 2024-05-21T01:19:55.550 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-05-21T01:19:55.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:55.697+0000 7f21ffa00640 1 Processor -- start 2024-05-21T01:19:55.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:55.697+0000 7f21ffa00640 1 -- start start 2024-05-21T01:19:55.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:55.697+0000 7f21ffa00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21f806f8b0 0x7f21f80c6850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:55.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:55.697+0000 7f21ffa00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f21f8153a60 0x7f21f8153ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:55.704 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:55.697+0000 7f21ffa00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21f80cdf40 con 0x7f21f806f4d0 2024-05-21T01:19:55.704 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:55.697+0000 7f21ffa00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f21f80c6590 con 0x7f21f8153a60 2024-05-21T01:19:55.704 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:55.697+0000 7f21ffa00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f21f815b570 con 0x7f21f806f8b0 2024-05-21T01:19:55.704 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:55.697+0000 7f21fda00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f21f8153a60 0x7f21f8153ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:55.704 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:55.697+0000 7f21fda00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f21f8153a60 0x7f21f8153ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46102/0 (socket says 172.21.15.63:46102) 2024-05-21T01:19:55.704 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:55.697+0000 7f21fda00640 1 -- 172.21.15.63:0/1965491929 learned_addr learned my addr 172.21.15.63:0/1965491929 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:19:55.704 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:55.697+0000 7f21f7e00640 1 --2- 172.21.15.63:0/1965491929 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21f806f8b0 0x7f21f80c6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:55.704 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:55.697+0000 7f21fda00640 1 -- 172.21.15.63:0/1965491929 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21f806f8b0 msgr2=0x7f21f80c6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:19:55.704 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:55.697+0000 7f21fda00640 1 --2- 172.21.15.63:0/1965491929 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21f806f8b0 0x7f21f80c6850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:55.704 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:55.697+0000 7f21fda00640 1 -- 172.21.15.63:0/1965491929 >> v1:172.21.15.131:6789/0 conn(0x7f21f806f4d0 legacy=0x7f21f80cd630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:55.704 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:55.697+0000 7f21fda00640 1 -- 172.21.15.63:0/1965491929 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21f80c6f00 con 0x7f21f8153a60 2024-05-21T01:19:55.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:55.701+0000 7f21fda00640 1 --2- 172.21.15.63:0/1965491929 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f21f8153a60 0x7f21f8153ef0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f21f0009e50 tx=0x7f21f001f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=140c1c627e06f230 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:19:55.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:55.701+0000 7f21f7400640 1 -- 172.21.15.63:0/1965491929 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f00b4070 con 0x7f21f8153a60 2024-05-21T01:19:55.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:55.701+0000 7f21f7400640 1 -- 172.21.15.63:0/1965491929 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21f00af400 con 0x7f21f8153a60 2024-05-21T01:19:55.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:55.701+0000 7f21f7400640 1 -- 172.21.15.63:0/1965491929 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f00af7d0 con 0x7f21f8153a60 2024-05-21T01:19:55.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:55.701+0000 7f21ffa00640 1 -- 172.21.15.63:0/1965491929 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f21f8153a60 msgr2=0x7f21f8153ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:55.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:55.701+0000 7f21ffa00640 1 --2- 172.21.15.63:0/1965491929 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f21f8153a60 0x7f21f8153ef0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f21f0009e50 tx=0x7f21f001f1b0 comp rx=0 tx=0).stop 2024-05-21T01:19:55.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:55.701+0000 7f21ffa00640 1 -- 172.21.15.63:0/1965491929 shutdown_connections 2024-05-21T01:19:55.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:55.701+0000 7f21ffa00640 1 --2- 172.21.15.63:0/1965491929 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f21f8153a60 0x7f21f8153ef0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:55.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:55.701+0000 7f21ffa00640 1 --2- 172.21.15.63:0/1965491929 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21f806f8b0 0x7f21f80c6850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:55.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:55.701+0000 7f21ffa00640 1 -- 172.21.15.63:0/1965491929 >> 172.21.15.63:0/1965491929 conn(0x7f21f8068290 msgr2=0x7f21f80686a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:19:55.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:55.701+0000 7f21ffa00640 1 -- 172.21.15.63:0/1965491929 shutdown_connections 2024-05-21T01:19:55.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:55.701+0000 7f21ffa00640 1 -- 172.21.15.63:0/1965491929 wait complete. 2024-05-21T01:19:55.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:55.705+0000 7f21ffa00640 1 Processor -- start 2024-05-21T01:19:55.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:55.705+0000 7f21ffa00640 1 -- start start 2024-05-21T01:19:55.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:55.705+0000 7f21ffa00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f21f806f4d0 0x7f21f81f0800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:55.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:55.705+0000 7f21ffa00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21f806f8b0 0x7f21f81f3c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:55.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:55.705+0000 7f21ffa00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21f8153a60 0x7f21f8158f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:55.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:55.705+0000 7f21ffa00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f21f80c77a0 con 0x7f21f806f4d0 2024-05-21T01:19:55.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:55.705+0000 7f21ffa00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f21f80c74c0 con 0x7f21f806f8b0 2024-05-21T01:19:55.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:55.705+0000 7f21ffa00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f21f815b200 con 0x7f21f8153a60 2024-05-21T01:19:55.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:55.705+0000 7f21fd000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f21f806f4d0 0x7f21f81f0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:55.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:55.705+0000 7f21fd000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f21f806f4d0 0x7f21f81f0800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46108/0 (socket says 172.21.15.63:46108) 2024-05-21T01:19:55.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:55.705+0000 7f21fd000640 1 -- 172.21.15.63:0/2039470679 learned_addr learned my addr 172.21.15.63:0/2039470679 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:19:55.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:55.705+0000 7f21f7e00640 1 --2- 172.21.15.63:0/2039470679 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21f806f8b0 0x7f21f81f3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:55.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:55.705+0000 7f21fda00640 1 --2- 172.21.15.63:0/2039470679 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21f8153a60 0x7f21f8158f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:55.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:55.705+0000 7f21fd000640 1 -- 172.21.15.63:0/2039470679 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21f8153a60 msgr2=0x7f21f8158f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:55.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:55.705+0000 7f21fd000640 1 --2- 172.21.15.63:0/2039470679 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21f8153a60 0x7f21f8158f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:55.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:55.705+0000 7f21fd000640 1 -- 172.21.15.63:0/2039470679 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21f806f8b0 msgr2=0x7f21f81f3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:55.712 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:55.705+0000 7f21fd000640 1 --2- 172.21.15.63:0/2039470679 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21f806f8b0 0x7f21f81f3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:55.712 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:55.705+0000 7f21fd000640 1 -- 172.21.15.63:0/2039470679 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21f8149f70 con 0x7f21f806f4d0 2024-05-21T01:19:55.712 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:55.705+0000 7f21fd000640 1 --2- 172.21.15.63:0/2039470679 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f21f806f4d0 0x7f21f81f0800 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f21ec00c3c0 tx=0x7f21ec00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:19:55.712 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:55.705+0000 7f21f4c00640 1 -- 172.21.15.63:0/2039470679 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21ec017070 con 0x7f21f806f4d0 2024-05-21T01:19:55.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:55.705+0000 7f21f4c00640 1 -- 172.21.15.63:0/2039470679 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21ec0052d0 con 0x7f21f806f4d0 2024-05-21T01:19:55.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:55.705+0000 7f21f4c00640 1 -- 172.21.15.63:0/2039470679 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21ec0054c0 con 0x7f21f806f4d0 2024-05-21T01:19:55.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:55.705+0000 7f21ffa00640 1 -- 172.21.15.63:0/2039470679 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21f814a250 con 0x7f21f806f4d0 2024-05-21T01:19:55.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:55.705+0000 7f21ffa00640 1 -- 172.21.15.63:0/2039470679 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21f81f0000 con 0x7f21f806f4d0 2024-05-21T01:19:55.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:55.709+0000 7f21ffa00640 1 -- 172.21.15.63:0/2039470679 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21f80cd0e0 con 0x7f21f806f4d0 2024-05-21T01:19:55.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:55.709+0000 7f21f4c00640 1 -- 172.21.15.63:0/2039470679 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7f21ec01a070 con 0x7f21f806f4d0 2024-05-21T01:19:55.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:55.709+0000 7f21f4c00640 1 --2- 172.21.15.63:0/2039470679 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f21d806f400 0x7f21d80718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:55.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:55.709+0000 7f21f4c00640 1 -- 172.21.15.63:0/2039470679 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 6007+0+0 (secure 0 0 0) 0x7f21ec08e690 con 0x7f21f806f4d0 2024-05-21T01:19:55.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:55.709+0000 7f21f7e00640 1 --2- 172.21.15.63:0/2039470679 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f21d806f400 0x7f21d80718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:55.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:55.709+0000 7f21f7e00640 1 --2- 172.21.15.63:0/2039470679 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f21d806f400 0x7f21d80718c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f21f815c520 tx=0x7f21e4009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:19:55.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:55.713+0000 7f21f4c00640 1 -- 172.21.15.63:0/2039470679 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f21ec05adf0 con 0x7f21f806f4d0 2024-05-21T01:19:55.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:55.881+0000 7f21ffa00640 1 -- 172.21.15.63:0/2039470679 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f21f806c1a0 con 0x7f21f806f4d0 2024-05-21T01:19:56.061 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-21T01:19:56.064 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-21T01:19:57.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:57.545+0000 7f21f4c00640 1 -- 172.21.15.63:0/2039470679 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v23) ==== 228+0+0 (secure 0 0 0) 0x7f21ec063430 con 0x7f21f806f4d0 2024-05-21T01:19:57.552 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_data_ec' created 2024-05-21T01:19:57.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:57.549+0000 7f21ffa00640 1 -- 172.21.15.63:0/2039470679 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f21d806f400 msgr2=0x7f21d80718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:57.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:57.549+0000 7f21ffa00640 1 --2- 172.21.15.63:0/2039470679 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f21d806f400 0x7f21d80718c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f21f815c520 tx=0x7f21e4009190 comp rx=0 tx=0).stop 2024-05-21T01:19:57.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:57.549+0000 7f21ffa00640 1 -- 172.21.15.63:0/2039470679 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f21f806f4d0 msgr2=0x7f21f81f0800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:57.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:57.549+0000 7f21ffa00640 1 --2- 172.21.15.63:0/2039470679 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f21f806f4d0 0x7f21f81f0800 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f21ec00c3c0 tx=0x7f21ec00c880 comp rx=0 tx=0).stop 2024-05-21T01:19:57.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:57.549+0000 7f21ffa00640 1 -- 172.21.15.63:0/2039470679 shutdown_connections 2024-05-21T01:19:57.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:57.549+0000 7f21ffa00640 1 --2- 172.21.15.63:0/2039470679 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f21d806f400 0x7f21d80718c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:57.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:57.549+0000 7f21ffa00640 1 --2- 172.21.15.63:0/2039470679 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21f8153a60 0x7f21f8158f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:57.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:57.549+0000 7f21ffa00640 1 --2- 172.21.15.63:0/2039470679 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21f806f8b0 0x7f21f81f3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:57.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:57.549+0000 7f21ffa00640 1 --2- 172.21.15.63:0/2039470679 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f21f806f4d0 0x7f21f81f0800 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:57.555 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:57.549+0000 7f21ffa00640 1 -- 172.21.15.63:0/2039470679 >> 172.21.15.63:0/2039470679 conn(0x7f21f8068290 msgr2=0x7f21f814d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:19:57.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:57.549+0000 7f21ffa00640 1 -- 172.21.15.63:0/2039470679 shutdown_connections 2024-05-21T01:19:57.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:57.549+0000 7f21ffa00640 1 -- 172.21.15.63:0/2039470679 wait complete. 2024-05-21T01:19:57.589 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-05-21T01:19:57.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:57.733+0000 7f4b4ea00640 1 Processor -- start 2024-05-21T01:19:57.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:57.733+0000 7f4b4ea00640 1 -- start start 2024-05-21T01:19:57.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:57.733+0000 7f4b4ea00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4b481540c0 0x7f4b4815d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:57.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:57.733+0000 7f4b4ea00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4b480c8700 0x7f4b48073e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:57.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:57.733+0000 7f4b4ea00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b4815d8d0 con 0x7f4b48159bc0 2024-05-21T01:19:57.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:57.733+0000 7f4b4ea00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f4b4815d6b0 con 0x7f4b480c8700 2024-05-21T01:19:57.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:57.733+0000 7f4b4ea00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f4b4815dbb0 con 0x7f4b481540c0 2024-05-21T01:19:57.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:57.733+0000 7f4b3f400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4b480c8700 0x7f4b48073e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:57.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:57.733+0000 7f4b3f400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4b480c8700 0x7f4b48073e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46120/0 (socket says 172.21.15.63:46120) 2024-05-21T01:19:57.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:57.733+0000 7f4b3f400640 1 -- 172.21.15.63:0/812496247 learned_addr learned my addr 172.21.15.63:0/812496247 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:19:57.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:57.733+0000 7f4b47e00640 1 --2- 172.21.15.63:0/812496247 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4b481540c0 0x7f4b4815d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:57.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:57.733+0000 7f4b3f400640 1 -- 172.21.15.63:0/812496247 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4b481540c0 msgr2=0x7f4b4815d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:19:57.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:57.733+0000 7f4b3f400640 1 --2- 172.21.15.63:0/812496247 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4b481540c0 0x7f4b4815d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:57.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:57.733+0000 7f4b3f400640 1 -- 172.21.15.63:0/812496247 >> v1:172.21.15.131:6789/0 conn(0x7f4b48159bc0 legacy=0x7f4b4815a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:57.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:57.733+0000 7f4b3f400640 1 -- 172.21.15.63:0/812496247 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b4815de90 con 0x7f4b480c8700 2024-05-21T01:19:57.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:57.737+0000 7f4b3f400640 1 --2- 172.21.15.63:0/812496247 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b480c8700 0x7f4b48073e20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4b30009870 tx=0x7f4b3001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c2098c8ef9cbc42 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:19:57.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:57.737+0000 7f4b47400640 1 -- 172.21.15.63:0/812496247 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b300b0070 con 0x7f4b480c8700 2024-05-21T01:19:57.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:57.737+0000 7f4b47400640 1 -- 172.21.15.63:0/812496247 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b300ab600 con 0x7f4b480c8700 2024-05-21T01:19:57.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:57.737+0000 7f4b47400640 1 -- 172.21.15.63:0/812496247 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b300ab9d0 con 0x7f4b480c8700 2024-05-21T01:19:57.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:57.737+0000 7f4b4ea00640 1 -- 172.21.15.63:0/812496247 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b480c8700 msgr2=0x7f4b48073e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:57.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:57.737+0000 7f4b4ea00640 1 --2- 172.21.15.63:0/812496247 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b480c8700 0x7f4b48073e20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4b30009870 tx=0x7f4b3001c4d0 comp rx=0 tx=0).stop 2024-05-21T01:19:57.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:57.737+0000 7f4b4ea00640 1 -- 172.21.15.63:0/812496247 shutdown_connections 2024-05-21T01:19:57.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:57.737+0000 7f4b4ea00640 1 --2- 172.21.15.63:0/812496247 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b480c8700 0x7f4b48073e20 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:57.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:57.737+0000 7f4b4ea00640 1 --2- 172.21.15.63:0/812496247 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4b481540c0 0x7f4b4815d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:57.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:57.737+0000 7f4b4ea00640 1 -- 172.21.15.63:0/812496247 >> 172.21.15.63:0/812496247 conn(0x7f4b480cf480 msgr2=0x7f4b480cf890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:19:57.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:57.737+0000 7f4b4ea00640 1 -- 172.21.15.63:0/812496247 shutdown_connections 2024-05-21T01:19:57.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:57.737+0000 7f4b4ea00640 1 -- 172.21.15.63:0/812496247 wait complete. 2024-05-21T01:19:57.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:57.741+0000 7f4b4ea00640 1 Processor -- start 2024-05-21T01:19:57.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:57.741+0000 7f4b4ea00640 1 -- start start 2024-05-21T01:19:57.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:57.741+0000 7f4b4ea00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4b480c8700 0x7f4b4815c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:57.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:57.741+0000 7f4b4ea00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4b481540c0 0x7f4b4814f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:57.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:57.741+0000 7f4b4ea00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b48159bc0 0x7f4b4814cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:57.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:57.741+0000 7f4b4ea00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f4b48166ea0 con 0x7f4b48159bc0 2024-05-21T01:19:57.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:57.741+0000 7f4b4ea00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f4b48166d20 con 0x7f4b480c8700 2024-05-21T01:19:57.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:57.741+0000 7f4b4ea00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f4b48167020 con 0x7f4b481540c0 2024-05-21T01:19:57.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:57.741+0000 7f4b4ca00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b48159bc0 0x7f4b4814cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:57.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:57.741+0000 7f4b4ca00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b48159bc0 0x7f4b4814cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46132/0 (socket says 172.21.15.63:46132) 2024-05-21T01:19:57.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:57.741+0000 7f4b4ca00640 1 -- 172.21.15.63:0/2116301445 learned_addr learned my addr 172.21.15.63:0/2116301445 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:19:57.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:57.741+0000 7f4b47e00640 1 --2- 172.21.15.63:0/2116301445 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4b480c8700 0x7f4b4815c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:57.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:57.741+0000 7f4b3f400640 1 --2- 172.21.15.63:0/2116301445 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4b481540c0 0x7f4b4814f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:57.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:57.741+0000 7f4b4ca00640 1 -- 172.21.15.63:0/2116301445 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4b481540c0 msgr2=0x7f4b4814f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:57.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:57.741+0000 7f4b4ca00640 1 --2- 172.21.15.63:0/2116301445 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4b481540c0 0x7f4b4814f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:57.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:57.741+0000 7f4b4ca00640 1 -- 172.21.15.63:0/2116301445 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4b480c8700 msgr2=0x7f4b4815c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:57.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:57.741+0000 7f4b4ca00640 1 --2- 172.21.15.63:0/2116301445 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4b480c8700 0x7f4b4815c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:57.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:57.741+0000 7f4b4ca00640 1 -- 172.21.15.63:0/2116301445 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b4814df00 con 0x7f4b48159bc0 2024-05-21T01:19:57.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:57.741+0000 7f4b4ca00640 1 --2- 172.21.15.63:0/2116301445 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b48159bc0 0x7f4b4814cbf0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4b4000c7c0 tx=0x7f4b4000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:19:57.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:57.741+0000 7f4b44c00640 1 -- 172.21.15.63:0/2116301445 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b40003b80 con 0x7f4b48159bc0 2024-05-21T01:19:57.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:57.741+0000 7f4b44c00640 1 -- 172.21.15.63:0/2116301445 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b40003d20 con 0x7f4b48159bc0 2024-05-21T01:19:57.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:57.741+0000 7f4b4ea00640 1 -- 172.21.15.63:0/2116301445 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b4815b670 con 0x7f4b48159bc0 2024-05-21T01:19:57.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:57.741+0000 7f4b44c00640 1 -- 172.21.15.63:0/2116301445 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b4000aa90 con 0x7f4b48159bc0 2024-05-21T01:19:57.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:57.741+0000 7f4b4ea00640 1 -- 172.21.15.63:0/2116301445 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b4815bc30 con 0x7f4b48159bc0 2024-05-21T01:19:57.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:57.745+0000 7f4b4ea00640 1 -- 172.21.15.63:0/2116301445 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b4806c1a0 con 0x7f4b48159bc0 2024-05-21T01:19:57.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:57.745+0000 7f4b44c00640 1 -- 172.21.15.63:0/2116301445 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7f4b4000ac30 con 0x7f4b48159bc0 2024-05-21T01:19:57.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:57.745+0000 7f4b44c00640 1 --2- 172.21.15.63:0/2116301445 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f4b2406f430 0x7f4b240718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:57.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:57.745+0000 7f4b44c00640 1 -- 172.21.15.63:0/2116301445 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6500+0+0 (secure 0 0 0) 0x7f4b4008f4c0 con 0x7f4b48159bc0 2024-05-21T01:19:57.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:57.745+0000 7f4b47e00640 1 --2- 172.21.15.63:0/2116301445 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f4b2406f430 0x7f4b240718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:57.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:57.745+0000 7f4b47e00640 1 --2- 172.21.15.63:0/2116301445 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f4b2406f430 0x7f4b240718f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4b380079c0 tx=0x7f4b38008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:19:57.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:57.749+0000 7f4b44c00640 1 -- 172.21.15.63:0/2116301445 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f4b4005c080 con 0x7f4b48159bc0 2024-05-21T01:19:57.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:57.913+0000 7f4b4ea00640 1 -- 172.21.15.63:0/2116301445 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f4b480745d0 con 0x7f4b48159bc0 2024-05-21T01:19:58.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:58.557+0000 7f4b44c00640 1 -- 172.21.15.63:0/2116301445 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v24) ==== 169+0+0 (secure 0 0 0) 0x7f4b40064070 con 0x7f4b48159bc0 2024-05-21T01:19:58.562 INFO:teuthology.orchestra.run.smithi063.stderr:set pool 4 allow_ec_overwrites to true 2024-05-21T01:19:58.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:58.561+0000 7f4b4ea00640 1 -- 172.21.15.63:0/2116301445 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f4b2406f430 msgr2=0x7f4b240718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:58.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:58.561+0000 7f4b4ea00640 1 --2- 172.21.15.63:0/2116301445 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f4b2406f430 0x7f4b240718f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4b380079c0 tx=0x7f4b38008040 comp rx=0 tx=0).stop 2024-05-21T01:19:58.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:58.561+0000 7f4b4ea00640 1 -- 172.21.15.63:0/2116301445 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b48159bc0 msgr2=0x7f4b4814cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:58.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:58.561+0000 7f4b4ea00640 1 --2- 172.21.15.63:0/2116301445 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b48159bc0 0x7f4b4814cbf0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4b4000c7c0 tx=0x7f4b4000cc80 comp rx=0 tx=0).stop 2024-05-21T01:19:58.566 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:58.561+0000 7f4b4ea00640 1 -- 172.21.15.63:0/2116301445 shutdown_connections 2024-05-21T01:19:58.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:58.561+0000 7f4b4ea00640 1 --2- 172.21.15.63:0/2116301445 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f4b2406f430 0x7f4b240718f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:58.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:58.561+0000 7f4b4ea00640 1 --2- 172.21.15.63:0/2116301445 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4b48159bc0 0x7f4b4814cbf0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:58.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:58.561+0000 7f4b4ea00640 1 --2- 172.21.15.63:0/2116301445 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4b481540c0 0x7f4b4814f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:58.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:58.561+0000 7f4b4ea00640 1 --2- 172.21.15.63:0/2116301445 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4b480c8700 0x7f4b4815c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:58.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:58.561+0000 7f4b4ea00640 1 -- 172.21.15.63:0/2116301445 >> 172.21.15.63:0/2116301445 conn(0x7f4b480cf480 msgr2=0x7f4b480c70c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:19:58.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:58.561+0000 7f4b4ea00640 1 -- 172.21.15.63:0/2116301445 shutdown_connections 2024-05-21T01:19:58.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:58.561+0000 7f4b4ea00640 1 -- 172.21.15.63:0/2116301445 wait complete. 2024-05-21T01:19:58.609 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-05-21T01:19:58.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:58.757+0000 7f25f8200640 1 Processor -- start 2024-05-21T01:19:58.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:58.757+0000 7f25f8200640 1 -- start start 2024-05-21T01:19:58.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:58.757+0000 7f25f8200640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f25f0156450 0x7f25f015d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:58.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:58.757+0000 7f25f8200640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25f0071d50 con 0x7f25f006f080 2024-05-21T01:19:58.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:58.757+0000 7f25f8200640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25f015bf20 con 0x7f25f0156070 2024-05-21T01:19:58.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:58.757+0000 7f25f8200640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f25f015c1e0 con 0x7f25f0156450 2024-05-21T01:19:58.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:58.757+0000 7f25f6200640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f25f0156450 0x7f25f015d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:58.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:58.757+0000 7f25f6200640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f25f0156450 0x7f25f015d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46346/0 (socket says 172.21.15.63:46346) 2024-05-21T01:19:58.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:58.757+0000 7f25f4e00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f25f006f080 0x7f25f00cf530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:52492/0 (socket says 172.21.15.63:52492) 2024-05-21T01:19:58.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:58.757+0000 7f25f6200640 1 -- 172.21.15.63:0/3559055774 learned_addr learned my addr 172.21.15.63:0/3559055774 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:19:58.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:58.757+0000 7f25f6200640 1 -- 172.21.15.63:0/3559055774 >> v1:172.21.15.131:6789/0 conn(0x7f25f0156070 legacy=0x7f25f0071640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:58.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:58.757+0000 7f25f6200640 1 -- 172.21.15.63:0/3559055774 >> v1:172.21.15.63:6789/0 conn(0x7f25f006f080 legacy=0x7f25f00cf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:58.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:58.757+0000 7f25f6200640 1 -- 172.21.15.63:0/3559055774 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25f015c4c0 con 0x7f25f0156450 2024-05-21T01:19:58.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:58.757+0000 7f25efe00640 1 -- 172.21.15.63:0/3559055774 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1980978328 0 0) 0x7f25f0071d50 con 0x7f25f006f080 2024-05-21T01:19:58.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:58.761+0000 7f25f6200640 1 --2- 172.21.15.63:0/3559055774 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f25f0156450 0x7f25f015d9d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f25e8009e50 tx=0x7f25e801ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3da09c39008a2af server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:19:58.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:58.761+0000 7f25efe00640 1 -- 172.21.15.63:0/3559055774 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25e80a5700 con 0x7f25f0156450 2024-05-21T01:19:58.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:58.761+0000 7f25efe00640 1 -- 172.21.15.63:0/3559055774 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25e80a58a0 con 0x7f25f0156450 2024-05-21T01:19:58.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:58.761+0000 7f25efe00640 1 -- 172.21.15.63:0/3559055774 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25e80a5c70 con 0x7f25f0156450 2024-05-21T01:19:58.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:58.761+0000 7f25f8200640 1 -- 172.21.15.63:0/3559055774 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f25f0156450 msgr2=0x7f25f015d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:58.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:58.761+0000 7f25f8200640 1 --2- 172.21.15.63:0/3559055774 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f25f0156450 0x7f25f015d9d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f25e8009e50 tx=0x7f25e801ca30 comp rx=0 tx=0).stop 2024-05-21T01:19:58.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:58.761+0000 7f25f8200640 1 -- 172.21.15.63:0/3559055774 shutdown_connections 2024-05-21T01:19:58.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:58.761+0000 7f25f8200640 1 --2- 172.21.15.63:0/3559055774 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f25f0156450 0x7f25f015d9d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:58.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:58.761+0000 7f25f8200640 1 -- 172.21.15.63:0/3559055774 >> 172.21.15.63:0/3559055774 conn(0x7f25f00735f0 msgr2=0x7f25f0073a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:19:58.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:58.761+0000 7f25f8200640 1 -- 172.21.15.63:0/3559055774 shutdown_connections 2024-05-21T01:19:58.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:58.761+0000 7f25f8200640 1 -- 172.21.15.63:0/3559055774 wait complete. 2024-05-21T01:19:58.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:58.765+0000 7f25f8200640 1 Processor -- start 2024-05-21T01:19:58.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:58.765+0000 7f25f8200640 1 -- start start 2024-05-21T01:19:58.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:58.765+0000 7f25f8200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25f006f080 0x7f25f014a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:58.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:58.765+0000 7f25f8200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f25f0156070 0x7f25f014c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:58.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:58.765+0000 7f25f8200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f25f0156450 0x7f25f01f57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:58.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:58.765+0000 7f25f8200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f25f006dfc0 con 0x7f25f0156450 2024-05-21T01:19:58.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:58.765+0000 7f25f8200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f25f015e320 con 0x7f25f006f080 2024-05-21T01:19:58.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:58.765+0000 7f25f8200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f25f006e140 con 0x7f25f0156070 2024-05-21T01:19:58.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:58.765+0000 7f25f6200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f25f0156450 0x7f25f01f57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:58.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:58.765+0000 7f25f6200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f25f0156450 0x7f25f01f57a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46356/0 (socket says 172.21.15.63:46356) 2024-05-21T01:19:58.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:58.765+0000 7f25f6200640 1 -- 172.21.15.63:0/3867493665 learned_addr learned my addr 172.21.15.63:0/3867493665 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:19:58.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:58.765+0000 7f25f5800640 1 --2- 172.21.15.63:0/3867493665 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25f006f080 0x7f25f014a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:58.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:58.765+0000 7f25f4e00640 1 --2- 172.21.15.63:0/3867493665 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f25f0156070 0x7f25f014c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:58.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:58.765+0000 7f25f6200640 1 -- 172.21.15.63:0/3867493665 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f25f0156070 msgr2=0x7f25f014c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:58.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:58.765+0000 7f25f6200640 1 --2- 172.21.15.63:0/3867493665 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f25f0156070 0x7f25f014c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:58.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:58.765+0000 7f25f6200640 1 -- 172.21.15.63:0/3867493665 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25f006f080 msgr2=0x7f25f014a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:58.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:58.765+0000 7f25f6200640 1 --2- 172.21.15.63:0/3867493665 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25f006f080 0x7f25f014a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:58.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:58.765+0000 7f25f6200640 1 -- 172.21.15.63:0/3867493665 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25f01f9810 con 0x7f25f0156450 2024-05-21T01:19:58.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:58.765+0000 7f25f6200640 1 --2- 172.21.15.63:0/3867493665 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f25f0156450 0x7f25f01f57a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f25e80af040 tx=0x7f25e80197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:19:58.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:58.765+0000 7f25ed600640 1 -- 172.21.15.63:0/3867493665 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25e80bc020 con 0x7f25f0156450 2024-05-21T01:19:58.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:58.765+0000 7f25ed600640 1 -- 172.21.15.63:0/3867493665 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25e80b8670 con 0x7f25f0156450 2024-05-21T01:19:58.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:58.765+0000 7f25f8200640 1 -- 172.21.15.63:0/3867493665 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25f01f89d0 con 0x7f25f0156450 2024-05-21T01:19:58.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:58.765+0000 7f25ed600640 1 -- 172.21.15.63:0/3867493665 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25e80b8a60 con 0x7f25f0156450 2024-05-21T01:19:58.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:58.765+0000 7f25f8200640 1 -- 172.21.15.63:0/3867493665 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25f01f8f70 con 0x7f25f0156450 2024-05-21T01:19:58.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:58.765+0000 7f25f8200640 1 -- 172.21.15.63:0/3867493665 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25f01f5480 con 0x7f25f0156450 2024-05-21T01:19:58.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:58.769+0000 7f25ed600640 1 -- 172.21.15.63:0/3867493665 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7f25e80bf020 con 0x7f25f0156450 2024-05-21T01:19:58.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:58.769+0000 7f25ed600640 1 --2- 172.21.15.63:0/3867493665 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f25d006f430 0x7f25d00718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:58.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:58.769+0000 7f25ed600640 1 -- 172.21.15.63:0/3867493665 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6500+0+0 (secure 0 0 0) 0x7f25e812a1b0 con 0x7f25f0156450 2024-05-21T01:19:58.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:58.769+0000 7f25f5800640 1 --2- 172.21.15.63:0/3867493665 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f25d006f430 0x7f25d00718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:58.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:58.769+0000 7f25f5800640 1 --2- 172.21.15.63:0/3867493665 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f25d006f430 0x7f25d00718f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f25e4007fd0 tx=0x7f25e4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:19:58.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:58.773+0000 7f25ed600640 1 -- 172.21.15.63:0/3867493665 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f25f01f5480 con 0x7f25f0156450 2024-05-21T01:19:58.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:58.973+0000 7f25f8200640 1 -- 172.21.15.63:0/3867493665 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7f25f006e320 con 0x7f25f0156450 2024-05-21T01:19:59.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:59.557+0000 7f25ed600640 1 -- 172.21.15.63:0/3867493665 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v5) ==== 137+0+0 (secure 0 0 0) 0x7f25e8016620 con 0x7f25f0156450 2024-05-21T01:19:59.564 INFO:teuthology.orchestra.run.smithi063.stderr:added data pool 4 to fsmap 2024-05-21T01:19:59.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:59.561+0000 7f25f8200640 1 -- 172.21.15.63:0/3867493665 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f25d006f430 msgr2=0x7f25d00718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:59.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:59.561+0000 7f25f8200640 1 --2- 172.21.15.63:0/3867493665 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f25d006f430 0x7f25d00718f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f25e4007fd0 tx=0x7f25e4009040 comp rx=0 tx=0).stop 2024-05-21T01:19:59.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:59.561+0000 7f25f8200640 1 -- 172.21.15.63:0/3867493665 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f25f0156450 msgr2=0x7f25f01f57a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:59.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:59.561+0000 7f25f8200640 1 --2- 172.21.15.63:0/3867493665 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f25f0156450 0x7f25f01f57a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f25e80af040 tx=0x7f25e80197d0 comp rx=0 tx=0).stop 2024-05-21T01:19:59.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:59.561+0000 7f25f8200640 1 -- 172.21.15.63:0/3867493665 shutdown_connections 2024-05-21T01:19:59.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:59.561+0000 7f25f8200640 1 --2- 172.21.15.63:0/3867493665 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f25d006f430 0x7f25d00718f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:59.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:59.561+0000 7f25f8200640 1 --2- 172.21.15.63:0/3867493665 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f25f0156450 0x7f25f01f57a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:59.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:59.561+0000 7f25f8200640 1 --2- 172.21.15.63:0/3867493665 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f25f0156070 0x7f25f014c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:59.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:59.561+0000 7f25f8200640 1 --2- 172.21.15.63:0/3867493665 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25f006f080 0x7f25f014a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:59.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:59.561+0000 7f25f8200640 1 -- 172.21.15.63:0/3867493665 >> 172.21.15.63:0/3867493665 conn(0x7f25f00735f0 msgr2=0x7f25f0155280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:19:59.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:59.561+0000 7f25f8200640 1 -- 172.21.15.63:0/3867493665 shutdown_connections 2024-05-21T01:19:59.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:59.561+0000 7f25f8200640 1 -- 172.21.15.63:0/3867493665 wait complete. 2024-05-21T01:19:59.589 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-21T01:19:59.732 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:59.725+0000 7f5ba4200640 1 Processor -- start 2024-05-21T01:19:59.732 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:59.729+0000 7f5ba4200640 1 -- start start 2024-05-21T01:19:59.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:59.729+0000 7f5ba4200640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f5b9c0cf790 0x7f5b9c0c69a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:59.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:59.729+0000 7f5ba4200640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f5b9c0cfb70 0x7f5b9c153b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:59.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:59.729+0000 7f5ba4200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5b9c0ca810 0x7f5b9c154080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:59.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:59.729+0000 7f5ba4200640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f5b9c0c8be0 con 0x7f5b9c0cfb70 2024-05-21T01:19:59.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:59.729+0000 7f5ba4200640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f5b9c0c8e80 con 0x7f5b9c0cf790 2024-05-21T01:19:59.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:59.729+0000 7f5ba4200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f5b9c0c9160 con 0x7f5b9c0ca810 2024-05-21T01:19:59.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:59.729+0000 7f5ba0e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f5b9c0cfb70 0x7f5b9c153b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:59.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:59.729+0000 7f5ba0e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f5b9c0cfb70 0x7f5b9c153b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46362/0 (socket says 172.21.15.63:46362) 2024-05-21T01:19:59.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:59.729+0000 7f5ba0e00640 1 -- 172.21.15.63:0/1014297038 learned_addr learned my addr 172.21.15.63:0/1014297038 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:19:59.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:59.729+0000 7f5ba1800640 1 --2- 172.21.15.63:0/1014297038 >> v2:172.21.15.131:3300/0 conn(0x7f5b9c0cf790 0x7f5b9c0c69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:59.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:59.729+0000 7f5ba2200640 1 --2- 172.21.15.63:0/1014297038 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5b9c0ca810 0x7f5b9c154080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:59.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:59.729+0000 7f5ba0e00640 1 -- 172.21.15.63:0/1014297038 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5b9c0ca810 msgr2=0x7f5b9c154080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:19:59.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:59.729+0000 7f5ba0e00640 1 --2- 172.21.15.63:0/1014297038 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5b9c0ca810 0x7f5b9c154080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:59.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:59.729+0000 7f5ba0e00640 1 -- 172.21.15.63:0/1014297038 >> v2:172.21.15.131:3300/0 conn(0x7f5b9c0cf790 msgr2=0x7f5b9c0c69a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:19:59.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:59.729+0000 7f5ba0e00640 1 --2- 172.21.15.63:0/1014297038 >> v2:172.21.15.131:3300/0 conn(0x7f5b9c0cf790 0x7f5b9c0c69a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:59.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:59.729+0000 7f5ba0e00640 1 -- 172.21.15.63:0/1014297038 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b9c0c9440 con 0x7f5b9c0cfb70 2024-05-21T01:19:59.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:59.733+0000 7f5ba0e00640 1 --2- 172.21.15.63:0/1014297038 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5b9c0cfb70 0x7f5b9c153b40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c0721a0 tx=0x7f5b8801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=445a894b166e5d64 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:19:59.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:59.733+0000 7f5b9be00640 1 -- 172.21.15.63:0/1014297038 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b880b0070 con 0x7f5b9c0cfb70 2024-05-21T01:19:59.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:59.733+0000 7f5b9be00640 1 -- 172.21.15.63:0/1014297038 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b880ab600 con 0x7f5b9c0cfb70 2024-05-21T01:19:59.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:59.733+0000 7f5b9be00640 1 -- 172.21.15.63:0/1014297038 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b880ab9d0 con 0x7f5b9c0cfb70 2024-05-21T01:19:59.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:59.733+0000 7f5ba4200640 1 -- 172.21.15.63:0/1014297038 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5b9c0cfb70 msgr2=0x7f5b9c153b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:59.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:59.733+0000 7f5ba4200640 1 --2- 172.21.15.63:0/1014297038 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5b9c0cfb70 0x7f5b9c153b40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c0721a0 tx=0x7f5b8801c490 comp rx=0 tx=0).stop 2024-05-21T01:19:59.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:59.733+0000 7f5ba4200640 1 -- 172.21.15.63:0/1014297038 shutdown_connections 2024-05-21T01:19:59.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:59.733+0000 7f5ba4200640 1 --2- 172.21.15.63:0/1014297038 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5b9c0ca810 0x7f5b9c154080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:59.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:59.733+0000 7f5ba4200640 1 --2- 172.21.15.63:0/1014297038 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5b9c0cfb70 0x7f5b9c153b40 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:59.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:59.733+0000 7f5ba4200640 1 --2- 172.21.15.63:0/1014297038 >> v2:172.21.15.131:3300/0 conn(0x7f5b9c0cf790 0x7f5b9c0c69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:59.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:59.733+0000 7f5ba4200640 1 -- 172.21.15.63:0/1014297038 >> 172.21.15.63:0/1014297038 conn(0x7f5b9c0735f0 msgr2=0x7f5b9c073a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:19:59.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:59.733+0000 7f5ba4200640 1 -- 172.21.15.63:0/1014297038 shutdown_connections 2024-05-21T01:19:59.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:59.733+0000 7f5ba4200640 1 -- 172.21.15.63:0/1014297038 wait complete. 2024-05-21T01:19:59.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:59.733+0000 7f5ba4200640 1 Processor -- start 2024-05-21T01:19:59.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:59.737+0000 7f5ba4200640 1 -- start start 2024-05-21T01:19:59.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:59.737+0000 7f5ba4200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5b9c0ca810 0x7f5b9c0cbd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:59.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:59.737+0000 7f5ba4200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5b9c0cf790 0x7f5b9c1f31a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:59.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:59.737+0000 7f5ba4200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5b9c0cfb70 0x7f5b9c146e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:59.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:59.737+0000 7f5ba4200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f5b9c15d6e0 con 0x7f5b9c0cfb70 2024-05-21T01:19:59.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:59.737+0000 7f5ba4200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f5b9c15d560 con 0x7f5b9c0ca810 2024-05-21T01:19:59.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:59.737+0000 7f5ba4200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f5b9c15d860 con 0x7f5b9c0cf790 2024-05-21T01:19:59.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:59.737+0000 7f5ba2200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5b9c0cfb70 0x7f5b9c146e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:59.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:59.737+0000 7f5ba2200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5b9c0cfb70 0x7f5b9c146e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46368/0 (socket says 172.21.15.63:46368) 2024-05-21T01:19:59.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:59.737+0000 7f5ba2200640 1 -- 172.21.15.63:0/1333551600 learned_addr learned my addr 172.21.15.63:0/1333551600 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:19:59.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:59.737+0000 7f5ba1800640 1 --2- 172.21.15.63:0/1333551600 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5b9c0ca810 0x7f5b9c0cbd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:59.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:59.737+0000 7f5ba0e00640 1 --2- 172.21.15.63:0/1333551600 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5b9c0cf790 0x7f5b9c1f31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:59.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:59.737+0000 7f5ba2200640 1 -- 172.21.15.63:0/1333551600 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5b9c0cf790 msgr2=0x7f5b9c1f31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:59.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:59.737+0000 7f5ba2200640 1 --2- 172.21.15.63:0/1333551600 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5b9c0cf790 0x7f5b9c1f31a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:59.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:59.737+0000 7f5ba2200640 1 -- 172.21.15.63:0/1333551600 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5b9c0ca810 msgr2=0x7f5b9c0cbd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:59.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:59.737+0000 7f5ba2200640 1 --2- 172.21.15.63:0/1333551600 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5b9c0ca810 0x7f5b9c0cbd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:59.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:59.737+0000 7f5ba2200640 1 -- 172.21.15.63:0/1333551600 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b9c159620 con 0x7f5b9c0cfb70 2024-05-21T01:19:59.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:59.737+0000 7f5ba0e00640 1 --2- 172.21.15.63:0/1333551600 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5b9c0cf790 0x7f5b9c1f31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T01:19:59.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:59.737+0000 7f5ba2200640 1 --2- 172.21.15.63:0/1333551600 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5b9c0cfb70 0x7f5b9c146e20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5b94007e90 tx=0x7f5b9400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:19:59.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:59.737+0000 7f5b99600640 1 -- 172.21.15.63:0/1333551600 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b94014420 con 0x7f5b9c0cfb70 2024-05-21T01:19:59.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:59.737+0000 7f5b99600640 1 -- 172.21.15.63:0/1333551600 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b94019070 con 0x7f5b9c0cfb70 2024-05-21T01:19:59.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:59.737+0000 7f5b99600640 1 -- 172.21.15.63:0/1333551600 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b94014820 con 0x7f5b9c0cfb70 2024-05-21T01:19:59.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:59.737+0000 7f5ba4200640 1 -- 172.21.15.63:0/1333551600 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b9c1498a0 con 0x7f5b9c0cfb70 2024-05-21T01:19:59.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:59.737+0000 7f5ba4200640 1 -- 172.21.15.63:0/1333551600 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b9c1f29a0 con 0x7f5b9c0cfb70 2024-05-21T01:19:59.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:59.737+0000 7f5ba4200640 1 -- 172.21.15.63:0/1333551600 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b9c0507f0 con 0x7f5b9c0cfb70 2024-05-21T01:19:59.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:59.741+0000 7f5b99600640 1 -- 172.21.15.63:0/1333551600 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7f5b940149c0 con 0x7f5b9c0cfb70 2024-05-21T01:19:59.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:59.741+0000 7f5b99600640 1 --2- 172.21.15.63:0/1333551600 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f5b7c06f400 0x7f5b7c0718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:19:59.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:59.741+0000 7f5b99600640 1 -- 172.21.15.63:0/1333551600 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f5b9408fe00 con 0x7f5b9c0cfb70 2024-05-21T01:19:59.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:59.741+0000 7f5ba1800640 1 --2- 172.21.15.63:0/1333551600 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f5b7c06f400 0x7f5b7c0718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:19:59.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:59.741+0000 7f5ba1800640 1 --2- 172.21.15.63:0/1333551600 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f5b7c06f400 0x7f5b7c0718c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5b90007a60 tx=0x7f5b90008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:19:59.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:59.745+0000 7f5b99600640 1 -- 172.21.15.63:0/1333551600 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f5b9405c9a0 con 0x7f5b9c0cfb70 2024-05-21T01:19:59.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:59.945+0000 7f5ba4200640 1 -- 172.21.15.63:0/1333551600 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5b9c0ca3e0 con 0x7f5b9c0cfb70 2024-05-21T01:19:59.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:59.945+0000 7f5b99600640 1 -- 172.21.15.63:0/1333551600 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+6826 (secure 0 0 0) 0x7f5b9405c2a0 con 0x7f5b9c0cfb70 2024-05-21T01:19:59.950 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-05-21T01:19:59.950 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6839/3045714273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6837","nonce":3045714273},{"type":"v1","addr":"172.21.15.131:6839","nonce":3045714273}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/2978367338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":2978367338},{"type":"v1","addr":"172.21.15.131:6835","nonce":2978367338}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/3005995321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6835","nonce":3005995321},{"type":"v1","addr":"172.21.15.63:6837","nonce":3005995321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4267,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6833/574189772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":574189772},{"type":"v1","addr":"172.21.15.63:6833","nonce":574189772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4270,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6838/3071941741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":3071941741},{"type":"v1","addr":"172.21.15.131:6838","nonce":3071941741}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-21T01:19:53.915775+0000","modified":"2024-05-21T01:19:58.978277+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:creating","state_seq":1,"addr":"172.21.15.63:6836/2892727989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":2892727989},{"type":"v1","addr":"172.21.15.63:6836","nonce":2892727989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-05-21T01:19:59.950 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 5 2024-05-21T01:19:59.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:59.945+0000 7f5ba4200640 1 -- 172.21.15.63:0/1333551600 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f5b7c06f400 msgr2=0x7f5b7c0718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:59.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:59.945+0000 7f5ba4200640 1 --2- 172.21.15.63:0/1333551600 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f5b7c06f400 0x7f5b7c0718c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5b90007a60 tx=0x7f5b90008040 comp rx=0 tx=0).stop 2024-05-21T01:19:59.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:59.945+0000 7f5ba4200640 1 -- 172.21.15.63:0/1333551600 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5b9c0cfb70 msgr2=0x7f5b9c146e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:19:59.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:59.945+0000 7f5ba4200640 1 --2- 172.21.15.63:0/1333551600 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5b9c0cfb70 0x7f5b9c146e20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5b94007e90 tx=0x7f5b9400e4b0 comp rx=0 tx=0).stop 2024-05-21T01:19:59.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:59.945+0000 7f5ba4200640 1 -- 172.21.15.63:0/1333551600 shutdown_connections 2024-05-21T01:19:59.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:59.945+0000 7f5ba4200640 1 --2- 172.21.15.63:0/1333551600 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f5b7c06f400 0x7f5b7c0718c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:59.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:59.945+0000 7f5ba4200640 1 --2- 172.21.15.63:0/1333551600 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5b9c0cfb70 0x7f5b9c146e20 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:59.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:59.945+0000 7f5ba4200640 1 --2- 172.21.15.63:0/1333551600 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5b9c0cf790 0x7f5b9c1f31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:59.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:59.945+0000 7f5ba4200640 1 --2- 172.21.15.63:0/1333551600 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5b9c0ca810 0x7f5b9c0cbd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:19:59.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:59.945+0000 7f5ba4200640 1 -- 172.21.15.63:0/1333551600 >> 172.21.15.63:0/1333551600 conn(0x7f5b9c0735f0 msgr2=0x7f5b9c14b100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:19:59.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:59.945+0000 7f5ba4200640 1 -- 172.21.15.63:0/1333551600 shutdown_connections 2024-05-21T01:19:59.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:19:59.945+0000 7f5ba4200640 1 -- 172.21.15.63:0/1333551600 wait complete. 2024-05-21T01:19:59.972 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-21T01:20:00.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.113+0000 7ff224a00640 1 Processor -- start 2024-05-21T01:20:00.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.113+0000 7ff224a00640 1 -- start start 2024-05-21T01:20:00.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.113+0000 7ff224a00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff2200cb810 0x7ff22015c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:00.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.113+0000 7ff224a00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff2200c9ec0 0x7ff2200ca350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:00.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.113+0000 7ff224a00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff220156280 con 0x7ff220155ea0 2024-05-21T01:20:00.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.113+0000 7ff224a00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7ff22006d830 con 0x7ff2200c9ec0 2024-05-21T01:20:00.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.113+0000 7ff224a00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7ff2200c8bf0 con 0x7ff2200cb810 2024-05-21T01:20:00.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.117+0000 7ff21f200640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff2200c9ec0 0x7ff2200ca350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:00.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.117+0000 7ff21f200640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff2200c9ec0 0x7ff2200ca350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46382/0 (socket says 172.21.15.63:46382) 2024-05-21T01:20:00.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.117+0000 7ff21f200640 1 -- 172.21.15.63:0/1633297523 learned_addr learned my addr 172.21.15.63:0/1633297523 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:00.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.117+0000 7ff215e00640 1 --2- 172.21.15.63:0/1633297523 >> v2:172.21.15.131:3300/0 conn(0x7ff2200cb810 0x7ff22015c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:00.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.117+0000 7ff21f200640 1 -- 172.21.15.63:0/1633297523 >> v2:172.21.15.131:3300/0 conn(0x7ff2200cb810 msgr2=0x7ff22015c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:00.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.117+0000 7ff21f200640 1 --2- 172.21.15.63:0/1633297523 >> v2:172.21.15.131:3300/0 conn(0x7ff2200cb810 0x7ff22015c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:00.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.117+0000 7ff21f200640 1 -- 172.21.15.63:0/1633297523 >> v1:172.21.15.131:6789/0 conn(0x7ff220155ea0 legacy=0x7ff22006d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:00.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.117+0000 7ff21f200640 1 -- 172.21.15.63:0/1633297523 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2200c8ed0 con 0x7ff2200c9ec0 2024-05-21T01:20:00.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.117+0000 7ff21f200640 1 --2- 172.21.15.63:0/1633297523 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2200c9ec0 0x7ff2200ca350 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff22006fbe0 tx=0x7ff21801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65d0c984457a7cd6 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:00.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.117+0000 7ff21de00640 1 -- 172.21.15.63:0/1633297523 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2180b0070 con 0x7ff2200c9ec0 2024-05-21T01:20:00.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.117+0000 7ff21de00640 1 -- 172.21.15.63:0/1633297523 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2180ab600 con 0x7ff2200c9ec0 2024-05-21T01:20:00.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.117+0000 7ff21de00640 1 -- 172.21.15.63:0/1633297523 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2180ab9d0 con 0x7ff2200c9ec0 2024-05-21T01:20:00.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.121+0000 7ff224a00640 1 -- 172.21.15.63:0/1633297523 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2200c9ec0 msgr2=0x7ff2200ca350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:00.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.121+0000 7ff224a00640 1 --2- 172.21.15.63:0/1633297523 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2200c9ec0 0x7ff2200ca350 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff22006fbe0 tx=0x7ff21801c520 comp rx=0 tx=0).stop 2024-05-21T01:20:00.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.121+0000 7ff224a00640 1 -- 172.21.15.63:0/1633297523 shutdown_connections 2024-05-21T01:20:00.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.121+0000 7ff224a00640 1 --2- 172.21.15.63:0/1633297523 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2200c9ec0 0x7ff2200ca350 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:00.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.121+0000 7ff224a00640 1 --2- 172.21.15.63:0/1633297523 >> v2:172.21.15.131:3300/0 conn(0x7ff2200cb810 0x7ff22015c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:00.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.121+0000 7ff224a00640 1 -- 172.21.15.63:0/1633297523 >> 172.21.15.63:0/1633297523 conn(0x7ff2200cacf0 msgr2=0x7ff2200cb100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:00.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.121+0000 7ff224a00640 1 -- 172.21.15.63:0/1633297523 shutdown_connections 2024-05-21T01:20:00.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.121+0000 7ff224a00640 1 -- 172.21.15.63:0/1633297523 wait complete. 2024-05-21T01:20:00.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.121+0000 7ff224a00640 1 Processor -- start 2024-05-21T01:20:00.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.121+0000 7ff224a00640 1 -- start start 2024-05-21T01:20:00.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.121+0000 7ff224a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff2200c9ec0 0x7ff220159a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:00.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.121+0000 7ff224a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2200cb810 0x7ff220150150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:00.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.121+0000 7ff224a00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff220155ea0 0x7ff22015b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:00.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.121+0000 7ff224a00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff2200723e0 con 0x7ff2200cb810 2024-05-21T01:20:00.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.121+0000 7ff224a00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7ff220072260 con 0x7ff2200c9ec0 2024-05-21T01:20:00.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.121+0000 7ff224a00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7ff220168c30 con 0x7ff220155ea0 2024-05-21T01:20:00.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.121+0000 7ff215e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2200cb810 0x7ff220150150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:00.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.121+0000 7ff215e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2200cb810 0x7ff220150150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46394/0 (socket says 172.21.15.63:46394) 2024-05-21T01:20:00.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.121+0000 7ff215e00640 1 -- 172.21.15.63:0/4022616008 learned_addr learned my addr 172.21.15.63:0/4022616008 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:00.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.121+0000 7ff21f200640 1 --2- 172.21.15.63:0/4022616008 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff220155ea0 0x7ff22015b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:00.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.121+0000 7ff21e800640 1 --2- 172.21.15.63:0/4022616008 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff2200c9ec0 0x7ff220159a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:00.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.121+0000 7ff215e00640 1 -- 172.21.15.63:0/4022616008 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff220155ea0 msgr2=0x7ff22015b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:00.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.121+0000 7ff215e00640 1 --2- 172.21.15.63:0/4022616008 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff220155ea0 0x7ff22015b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:00.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.121+0000 7ff215e00640 1 -- 172.21.15.63:0/4022616008 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff2200c9ec0 msgr2=0x7ff220159a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:00.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.121+0000 7ff215e00640 1 --2- 172.21.15.63:0/4022616008 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff2200c9ec0 0x7ff220159a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:00.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.121+0000 7ff215e00640 1 -- 172.21.15.63:0/4022616008 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff220147de0 con 0x7ff2200cb810 2024-05-21T01:20:00.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.125+0000 7ff215e00640 1 --2- 172.21.15.63:0/4022616008 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2200cb810 0x7ff220150150 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff20800e930 tx=0x7ff20800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:00.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.125+0000 7ff217400640 1 -- 172.21.15.63:0/4022616008 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff208017070 con 0x7ff2200cb810 2024-05-21T01:20:00.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.125+0000 7ff217400640 1 -- 172.21.15.63:0/4022616008 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff20800ca00 con 0x7ff2200cb810 2024-05-21T01:20:00.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.125+0000 7ff217400640 1 -- 172.21.15.63:0/4022616008 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff20800cdb0 con 0x7ff2200cb810 2024-05-21T01:20:00.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.125+0000 7ff224a00640 1 -- 172.21.15.63:0/4022616008 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff220141c20 con 0x7ff2200cb810 2024-05-21T01:20:00.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.125+0000 7ff224a00640 1 -- 172.21.15.63:0/4022616008 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2201421e0 con 0x7ff2200cb810 2024-05-21T01:20:00.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.125+0000 7ff224a00640 1 -- 172.21.15.63:0/4022616008 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff22006c0c0 con 0x7ff2200cb810 2024-05-21T01:20:00.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.125+0000 7ff217400640 1 -- 172.21.15.63:0/4022616008 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7ff20801a070 con 0x7ff2200cb810 2024-05-21T01:20:00.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.125+0000 7ff217400640 1 --2- 172.21.15.63:0/4022616008 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7ff1fc06f400 0x7ff1fc0718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:00.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.125+0000 7ff217400640 1 -- 172.21.15.63:0/4022616008 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7ff20808f5a0 con 0x7ff2200cb810 2024-05-21T01:20:00.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.129+0000 7ff21e800640 1 --2- 172.21.15.63:0/4022616008 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7ff1fc06f400 0x7ff1fc0718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:00.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.129+0000 7ff21e800640 1 --2- 172.21.15.63:0/4022616008 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7ff1fc06f400 0x7ff1fc0718c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff210001e40 tx=0x7ff210009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:00.136 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.133+0000 7ff217400640 1 -- 172.21.15.63:0/4022616008 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7ff20805bbb0 con 0x7ff2200cb810 2024-05-21T01:20:00.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.301+0000 7ff224a00640 1 -- 172.21.15.63:0/4022616008 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff22006d9d0 con 0x7ff2200cb810 2024-05-21T01:20:00.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.301+0000 7ff217400640 1 -- 172.21.15.63:0/4022616008 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18482 (secure 0 0 0) 0x7ff20805feb0 con 0x7ff2200cb810 2024-05-21T01:20:00.306 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-05-21T01:20:00.306 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":25,"fsid":"9a7cbd84-ceb2-41c8-8b6e-ab931f86c51a","created":"2024-05-21T01:19:37.688082+0000","modified":"2024-05-21T01:19:58.978125+0000","last_up_change":"2024-05-21T01:19:48.472107+0000","last_in_change":"2024-05-21T01:19:39.973975+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-21T01:19:46.485266+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-21T01:19:52.032741+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-21T01:19:52.867322+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-21T01:19:56.562363+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cda28135-00bb-4194-adcb-e0abf3ae43f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":3740454920},{"type":"v1","addr":"172.21.15.63:6801","nonce":3740454920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":3740454920},{"type":"v1","addr":"172.21.15.63:6804","nonce":3740454920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":3740454920},{"type":"v1","addr":"172.21.15.63:6812","nonce":3740454920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":3740454920},{"type":"v1","addr":"172.21.15.63:6808","nonce":3740454920}]},"public_addr":"172.21.15.63:6801/3740454920","cluster_addr":"172.21.15.63:6804/3740454920","heartbeat_back_addr":"172.21.15.63:6812/3740454920","heartbeat_front_addr":"172.21.15.63:6808/3740454920","state":["exists","up"]},{"osd":1,"uuid":"4aeb370d-ec2f-4a91-b17b-035fd72bdaea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6803","nonce":896993303},{"type":"v1","addr":"172.21.15.63:6805","nonce":896993303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6807","nonce":896993303},{"type":"v1","addr":"172.21.15.63:6809","nonce":896993303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":896993303},{"type":"v1","addr":"172.21.15.63:6816","nonce":896993303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6811","nonce":896993303},{"type":"v1","addr":"172.21.15.63:6813","nonce":896993303}]},"public_addr":"172.21.15.63:6805/896993303","cluster_addr":"172.21.15.63:6809/896993303","heartbeat_back_addr":"172.21.15.63:6816/896993303","heartbeat_front_addr":"172.21.15.63:6813/896993303","state":["exists","up"]},{"osd":2,"uuid":"8368b112-35a3-43cf-ad1c-803f05708091","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":845807419},{"type":"v1","addr":"172.21.15.63:6817","nonce":845807419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":845807419},{"type":"v1","addr":"172.21.15.63:6819","nonce":845807419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":845807419},{"type":"v1","addr":"172.21.15.63:6823","nonce":845807419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":845807419},{"type":"v1","addr":"172.21.15.63:6821","nonce":845807419}]},"public_addr":"172.21.15.63:6817/845807419","cluster_addr":"172.21.15.63:6819/845807419","heartbeat_back_addr":"172.21.15.63:6823/845807419","heartbeat_front_addr":"172.21.15.63:6821/845807419","state":["exists","up"]},{"osd":3,"uuid":"26208950-e3ca-4b9a-94cd-c159453a5dfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":521563809},{"type":"v1","addr":"172.21.15.63:6825","nonce":521563809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":521563809},{"type":"v1","addr":"172.21.15.63:6827","nonce":521563809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":521563809},{"type":"v1","addr":"172.21.15.63:6831","nonce":521563809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":521563809},{"type":"v1","addr":"172.21.15.63:6829","nonce":521563809}]},"public_addr":"172.21.15.63:6825/521563809","cluster_addr":"172.21.15.63:6827/521563809","heartbeat_back_addr":"172.21.15.63:6831/521563809","heartbeat_front_addr":"172.21.15.63:6829/521563809","state":["exists","up"]},{"osd":4,"uuid":"d8c93283-1e10-4419-9934-d5048c5d0ad1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":2660673588},{"type":"v1","addr":"172.21.15.131:6801","nonce":2660673588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":2660673588},{"type":"v1","addr":"172.21.15.131:6803","nonce":2660673588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":2660673588},{"type":"v1","addr":"172.21.15.131:6807","nonce":2660673588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":2660673588},{"type":"v1","addr":"172.21.15.131:6805","nonce":2660673588}]},"public_addr":"172.21.15.131:6801/2660673588","cluster_addr":"172.21.15.131:6803/2660673588","heartbeat_back_addr":"172.21.15.131:6807/2660673588","heartbeat_front_addr":"172.21.15.131:6805/2660673588","state":["exists","up"]},{"osd":5,"uuid":"93a6fe9b-eaa6-4474-bf9b-ae0571feacf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6809","nonce":2508702891},{"type":"v1","addr":"172.21.15.131:6811","nonce":2508702891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6813","nonce":2508702891},{"type":"v1","addr":"172.21.15.131:6815","nonce":2508702891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6821","nonce":2508702891},{"type":"v1","addr":"172.21.15.131:6823","nonce":2508702891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6817","nonce":2508702891},{"type":"v1","addr":"172.21.15.131:6819","nonce":2508702891}]},"public_addr":"172.21.15.131:6811/2508702891","cluster_addr":"172.21.15.131:6815/2508702891","heartbeat_back_addr":"172.21.15.131:6823/2508702891","heartbeat_front_addr":"172.21.15.131:6819/2508702891","state":["exists","up"]},{"osd":6,"uuid":"e05e6c8c-2dda-49ab-8116-5ea9038d0f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":614380392},{"type":"v1","addr":"172.21.15.131:6810","nonce":614380392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":614380392},{"type":"v1","addr":"172.21.15.131:6814","nonce":614380392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":614380392},{"type":"v1","addr":"172.21.15.131:6822","nonce":614380392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":614380392},{"type":"v1","addr":"172.21.15.131:6818","nonce":614380392}]},"public_addr":"172.21.15.131:6810/614380392","cluster_addr":"172.21.15.131:6814/614380392","heartbeat_back_addr":"172.21.15.131:6822/614380392","heartbeat_front_addr":"172.21.15.131:6818/614380392","state":["exists","up"]},{"osd":7,"uuid":"0b393e5e-eeef-4e32-b23a-d405a8b0e7b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":4219797450},{"type":"v1","addr":"172.21.15.131:6825","nonce":4219797450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":4219797450},{"type":"v1","addr":"172.21.15.131:6827","nonce":4219797450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":4219797450},{"type":"v1","addr":"172.21.15.131:6831","nonce":4219797450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":4219797450},{"type":"v1","addr":"172.21.15.131:6829","nonce":4219797450}]},"public_addr":"172.21.15.131:6825/4219797450","cluster_addr":"172.21.15.131:6827/4219797450","heartbeat_back_addr":"172.21.15.131:6831/4219797450","heartbeat_front_addr":"172.21.15.131:6829/4219797450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.647841+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.912560+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.684614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.936286+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.380500+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.553497+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.517866+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.310320+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-21T01:20:00.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.301+0000 7ff224a00640 1 -- 172.21.15.63:0/4022616008 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7ff1fc06f400 msgr2=0x7ff1fc0718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:00.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.301+0000 7ff224a00640 1 --2- 172.21.15.63:0/4022616008 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7ff1fc06f400 0x7ff1fc0718c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff210001e40 tx=0x7ff210009040 comp rx=0 tx=0).stop 2024-05-21T01:20:00.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.301+0000 7ff224a00640 1 -- 172.21.15.63:0/4022616008 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2200cb810 msgr2=0x7ff220150150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:00.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.301+0000 7ff224a00640 1 --2- 172.21.15.63:0/4022616008 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2200cb810 0x7ff220150150 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff20800e930 tx=0x7ff20800edf0 comp rx=0 tx=0).stop 2024-05-21T01:20:00.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.301+0000 7ff224a00640 1 -- 172.21.15.63:0/4022616008 shutdown_connections 2024-05-21T01:20:00.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.301+0000 7ff224a00640 1 --2- 172.21.15.63:0/4022616008 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7ff1fc06f400 0x7ff1fc0718c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:00.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.301+0000 7ff224a00640 1 --2- 172.21.15.63:0/4022616008 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff220155ea0 0x7ff22015b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:00.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.301+0000 7ff224a00640 1 --2- 172.21.15.63:0/4022616008 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2200cb810 0x7ff220150150 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:00.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.301+0000 7ff224a00640 1 --2- 172.21.15.63:0/4022616008 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff2200c9ec0 0x7ff220159a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:00.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.301+0000 7ff224a00640 1 -- 172.21.15.63:0/4022616008 >> 172.21.15.63:0/4022616008 conn(0x7ff2200cacf0 msgr2=0x7ff2200cd980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:00.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.305+0000 7ff224a00640 1 -- 172.21.15.63:0/4022616008 shutdown_connections 2024-05-21T01:20:00.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.305+0000 7ff224a00640 1 -- 172.21.15.63:0/4022616008 wait complete. 2024-05-21T01:20:00.328 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-21T01:20:00.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.465+0000 7f8b95200640 1 Processor -- start 2024-05-21T01:20:00.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.465+0000 7f8b95200640 1 -- start start 2024-05-21T01:20:00.472 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.465+0000 7f8b95200640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f8b90156150 0x7f8b9015bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:00.472 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.465+0000 7f8b95200640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8b9006d5b0 0x7f8b9006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:00.472 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.465+0000 7f8b95200640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b9006f510 con 0x7f8b90073480 2024-05-21T01:20:00.472 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.465+0000 7f8b95200640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f8b90070a20 con 0x7f8b9006d5b0 2024-05-21T01:20:00.472 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.465+0000 7f8b95200640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f8b90073ac0 con 0x7f8b90156150 2024-05-21T01:20:00.472 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.465+0000 7f8b8e800640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8b9006d5b0 0x7f8b9006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:00.473 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.465+0000 7f8b8e800640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8b9006d5b0 0x7f8b9006d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46410/0 (socket says 172.21.15.63:46410) 2024-05-21T01:20:00.473 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.465+0000 7f8b8e800640 1 -- 172.21.15.63:0/1810669534 learned_addr learned my addr 172.21.15.63:0/1810669534 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:00.473 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.465+0000 7f8b8de00640 1 --2- 172.21.15.63:0/1810669534 >> v2:172.21.15.131:3300/0 conn(0x7f8b90156150 0x7f8b9015bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:00.473 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.469+0000 7f8b8e800640 1 -- 172.21.15.63:0/1810669534 >> v2:172.21.15.131:3300/0 conn(0x7f8b90156150 msgr2=0x7f8b9015bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:00.473 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.469+0000 7f8b8e800640 1 --2- 172.21.15.63:0/1810669534 >> v2:172.21.15.131:3300/0 conn(0x7f8b90156150 0x7f8b9015bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:00.473 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.469+0000 7f8b8e800640 1 -- 172.21.15.63:0/1810669534 >> v1:172.21.15.131:6789/0 conn(0x7f8b90073480 legacy=0x7f8b90071190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:00.473 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.469+0000 7f8b8e800640 1 -- 172.21.15.63:0/1810669534 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b90073da0 con 0x7f8b9006d5b0 2024-05-21T01:20:00.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.469+0000 7f8b8e800640 1 --2- 172.21.15.63:0/1810669534 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b9006d5b0 0x7f8b9006d9c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8b90070ba0 tx=0x7f8b8801c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87e6bb125a6ea025 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:00.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.469+0000 7f8b8d400640 1 -- 172.21.15.63:0/1810669534 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b880a55e0 con 0x7f8b9006d5b0 2024-05-21T01:20:00.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.469+0000 7f8b8d400640 1 -- 172.21.15.63:0/1810669534 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b880a5780 con 0x7f8b9006d5b0 2024-05-21T01:20:00.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.469+0000 7f8b8d400640 1 -- 172.21.15.63:0/1810669534 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b880a5b50 con 0x7f8b9006d5b0 2024-05-21T01:20:00.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.469+0000 7f8b95200640 1 -- 172.21.15.63:0/1810669534 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b9006d5b0 msgr2=0x7f8b9006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:00.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.469+0000 7f8b95200640 1 --2- 172.21.15.63:0/1810669534 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b9006d5b0 0x7f8b9006d9c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8b90070ba0 tx=0x7f8b8801c960 comp rx=0 tx=0).stop 2024-05-21T01:20:00.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.469+0000 7f8b95200640 1 -- 172.21.15.63:0/1810669534 shutdown_connections 2024-05-21T01:20:00.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.469+0000 7f8b95200640 1 --2- 172.21.15.63:0/1810669534 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b9006d5b0 0x7f8b9006d9c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:00.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.469+0000 7f8b95200640 1 --2- 172.21.15.63:0/1810669534 >> v2:172.21.15.131:3300/0 conn(0x7f8b90156150 0x7f8b9015bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:00.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.469+0000 7f8b95200640 1 -- 172.21.15.63:0/1810669534 >> 172.21.15.63:0/1810669534 conn(0x7f8b900cbf10 msgr2=0x7f8b900cc320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:00.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.469+0000 7f8b95200640 1 -- 172.21.15.63:0/1810669534 shutdown_connections 2024-05-21T01:20:00.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.473+0000 7f8b95200640 1 -- 172.21.15.63:0/1810669534 wait complete. 2024-05-21T01:20:00.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.473+0000 7f8b95200640 1 Processor -- start 2024-05-21T01:20:00.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.473+0000 7f8b95200640 1 -- start start 2024-05-21T01:20:00.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.473+0000 7f8b95200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b9006d5b0 0x7f8b9014d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:00.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.473+0000 7f8b95200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8b90073480 0x7f8b901f5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:00.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.473+0000 7f8b95200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8b90156150 0x7f8b901f5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:00.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.473+0000 7f8b95200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f8b90071a20 con 0x7f8b9006d5b0 2024-05-21T01:20:00.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.473+0000 7f8b95200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f8b900718a0 con 0x7f8b90156150 2024-05-21T01:20:00.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.473+0000 7f8b95200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f8b90168ed0 con 0x7f8b90073480 2024-05-21T01:20:00.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.473+0000 7f8b8de00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b9006d5b0 0x7f8b9014d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:00.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.473+0000 7f8b8de00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b9006d5b0 0x7f8b9014d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46422/0 (socket says 172.21.15.63:46422) 2024-05-21T01:20:00.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.473+0000 7f8b8de00640 1 -- 172.21.15.63:0/628613217 learned_addr learned my addr 172.21.15.63:0/628613217 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:00.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.473+0000 7f8b8e800640 1 --2- 172.21.15.63:0/628613217 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8b90156150 0x7f8b901f5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:00.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.473+0000 7f8b87e00640 1 --2- 172.21.15.63:0/628613217 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8b90073480 0x7f8b901f5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:00.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.473+0000 7f8b8de00640 1 -- 172.21.15.63:0/628613217 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8b90073480 msgr2=0x7f8b901f5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:00.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.473+0000 7f8b8de00640 1 --2- 172.21.15.63:0/628613217 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8b90073480 0x7f8b901f5330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:00.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.473+0000 7f8b8de00640 1 -- 172.21.15.63:0/628613217 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8b90156150 msgr2=0x7f8b901f5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:00.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.473+0000 7f8b8de00640 1 --2- 172.21.15.63:0/628613217 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8b90156150 0x7f8b901f5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:00.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.473+0000 7f8b8de00640 1 -- 172.21.15.63:0/628613217 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b900c6ad0 con 0x7f8b9006d5b0 2024-05-21T01:20:00.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.473+0000 7f8b8de00640 1 --2- 172.21.15.63:0/628613217 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b9006d5b0 0x7f8b9014d0c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8b8000d5f0 tx=0x7f8b8000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:00.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.473+0000 7f8b86000640 1 -- 172.21.15.63:0/628613217 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b800125f0 con 0x7f8b9006d5b0 2024-05-21T01:20:00.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.473+0000 7f8b86000640 1 -- 172.21.15.63:0/628613217 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b80019070 con 0x7f8b9006d5b0 2024-05-21T01:20:00.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.473+0000 7f8b86000640 1 -- 172.21.15.63:0/628613217 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b800129b0 con 0x7f8b9006d5b0 2024-05-21T01:20:00.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.473+0000 7f8b95200640 1 -- 172.21.15.63:0/628613217 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b901f8860 con 0x7f8b9006d5b0 2024-05-21T01:20:00.481 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.473+0000 7f8b95200640 1 -- 172.21.15.63:0/628613217 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b901f8e20 con 0x7f8b9006d5b0 2024-05-21T01:20:00.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.477+0000 7f8b95200640 1 -- 172.21.15.63:0/628613217 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b900507f0 con 0x7f8b9006d5b0 2024-05-21T01:20:00.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.477+0000 7f8b86000640 1 -- 172.21.15.63:0/628613217 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7f8b80012b50 con 0x7f8b9006d5b0 2024-05-21T01:20:00.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.477+0000 7f8b86000640 1 --2- 172.21.15.63:0/628613217 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f8b6c06f400 0x7f8b6c0718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:00.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.477+0000 7f8b86000640 1 -- 172.21.15.63:0/628613217 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f8b8008fa00 con 0x7f8b9006d5b0 2024-05-21T01:20:00.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.477+0000 7f8b87e00640 1 --2- 172.21.15.63:0/628613217 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f8b6c06f400 0x7f8b6c0718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:00.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.481+0000 7f8b87e00640 1 --2- 172.21.15.63:0/628613217 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f8b6c06f400 0x7f8b6c0718c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8b90148b70 tx=0x7f8b78008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:00.487 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.481+0000 7f8b86000640 1 -- 172.21.15.63:0/628613217 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f8b8005c630 con 0x7f8b9006d5b0 2024-05-21T01:20:00.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.657+0000 7f8b95200640 1 -- 172.21.15.63:0/628613217 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8b90159980 con 0x7f8b9006d5b0 2024-05-21T01:20:00.662 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.657+0000 7f8b86000640 1 -- 172.21.15.63:0/628613217 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18482 (secure 0 0 0) 0x7f8b8005bf30 con 0x7f8b9006d5b0 2024-05-21T01:20:00.662 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-05-21T01:20:00.662 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":25,"fsid":"9a7cbd84-ceb2-41c8-8b6e-ab931f86c51a","created":"2024-05-21T01:19:37.688082+0000","modified":"2024-05-21T01:19:58.978125+0000","last_up_change":"2024-05-21T01:19:48.472107+0000","last_in_change":"2024-05-21T01:19:39.973975+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-21T01:19:46.485266+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-21T01:19:52.032741+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-21T01:19:52.867322+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-21T01:19:56.562363+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cda28135-00bb-4194-adcb-e0abf3ae43f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":3740454920},{"type":"v1","addr":"172.21.15.63:6801","nonce":3740454920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":3740454920},{"type":"v1","addr":"172.21.15.63:6804","nonce":3740454920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":3740454920},{"type":"v1","addr":"172.21.15.63:6812","nonce":3740454920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":3740454920},{"type":"v1","addr":"172.21.15.63:6808","nonce":3740454920}]},"public_addr":"172.21.15.63:6801/3740454920","cluster_addr":"172.21.15.63:6804/3740454920","heartbeat_back_addr":"172.21.15.63:6812/3740454920","heartbeat_front_addr":"172.21.15.63:6808/3740454920","state":["exists","up"]},{"osd":1,"uuid":"4aeb370d-ec2f-4a91-b17b-035fd72bdaea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6803","nonce":896993303},{"type":"v1","addr":"172.21.15.63:6805","nonce":896993303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6807","nonce":896993303},{"type":"v1","addr":"172.21.15.63:6809","nonce":896993303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":896993303},{"type":"v1","addr":"172.21.15.63:6816","nonce":896993303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6811","nonce":896993303},{"type":"v1","addr":"172.21.15.63:6813","nonce":896993303}]},"public_addr":"172.21.15.63:6805/896993303","cluster_addr":"172.21.15.63:6809/896993303","heartbeat_back_addr":"172.21.15.63:6816/896993303","heartbeat_front_addr":"172.21.15.63:6813/896993303","state":["exists","up"]},{"osd":2,"uuid":"8368b112-35a3-43cf-ad1c-803f05708091","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":845807419},{"type":"v1","addr":"172.21.15.63:6817","nonce":845807419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":845807419},{"type":"v1","addr":"172.21.15.63:6819","nonce":845807419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":845807419},{"type":"v1","addr":"172.21.15.63:6823","nonce":845807419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":845807419},{"type":"v1","addr":"172.21.15.63:6821","nonce":845807419}]},"public_addr":"172.21.15.63:6817/845807419","cluster_addr":"172.21.15.63:6819/845807419","heartbeat_back_addr":"172.21.15.63:6823/845807419","heartbeat_front_addr":"172.21.15.63:6821/845807419","state":["exists","up"]},{"osd":3,"uuid":"26208950-e3ca-4b9a-94cd-c159453a5dfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":521563809},{"type":"v1","addr":"172.21.15.63:6825","nonce":521563809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":521563809},{"type":"v1","addr":"172.21.15.63:6827","nonce":521563809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":521563809},{"type":"v1","addr":"172.21.15.63:6831","nonce":521563809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":521563809},{"type":"v1","addr":"172.21.15.63:6829","nonce":521563809}]},"public_addr":"172.21.15.63:6825/521563809","cluster_addr":"172.21.15.63:6827/521563809","heartbeat_back_addr":"172.21.15.63:6831/521563809","heartbeat_front_addr":"172.21.15.63:6829/521563809","state":["exists","up"]},{"osd":4,"uuid":"d8c93283-1e10-4419-9934-d5048c5d0ad1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":2660673588},{"type":"v1","addr":"172.21.15.131:6801","nonce":2660673588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":2660673588},{"type":"v1","addr":"172.21.15.131:6803","nonce":2660673588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":2660673588},{"type":"v1","addr":"172.21.15.131:6807","nonce":2660673588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":2660673588},{"type":"v1","addr":"172.21.15.131:6805","nonce":2660673588}]},"public_addr":"172.21.15.131:6801/2660673588","cluster_addr":"172.21.15.131:6803/2660673588","heartbeat_back_addr":"172.21.15.131:6807/2660673588","heartbeat_front_addr":"172.21.15.131:6805/2660673588","state":["exists","up"]},{"osd":5,"uuid":"93a6fe9b-eaa6-4474-bf9b-ae0571feacf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6809","nonce":2508702891},{"type":"v1","addr":"172.21.15.131:6811","nonce":2508702891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6813","nonce":2508702891},{"type":"v1","addr":"172.21.15.131:6815","nonce":2508702891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6821","nonce":2508702891},{"type":"v1","addr":"172.21.15.131:6823","nonce":2508702891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6817","nonce":2508702891},{"type":"v1","addr":"172.21.15.131:6819","nonce":2508702891}]},"public_addr":"172.21.15.131:6811/2508702891","cluster_addr":"172.21.15.131:6815/2508702891","heartbeat_back_addr":"172.21.15.131:6823/2508702891","heartbeat_front_addr":"172.21.15.131:6819/2508702891","state":["exists","up"]},{"osd":6,"uuid":"e05e6c8c-2dda-49ab-8116-5ea9038d0f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":614380392},{"type":"v1","addr":"172.21.15.131:6810","nonce":614380392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":614380392},{"type":"v1","addr":"172.21.15.131:6814","nonce":614380392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":614380392},{"type":"v1","addr":"172.21.15.131:6822","nonce":614380392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":614380392},{"type":"v1","addr":"172.21.15.131:6818","nonce":614380392}]},"public_addr":"172.21.15.131:6810/614380392","cluster_addr":"172.21.15.131:6814/614380392","heartbeat_back_addr":"172.21.15.131:6822/614380392","heartbeat_front_addr":"172.21.15.131:6818/614380392","state":["exists","up"]},{"osd":7,"uuid":"0b393e5e-eeef-4e32-b23a-d405a8b0e7b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":4219797450},{"type":"v1","addr":"172.21.15.131:6825","nonce":4219797450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":4219797450},{"type":"v1","addr":"172.21.15.131:6827","nonce":4219797450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":4219797450},{"type":"v1","addr":"172.21.15.131:6831","nonce":4219797450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":4219797450},{"type":"v1","addr":"172.21.15.131:6829","nonce":4219797450}]},"public_addr":"172.21.15.131:6825/4219797450","cluster_addr":"172.21.15.131:6827/4219797450","heartbeat_back_addr":"172.21.15.131:6831/4219797450","heartbeat_front_addr":"172.21.15.131:6829/4219797450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.647841+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.912560+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.684614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.936286+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.380500+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.553497+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.517866+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.310320+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-21T01:20:00.664 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.657+0000 7f8b95200640 1 -- 172.21.15.63:0/628613217 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f8b6c06f400 msgr2=0x7f8b6c0718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:00.664 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.657+0000 7f8b95200640 1 --2- 172.21.15.63:0/628613217 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f8b6c06f400 0x7f8b6c0718c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8b90148b70 tx=0x7f8b78008040 comp rx=0 tx=0).stop 2024-05-21T01:20:00.664 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.657+0000 7f8b95200640 1 -- 172.21.15.63:0/628613217 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b9006d5b0 msgr2=0x7f8b9014d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:00.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.657+0000 7f8b95200640 1 --2- 172.21.15.63:0/628613217 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b9006d5b0 0x7f8b9014d0c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8b8000d5f0 tx=0x7f8b8000dab0 comp rx=0 tx=0).stop 2024-05-21T01:20:00.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.657+0000 7f8b95200640 1 -- 172.21.15.63:0/628613217 shutdown_connections 2024-05-21T01:20:00.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.657+0000 7f8b95200640 1 --2- 172.21.15.63:0/628613217 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f8b6c06f400 0x7f8b6c0718c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:00.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.657+0000 7f8b95200640 1 --2- 172.21.15.63:0/628613217 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8b90156150 0x7f8b901f5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:00.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.657+0000 7f8b95200640 1 --2- 172.21.15.63:0/628613217 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8b90073480 0x7f8b901f5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:00.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.657+0000 7f8b95200640 1 --2- 172.21.15.63:0/628613217 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b9006d5b0 0x7f8b9014d0c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:00.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.657+0000 7f8b95200640 1 -- 172.21.15.63:0/628613217 >> 172.21.15.63:0/628613217 conn(0x7f8b900cbf10 msgr2=0x7f8b90145890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:00.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.661+0000 7f8b95200640 1 -- 172.21.15.63:0/628613217 shutdown_connections 2024-05-21T01:20:00.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.661+0000 7f8b95200640 1 -- 172.21.15.63:0/628613217 wait complete. 2024-05-21T01:20:00.699 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-21T01:20:00.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.833+0000 7f9a53a00640 1 Processor -- start 2024-05-21T01:20:00.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.833+0000 7f9a53a00640 1 -- start start 2024-05-21T01:20:00.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.837+0000 7f9a53a00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9a4c1563f0 0x7f9a4c15c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:00.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.837+0000 7f9a53a00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9a4c06ff60 0x7f9a4c0703a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:00.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.837+0000 7f9a53a00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a4c15f560 con 0x7f9a4c156010 2024-05-21T01:20:00.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.837+0000 7f9a53a00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f9a4c15f800 con 0x7f9a4c06ff60 2024-05-21T01:20:00.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.837+0000 7f9a53a00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f9a4c15fae0 con 0x7f9a4c1563f0 2024-05-21T01:20:00.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.837+0000 7f9a51a00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9a4c06ff60 0x7f9a4c0703a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:00.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.837+0000 7f9a51a00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9a4c06ff60 0x7f9a4c0703a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46430/0 (socket says 172.21.15.63:46430) 2024-05-21T01:20:00.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.837+0000 7f9a51a00640 1 -- 172.21.15.63:0/3934416362 learned_addr learned my addr 172.21.15.63:0/3934416362 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:00.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.837+0000 7f9a4be00640 1 --2- 172.21.15.63:0/3934416362 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9a4c1563f0 0x7f9a4c15c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:00.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.837+0000 7f9a51a00640 1 -- 172.21.15.63:0/3934416362 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9a4c1563f0 msgr2=0x7f9a4c15c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:00.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.837+0000 7f9a51a00640 1 --2- 172.21.15.63:0/3934416362 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9a4c1563f0 0x7f9a4c15c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:00.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.837+0000 7f9a51a00640 1 -- 172.21.15.63:0/3934416362 >> v1:172.21.15.131:6789/0 conn(0x7f9a4c156010 legacy=0x7f9a4c0c8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:00.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.837+0000 7f9a51a00640 1 -- 172.21.15.63:0/3934416362 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a4c15fdc0 con 0x7f9a4c06ff60 2024-05-21T01:20:00.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.837+0000 7f9a4be00640 1 --2- 172.21.15.63:0/3934416362 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9a4c1563f0 0x7f9a4c15c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T01:20:00.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.841+0000 7f9a51a00640 1 --2- 172.21.15.63:0/3934416362 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a4c06ff60 0x7f9a4c0703a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9a44009e50 tx=0x7f9a4401ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50d504ef5f1b553e server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:00.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.841+0000 7f9a4b400640 1 -- 172.21.15.63:0/3934416362 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a440a5700 con 0x7f9a4c06ff60 2024-05-21T01:20:00.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.841+0000 7f9a4b400640 1 -- 172.21.15.63:0/3934416362 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a440a58a0 con 0x7f9a4c06ff60 2024-05-21T01:20:00.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.841+0000 7f9a4b400640 1 -- 172.21.15.63:0/3934416362 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a440a5c70 con 0x7f9a4c06ff60 2024-05-21T01:20:00.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.841+0000 7f9a53a00640 1 -- 172.21.15.63:0/3934416362 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a4c06ff60 msgr2=0x7f9a4c0703a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:00.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.841+0000 7f9a53a00640 1 --2- 172.21.15.63:0/3934416362 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a4c06ff60 0x7f9a4c0703a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9a44009e50 tx=0x7f9a4401ca30 comp rx=0 tx=0).stop 2024-05-21T01:20:00.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.841+0000 7f9a53a00640 1 -- 172.21.15.63:0/3934416362 shutdown_connections 2024-05-21T01:20:00.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.841+0000 7f9a53a00640 1 --2- 172.21.15.63:0/3934416362 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a4c06ff60 0x7f9a4c0703a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:00.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.841+0000 7f9a53a00640 1 --2- 172.21.15.63:0/3934416362 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9a4c1563f0 0x7f9a4c15c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:00.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.841+0000 7f9a53a00640 1 -- 172.21.15.63:0/3934416362 >> 172.21.15.63:0/3934416362 conn(0x7f9a4c0ce640 msgr2=0x7f9a4c0cea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:00.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.841+0000 7f9a53a00640 1 -- 172.21.15.63:0/3934416362 shutdown_connections 2024-05-21T01:20:00.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.841+0000 7f9a53a00640 1 -- 172.21.15.63:0/3934416362 wait complete. 2024-05-21T01:20:00.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.841+0000 7f9a53a00640 1 Processor -- start 2024-05-21T01:20:00.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.841+0000 7f9a53a00640 1 -- start start 2024-05-21T01:20:00.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.845+0000 7f9a53a00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9a4c06ff60 0x7f9a4c158130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:00.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.845+0000 7f9a53a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a4c156010 0x7f9a4c1f5690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:00.849 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.845+0000 7f9a53a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9a4c1563f0 0x7f9a4c0c5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:00.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.845+0000 7f9a53a00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f9a4c1689e0 con 0x7f9a4c156010 2024-05-21T01:20:00.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.845+0000 7f9a53a00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f9a4c168860 con 0x7f9a4c1563f0 2024-05-21T01:20:00.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.845+0000 7f9a53a00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f9a4c168b60 con 0x7f9a4c06ff60 2024-05-21T01:20:00.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.845+0000 7f9a4be00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a4c156010 0x7f9a4c1f5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:00.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.845+0000 7f9a4be00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a4c156010 0x7f9a4c1f5690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46440/0 (socket says 172.21.15.63:46440) 2024-05-21T01:20:00.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.845+0000 7f9a4be00640 1 -- 172.21.15.63:0/697478103 learned_addr learned my addr 172.21.15.63:0/697478103 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:00.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.845+0000 7f9a51000640 1 --2- 172.21.15.63:0/697478103 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9a4c06ff60 0x7f9a4c158130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:00.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.845+0000 7f9a51a00640 1 --2- 172.21.15.63:0/697478103 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9a4c1563f0 0x7f9a4c0c5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:00.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.845+0000 7f9a4be00640 1 -- 172.21.15.63:0/697478103 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9a4c06ff60 msgr2=0x7f9a4c158130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:00.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.845+0000 7f9a4be00640 1 --2- 172.21.15.63:0/697478103 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9a4c06ff60 0x7f9a4c158130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:00.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.845+0000 7f9a4be00640 1 -- 172.21.15.63:0/697478103 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9a4c1563f0 msgr2=0x7f9a4c0c5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:00.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.845+0000 7f9a4be00640 1 --2- 172.21.15.63:0/697478103 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9a4c1563f0 0x7f9a4c0c5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:00.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.845+0000 7f9a4be00640 1 -- 172.21.15.63:0/697478103 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a4c1569a0 con 0x7f9a4c156010 2024-05-21T01:20:00.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.845+0000 7f9a4be00640 1 --2- 172.21.15.63:0/697478103 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a4c156010 0x7f9a4c1f5690 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9a3800d800 tx=0x7f9a3800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:00.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.845+0000 7f9a48c00640 1 -- 172.21.15.63:0/697478103 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a380096a0 con 0x7f9a4c156010 2024-05-21T01:20:00.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.845+0000 7f9a48c00640 1 -- 172.21.15.63:0/697478103 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a38019070 con 0x7f9a4c156010 2024-05-21T01:20:00.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.845+0000 7f9a53a00640 1 -- 172.21.15.63:0/697478103 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a4c1f4bd0 con 0x7f9a4c156010 2024-05-21T01:20:00.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.845+0000 7f9a48c00640 1 -- 172.21.15.63:0/697478103 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a38009a80 con 0x7f9a4c156010 2024-05-21T01:20:00.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.845+0000 7f9a53a00640 1 -- 172.21.15.63:0/697478103 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a4c1f4e90 con 0x7f9a4c156010 2024-05-21T01:20:00.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.845+0000 7f9a53a00640 1 -- 172.21.15.63:0/697478103 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a4c0507f0 con 0x7f9a4c156010 2024-05-21T01:20:00.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.845+0000 7f9a48c00640 1 -- 172.21.15.63:0/697478103 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7f9a38009c20 con 0x7f9a4c156010 2024-05-21T01:20:00.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.849+0000 7f9a48c00640 1 --2- 172.21.15.63:0/697478103 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f9a2c06f400 0x7f9a2c0718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:00.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.849+0000 7f9a48c00640 1 -- 172.21.15.63:0/697478103 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f9a3808fa40 con 0x7f9a4c156010 2024-05-21T01:20:00.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.849+0000 7f9a51000640 1 --2- 172.21.15.63:0/697478103 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f9a2c06f400 0x7f9a2c0718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:00.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.849+0000 7f9a51000640 1 --2- 172.21.15.63:0/697478103 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f9a2c06f400 0x7f9a2c0718c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9a400016f0 tx=0x7f9a40009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:00.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:00.853+0000 7f9a48c00640 1 -- 172.21.15.63:0/697478103 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f9a3805c660 con 0x7f9a4c156010 2024-05-21T01:20:01.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:01.053+0000 7f9a53a00640 1 -- 172.21.15.63:0/697478103 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9a4c0cebb0 con 0x7f9a4c156010 2024-05-21T01:20:01.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:01.053+0000 7f9a48c00640 1 -- 172.21.15.63:0/697478103 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+6831 (secure 0 0 0) 0x7f9a3805bf60 con 0x7f9a4c156010 2024-05-21T01:20:01.057 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-05-21T01:20:01.057 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6839/3045714273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6837","nonce":3045714273},{"type":"v1","addr":"172.21.15.131:6839","nonce":3045714273}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/2978367338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":2978367338},{"type":"v1","addr":"172.21.15.131:6835","nonce":2978367338}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/3005995321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6835","nonce":3005995321},{"type":"v1","addr":"172.21.15.63:6837","nonce":3005995321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4267,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6833/574189772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":574189772},{"type":"v1","addr":"172.21.15.63:6833","nonce":574189772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4270,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6838/3071941741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":3071941741},{"type":"v1","addr":"172.21.15.131:6838","nonce":3071941741}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-21T01:19:53.915775+0000","modified":"2024-05-21T01:20:00.573530+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.63:6836/2892727989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":2892727989},{"type":"v1","addr":"172.21.15.63:6836","nonce":2892727989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4276,"qdb_cluster":[4276]},"id":1}]} 2024-05-21T01:20:01.057 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 7 2024-05-21T01:20:01.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:01.053+0000 7f9a53a00640 1 -- 172.21.15.63:0/697478103 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f9a2c06f400 msgr2=0x7f9a2c0718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:01.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:01.053+0000 7f9a53a00640 1 --2- 172.21.15.63:0/697478103 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f9a2c06f400 0x7f9a2c0718c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9a400016f0 tx=0x7f9a40009040 comp rx=0 tx=0).stop 2024-05-21T01:20:01.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:01.053+0000 7f9a53a00640 1 -- 172.21.15.63:0/697478103 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a4c156010 msgr2=0x7f9a4c1f5690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:01.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:01.053+0000 7f9a53a00640 1 --2- 172.21.15.63:0/697478103 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a4c156010 0x7f9a4c1f5690 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9a3800d800 tx=0x7f9a3800dcc0 comp rx=0 tx=0).stop 2024-05-21T01:20:01.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:01.053+0000 7f9a53a00640 1 -- 172.21.15.63:0/697478103 shutdown_connections 2024-05-21T01:20:01.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:01.053+0000 7f9a53a00640 1 --2- 172.21.15.63:0/697478103 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f9a2c06f400 0x7f9a2c0718c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:01.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:01.053+0000 7f9a53a00640 1 --2- 172.21.15.63:0/697478103 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9a4c1563f0 0x7f9a4c0c5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:01.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:01.053+0000 7f9a53a00640 1 --2- 172.21.15.63:0/697478103 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a4c156010 0x7f9a4c1f5690 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:01.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:01.053+0000 7f9a53a00640 1 --2- 172.21.15.63:0/697478103 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9a4c06ff60 0x7f9a4c158130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:01.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:01.053+0000 7f9a53a00640 1 -- 172.21.15.63:0/697478103 >> 172.21.15.63:0/697478103 conn(0x7f9a4c0ce640 msgr2=0x7f9a4c073360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:01.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:01.053+0000 7f9a53a00640 1 -- 172.21.15.63:0/697478103 shutdown_connections 2024-05-21T01:20:01.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:01.053+0000 7f9a53a00640 1 -- 172.21.15.63:0/697478103 wait complete. 2024-05-21T01:20:01.077 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-21T01:20:01.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:01.213+0000 7fcb1bc00640 1 Processor -- start 2024-05-21T01:20:01.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:01.213+0000 7fcb1bc00640 1 -- start start 2024-05-21T01:20:01.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:01.213+0000 7fcb1bc00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fcb1415bd30 0x7fcb14073480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:01.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:01.213+0000 7fcb1bc00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb1406f510 con 0x7fcb1406d5b0 2024-05-21T01:20:01.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:01.213+0000 7fcb1bc00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb14073ac0 con 0x7fcb14156150 2024-05-21T01:20:01.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:01.213+0000 7fcb1bc00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fcb14070a20 con 0x7fcb1415bd30 2024-05-21T01:20:01.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:01.213+0000 7fcb19c00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fcb1406d5b0 0x7fcb141666b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:52506/0 (socket says 172.21.15.63:52506) 2024-05-21T01:20:01.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:01.213+0000 7fcb19c00640 1 -- 172.21.15.63:0/1875561841 learned_addr learned my addr 172.21.15.63:0/1875561841 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-05-21T01:20:01.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:01.213+0000 7fcb0be00640 1 --2- 172.21.15.63:0/1875561841 >> v2:172.21.15.131:3300/0 conn(0x7fcb1415bd30 0x7fcb14073480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:01.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:01.213+0000 7fcb13e00640 1 -- 172.21.15.63:0/1875561841 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 832249734 0 0) 0x7fcb1406f510 con 0x7fcb1406d5b0 2024-05-21T01:20:01.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:01.217+0000 7fcb13e00640 1 -- 172.21.15.63:0/1875561841 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcaf8003530 con 0x7fcb1406d5b0 2024-05-21T01:20:01.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:01.217+0000 7fcb0be00640 1 -- 172.21.15.63:0/1875561841 >> v1:172.21.15.131:6789/0 conn(0x7fcb14156150 legacy=0x7fcb14071190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:01.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:01.217+0000 7fcb0be00640 1 -- 172.21.15.63:0/1875561841 >> v1:172.21.15.63:6789/0 conn(0x7fcb1406d5b0 legacy=0x7fcb141666b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:01.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:01.217+0000 7fcb0be00640 1 -- 172.21.15.63:0/1875561841 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb14073da0 con 0x7fcb1415bd30 2024-05-21T01:20:01.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:01.217+0000 7fcb0be00640 1 --2- 172.21.15.63:0/1875561841 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcb1415bd30 0x7fcb14073480 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcafc0097c0 tx=0x7fcafc01c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=25bd5f0f5062d158 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:01.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:01.217+0000 7fcb13e00640 1 -- 172.21.15.63:0/1875561841 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcafc0b0070 con 0x7fcb1415bd30 2024-05-21T01:20:01.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:01.217+0000 7fcb13e00640 1 -- 172.21.15.63:0/1875561841 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcafc0ab600 con 0x7fcb1415bd30 2024-05-21T01:20:01.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:01.217+0000 7fcb13e00640 1 -- 172.21.15.63:0/1875561841 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcafc0ab9b0 con 0x7fcb1415bd30 2024-05-21T01:20:01.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:01.221+0000 7fcb1bc00640 1 -- 172.21.15.63:0/1875561841 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcb1415bd30 msgr2=0x7fcb14073480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:01.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:01.221+0000 7fcb1bc00640 1 --2- 172.21.15.63:0/1875561841 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcb1415bd30 0x7fcb14073480 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcafc0097c0 tx=0x7fcafc01c410 comp rx=0 tx=0).stop 2024-05-21T01:20:01.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:01.221+0000 7fcb1bc00640 1 -- 172.21.15.63:0/1875561841 shutdown_connections 2024-05-21T01:20:01.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:01.221+0000 7fcb1bc00640 1 --2- 172.21.15.63:0/1875561841 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcb1415bd30 0x7fcb14073480 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:01.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:01.221+0000 7fcb1bc00640 1 -- 172.21.15.63:0/1875561841 >> 172.21.15.63:0/1875561841 conn(0x7fcb140cbf10 msgr2=0x7fcb140cc320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:01.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:01.221+0000 7fcb1bc00640 1 -- 172.21.15.63:0/1875561841 shutdown_connections 2024-05-21T01:20:01.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:01.221+0000 7fcb1bc00640 1 -- 172.21.15.63:0/1875561841 wait complete. 2024-05-21T01:20:01.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:01.221+0000 7fcb1bc00640 1 Processor -- start 2024-05-21T01:20:01.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:01.221+0000 7fcb1bc00640 1 -- start start 2024-05-21T01:20:01.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:01.221+0000 7fcb1bc00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcb1406d5b0 0x7fcb140c9540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:01.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:01.221+0000 7fcb1bc00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcb14156150 0x7fcb1414e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:01.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:01.221+0000 7fcb1bc00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb1415bd30 0x7fcb1414e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:01.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:01.221+0000 7fcb1bc00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fcb14074a50 con 0x7fcb1415bd30 2024-05-21T01:20:01.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:01.221+0000 7fcb1bc00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fcb140748d0 con 0x7fcb14156150 2024-05-21T01:20:01.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:01.221+0000 7fcb1bc00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fcb140718a0 con 0x7fcb1406d5b0 2024-05-21T01:20:01.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:01.221+0000 7fcb19c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb1415bd30 0x7fcb1414e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:01.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:01.221+0000 7fcb19c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb1415bd30 0x7fcb1414e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46442/0 (socket says 172.21.15.63:46442) 2024-05-21T01:20:01.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:01.221+0000 7fcb19c00640 1 -- 172.21.15.63:0/1260659175 learned_addr learned my addr 172.21.15.63:0/1260659175 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:01.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:01.221+0000 7fcb19200640 1 --2- 172.21.15.63:0/1260659175 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcb1406d5b0 0x7fcb140c9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:01.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:01.221+0000 7fcb0be00640 1 --2- 172.21.15.63:0/1260659175 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcb14156150 0x7fcb1414e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:01.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:01.221+0000 7fcb19c00640 1 -- 172.21.15.63:0/1260659175 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcb1406d5b0 msgr2=0x7fcb140c9540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:01.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:01.221+0000 7fcb19c00640 1 --2- 172.21.15.63:0/1260659175 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcb1406d5b0 0x7fcb140c9540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:01.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:01.221+0000 7fcb19c00640 1 -- 172.21.15.63:0/1260659175 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcb14156150 msgr2=0x7fcb1414e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:01.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:01.221+0000 7fcb19c00640 1 --2- 172.21.15.63:0/1260659175 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcb14156150 0x7fcb1414e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:01.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:01.221+0000 7fcb19c00640 1 -- 172.21.15.63:0/1260659175 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb141f47e0 con 0x7fcb1415bd30 2024-05-21T01:20:01.229 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:01.221+0000 7fcb19c00640 1 --2- 172.21.15.63:0/1260659175 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb1415bd30 0x7fcb1414e6f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c00cb70 tx=0x7fcb0c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:01.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:01.225+0000 7fcb11600640 1 -- 172.21.15.63:0/1260659175 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb0c00ad40 con 0x7fcb1415bd30 2024-05-21T01:20:01.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:01.225+0000 7fcb11600640 1 -- 172.21.15.63:0/1260659175 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb0c012400 con 0x7fcb1415bd30 2024-05-21T01:20:01.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:01.225+0000 7fcb11600640 1 -- 172.21.15.63:0/1260659175 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb0c0127b0 con 0x7fcb1415bd30 2024-05-21T01:20:01.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:01.225+0000 7fcb1bc00640 1 -- 172.21.15.63:0/1260659175 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb141f5600 con 0x7fcb1415bd30 2024-05-21T01:20:01.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:01.225+0000 7fcb1bc00640 1 -- 172.21.15.63:0/1260659175 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb141f4d60 con 0x7fcb1415bd30 2024-05-21T01:20:01.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:01.225+0000 7fcb1bc00640 1 -- 172.21.15.63:0/1260659175 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb140507f0 con 0x7fcb1415bd30 2024-05-21T01:20:01.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:01.225+0000 7fcb11600640 1 -- 172.21.15.63:0/1260659175 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7fcb0c012950 con 0x7fcb1415bd30 2024-05-21T01:20:01.231 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:01.225+0000 7fcb11600640 1 --2- 172.21.15.63:0/1260659175 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fcaf006f400 0x7fcaf00718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:01.231 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:01.225+0000 7fcb11600640 1 -- 172.21.15.63:0/1260659175 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fcb0c08faf0 con 0x7fcb1415bd30 2024-05-21T01:20:01.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:01.225+0000 7fcb19200640 1 --2- 172.21.15.63:0/1260659175 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fcaf006f400 0x7fcaf00718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:01.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:01.229+0000 7fcb19200640 1 --2- 172.21.15.63:0/1260659175 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fcaf006f400 0x7fcaf00718c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcb04007fd0 tx=0x7fcb04009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:01.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:01.229+0000 7fcb11600640 1 -- 172.21.15.63:0/1260659175 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fcb0c05c050 con 0x7fcb1415bd30 2024-05-21T01:20:01.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:01.397+0000 7fcb1bc00640 1 -- 172.21.15.63:0/1260659175 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcb140ca260 con 0x7fcb1415bd30 2024-05-21T01:20:01.402 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:01.397+0000 7fcb11600640 1 -- 172.21.15.63:0/1260659175 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18482 (secure 0 0 0) 0x7fcb0c060350 con 0x7fcb1415bd30 2024-05-21T01:20:01.402 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-05-21T01:20:01.402 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":25,"fsid":"9a7cbd84-ceb2-41c8-8b6e-ab931f86c51a","created":"2024-05-21T01:19:37.688082+0000","modified":"2024-05-21T01:19:58.978125+0000","last_up_change":"2024-05-21T01:19:48.472107+0000","last_in_change":"2024-05-21T01:19:39.973975+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-21T01:19:46.485266+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-21T01:19:52.032741+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-21T01:19:52.867322+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-21T01:19:56.562363+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cda28135-00bb-4194-adcb-e0abf3ae43f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":3740454920},{"type":"v1","addr":"172.21.15.63:6801","nonce":3740454920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":3740454920},{"type":"v1","addr":"172.21.15.63:6804","nonce":3740454920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":3740454920},{"type":"v1","addr":"172.21.15.63:6812","nonce":3740454920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":3740454920},{"type":"v1","addr":"172.21.15.63:6808","nonce":3740454920}]},"public_addr":"172.21.15.63:6801/3740454920","cluster_addr":"172.21.15.63:6804/3740454920","heartbeat_back_addr":"172.21.15.63:6812/3740454920","heartbeat_front_addr":"172.21.15.63:6808/3740454920","state":["exists","up"]},{"osd":1,"uuid":"4aeb370d-ec2f-4a91-b17b-035fd72bdaea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6803","nonce":896993303},{"type":"v1","addr":"172.21.15.63:6805","nonce":896993303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6807","nonce":896993303},{"type":"v1","addr":"172.21.15.63:6809","nonce":896993303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":896993303},{"type":"v1","addr":"172.21.15.63:6816","nonce":896993303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6811","nonce":896993303},{"type":"v1","addr":"172.21.15.63:6813","nonce":896993303}]},"public_addr":"172.21.15.63:6805/896993303","cluster_addr":"172.21.15.63:6809/896993303","heartbeat_back_addr":"172.21.15.63:6816/896993303","heartbeat_front_addr":"172.21.15.63:6813/896993303","state":["exists","up"]},{"osd":2,"uuid":"8368b112-35a3-43cf-ad1c-803f05708091","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":845807419},{"type":"v1","addr":"172.21.15.63:6817","nonce":845807419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":845807419},{"type":"v1","addr":"172.21.15.63:6819","nonce":845807419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":845807419},{"type":"v1","addr":"172.21.15.63:6823","nonce":845807419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":845807419},{"type":"v1","addr":"172.21.15.63:6821","nonce":845807419}]},"public_addr":"172.21.15.63:6817/845807419","cluster_addr":"172.21.15.63:6819/845807419","heartbeat_back_addr":"172.21.15.63:6823/845807419","heartbeat_front_addr":"172.21.15.63:6821/845807419","state":["exists","up"]},{"osd":3,"uuid":"26208950-e3ca-4b9a-94cd-c159453a5dfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":521563809},{"type":"v1","addr":"172.21.15.63:6825","nonce":521563809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":521563809},{"type":"v1","addr":"172.21.15.63:6827","nonce":521563809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":521563809},{"type":"v1","addr":"172.21.15.63:6831","nonce":521563809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":521563809},{"type":"v1","addr":"172.21.15.63:6829","nonce":521563809}]},"public_addr":"172.21.15.63:6825/521563809","cluster_addr":"172.21.15.63:6827/521563809","heartbeat_back_addr":"172.21.15.63:6831/521563809","heartbeat_front_addr":"172.21.15.63:6829/521563809","state":["exists","up"]},{"osd":4,"uuid":"d8c93283-1e10-4419-9934-d5048c5d0ad1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":2660673588},{"type":"v1","addr":"172.21.15.131:6801","nonce":2660673588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":2660673588},{"type":"v1","addr":"172.21.15.131:6803","nonce":2660673588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":2660673588},{"type":"v1","addr":"172.21.15.131:6807","nonce":2660673588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":2660673588},{"type":"v1","addr":"172.21.15.131:6805","nonce":2660673588}]},"public_addr":"172.21.15.131:6801/2660673588","cluster_addr":"172.21.15.131:6803/2660673588","heartbeat_back_addr":"172.21.15.131:6807/2660673588","heartbeat_front_addr":"172.21.15.131:6805/2660673588","state":["exists","up"]},{"osd":5,"uuid":"93a6fe9b-eaa6-4474-bf9b-ae0571feacf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6809","nonce":2508702891},{"type":"v1","addr":"172.21.15.131:6811","nonce":2508702891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6813","nonce":2508702891},{"type":"v1","addr":"172.21.15.131:6815","nonce":2508702891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6821","nonce":2508702891},{"type":"v1","addr":"172.21.15.131:6823","nonce":2508702891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6817","nonce":2508702891},{"type":"v1","addr":"172.21.15.131:6819","nonce":2508702891}]},"public_addr":"172.21.15.131:6811/2508702891","cluster_addr":"172.21.15.131:6815/2508702891","heartbeat_back_addr":"172.21.15.131:6823/2508702891","heartbeat_front_addr":"172.21.15.131:6819/2508702891","state":["exists","up"]},{"osd":6,"uuid":"e05e6c8c-2dda-49ab-8116-5ea9038d0f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":614380392},{"type":"v1","addr":"172.21.15.131:6810","nonce":614380392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":614380392},{"type":"v1","addr":"172.21.15.131:6814","nonce":614380392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":614380392},{"type":"v1","addr":"172.21.15.131:6822","nonce":614380392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":614380392},{"type":"v1","addr":"172.21.15.131:6818","nonce":614380392}]},"public_addr":"172.21.15.131:6810/614380392","cluster_addr":"172.21.15.131:6814/614380392","heartbeat_back_addr":"172.21.15.131:6822/614380392","heartbeat_front_addr":"172.21.15.131:6818/614380392","state":["exists","up"]},{"osd":7,"uuid":"0b393e5e-eeef-4e32-b23a-d405a8b0e7b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":4219797450},{"type":"v1","addr":"172.21.15.131:6825","nonce":4219797450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":4219797450},{"type":"v1","addr":"172.21.15.131:6827","nonce":4219797450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":4219797450},{"type":"v1","addr":"172.21.15.131:6831","nonce":4219797450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":4219797450},{"type":"v1","addr":"172.21.15.131:6829","nonce":4219797450}]},"public_addr":"172.21.15.131:6825/4219797450","cluster_addr":"172.21.15.131:6827/4219797450","heartbeat_back_addr":"172.21.15.131:6831/4219797450","heartbeat_front_addr":"172.21.15.131:6829/4219797450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.647841+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.912560+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.684614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.936286+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.380500+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.553497+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.517866+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.310320+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-21T01:20:01.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:01.397+0000 7fcb1bc00640 1 -- 172.21.15.63:0/1260659175 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fcaf006f400 msgr2=0x7fcaf00718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:01.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:01.397+0000 7fcb1bc00640 1 --2- 172.21.15.63:0/1260659175 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fcaf006f400 0x7fcaf00718c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcb04007fd0 tx=0x7fcb04009040 comp rx=0 tx=0).stop 2024-05-21T01:20:01.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:01.397+0000 7fcb1bc00640 1 -- 172.21.15.63:0/1260659175 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb1415bd30 msgr2=0x7fcb1414e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:01.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:01.397+0000 7fcb1bc00640 1 --2- 172.21.15.63:0/1260659175 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb1415bd30 0x7fcb1414e6f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c00cb70 tx=0x7fcb0c00a430 comp rx=0 tx=0).stop 2024-05-21T01:20:01.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:01.397+0000 7fcb1bc00640 1 -- 172.21.15.63:0/1260659175 shutdown_connections 2024-05-21T01:20:01.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:01.397+0000 7fcb1bc00640 1 --2- 172.21.15.63:0/1260659175 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fcaf006f400 0x7fcaf00718c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:01.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:01.397+0000 7fcb1bc00640 1 --2- 172.21.15.63:0/1260659175 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcb1415bd30 0x7fcb1414e6f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:01.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:01.397+0000 7fcb1bc00640 1 --2- 172.21.15.63:0/1260659175 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcb14156150 0x7fcb1414e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:01.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:01.397+0000 7fcb1bc00640 1 --2- 172.21.15.63:0/1260659175 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcb1406d5b0 0x7fcb140c9540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:01.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:01.397+0000 7fcb1bc00640 1 -- 172.21.15.63:0/1260659175 >> 172.21.15.63:0/1260659175 conn(0x7fcb140cbf10 msgr2=0x7fcb1415fa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:01.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:01.401+0000 7fcb1bc00640 1 -- 172.21.15.63:0/1260659175 shutdown_connections 2024-05-21T01:20:01.405 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:01.401+0000 7fcb1bc00640 1 -- 172.21.15.63:0/1260659175 wait complete. 2024-05-21T01:20:02.026 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-21T01:19:53.915775+0000', 'modified': '2024-05-21T01:20:00.573530+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4276}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4276': {'gid': 4276, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.63:6836/2892727989', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6834', 'nonce': 2892727989}, {'type': 'v1', 'addr': '172.21.15.63:6836', 'nonce': 2892727989}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4276, 'qdb_cluster': [4276]} 2024-05-21T01:20:02.026 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-21T01:20:02.027 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-05-21T01:20:02.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.169+0000 7f46ff200640 1 Processor -- start 2024-05-21T01:20:02.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.169+0000 7f46ff200640 1 -- start start 2024-05-21T01:20:02.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.169+0000 7f46ff200640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f46f806f080 0x7f46f80cf530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:02.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.169+0000 7f46ff200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f46f8156450 0x7f46f80cfa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:02.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.169+0000 7f46ff200640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46f8071d50 con 0x7f46f8156070 2024-05-21T01:20:02.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.169+0000 7f46ff200640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f46f815bf20 con 0x7f46f806f080 2024-05-21T01:20:02.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.169+0000 7f46ff200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f46f815c1e0 con 0x7f46f8156450 2024-05-21T01:20:02.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.169+0000 7f46fd200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f46f8156450 0x7f46f80cfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:02.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.169+0000 7f46efe00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f46f806f080 0x7f46f80cf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:02.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.169+0000 7f46fd200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f46f8156450 0x7f46f80cfa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.63:42146/0 (socket says 172.21.15.63:42146) 2024-05-21T01:20:02.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.169+0000 7f46fd200640 1 -- 172.21.15.63:0/3611318597 learned_addr learned my addr 172.21.15.63:0/3611318597 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:02.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.169+0000 7f46f7e00640 1 --1- 172.21.15.63:0/3611318597 >> v1:172.21.15.131:6789/0 conn(0x7f46f8156070 0x7f46f8071640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.63:40720/0 (socket says 172.21.15.63:40720) 2024-05-21T01:20:02.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.173+0000 7f46fd200640 1 -- 172.21.15.63:0/3611318597 >> v2:172.21.15.131:3300/0 conn(0x7f46f806f080 msgr2=0x7f46f80cf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:02.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.173+0000 7f46fd200640 1 --2- 172.21.15.63:0/3611318597 >> v2:172.21.15.131:3300/0 conn(0x7f46f806f080 0x7f46f80cf530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:02.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.173+0000 7f46fd200640 1 -- 172.21.15.63:0/3611318597 >> v1:172.21.15.131:6789/0 conn(0x7f46f8156070 legacy=0x7f46f8071640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:02.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.173+0000 7f46fd200640 1 -- 172.21.15.63:0/3611318597 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46f815c4c0 con 0x7f46f8156450 2024-05-21T01:20:02.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.173+0000 7f46fd200640 1 --2- 172.21.15.63:0/3611318597 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f46f8156450 0x7f46f80cfa70 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f46f0009e50 tx=0x7f46f001ca30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ad7d991b6bd0494 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:02.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.173+0000 7f46f7400640 1 -- 172.21.15.63:0/3611318597 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f00a5700 con 0x7f46f8156450 2024-05-21T01:20:02.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.173+0000 7f46f7400640 1 -- 172.21.15.63:0/3611318597 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46f00a58a0 con 0x7f46f8156450 2024-05-21T01:20:02.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.173+0000 7f46f7400640 1 -- 172.21.15.63:0/3611318597 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f00a5c70 con 0x7f46f8156450 2024-05-21T01:20:02.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.173+0000 7f46ff200640 1 -- 172.21.15.63:0/3611318597 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f46f8156450 msgr2=0x7f46f80cfa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:02.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.173+0000 7f46ff200640 1 --2- 172.21.15.63:0/3611318597 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f46f8156450 0x7f46f80cfa70 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f46f0009e50 tx=0x7f46f001ca30 comp rx=0 tx=0).stop 2024-05-21T01:20:02.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.177+0000 7f46ff200640 1 -- 172.21.15.63:0/3611318597 shutdown_connections 2024-05-21T01:20:02.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.177+0000 7f46ff200640 1 --2- 172.21.15.63:0/3611318597 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f46f8156450 0x7f46f80cfa70 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:02.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.177+0000 7f46ff200640 1 --2- 172.21.15.63:0/3611318597 >> v2:172.21.15.131:3300/0 conn(0x7f46f806f080 0x7f46f80cf530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:02.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.177+0000 7f46ff200640 1 -- 172.21.15.63:0/3611318597 >> 172.21.15.63:0/3611318597 conn(0x7f46f80735f0 msgr2=0x7f46f8073a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:02.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.177+0000 7f46ff200640 1 -- 172.21.15.63:0/3611318597 shutdown_connections 2024-05-21T01:20:02.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.177+0000 7f46ff200640 1 -- 172.21.15.63:0/3611318597 wait complete. 2024-05-21T01:20:02.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.177+0000 7f46ff200640 1 Processor -- start 2024-05-21T01:20:02.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.177+0000 7f46ff200640 1 -- start start 2024-05-21T01:20:02.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.177+0000 7f46ff200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46f806f080 0x7f46f81f5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:02.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.177+0000 7f46ff200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f46f8156070 0x7f46f81459b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:02.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.177+0000 7f46ff200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f46f8156450 0x7f46f8154b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:02.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.177+0000 7f46ff200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f46f806e140 con 0x7f46f8156450 2024-05-21T01:20:02.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.177+0000 7f46ff200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f46f806dfc0 con 0x7f46f806f080 2024-05-21T01:20:02.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.177+0000 7f46ff200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f46f81688b0 con 0x7f46f8156070 2024-05-21T01:20:02.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.177+0000 7f46fd200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f46f8156450 0x7f46f8154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:02.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.177+0000 7f46fd200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f46f8156450 0x7f46f8154b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46456/0 (socket says 172.21.15.63:46456) 2024-05-21T01:20:02.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.177+0000 7f46fd200640 1 -- 172.21.15.63:0/2174711743 learned_addr learned my addr 172.21.15.63:0/2174711743 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:02.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.177+0000 7f46f7e00640 1 --2- 172.21.15.63:0/2174711743 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46f806f080 0x7f46f81f5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:02.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.177+0000 7f46efe00640 1 --2- 172.21.15.63:0/2174711743 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f46f8156070 0x7f46f81459b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:02.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.177+0000 7f46fd200640 1 -- 172.21.15.63:0/2174711743 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f46f8156070 msgr2=0x7f46f81459b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:02.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.177+0000 7f46fd200640 1 --2- 172.21.15.63:0/2174711743 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f46f8156070 0x7f46f81459b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:02.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.177+0000 7f46fd200640 1 -- 172.21.15.63:0/2174711743 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46f806f080 msgr2=0x7f46f81f5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:02.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.177+0000 7f46fd200640 1 --2- 172.21.15.63:0/2174711743 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46f806f080 0x7f46f81f5c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:02.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.177+0000 7f46fd200640 1 -- 172.21.15.63:0/2174711743 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46f80ca1c0 con 0x7f46f8156450 2024-05-21T01:20:02.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.177+0000 7f46fd200640 1 --2- 172.21.15.63:0/2174711743 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f46f8156450 0x7f46f8154b10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f46f00af040 tx=0x7f46f00197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:02.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.177+0000 7f46f4c00640 1 -- 172.21.15.63:0/2174711743 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f00b8440 con 0x7f46f8156450 2024-05-21T01:20:02.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.181+0000 7f46f4c00640 1 -- 172.21.15.63:0/2174711743 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46f00b8620 con 0x7f46f8156450 2024-05-21T01:20:02.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.181+0000 7f46f4c00640 1 -- 172.21.15.63:0/2174711743 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f00b8a10 con 0x7f46f8156450 2024-05-21T01:20:02.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.181+0000 7f46ff200640 1 -- 172.21.15.63:0/2174711743 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46f8146130 con 0x7f46f8156450 2024-05-21T01:20:02.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.181+0000 7f46ff200640 1 -- 172.21.15.63:0/2174711743 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46f8144bf0 con 0x7f46f8156450 2024-05-21T01:20:02.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.181+0000 7f46f4c00640 1 -- 172.21.15.63:0/2174711743 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7f46f00c1020 con 0x7f46f8156450 2024-05-21T01:20:02.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.181+0000 7f46f4c00640 1 --2- 172.21.15.63:0/2174711743 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f46d406f400 0x7f46d40718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:02.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.181+0000 7f46f4c00640 1 -- 172.21.15.63:0/2174711743 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f46f0129c00 con 0x7f46f8156450 2024-05-21T01:20:02.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.185+0000 7f47026e0000 1 Processor -- start 2024-05-21T01:20:02.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.185+0000 7f46f7e00640 1 --2- 172.21.15.63:0/2174711743 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f46d406f400 0x7f46d40718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:02.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.185+0000 7f47026e0000 1 -- start start 2024-05-21T01:20:02.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.185+0000 7f47026e0000 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55839f6544a0 0x55839f61d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:02.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.185+0000 7f46f7e00640 1 --2- 172.21.15.63:0/2174711743 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f46d406f400 0x7f46d40718c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f46e8000f70 tx=0x7f46e8007e90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:02.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.185+0000 7f47026e0000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55839f61d740 0x55839f63c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:02.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.185+0000 7f47026e0000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55839f63cef0 0x55839f63d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:02.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.185+0000 7f47026e0000 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55839f4716d0 con 0x55839f6544a0 2024-05-21T01:20:02.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.185+0000 7f47026e0000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55839f461270 con 0x55839f63cef0 2024-05-21T01:20:02.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.185+0000 7f47026e0000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55839f4652b0 con 0x55839f61d740 2024-05-21T01:20:02.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.185+0000 7f46f7e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55839f6544a0 0x55839f61d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:02.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.185+0000 7f46f7e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55839f6544a0 0x55839f61d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46472/0 (socket says 172.21.15.63:46472) 2024-05-21T01:20:02.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.185+0000 7f46f7e00640 1 -- 172.21.15.63:0/842095845 learned_addr learned my addr 172.21.15.63:0/842095845 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:02.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.185+0000 7f46fd200640 1 --2- 172.21.15.63:0/842095845 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55839f63cef0 0x55839f63d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:02.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.185+0000 7f46efe00640 1 --2- 172.21.15.63:0/842095845 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55839f61d740 0x55839f63c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:02.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.185+0000 7f46f7e00640 1 -- 172.21.15.63:0/842095845 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55839f61d740 msgr2=0x55839f63c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:02.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.185+0000 7f46f7e00640 1 --2- 172.21.15.63:0/842095845 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55839f61d740 0x55839f63c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:02.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.185+0000 7f46f7e00640 1 -- 172.21.15.63:0/842095845 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55839f63cef0 msgr2=0x55839f63d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:02.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.185+0000 7f46f7e00640 1 --2- 172.21.15.63:0/842095845 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55839f63cef0 0x55839f63d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:02.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.185+0000 7f46f7e00640 1 -- 172.21.15.63:0/842095845 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55839f43fbf0 con 0x55839f6544a0 2024-05-21T01:20:02.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.185+0000 7f46f7e00640 1 --2- 172.21.15.63:0/842095845 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55839f6544a0 0x55839f61d200 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f46e8007840 tx=0x7f46e8013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6eae76df457eecc server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:02.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.185+0000 7f46ecc00640 1 -- 172.21.15.63:0/842095845 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e8026070 con 0x55839f6544a0 2024-05-21T01:20:02.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.185+0000 7f46ecc00640 1 -- 172.21.15.63:0/842095845 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46e8013940 con 0x55839f6544a0 2024-05-21T01:20:02.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.185+0000 7f46ecc00640 1 -- 172.21.15.63:0/842095845 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e8013cf0 con 0x55839f6544a0 2024-05-21T01:20:02.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.185+0000 7f47026e0000 1 -- 172.21.15.63:0/842095845 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55839f6544a0 msgr2=0x55839f61d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:02.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.185+0000 7f47026e0000 1 --2- 172.21.15.63:0/842095845 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55839f6544a0 0x55839f61d200 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f46e8007840 tx=0x7f46e8013000 comp rx=0 tx=0).stop 2024-05-21T01:20:02.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.185+0000 7f47026e0000 1 -- 172.21.15.63:0/842095845 shutdown_connections 2024-05-21T01:20:02.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.185+0000 7f47026e0000 1 --2- 172.21.15.63:0/842095845 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55839f63cef0 0x55839f63d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:02.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.185+0000 7f47026e0000 1 --2- 172.21.15.63:0/842095845 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55839f61d740 0x55839f63c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:02.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.185+0000 7f47026e0000 1 --2- 172.21.15.63:0/842095845 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55839f6544a0 0x55839f61d200 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:02.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.185+0000 7f47026e0000 1 -- 172.21.15.63:0/842095845 >> 172.21.15.63:0/842095845 conn(0x55839f4fcef0 msgr2=0x55839f653b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:02.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.185+0000 7f47026e0000 1 -- 172.21.15.63:0/842095845 shutdown_connections 2024-05-21T01:20:02.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.185+0000 7f47026e0000 1 -- 172.21.15.63:0/842095845 wait complete. 2024-05-21T01:20:02.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.185+0000 7f47026e0000 1 -- start start 2024-05-21T01:20:02.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.185+0000 7f47026e0000 1 Processor -- start 2024-05-21T01:20:02.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.189+0000 7f47026e0000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55839f61d740 0x55839f661050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:02.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.189+0000 7f47026e0000 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55839f63cef0 0x55839f661590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:02.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.189+0000 7f47026e0000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55839f6544a0 0x55839f618c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:02.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.189+0000 7f47026e0000 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55839f424630 con 0x55839f63cef0 2024-05-21T01:20:02.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.189+0000 7f47026e0000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55839f4e5570 con 0x55839f61d740 2024-05-21T01:20:02.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.189+0000 7f47026e0000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55839f4704a0 con 0x55839f6544a0 2024-05-21T01:20:02.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.189+0000 7f47026e0000 10 client.0 _ll_register_callbacks cb 0x55839f600540 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-21T01:20:02.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.189+0000 7f46efe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55839f63cef0 0x55839f661590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:02.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.189+0000 7f46efe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55839f63cef0 0x55839f661590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46476/0 (socket says 172.21.15.63:46476) 2024-05-21T01:20:02.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.189+0000 7f46efe00640 1 -- 172.21.15.63:0/3129859869 learned_addr learned my addr 172.21.15.63:0/3129859869 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:02.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.189+0000 7f46f7e00640 1 --2- 172.21.15.63:0/3129859869 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55839f61d740 0x55839f661050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:02.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.189+0000 7f46fd200640 1 --2- 172.21.15.63:0/3129859869 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55839f6544a0 0x55839f618c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:02.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.189+0000 7f46efe00640 1 -- 172.21.15.63:0/3129859869 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55839f6544a0 msgr2=0x55839f618c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:02.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.189+0000 7f46efe00640 1 --2- 172.21.15.63:0/3129859869 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55839f6544a0 0x55839f618c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:02.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.189+0000 7f46efe00640 1 -- 172.21.15.63:0/3129859869 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55839f61d740 msgr2=0x55839f661050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:02.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.189+0000 7f46efe00640 1 --2- 172.21.15.63:0/3129859869 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55839f61d740 0x55839f661050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:02.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.189+0000 7f46efe00640 1 -- 172.21.15.63:0/3129859869 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55839f4a99b0 con 0x55839f63cef0 2024-05-21T01:20:02.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.189+0000 7f46f7e00640 1 --2- 172.21.15.63:0/3129859869 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55839f61d740 0x55839f661050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T01:20:02.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.189+0000 7f46fd200640 1 --2- 172.21.15.63:0/3129859869 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55839f6544a0 0x55839f618c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T01:20:02.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.189+0000 7f46efe00640 1 --2- 172.21.15.63:0/3129859869 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55839f63cef0 0x55839f661590 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f46e0014770 tx=0x7f46e0014c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c177de87c389009b server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:02.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.189+0000 7f46e5600640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-05-21T01:20:02.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.189+0000 7f46e5600640 1 -- 172.21.15.63:0/3129859869 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e0022060 con 0x55839f63cef0 2024-05-21T01:20:02.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.189+0000 7f47026e0000 1 -- 172.21.15.63:0/3129859869 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f46e8013940 con 0x55839f63cef0 2024-05-21T01:20:02.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.189+0000 7f46e5600640 1 -- 172.21.15.63:0/3129859869 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f46e0012b20 con 0x55839f63cef0 2024-05-21T01:20:02.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.189+0000 7f46e5600640 1 -- 172.21.15.63:0/3129859869 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f46e0028050 con 0x55839f63cef0 2024-05-21T01:20:02.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.189+0000 7f47026e0000 10 client.4374 fetch_fsmap learned FSMap version 7 2024-05-21T01:20:02.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.189+0000 7f47026e0000 1 -- 172.21.15.63:0/3129859869 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x55839f43c510 con 0x55839f63cef0 2024-05-21T01:20:02.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.189+0000 7f46e5600640 1 -- 172.21.15.63:0/3129859869 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46e8013940 con 0x55839f63cef0 2024-05-21T01:20:02.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.189+0000 7f46e5600640 1 -- 172.21.15.63:0/3129859869 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 7) ==== 4712+0+0 (secure 0 0 0) 0x7f46e002b020 con 0x55839f63cef0 2024-05-21T01:20:02.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.189+0000 7f47026e0000 10 client.4374 fetch_fsmap finished waiting for FSMap version 7 2024-05-21T01:20:02.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.189+0000 7f47026e0000 10 client.4374 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-21T01:20:02.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.189+0000 7f47026e0000 20 client.4374 populate_metadata read hostname 'smithi063' 2024-05-21T01:20:02.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.189+0000 7f47026e0000 1 --2- 172.21.15.63:0/3129859869 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x55839f6199d0 0x55839f619db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:02.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.189+0000 7f47026e0000 4 client.4374 mds_command: new command op to 4276 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-21T01:20:02.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.189+0000 7f47026e0000 1 -- 172.21.15.63:0/3129859869 --> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55839f3fcbc0 con 0x55839f6199d0 2024-05-21T01:20:02.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.189+0000 7f46f7e00640 1 --2- 172.21.15.63:0/3129859869 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x55839f6199d0 0x55839f619db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:02.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.189+0000 7f46f7e00640 1 --2- 172.21.15.63:0/3129859869 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x55839f6199d0 0x55839f619db0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2abd423333c934a server_cookie=63a8fa2546daec2a in_seq=0 out_seq=0 2024-05-21T01:20:02.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:02.189+0000 7f46e5600640 10 client.4374 ms_handle_connect on v2:172.21.15.63:6834/2892727989 2024-05-21T01:20:05.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.581+0000 7f46e5600640 1 -- 172.21.15.63:0/3129859869 <== mds.0 v2:172.21.15.63:6834/2892727989 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x55839f3fcbc0 con 0x55839f6199d0 2024-05-21T01:20:05.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.581+0000 7f46e5600640 10 client.4374 handle_command_reply: tid=0 2024-05-21T01:20:05.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.581+0000 7f47026e0000 1 client.4374 shutdown 2024-05-21T01:20:05.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.581+0000 7f47026e0000 1 -- 172.21.15.63:0/3129859869 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55839f63cef0 msgr2=0x55839f661590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:05.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.581+0000 7f47026e0000 1 --2- 172.21.15.63:0/3129859869 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55839f63cef0 0x55839f661590 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f46e0014770 tx=0x7f46e0014c30 comp rx=0 tx=0).stop 2024-05-21T01:20:05.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.581+0000 7f47026e0000 1 -- 172.21.15.63:0/3129859869 shutdown_connections 2024-05-21T01:20:05.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.581+0000 7f47026e0000 1 --2- 172.21.15.63:0/3129859869 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x55839f6199d0 0x55839f619db0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:05.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.581+0000 7f47026e0000 1 --2- 172.21.15.63:0/3129859869 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55839f6544a0 0x55839f618c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:05.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.581+0000 7f47026e0000 1 --2- 172.21.15.63:0/3129859869 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55839f63cef0 0x55839f661590 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:05.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.581+0000 7f47026e0000 1 --2- 172.21.15.63:0/3129859869 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55839f61d740 0x55839f661050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:05.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.581+0000 7f46e5600640 0 client.4374 ms_handle_reset on v2:172.21.15.63:6834/2892727989 2024-05-21T01:20:05.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.581+0000 7f47026e0000 1 -- 172.21.15.63:0/3129859869 >> 172.21.15.63:0/3129859869 conn(0x55839f4fcef0 msgr2=0x55839f6138e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:05.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.581+0000 7f47026e0000 1 -- 172.21.15.63:0/3129859869 shutdown_connections 2024-05-21T01:20:05.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.581+0000 7f47026e0000 1 -- 172.21.15.63:0/3129859869 wait complete. 2024-05-21T01:20:05.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.581+0000 7f47026e0000 20 client.4374 trim_cache size 0 max 16384 2024-05-21T01:20:05.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.601+0000 7f47026e0000 1 Processor -- start 2024-05-21T01:20:05.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.601+0000 7f47026e0000 1 -- start start 2024-05-21T01:20:05.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.601+0000 7f47026e0000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55839f61d740 0x55839f671610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:05.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.601+0000 7f47026e0000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55839f63cef0 0x55839f6701e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:05.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.601+0000 7f47026e0000 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55839f6544a0 0x55839f670720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:05.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.601+0000 7f47026e0000 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f46f8201020 con 0x55839f6544a0 2024-05-21T01:20:05.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.601+0000 7f47026e0000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f46f8201680 con 0x55839f61d740 2024-05-21T01:20:05.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.601+0000 7f47026e0000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55839f3fe200 con 0x55839f63cef0 2024-05-21T01:20:05.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.605+0000 7f46fd200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55839f6544a0 0x55839f670720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:05.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.605+0000 7f46fd200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55839f6544a0 0x55839f670720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46478/0 (socket says 172.21.15.63:46478) 2024-05-21T01:20:05.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.605+0000 7f46fd200640 1 -- 172.21.15.63:0/397276464 learned_addr learned my addr 172.21.15.63:0/397276464 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:05.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.605+0000 7f46f7e00640 1 --2- 172.21.15.63:0/397276464 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55839f61d740 0x55839f671610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:05.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.605+0000 7f46efe00640 1 --2- 172.21.15.63:0/397276464 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55839f63cef0 0x55839f6701e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:05.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.605+0000 7f46fd200640 1 -- 172.21.15.63:0/397276464 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55839f63cef0 msgr2=0x55839f6701e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:05.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.605+0000 7f46fd200640 1 --2- 172.21.15.63:0/397276464 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55839f63cef0 0x55839f6701e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:05.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.605+0000 7f46fd200640 1 -- 172.21.15.63:0/397276464 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55839f61d740 msgr2=0x55839f671610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:05.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.605+0000 7f46fd200640 1 --2- 172.21.15.63:0/397276464 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55839f61d740 0x55839f671610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:05.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.605+0000 7f46fd200640 1 -- 172.21.15.63:0/397276464 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55839f402860 con 0x55839f6544a0 2024-05-21T01:20:05.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.605+0000 7f46f7e00640 1 --2- 172.21.15.63:0/397276464 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55839f61d740 0x55839f671610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T01:20:05.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.605+0000 7f46fd200640 1 --2- 172.21.15.63:0/397276464 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55839f6544a0 0x55839f670720 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f46f001cf10 tx=0x7f46f0009640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=401d6963956fa9a0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:05.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.605+0000 7f46e7e00640 1 -- 172.21.15.63:0/397276464 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f00f5bd0 con 0x55839f6544a0 2024-05-21T01:20:05.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.605+0000 7f46e7e00640 1 -- 172.21.15.63:0/397276464 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46f00a5870 con 0x55839f6544a0 2024-05-21T01:20:05.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.605+0000 7f46e7e00640 1 -- 172.21.15.63:0/397276464 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f00febe0 con 0x55839f6544a0 2024-05-21T01:20:05.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.605+0000 7f47026e0000 1 -- 172.21.15.63:0/397276464 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55839f6544a0 msgr2=0x55839f670720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:05.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.605+0000 7f47026e0000 1 --2- 172.21.15.63:0/397276464 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55839f6544a0 0x55839f670720 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f46f001cf10 tx=0x7f46f0009640 comp rx=0 tx=0).stop 2024-05-21T01:20:05.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.605+0000 7f47026e0000 1 -- 172.21.15.63:0/397276464 shutdown_connections 2024-05-21T01:20:05.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.605+0000 7f47026e0000 1 --2- 172.21.15.63:0/397276464 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55839f6544a0 0x55839f670720 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:05.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.605+0000 7f47026e0000 1 --2- 172.21.15.63:0/397276464 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55839f63cef0 0x55839f6701e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:05.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.605+0000 7f47026e0000 1 --2- 172.21.15.63:0/397276464 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55839f61d740 0x55839f671610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:05.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.605+0000 7f47026e0000 1 -- 172.21.15.63:0/397276464 >> 172.21.15.63:0/397276464 conn(0x55839f4fcef0 msgr2=0x55839f64f360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:05.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.605+0000 7f47026e0000 1 -- 172.21.15.63:0/397276464 shutdown_connections 2024-05-21T01:20:05.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.605+0000 7f47026e0000 1 -- 172.21.15.63:0/397276464 wait complete. 2024-05-21T01:20:05.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.605+0000 7f47026e0000 1 -- start start 2024-05-21T01:20:05.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.605+0000 7f47026e0000 1 Processor -- start 2024-05-21T01:20:05.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.609+0000 7f47026e0000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55839f61d740 0x55839f6ce660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:05.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.609+0000 7f47026e0000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55839f63cef0 0x55839f6ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:05.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.609+0000 7f47026e0000 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55839f6544a0 0x55839f663ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:05.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.609+0000 7f47026e0000 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55839f4645c0 con 0x55839f6544a0 2024-05-21T01:20:05.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.609+0000 7f47026e0000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55839f3f97b0 con 0x55839f63cef0 2024-05-21T01:20:05.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.609+0000 7f47026e0000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55839f4698e0 con 0x55839f61d740 2024-05-21T01:20:05.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.609+0000 7f47026e0000 10 client.0 _ll_register_callbacks cb 0x7f46e0009820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-21T01:20:05.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.609+0000 7f46fd200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55839f6544a0 0x55839f663ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:05.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.609+0000 7f46fd200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55839f6544a0 0x55839f663ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46490/0 (socket says 172.21.15.63:46490) 2024-05-21T01:20:05.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.609+0000 7f46fd200640 1 -- 172.21.15.63:0/2249685814 learned_addr learned my addr 172.21.15.63:0/2249685814 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:05.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.609+0000 7f46f7e00640 1 --2- 172.21.15.63:0/2249685814 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55839f61d740 0x55839f6ce660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:05.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.609+0000 7f46efe00640 1 --2- 172.21.15.63:0/2249685814 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55839f63cef0 0x55839f6ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:05.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.609+0000 7f46fd200640 1 -- 172.21.15.63:0/2249685814 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55839f61d740 msgr2=0x55839f6ce660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:05.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.609+0000 7f46fd200640 1 --2- 172.21.15.63:0/2249685814 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55839f61d740 0x55839f6ce660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:05.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.609+0000 7f46fd200640 1 -- 172.21.15.63:0/2249685814 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55839f63cef0 msgr2=0x55839f6ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:05.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.609+0000 7f46fd200640 1 --2- 172.21.15.63:0/2249685814 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55839f63cef0 0x55839f6ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:05.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.609+0000 7f46fd200640 1 -- 172.21.15.63:0/2249685814 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55839f418e80 con 0x55839f6544a0 2024-05-21T01:20:05.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.609+0000 7f46f7e00640 1 --2- 172.21.15.63:0/2249685814 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55839f61d740 0x55839f6ce660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T01:20:05.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.609+0000 7f46efe00640 1 --2- 172.21.15.63:0/2249685814 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55839f63cef0 0x55839f6ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T01:20:05.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.609+0000 7f46fd200640 1 --2- 172.21.15.63:0/2249685814 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55839f6544a0 0x55839f663ae0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f46f001c4a0 tx=0x7f46f0127c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8325a44d2bf73753 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:05.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.609+0000 7f46e5600640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-05-21T01:20:05.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.609+0000 7f46e5600640 1 -- 172.21.15.63:0/2249685814 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f00f60c0 con 0x55839f6544a0 2024-05-21T01:20:05.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.609+0000 7f46e5600640 1 -- 172.21.15.63:0/2249685814 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f46f00f5320 con 0x55839f6544a0 2024-05-21T01:20:05.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.609+0000 7f47026e0000 1 -- 172.21.15.63:0/2249685814 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f46f00a5870 con 0x55839f6544a0 2024-05-21T01:20:05.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.609+0000 7f46e5600640 1 -- 172.21.15.63:0/2249685814 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f46f00fa3c0 con 0x55839f6544a0 2024-05-21T01:20:05.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.609+0000 7f47026e0000 10 client.4380 fetch_fsmap learned FSMap version 7 2024-05-21T01:20:05.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.609+0000 7f47026e0000 1 -- 172.21.15.63:0/2249685814 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x55839f4e5a00 con 0x55839f6544a0 2024-05-21T01:20:05.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.609+0000 7f46e5600640 1 -- 172.21.15.63:0/2249685814 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46f00a5870 con 0x55839f6544a0 2024-05-21T01:20:05.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.609+0000 7f46e5600640 1 -- 172.21.15.63:0/2249685814 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 7) ==== 4712+0+0 (secure 0 0 0) 0x7f46f00f1a30 con 0x55839f6544a0 2024-05-21T01:20:05.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.609+0000 7f47026e0000 10 client.4380 fetch_fsmap finished waiting for FSMap version 7 2024-05-21T01:20:05.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.609+0000 7f47026e0000 10 client.4380 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-21T01:20:05.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.609+0000 7f47026e0000 20 client.4380 populate_metadata read hostname 'smithi063' 2024-05-21T01:20:05.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.609+0000 7f47026e0000 1 --2- 172.21.15.63:0/2249685814 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x55839f664410 0x55839f6647f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:05.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.609+0000 7f47026e0000 4 client.4380 mds_command: new command op to 4276 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-21T01:20:05.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.609+0000 7f47026e0000 1 -- 172.21.15.63:0/2249685814 --> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] -- command(tid 0: {"prefix": "status"}) -- 0x55839f400dc0 con 0x55839f664410 2024-05-21T01:20:05.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.609+0000 7f46f7e00640 1 --2- 172.21.15.63:0/2249685814 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x55839f664410 0x55839f6647f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:05.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.609+0000 7f46f7e00640 1 --2- 172.21.15.63:0/2249685814 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x55839f664410 0x55839f6647f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1e1ed8c07e0121f server_cookie=3b493f031e6bc1a0 in_seq=0 out_seq=0 2024-05-21T01:20:05.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.609+0000 7f46e5600640 10 client.4380 ms_handle_connect on v2:172.21.15.63:6834/2892727989 2024-05-21T01:20:05.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.609+0000 7f46e5600640 1 -- 172.21.15.63:0/2249685814 <== mds.0 v2:172.21.15.63:6834/2892727989 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x55839f400dc0 con 0x55839f664410 2024-05-21T01:20:05.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.609+0000 7f46e5600640 10 client.4380 handle_command_reply: tid=0 2024-05-21T01:20:05.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.609+0000 7f47026e0000 1 client.4380 shutdown 2024-05-21T01:20:05.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.609+0000 7f47026e0000 1 -- 172.21.15.63:0/2249685814 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55839f6544a0 msgr2=0x55839f663ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:05.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.609+0000 7f47026e0000 1 --2- 172.21.15.63:0/2249685814 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55839f6544a0 0x55839f663ae0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f46f001c4a0 tx=0x7f46f0127c20 comp rx=0 tx=0).stop 2024-05-21T01:20:05.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.613+0000 7f47026e0000 1 -- 172.21.15.63:0/2249685814 shutdown_connections 2024-05-21T01:20:05.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.613+0000 7f47026e0000 1 --2- 172.21.15.63:0/2249685814 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x55839f664410 0x55839f6647f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:05.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.613+0000 7f47026e0000 1 --2- 172.21.15.63:0/2249685814 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55839f6544a0 0x55839f663ae0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:05.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.613+0000 7f47026e0000 1 --2- 172.21.15.63:0/2249685814 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55839f63cef0 0x55839f6ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:05.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.613+0000 7f47026e0000 1 --2- 172.21.15.63:0/2249685814 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55839f61d740 0x55839f6ce660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:05.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.613+0000 7f46e5600640 0 client.4380 ms_handle_reset on v2:172.21.15.63:6834/2892727989 2024-05-21T01:20:05.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.613+0000 7f47026e0000 1 -- 172.21.15.63:0/2249685814 >> 172.21.15.63:0/2249685814 conn(0x55839f4fcef0 msgr2=0x55839f6158f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:05.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.613+0000 7f47026e0000 1 -- 172.21.15.63:0/2249685814 shutdown_connections 2024-05-21T01:20:05.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.613+0000 7f47026e0000 1 -- 172.21.15.63:0/2249685814 wait complete. 2024-05-21T01:20:05.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.613+0000 7f47026e0000 20 client.4380 trim_cache size 0 max 16384 2024-05-21T01:20:05.620 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-05-21T01:20:05.620 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_fsid": "9a7cbd84-ceb2-41c8-8b6e-ab931f86c51a", 2024-05-21T01:20:05.620 INFO:teuthology.orchestra.run.smithi063.stdout: "whoami": 0, 2024-05-21T01:20:05.620 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 4276, 2024-05-21T01:20:05.620 INFO:teuthology.orchestra.run.smithi063.stdout: "want_state": "up:active", 2024-05-21T01:20:05.620 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "up:active", 2024-05-21T01:20:05.620 INFO:teuthology.orchestra.run.smithi063.stdout: "fs_name": "cephfs", 2024-05-21T01:20:05.620 INFO:teuthology.orchestra.run.smithi063.stdout: "rank_uptime": 11.079002459, 2024-05-21T01:20:05.620 INFO:teuthology.orchestra.run.smithi063.stdout: "mdsmap_epoch": 6, 2024-05-21T01:20:05.620 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch": 25, 2024-05-21T01:20:05.620 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch_barrier": 25, 2024-05-21T01:20:05.620 INFO:teuthology.orchestra.run.smithi063.stdout: "uptime": 16.952966995000001 2024-05-21T01:20:05.620 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-05-21T01:20:05.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.613+0000 7f46ff200640 1 -- 172.21.15.63:0/2174711743 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f46d406f400 msgr2=0x7f46d40718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:05.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.613+0000 7f46ff200640 1 --2- 172.21.15.63:0/2174711743 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f46d406f400 0x7f46d40718c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f46e8000f70 tx=0x7f46e8007e90 comp rx=0 tx=0).stop 2024-05-21T01:20:05.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.613+0000 7f46ff200640 1 -- 172.21.15.63:0/2174711743 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f46f8156450 msgr2=0x7f46f8154b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:05.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.613+0000 7f46ff200640 1 --2- 172.21.15.63:0/2174711743 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f46f8156450 0x7f46f8154b10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f46f00af040 tx=0x7f46f00197d0 comp rx=0 tx=0).stop 2024-05-21T01:20:05.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.613+0000 7f46ff200640 1 -- 172.21.15.63:0/2174711743 shutdown_connections 2024-05-21T01:20:05.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.613+0000 7f46ff200640 1 --2- 172.21.15.63:0/2174711743 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f46d406f400 0x7f46d40718c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:05.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.613+0000 7f46ff200640 1 --2- 172.21.15.63:0/2174711743 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f46f8156450 0x7f46f8154b10 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:05.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.613+0000 7f46ff200640 1 --2- 172.21.15.63:0/2174711743 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f46f8156070 0x7f46f81459b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:05.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.613+0000 7f46ff200640 1 --2- 172.21.15.63:0/2174711743 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46f806f080 0x7f46f81f5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:05.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.613+0000 7f46ff200640 1 -- 172.21.15.63:0/2174711743 >> 172.21.15.63:0/2174711743 conn(0x7f46f80735f0 msgr2=0x7f46f8071640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:05.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.613+0000 7f46ff200640 1 -- 172.21.15.63:0/2174711743 shutdown_connections 2024-05-21T01:20:05.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.613+0000 7f46ff200640 1 -- 172.21.15.63:0/2174711743 wait complete. 2024-05-21T01:20:05.641 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-21T01:20:05.641 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-05-21T01:20:05.641 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-21T01:20:05.678 INFO:tasks.ceph.mds.c.smithi063.stderr:2024-05-21T01:20:05.673+0000 7f1e92c00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-21T01:20:05.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.781+0000 7f84f5e00640 1 Processor -- start 2024-05-21T01:20:05.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.781+0000 7f84f5e00640 1 -- start start 2024-05-21T01:20:05.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.781+0000 7f84f5e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f84f006f5d0 0x7f84f00c8a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:05.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.781+0000 7f84f5e00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84f0072550 con 0x7f84f006f9b0 2024-05-21T01:20:05.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.781+0000 7f84f5e00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84f0159100 con 0x7f84f015ce40 2024-05-21T01:20:05.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.781+0000 7f84f5e00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f84f01593e0 con 0x7f84f006f5d0 2024-05-21T01:20:05.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.781+0000 7f84e7e00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f84f006f9b0 0x7f84f0152a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:52518/0 (socket says 172.21.15.63:52518) 2024-05-21T01:20:05.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.781+0000 7f84e7e00640 1 -- 172.21.15.63:0/443805872 learned_addr learned my addr 172.21.15.63:0/443805872 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-05-21T01:20:05.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.781+0000 7f84eea00640 1 --2- 172.21.15.63:0/443805872 >> v2:172.21.15.131:3300/0 conn(0x7f84f006f5d0 0x7f84f00c8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:05.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.785+0000 7f84ee000640 1 -- 172.21.15.63:0/443805872 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3293441141 0 0) 0x7f84f0072550 con 0x7f84f006f9b0 2024-05-21T01:20:05.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.785+0000 7f84ee000640 1 -- 172.21.15.63:0/443805872 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f84d4003530 con 0x7f84f006f9b0 2024-05-21T01:20:05.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.785+0000 7f84eea00640 1 -- 172.21.15.63:0/443805872 >> v1:172.21.15.131:6789/0 conn(0x7f84f015ce40 legacy=0x7f84f0072d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:05.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.785+0000 7f84eea00640 1 -- 172.21.15.63:0/443805872 >> v1:172.21.15.63:6789/0 conn(0x7f84f006f9b0 legacy=0x7f84f0152a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:05.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.785+0000 7f84eea00640 1 -- 172.21.15.63:0/443805872 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84f01596c0 con 0x7f84f006f5d0 2024-05-21T01:20:05.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.785+0000 7f84eea00640 1 --2- 172.21.15.63:0/443805872 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f84f006f5d0 0x7f84f00c8a20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f84e00097c0 tx=0x7f84e001c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=90a17a6c705548d server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:05.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.785+0000 7f84ee000640 1 -- 172.21.15.63:0/443805872 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84e00b0070 con 0x7f84f006f5d0 2024-05-21T01:20:05.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.785+0000 7f84ee000640 1 -- 172.21.15.63:0/443805872 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84e00ab600 con 0x7f84f006f5d0 2024-05-21T01:20:05.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.785+0000 7f84ee000640 1 -- 172.21.15.63:0/443805872 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84e00ab9b0 con 0x7f84f006f5d0 2024-05-21T01:20:05.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.789+0000 7f84f5e00640 1 -- 172.21.15.63:0/443805872 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f84f006f5d0 msgr2=0x7f84f00c8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:05.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.789+0000 7f84f5e00640 1 --2- 172.21.15.63:0/443805872 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f84f006f5d0 0x7f84f00c8a20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f84e00097c0 tx=0x7f84e001c4a0 comp rx=0 tx=0).stop 2024-05-21T01:20:05.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.789+0000 7f84f5e00640 1 -- 172.21.15.63:0/443805872 shutdown_connections 2024-05-21T01:20:05.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.789+0000 7f84f5e00640 1 --2- 172.21.15.63:0/443805872 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f84f006f5d0 0x7f84f00c8a20 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:05.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.789+0000 7f84f5e00640 1 -- 172.21.15.63:0/443805872 >> 172.21.15.63:0/443805872 conn(0x7f84f0068460 msgr2=0x7f84f0068870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:05.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.789+0000 7f84f5e00640 1 -- 172.21.15.63:0/443805872 shutdown_connections 2024-05-21T01:20:05.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.789+0000 7f84f5e00640 1 -- 172.21.15.63:0/443805872 wait complete. 2024-05-21T01:20:05.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.789+0000 7f84f5e00640 1 Processor -- start 2024-05-21T01:20:05.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.789+0000 7f84f5e00640 1 -- start start 2024-05-21T01:20:05.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.789+0000 7f84f5e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f84f006f5d0 0x7f84f01ed450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:05.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.789+0000 7f84f5e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f84f006f9b0 0x7f84f01670b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:05.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.789+0000 7f84f5e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f84f015ce40 0x7f84f013e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:05.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.789+0000 7f84f5e00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f84f01532d0 con 0x7f84f006f5d0 2024-05-21T01:20:05.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.789+0000 7f84f5e00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f84f0153150 con 0x7f84f015ce40 2024-05-21T01:20:05.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.789+0000 7f84f5e00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f84f00cdb80 con 0x7f84f006f9b0 2024-05-21T01:20:05.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.789+0000 7f84eea00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f84f006f5d0 0x7f84f01ed450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:05.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.789+0000 7f84eea00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f84f006f5d0 0x7f84f01ed450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:46504/0 (socket says 172.21.15.63:46504) 2024-05-21T01:20:05.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.789+0000 7f84eea00640 1 -- 172.21.15.63:0/1962794603 learned_addr learned my addr 172.21.15.63:0/1962794603 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:05.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.789+0000 7f84e7e00640 1 --2- 172.21.15.63:0/1962794603 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f84f006f9b0 0x7f84f01670b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:05.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.789+0000 7f84ef400640 1 --2- 172.21.15.63:0/1962794603 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f84f015ce40 0x7f84f013e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:05.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.789+0000 7f84eea00640 1 -- 172.21.15.63:0/1962794603 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f84f006f9b0 msgr2=0x7f84f01670b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:05.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.789+0000 7f84eea00640 1 --2- 172.21.15.63:0/1962794603 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f84f006f9b0 0x7f84f01670b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:05.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.789+0000 7f84eea00640 1 -- 172.21.15.63:0/1962794603 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f84f015ce40 msgr2=0x7f84f013e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:05.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.789+0000 7f84eea00640 1 --2- 172.21.15.63:0/1962794603 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f84f015ce40 0x7f84f013e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:05.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.789+0000 7f84eea00640 1 -- 172.21.15.63:0/1962794603 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84f0148c40 con 0x7f84f006f5d0 2024-05-21T01:20:05.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.793+0000 7f84eea00640 1 --2- 172.21.15.63:0/1962794603 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f84f006f5d0 0x7f84f01ed450 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f84e00190b0 tx=0x7f84e001ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:05.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.793+0000 7f84e7400640 1 -- 172.21.15.63:0/1962794603 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84e00b0070 con 0x7f84f006f5d0 2024-05-21T01:20:05.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.793+0000 7f84e7400640 1 -- 172.21.15.63:0/1962794603 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84e00b1040 con 0x7f84f006f5d0 2024-05-21T01:20:05.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.793+0000 7f84e7400640 1 -- 172.21.15.63:0/1962794603 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84e00abdc0 con 0x7f84f006f5d0 2024-05-21T01:20:05.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.793+0000 7f84f5e00640 1 -- 172.21.15.63:0/1962794603 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84f01665d0 con 0x7f84f006f5d0 2024-05-21T01:20:05.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.793+0000 7f84f5e00640 1 -- 172.21.15.63:0/1962794603 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84f0166b90 con 0x7f84f006f5d0 2024-05-21T01:20:05.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.793+0000 7f84f5e00640 1 -- 172.21.15.63:0/1962794603 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84f00507f0 con 0x7f84f006f5d0 2024-05-21T01:20:05.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.793+0000 7f84e7400640 1 -- 172.21.15.63:0/1962794603 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7f84e00bc060 con 0x7f84f006f5d0 2024-05-21T01:20:05.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.793+0000 7f84e7400640 1 --2- 172.21.15.63:0/1962794603 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f84cc06f430 0x7f84cc0718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:05.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.797+0000 7f84e7400640 1 -- 172.21.15.63:0/1962794603 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f84e01287e0 con 0x7f84f006f5d0 2024-05-21T01:20:05.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.797+0000 7f84e7e00640 1 --2- 172.21.15.63:0/1962794603 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f84cc06f430 0x7f84cc0718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:05.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.797+0000 7f84e7e00640 1 --2- 172.21.15.63:0/1962794603 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f84cc06f430 0x7f84cc0718f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f84f00688b0 tx=0x7f84d8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:05.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:05.801+0000 7f84e7400640 1 -- 172.21.15.63:0/1962794603 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f84e0016090 con 0x7f84f006f5d0 2024-05-21T01:20:06.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:06.001+0000 7f84f5e00640 1 -- 172.21.15.63:0/1962794603 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f84f0145040 con 0x7f84f006f5d0 2024-05-21T01:20:06.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:06.001+0000 7f84e7400640 1 -- 172.21.15.63:0/1962794603 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+88 (secure 0 0 0) 0x7f84e00f54b0 con 0x7f84f006f5d0 2024-05-21T01:20:06.007 INFO:teuthology.orchestra.run.smithi063.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-05-21T01:20:06.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:06.005+0000 7f84f5e00640 1 -- 172.21.15.63:0/1962794603 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f84cc06f430 msgr2=0x7f84cc0718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:06.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:06.005+0000 7f84f5e00640 1 --2- 172.21.15.63:0/1962794603 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f84cc06f430 0x7f84cc0718f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f84f00688b0 tx=0x7f84d8009040 comp rx=0 tx=0).stop 2024-05-21T01:20:06.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:06.005+0000 7f84f5e00640 1 -- 172.21.15.63:0/1962794603 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f84f006f5d0 msgr2=0x7f84f01ed450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:06.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:06.005+0000 7f84f5e00640 1 --2- 172.21.15.63:0/1962794603 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f84f006f5d0 0x7f84f01ed450 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f84e00190b0 tx=0x7f84e001ace0 comp rx=0 tx=0).stop 2024-05-21T01:20:06.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:06.005+0000 7f84f5e00640 1 -- 172.21.15.63:0/1962794603 shutdown_connections 2024-05-21T01:20:06.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:06.005+0000 7f84f5e00640 1 --2- 172.21.15.63:0/1962794603 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f84cc06f430 0x7f84cc0718f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:06.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:06.005+0000 7f84f5e00640 1 --2- 172.21.15.63:0/1962794603 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f84f015ce40 0x7f84f013e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:06.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:06.005+0000 7f84f5e00640 1 --2- 172.21.15.63:0/1962794603 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f84f006f9b0 0x7f84f01670b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:06.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:06.005+0000 7f84f5e00640 1 --2- 172.21.15.63:0/1962794603 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f84f006f5d0 0x7f84f01ed450 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:06.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:06.005+0000 7f84f5e00640 1 -- 172.21.15.63:0/1962794603 >> 172.21.15.63:0/1962794603 conn(0x7f84f0068460 msgr2=0x7f84f0157900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:06.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:06.005+0000 7f84f5e00640 1 -- 172.21.15.63:0/1962794603 shutdown_connections 2024-05-21T01:20:06.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:06.005+0000 7f84f5e00640 1 -- 172.21.15.63:0/1962794603 wait complete. 2024-05-21T01:20:06.028 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-21T01:20:06.028 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-21T01:20:06.028 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi063.front.sepia.ceph.com 2024-05-21T01:20:06.028 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-05-21T01:20:06.028 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-05-21T01:20:06.028 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-21T01:20:06.028 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-21T01:20:06.028 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-21T01:20:06.028 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-05-21T01:20:06.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-21T01:20:06.029 DEBUG:teuthology.orchestra.run.smithi063:> ip addr 2024-05-21T01:20:06.080 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-21T01:20:06.080 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-21T01:20:06.080 INFO:teuthology.orchestra.run.smithi063.stdout: inet 127.0.0.1/8 scope host lo 2024-05-21T01:20:06.080 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-05-21T01:20:06.080 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 ::1/128 scope host 2024-05-21T01:20:06.080 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-05-21T01:20:06.080 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-21T01:20:06.080 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2024-05-21T01:20:06.080 INFO:teuthology.orchestra.run.smithi063.stdout: altname enp7s0f0 2024-05-21T01:20:06.080 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-21T01:20:06.081 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2024-05-21T01:20:06.081 INFO:teuthology.orchestra.run.smithi063.stdout: altname enp7s0f1 2024-05-21T01:20:06.081 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-21T01:20:06.081 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2024-05-21T01:20:06.081 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-21T01:20:06.081 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2024-05-21T01:20:06.081 INFO:teuthology.orchestra.run.smithi063.stdout: inet 172.21.15.63/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-21T01:20:06.081 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft 42458sec preferred_lft 42458sec 2024-05-21T01:20:06.081 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::ec4:7aff:feb6:f8d7/64 scope link 2024-05-21T01:20:06.081 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-05-21T01:20:06.081 INFO:teuthology.orchestra.run.smithi063.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-05-21T01:20:06.081 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 02:42:43:63:2c:d7 brd ff:ff:ff:ff:ff:ff 2024-05-21T01:20:06.081 INFO:teuthology.orchestra.run.smithi063.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-05-21T01:20:06.081 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-05-21T01:20:06.083 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-21T01:20:06.083 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-21T01:20:06.083 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2024-05-21T01:20:06.083 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link add name ceph-brx type bridge 2024-05-21T01:20:06.083 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip addr flush dev ceph-brx 2024-05-21T01:20:06.083 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link set ceph-brx up 2024-05-21T01:20:06.083 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-21T01:20:06.083 DEBUG:teuthology.orchestra.run.smithi063:> ') 2024-05-21T01:20:06.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-21T01:20:06.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-21T01:20:06.238 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-21T01:20:06.239 DEBUG:teuthology.orchestra.run.smithi063:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-21T01:20:06.257 INFO:teuthology.orchestra.run.smithi063.stdout:1 2024-05-21T01:20:06.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-21T01:20:06.259 DEBUG:teuthology.orchestra.run.smithi063:> route 2024-05-21T01:20:06.334 INFO:teuthology.orchestra.run.smithi063.stdout:Kernel IP routing table 2024-05-21T01:20:06.334 INFO:teuthology.orchestra.run.smithi063.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-21T01:20:06.334 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-05-21T01:20:06.334 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-21T01:20:06.334 INFO:teuthology.orchestra.run.smithi063.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-05-21T01:20:06.334 INFO:teuthology.orchestra.run.smithi063.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-05-21T01:20:06.334 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-21T01:20:06.334 INFO:teuthology.orchestra.run.smithi063.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-21T01:20:06.334 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-21T01:20:06.334 INFO:teuthology.orchestra.run.smithi063.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-21T01:20:06.335 INFO:teuthology.orchestra.run.smithi063.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-21T01:20:06.335 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-21T01:20:06.335 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2024-05-21T01:20:06.335 DEBUG:teuthology.orchestra.run.smithi063:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-21T01:20:06.335 DEBUG:teuthology.orchestra.run.smithi063:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-21T01:20:06.335 DEBUG:teuthology.orchestra.run.smithi063:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-21T01:20:06.335 DEBUG:teuthology.orchestra.run.smithi063:> ') 2024-05-21T01:20:06.422 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-21T01:20:06.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-21T01:20:06.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-21T01:20:06.472 DEBUG:teuthology.orchestra.run.smithi063:> ip netns list 2024-05-21T01:20:06.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-21T01:20:06.482 DEBUG:teuthology.orchestra.run.smithi063:> ip netns list-id 2024-05-21T01:20:06.537 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-21T01:20:06.537 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2024-05-21T01:20:06.537 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-21T01:20:06.537 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-05-21T01:20:06.537 DEBUG:teuthology.orchestra.run.smithi063:> ') 2024-05-21T01:20:06.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-21T01:20:06.664 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-21T01:20:06.671 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-05-21T01:20:06.671 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-21T01:20:06.671 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2024-05-21T01:20:06.671 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-05-21T01:20:06.671 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-21T01:20:06.671 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-05-21T01:20:06.671 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-05-21T01:20:06.671 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-05-21T01:20:06.672 DEBUG:teuthology.orchestra.run.smithi063:> ') 2024-05-21T01:20:06.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-21T01:20:06.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-21T01:20:06.845 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-21T01:20:06.845 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2024-05-21T01:20:06.845 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link set brx.0 up 2024-05-21T01:20:06.845 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link set dev brx.0 master ceph-brx 2024-05-21T01:20:06.845 DEBUG:teuthology.orchestra.run.smithi063:> ') 2024-05-21T01:20:06.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-21T01:20:06.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-21T01:20:06.977 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-05-21T01:20:06.978 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-21T01:20:06.978 DEBUG:teuthology.orchestra.run.smithi063:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-05-21T01:20:07.028 INFO:teuthology.orchestra.run.smithi063.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-05-21T01:20:07.028 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-21T01:20:07.028 DEBUG:teuthology.orchestra.run.smithi063:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-05-21T01:20:07.079 DEBUG:teuthology.orchestra.run.smithi063:> sudo modprobe fuse 2024-05-21T01:20:07.140 DEBUG:teuthology.orchestra.run.smithi063:> cat /proc/self/mounts | awk '{print $2}' 2024-05-21T01:20:07.193 INFO:teuthology.orchestra.run.smithi063.stdout:/sys 2024-05-21T01:20:07.194 INFO:teuthology.orchestra.run.smithi063.stdout:/proc 2024-05-21T01:20:07.194 INFO:teuthology.orchestra.run.smithi063.stdout:/dev 2024-05-21T01:20:07.194 INFO:teuthology.orchestra.run.smithi063.stdout:/dev/pts 2024-05-21T01:20:07.194 INFO:teuthology.orchestra.run.smithi063.stdout:/run 2024-05-21T01:20:07.194 INFO:teuthology.orchestra.run.smithi063.stdout:/ 2024-05-21T01:20:07.194 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/kernel/security 2024-05-21T01:20:07.194 INFO:teuthology.orchestra.run.smithi063.stdout:/dev/shm 2024-05-21T01:20:07.194 INFO:teuthology.orchestra.run.smithi063.stdout:/run/lock 2024-05-21T01:20:07.194 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/fs/cgroup 2024-05-21T01:20:07.194 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/fs/pstore 2024-05-21T01:20:07.195 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/fs/bpf 2024-05-21T01:20:07.195 INFO:teuthology.orchestra.run.smithi063.stdout:/proc/sys/fs/binfmt_misc 2024-05-21T01:20:07.195 INFO:teuthology.orchestra.run.smithi063.stdout:/dev/hugepages 2024-05-21T01:20:07.195 INFO:teuthology.orchestra.run.smithi063.stdout:/dev/mqueue 2024-05-21T01:20:07.195 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/kernel/debug 2024-05-21T01:20:07.195 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/kernel/tracing 2024-05-21T01:20:07.195 INFO:teuthology.orchestra.run.smithi063.stdout:/proc/fs/nfsd 2024-05-21T01:20:07.195 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/fs/fuse/connections 2024-05-21T01:20:07.195 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/kernel/config 2024-05-21T01:20:07.195 INFO:teuthology.orchestra.run.smithi063.stdout:/run/credentials/systemd-sysusers.service 2024-05-21T01:20:07.195 INFO:teuthology.orchestra.run.smithi063.stdout:/run/rpc_pipefs 2024-05-21T01:20:07.195 INFO:teuthology.orchestra.run.smithi063.stdout:/run/user/1000 2024-05-21T01:20:07.195 INFO:teuthology.orchestra.run.smithi063.stdout:/var/lib/ceph 2024-05-21T01:20:07.196 INFO:teuthology.orchestra.run.smithi063.stdout:/var/lib/ceph/osd/ceph-0 2024-05-21T01:20:07.196 INFO:teuthology.orchestra.run.smithi063.stdout:/var/lib/ceph/osd/ceph-1 2024-05-21T01:20:07.196 INFO:teuthology.orchestra.run.smithi063.stdout:/var/lib/ceph/osd/ceph-2 2024-05-21T01:20:07.196 INFO:teuthology.orchestra.run.smithi063.stdout:/var/lib/ceph/osd/ceph-3 2024-05-21T01:20:07.196 INFO:teuthology.orchestra.run.smithi063.stdout:/run/netns 2024-05-21T01:20:07.196 INFO:teuthology.orchestra.run.smithi063.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-21T01:20:07.196 INFO:teuthology.orchestra.run.smithi063.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-21T01:20:07.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-21T01:20:07.197 DEBUG:teuthology.orchestra.run.smithi063:> ls /sys/fs/fuse/connections 2024-05-21T01:20:07.249 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-21T01:20:07.249 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-05-21T01:20:07.294 DEBUG:teuthology.orchestra.run.smithi063:> sudo modprobe fuse 2024-05-21T01:20:07.315 DEBUG:teuthology.orchestra.run.smithi063:> cat /proc/self/mounts | awk '{print $2}' 2024-05-21T01:20:07.370 INFO:teuthology.orchestra.run.smithi063.stdout:/sys 2024-05-21T01:20:07.370 INFO:teuthology.orchestra.run.smithi063.stdout:/proc 2024-05-21T01:20:07.370 INFO:teuthology.orchestra.run.smithi063.stdout:/dev 2024-05-21T01:20:07.371 INFO:teuthology.orchestra.run.smithi063.stdout:/dev/pts 2024-05-21T01:20:07.371 INFO:teuthology.orchestra.run.smithi063.stdout:/run 2024-05-21T01:20:07.371 INFO:teuthology.orchestra.run.smithi063.stdout:/ 2024-05-21T01:20:07.371 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/kernel/security 2024-05-21T01:20:07.371 INFO:teuthology.orchestra.run.smithi063.stdout:/dev/shm 2024-05-21T01:20:07.371 INFO:teuthology.orchestra.run.smithi063.stdout:/run/lock 2024-05-21T01:20:07.371 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/fs/cgroup 2024-05-21T01:20:07.371 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/fs/pstore 2024-05-21T01:20:07.371 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/fs/bpf 2024-05-21T01:20:07.371 INFO:teuthology.orchestra.run.smithi063.stdout:/proc/sys/fs/binfmt_misc 2024-05-21T01:20:07.371 INFO:teuthology.orchestra.run.smithi063.stdout:/dev/hugepages 2024-05-21T01:20:07.371 INFO:teuthology.orchestra.run.smithi063.stdout:/dev/mqueue 2024-05-21T01:20:07.371 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/kernel/debug 2024-05-21T01:20:07.372 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/kernel/tracing 2024-05-21T01:20:07.372 INFO:teuthology.orchestra.run.smithi063.stdout:/proc/fs/nfsd 2024-05-21T01:20:07.372 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/fs/fuse/connections 2024-05-21T01:20:07.372 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/kernel/config 2024-05-21T01:20:07.372 INFO:teuthology.orchestra.run.smithi063.stdout:/run/credentials/systemd-sysusers.service 2024-05-21T01:20:07.372 INFO:teuthology.orchestra.run.smithi063.stdout:/run/rpc_pipefs 2024-05-21T01:20:07.372 INFO:teuthology.orchestra.run.smithi063.stdout:/run/user/1000 2024-05-21T01:20:07.372 INFO:teuthology.orchestra.run.smithi063.stdout:/var/lib/ceph 2024-05-21T01:20:07.372 INFO:teuthology.orchestra.run.smithi063.stdout:/var/lib/ceph/osd/ceph-0 2024-05-21T01:20:07.372 INFO:teuthology.orchestra.run.smithi063.stdout:/var/lib/ceph/osd/ceph-1 2024-05-21T01:20:07.372 INFO:teuthology.orchestra.run.smithi063.stdout:/var/lib/ceph/osd/ceph-2 2024-05-21T01:20:07.372 INFO:teuthology.orchestra.run.smithi063.stdout:/var/lib/ceph/osd/ceph-3 2024-05-21T01:20:07.372 INFO:teuthology.orchestra.run.smithi063.stdout:/run/netns 2024-05-21T01:20:07.372 INFO:teuthology.orchestra.run.smithi063.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-21T01:20:07.373 INFO:teuthology.orchestra.run.smithi063.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-21T01:20:07.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-21T01:20:07.374 DEBUG:teuthology.orchestra.run.smithi063:> ls /sys/fs/fuse/connections 2024-05-21T01:20:07.393 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi063.stderr:2024-05-21T01:20:07.389+0000 7f11a73fc580 -1 init, newargv = 0x55c96a866b20 newargc=15 2024-05-21T01:20:07.393 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi063.stderr:ceph-fuse[32124]: starting ceph client 2024-05-21T01:20:07.606 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi063.stderr:ceph-fuse[32124]: starting fuse 2024-05-21T01:20:08.504 DEBUG:teuthology.orchestra.run.smithi063:> sudo modprobe fuse 2024-05-21T01:20:08.529 DEBUG:teuthology.orchestra.run.smithi063:> cat /proc/self/mounts | awk '{print $2}' 2024-05-21T01:20:08.582 INFO:teuthology.orchestra.run.smithi063.stdout:/sys 2024-05-21T01:20:08.583 INFO:teuthology.orchestra.run.smithi063.stdout:/proc 2024-05-21T01:20:08.583 INFO:teuthology.orchestra.run.smithi063.stdout:/dev 2024-05-21T01:20:08.583 INFO:teuthology.orchestra.run.smithi063.stdout:/dev/pts 2024-05-21T01:20:08.583 INFO:teuthology.orchestra.run.smithi063.stdout:/run 2024-05-21T01:20:08.583 INFO:teuthology.orchestra.run.smithi063.stdout:/ 2024-05-21T01:20:08.583 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/kernel/security 2024-05-21T01:20:08.583 INFO:teuthology.orchestra.run.smithi063.stdout:/dev/shm 2024-05-21T01:20:08.583 INFO:teuthology.orchestra.run.smithi063.stdout:/run/lock 2024-05-21T01:20:08.584 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/fs/cgroup 2024-05-21T01:20:08.584 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/fs/pstore 2024-05-21T01:20:08.584 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/fs/bpf 2024-05-21T01:20:08.584 INFO:teuthology.orchestra.run.smithi063.stdout:/proc/sys/fs/binfmt_misc 2024-05-21T01:20:08.584 INFO:teuthology.orchestra.run.smithi063.stdout:/dev/hugepages 2024-05-21T01:20:08.584 INFO:teuthology.orchestra.run.smithi063.stdout:/dev/mqueue 2024-05-21T01:20:08.585 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/kernel/debug 2024-05-21T01:20:08.585 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/kernel/tracing 2024-05-21T01:20:08.585 INFO:teuthology.orchestra.run.smithi063.stdout:/proc/fs/nfsd 2024-05-21T01:20:08.585 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/fs/fuse/connections 2024-05-21T01:20:08.585 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/kernel/config 2024-05-21T01:20:08.585 INFO:teuthology.orchestra.run.smithi063.stdout:/run/credentials/systemd-sysusers.service 2024-05-21T01:20:08.585 INFO:teuthology.orchestra.run.smithi063.stdout:/run/rpc_pipefs 2024-05-21T01:20:08.585 INFO:teuthology.orchestra.run.smithi063.stdout:/run/user/1000 2024-05-21T01:20:08.585 INFO:teuthology.orchestra.run.smithi063.stdout:/var/lib/ceph 2024-05-21T01:20:08.585 INFO:teuthology.orchestra.run.smithi063.stdout:/var/lib/ceph/osd/ceph-0 2024-05-21T01:20:08.585 INFO:teuthology.orchestra.run.smithi063.stdout:/var/lib/ceph/osd/ceph-1 2024-05-21T01:20:08.585 INFO:teuthology.orchestra.run.smithi063.stdout:/var/lib/ceph/osd/ceph-2 2024-05-21T01:20:08.585 INFO:teuthology.orchestra.run.smithi063.stdout:/var/lib/ceph/osd/ceph-3 2024-05-21T01:20:08.585 INFO:teuthology.orchestra.run.smithi063.stdout:/run/netns 2024-05-21T01:20:08.585 INFO:teuthology.orchestra.run.smithi063.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-21T01:20:08.586 INFO:teuthology.orchestra.run.smithi063.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-21T01:20:08.586 INFO:teuthology.orchestra.run.smithi063.stdout:/home/ubuntu/cephtest/mnt.admin 2024-05-21T01:20:08.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-21T01:20:08.587 DEBUG:teuthology.orchestra.run.smithi063:> ls /sys/fs/fuse/connections 2024-05-21T01:20:08.637 INFO:teuthology.orchestra.run.smithi063.stdout:44 2024-05-21T01:20:08.637 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-05-21T01:20:08.637 DEBUG:teuthology.orchestra.run.smithi063:> sudo stdin-killer -- python3 -c ' 2024-05-21T01:20:08.637 DEBUG:teuthology.orchestra.run.smithi063:> import glob 2024-05-21T01:20:08.637 DEBUG:teuthology.orchestra.run.smithi063:> import re 2024-05-21T01:20:08.638 DEBUG:teuthology.orchestra.run.smithi063:> import os 2024-05-21T01:20:08.638 DEBUG:teuthology.orchestra.run.smithi063:> import subprocess 2024-05-21T01:20:08.638 DEBUG:teuthology.orchestra.run.smithi063:> 2024-05-21T01:20:08.638 DEBUG:teuthology.orchestra.run.smithi063:> def _find_admin_socket(client_name): 2024-05-21T01:20:08.638 DEBUG:teuthology.orchestra.run.smithi063:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-05-21T01:20:08.638 DEBUG:teuthology.orchestra.run.smithi063:> files = glob.glob(asok_path) 2024-05-21T01:20:08.638 DEBUG:teuthology.orchestra.run.smithi063:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-05-21T01:20:08.638 DEBUG:teuthology.orchestra.run.smithi063:> 2024-05-21T01:20:08.638 DEBUG:teuthology.orchestra.run.smithi063:> # Given a non-glob path, it better be there 2024-05-21T01:20:08.638 DEBUG:teuthology.orchestra.run.smithi063:> if "*" not in asok_path: 2024-05-21T01:20:08.638 DEBUG:teuthology.orchestra.run.smithi063:> assert(len(files) == 1) 2024-05-21T01:20:08.638 DEBUG:teuthology.orchestra.run.smithi063:> return files[0] 2024-05-21T01:20:08.638 DEBUG:teuthology.orchestra.run.smithi063:> 2024-05-21T01:20:08.638 DEBUG:teuthology.orchestra.run.smithi063:> for f in files: 2024-05-21T01:20:08.639 DEBUG:teuthology.orchestra.run.smithi063:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-21T01:20:08.639 DEBUG:teuthology.orchestra.run.smithi063:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-21T01:20:08.639 DEBUG:teuthology.orchestra.run.smithi063:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-21T01:20:08.639 DEBUG:teuthology.orchestra.run.smithi063:> contents = proc_f.read() 2024-05-21T01:20:08.639 DEBUG:teuthology.orchestra.run.smithi063:> if mountpoint in contents: 2024-05-21T01:20:08.639 DEBUG:teuthology.orchestra.run.smithi063:> return f 2024-05-21T01:20:08.639 DEBUG:teuthology.orchestra.run.smithi063:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-21T01:20:08.639 DEBUG:teuthology.orchestra.run.smithi063:> 2024-05-21T01:20:08.639 DEBUG:teuthology.orchestra.run.smithi063:> print(_find_admin_socket("client.admin")) 2024-05-21T01:20:08.639 DEBUG:teuthology.orchestra.run.smithi063:> ' 2024-05-21T01:20:08.774 INFO:teuthology.orchestra.run.smithi063.stdout:/var/run/ceph/ceph-client.admin.32124.asok 2024-05-21T01:20:08.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-21T01:20:08.786 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.32124.asok 2024-05-21T01:20:08.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-21T01:20:08.787 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.32124.asok status 2024-05-21T01:20:08.967 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-05-21T01:20:08.967 INFO:teuthology.orchestra.run.smithi063.stdout: "metadata": { 2024-05-21T01:20:08.967 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph_sha1": "0051ea03417a66dbfd5a17ea02c9049bcda16863", 2024-05-21T01:20:08.967 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph_version": "ceph version 19.0.0-3830-g0051ea03 (0051ea03417a66dbfd5a17ea02c9049bcda16863) squid (dev)", 2024-05-21T01:20:08.967 INFO:teuthology.orchestra.run.smithi063.stdout: "entity_id": "admin", 2024-05-21T01:20:08.968 INFO:teuthology.orchestra.run.smithi063.stdout: "hostname": "smithi063", 2024-05-21T01:20:08.968 INFO:teuthology.orchestra.run.smithi063.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-05-21T01:20:08.968 INFO:teuthology.orchestra.run.smithi063.stdout: "pid": "32124", 2024-05-21T01:20:08.968 INFO:teuthology.orchestra.run.smithi063.stdout: "root": "/" 2024-05-21T01:20:08.968 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-05-21T01:20:08.968 INFO:teuthology.orchestra.run.smithi063.stdout: "dentry_count": 0, 2024-05-21T01:20:08.968 INFO:teuthology.orchestra.run.smithi063.stdout: "dentry_pinned_count": 0, 2024-05-21T01:20:08.968 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 4392, 2024-05-21T01:20:08.968 INFO:teuthology.orchestra.run.smithi063.stdout: "inst": { 2024-05-21T01:20:08.968 INFO:teuthology.orchestra.run.smithi063.stdout: "name": { 2024-05-21T01:20:08.968 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "client", 2024-05-21T01:20:08.968 INFO:teuthology.orchestra.run.smithi063.stdout: "num": 4392 2024-05-21T01:20:08.968 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-05-21T01:20:08.968 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": { 2024-05-21T01:20:08.968 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-05-21T01:20:08.969 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "192.168.0.1:0", 2024-05-21T01:20:08.969 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 433968862 2024-05-21T01:20:08.969 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-05-21T01:20:08.969 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-05-21T01:20:08.969 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": { 2024-05-21T01:20:08.969 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2024-05-21T01:20:08.969 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "192.168.0.1:0", 2024-05-21T01:20:08.969 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 433968862 2024-05-21T01:20:08.969 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-05-21T01:20:08.969 INFO:teuthology.orchestra.run.smithi063.stdout: "inst_str": "client.4392 192.168.0.1:0/433968862", 2024-05-21T01:20:08.969 INFO:teuthology.orchestra.run.smithi063.stdout: "addr_str": "192.168.0.1:0/433968862", 2024-05-21T01:20:08.969 INFO:teuthology.orchestra.run.smithi063.stdout: "inode_count": 1, 2024-05-21T01:20:08.969 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_epoch": 6, 2024-05-21T01:20:08.969 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_epoch": 25, 2024-05-21T01:20:08.969 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_epoch_barrier": 0, 2024-05-21T01:20:08.970 INFO:teuthology.orchestra.run.smithi063.stdout: "blocklisted": false, 2024-05-21T01:20:08.970 INFO:teuthology.orchestra.run.smithi063.stdout: "fs_name": "cephfs" 2024-05-21T01:20:08.970 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-05-21T01:20:08.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-21T01:20:08.982 DEBUG:teuthology.orchestra.run.smithi063:> stat --file-system '--printf=%T 2024-05-21T01:20:08.983 DEBUG:teuthology.orchestra.run.smithi063:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-05-21T01:20:08.992 INFO:teuthology.orchestra.run.smithi063.stdout:fuseblk 2024-05-21T01:20:08.992 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-05-21T01:20:08.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-21T01:20:08.992 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-05-21T01:20:09.056 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-05-21T01:20:09.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-21T01:20:09.574 INFO:teuthology.orchestra.run.smithi063.stdout:# file: . 2024-05-21T01:20:09.574 INFO:teuthology.orchestra.run.smithi063.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-05-21T01:20:09.574 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-05-21T01:20:09.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-21T01:20:09.582 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-05-21T01:20:09.582 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-21T01:20:09.591 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-21T01:20:09.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.773+0000 7fa853e00640 1 Processor -- start 2024-05-21T01:20:09.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.773+0000 7fa853e00640 1 -- start start 2024-05-21T01:20:09.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.773+0000 7fa853e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa854155e10 0x7fa85415c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:09.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.773+0000 7fa853e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa854074620 0x7fa8540738a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:09.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.773+0000 7fa853e00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa85415cbd0 con 0x7fa85415d130 2024-05-21T01:20:09.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.773+0000 7fa853e00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fa85406ded0 con 0x7fa854074620 2024-05-21T01:20:09.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.773+0000 7fa853e00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fa85406d650 con 0x7fa854155e10 2024-05-21T01:20:09.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.773+0000 7fa84be00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fa85415d130 0x7fa85415fbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:55840/0 (socket says 172.21.15.63:55840) 2024-05-21T01:20:09.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.773+0000 7fa84be00640 1 -- 172.21.15.63:0/3684527805 learned_addr learned my addr 172.21.15.63:0/3684527805 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-05-21T01:20:09.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.773+0000 7fa853400640 1 --2- 172.21.15.63:0/3684527805 >> v2:172.21.15.131:3300/0 conn(0x7fa854074620 0x7fa8540738a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:09.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.773+0000 7fa852a00640 1 --2- 172.21.15.63:0/3684527805 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa854155e10 0x7fa85415c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:09.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.773+0000 7fa852000640 1 -- 172.21.15.63:0/3684527805 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2639097110 0 0) 0x7fa85415cbd0 con 0x7fa85415d130 2024-05-21T01:20:09.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.773+0000 7fa852000640 1 -- 172.21.15.63:0/3684527805 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa838003530 con 0x7fa85415d130 2024-05-21T01:20:09.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.773+0000 7fa852000640 1 -- 172.21.15.63:0/3684527805 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1889769887 0 0) 0x7fa838003530 con 0x7fa85415d130 2024-05-21T01:20:09.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.773+0000 7fa852000640 1 -- 172.21.15.63:0/3684527805 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa854155e10 msgr2=0x7fa85415c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:09.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.773+0000 7fa852000640 1 --2- 172.21.15.63:0/3684527805 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa854155e10 0x7fa85415c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:09.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.773+0000 7fa852000640 1 -- 172.21.15.63:0/3684527805 >> v2:172.21.15.131:3300/0 conn(0x7fa854074620 msgr2=0x7fa8540738a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:09.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.773+0000 7fa852000640 1 --2- 172.21.15.63:0/3684527805 >> v2:172.21.15.131:3300/0 conn(0x7fa854074620 0x7fa8540738a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:09.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.773+0000 7fa852000640 1 -- 172.21.15.63:0/3684527805 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa85406d910 con 0x7fa85415d130 2024-05-21T01:20:09.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.773+0000 7fa852000640 1 -- 172.21.15.63:0/3684527805 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 466403955 0 0) 0x7fa83c001700 con 0x7fa85415d130 2024-05-21T01:20:09.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.773+0000 7fa852000640 1 -- 172.21.15.63:0/3684527805 >> v1:172.21.15.63:6789/0 conn(0x7fa85415d130 legacy=0x7fa85415fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:09.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.773+0000 7fa852000640 1 --2- 172.21.15.63:0/3684527805 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa838003a10 0x7fa838003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:09.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.773+0000 7fa852000640 1 --2- 172.21.15.63:0/3684527805 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa854155e10 0x7fa838004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:09.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.773+0000 7fa852000640 1 --2- 172.21.15.63:0/3684527805 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa838004d50 0x7fa8380051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:09.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.773+0000 7fa852000640 1 -- 172.21.15.63:0/3684527805 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fa85406ded0 con 0x7fa838003a10 2024-05-21T01:20:09.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.773+0000 7fa852000640 1 -- 172.21.15.63:0/3684527805 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa85406d650 con 0x7fa838004d50 2024-05-21T01:20:09.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.773+0000 7fa852000640 1 -- 172.21.15.63:0/3684527805 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fa83800b9d0 con 0x7fa854155e10 2024-05-21T01:20:09.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.773+0000 7fa853400640 1 --2- 172.21.15.63:0/3684527805 >> v2:172.21.15.131:3300/0 conn(0x7fa854074620 0x7fa8540738a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-21T01:20:09.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.773+0000 7fa852a00640 1 --2- 172.21.15.63:0/3684527805 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa838003a10 0x7fa838003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:09.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.773+0000 7fa84be00640 1 --2- 172.21.15.63:0/3684527805 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa854155e10 0x7fa838004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:09.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.777+0000 7fa852a00640 1 -- 172.21.15.63:0/3684527805 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa854155e10 msgr2=0x7fa838004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:09.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.777+0000 7fa852a00640 1 --2- 172.21.15.63:0/3684527805 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa854155e10 0x7fa838004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:09.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.777+0000 7fa852a00640 1 -- 172.21.15.63:0/3684527805 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa838004d50 msgr2=0x7fa8380051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:09.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.777+0000 7fa852a00640 1 --2- 172.21.15.63:0/3684527805 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa838004d50 0x7fa8380051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:09.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.777+0000 7fa852a00640 1 -- 172.21.15.63:0/3684527805 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa838003530 con 0x7fa838003a10 2024-05-21T01:20:09.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.777+0000 7fa84be00640 1 --2- 172.21.15.63:0/3684527805 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa854155e10 0x7fa838004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T01:20:09.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.777+0000 7fa852a00640 1 --2- 172.21.15.63:0/3684527805 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa838003a10 0x7fa838003e30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa844009ae0 tx=0x7fa84401ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b65dd3b0ba98eff server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:09.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.777+0000 7fa852000640 1 -- 172.21.15.63:0/3684527805 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8440096b0 con 0x7fa838003a10 2024-05-21T01:20:09.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.777+0000 7fa852000640 1 -- 172.21.15.63:0/3684527805 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8440a6450 con 0x7fa838003a10 2024-05-21T01:20:09.783 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.777+0000 7fa852000640 1 -- 172.21.15.63:0/3684527805 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8440a6840 con 0x7fa838003a10 2024-05-21T01:20:09.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.777+0000 7fa853e00640 1 -- 172.21.15.63:0/3684527805 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa838003a10 msgr2=0x7fa838003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:09.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.777+0000 7fa853e00640 1 --2- 172.21.15.63:0/3684527805 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa838003a10 0x7fa838003e30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa844009ae0 tx=0x7fa84401ca70 comp rx=0 tx=0).stop 2024-05-21T01:20:09.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.777+0000 7fa853400640 1 -- 172.21.15.63:0/3684527805 reap_dead start 2024-05-21T01:20:09.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.777+0000 7fa853e00640 1 -- 172.21.15.63:0/3684527805 shutdown_connections 2024-05-21T01:20:09.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.777+0000 7fa853e00640 1 -- 172.21.15.63:0/3684527805 >> 172.21.15.63:0/3684527805 conn(0x7fa85406caa0 msgr2=0x7fa854068290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:09.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.777+0000 7fa853e00640 1 -- 172.21.15.63:0/3684527805 shutdown_connections 2024-05-21T01:20:09.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.777+0000 7fa853e00640 1 -- 172.21.15.63:0/3684527805 wait complete. 2024-05-21T01:20:09.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.781+0000 7fa853e00640 1 Processor -- start 2024-05-21T01:20:09.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.781+0000 7fa853e00640 1 -- start start 2024-05-21T01:20:09.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.781+0000 7fa853e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa838003a10 0x7fa8540ca340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:09.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.781+0000 7fa853e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa8540c8060 0x7fa8541f8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:09.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.781+0000 7fa853e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8540c84a0 0x7fa8541f8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:09.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.781+0000 7fa853e00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fa854074170 con 0x7fa838003a10 2024-05-21T01:20:09.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.781+0000 7fa853e00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa854073ff0 con 0x7fa8540c84a0 2024-05-21T01:20:09.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.781+0000 7fa853e00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fa854166dd0 con 0x7fa8540c8060 2024-05-21T01:20:09.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.781+0000 7fa852a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa838003a10 0x7fa8540ca340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:09.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.781+0000 7fa852a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa838003a10 0x7fa8540ca340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:49404/0 (socket says 172.21.15.63:49404) 2024-05-21T01:20:09.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.781+0000 7fa852a00640 1 -- 172.21.15.63:0/1237027547 learned_addr learned my addr 172.21.15.63:0/1237027547 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:09.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.781+0000 7fa84be00640 1 --2- 172.21.15.63:0/1237027547 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa8540c8060 0x7fa8541f8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:09.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.781+0000 7fa853400640 1 --2- 172.21.15.63:0/1237027547 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8540c84a0 0x7fa8541f8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:09.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.781+0000 7fa852a00640 1 -- 172.21.15.63:0/1237027547 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa8540c8060 msgr2=0x7fa8541f8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:09.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.781+0000 7fa852a00640 1 --2- 172.21.15.63:0/1237027547 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa8540c8060 0x7fa8541f8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:09.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.781+0000 7fa852a00640 1 -- 172.21.15.63:0/1237027547 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8540c84a0 msgr2=0x7fa8541f8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:09.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.781+0000 7fa852a00640 1 --2- 172.21.15.63:0/1237027547 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8540c84a0 0x7fa8541f8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:09.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.781+0000 7fa852a00640 1 -- 172.21.15.63:0/1237027547 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa854162f70 con 0x7fa838003a10 2024-05-21T01:20:09.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.781+0000 7fa84be00640 1 --2- 172.21.15.63:0/1237027547 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa8540c8060 0x7fa8541f8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T01:20:09.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.781+0000 7fa852a00640 1 --2- 172.21.15.63:0/1237027547 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa838003a10 0x7fa8540ca340 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa84401c8a0 tx=0x7fa838005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:09.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.781+0000 7fa84aa00640 1 -- 172.21.15.63:0/1237027547 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8440be070 con 0x7fa838003a10 2024-05-21T01:20:09.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.781+0000 7fa84aa00640 1 -- 172.21.15.63:0/1237027547 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa84400f000 con 0x7fa838003a10 2024-05-21T01:20:09.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.781+0000 7fa84aa00640 1 -- 172.21.15.63:0/1237027547 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8440a7430 con 0x7fa838003a10 2024-05-21T01:20:09.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.781+0000 7fa853e00640 1 -- 172.21.15.63:0/1237027547 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8540ca880 con 0x7fa838003a10 2024-05-21T01:20:09.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.785+0000 7fa853e00640 1 -- 172.21.15.63:0/1237027547 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa854162920 con 0x7fa838003a10 2024-05-21T01:20:09.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.785+0000 7fa853e00640 1 -- 172.21.15.63:0/1237027547 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa85406c0c0 con 0x7fa838003a10 2024-05-21T01:20:09.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.785+0000 7fa84aa00640 1 -- 172.21.15.63:0/1237027547 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7fa8440c1070 con 0x7fa838003a10 2024-05-21T01:20:09.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.785+0000 7fa84aa00640 1 --2- 172.21.15.63:0/1237027547 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fa83006f430 0x7fa8300718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:09.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.785+0000 7fa84aa00640 1 -- 172.21.15.63:0/1237027547 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fa844128fe0 con 0x7fa838003a10 2024-05-21T01:20:09.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.785+0000 7fa84be00640 1 --2- 172.21.15.63:0/1237027547 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fa83006f430 0x7fa8300718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:09.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.789+0000 7fa84be00640 1 --2- 172.21.15.63:0/1237027547 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fa83006f430 0x7fa8300718f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa83c001000 tx=0x7fa83c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:09.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.789+0000 7fa84aa00640 1 -- 172.21.15.63:0/1237027547 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fa854162f70 con 0x7fa838003a10 2024-05-21T01:20:09.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.965+0000 7fa853e00640 1 -- 172.21.15.63:0/1237027547 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fa854074400 con 0x7fa838003a10 2024-05-21T01:20:09.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.965+0000 7fa84aa00640 1 -- 172.21.15.63:0/1237027547 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7fa8440ac020 con 0x7fa838003a10 2024-05-21T01:20:09.972 INFO:teuthology.orchestra.run.smithi063.stderr:listed 0 entries 2024-05-21T01:20:09.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.969+0000 7fa853e00640 1 -- 172.21.15.63:0/1237027547 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fa83006f430 msgr2=0x7fa8300718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:09.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.969+0000 7fa853e00640 1 --2- 172.21.15.63:0/1237027547 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fa83006f430 0x7fa8300718f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa83c001000 tx=0x7fa83c009040 comp rx=0 tx=0).stop 2024-05-21T01:20:09.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.969+0000 7fa853e00640 1 -- 172.21.15.63:0/1237027547 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa838003a10 msgr2=0x7fa8540ca340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:09.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.969+0000 7fa853e00640 1 --2- 172.21.15.63:0/1237027547 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa838003a10 0x7fa8540ca340 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa84401c8a0 tx=0x7fa838005840 comp rx=0 tx=0).stop 2024-05-21T01:20:09.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.969+0000 7fa853e00640 1 -- 172.21.15.63:0/1237027547 shutdown_connections 2024-05-21T01:20:09.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.969+0000 7fa853e00640 1 --2- 172.21.15.63:0/1237027547 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fa83006f430 0x7fa8300718f0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:09.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.969+0000 7fa853e00640 1 --2- 172.21.15.63:0/1237027547 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8540c84a0 0x7fa8541f8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:09.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.969+0000 7fa853e00640 1 --2- 172.21.15.63:0/1237027547 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa8540c8060 0x7fa8541f8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:09.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.969+0000 7fa853e00640 1 --2- 172.21.15.63:0/1237027547 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa838003a10 0x7fa8540ca340 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:09.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.969+0000 7fa853e00640 1 -- 172.21.15.63:0/1237027547 >> 172.21.15.63:0/1237027547 conn(0x7fa85406caa0 msgr2=0x7fa85415af90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:09.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.969+0000 7fa853e00640 1 -- 172.21.15.63:0/1237027547 shutdown_connections 2024-05-21T01:20:09.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:09.969+0000 7fa853e00640 1 -- 172.21.15.63:0/1237027547 wait complete. 2024-05-21T01:20:09.993 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-05-21T01:20:09.993 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-21T01:20:10.002 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-21T01:20:10.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:10.177+0000 7f4bb1400640 1 Processor -- start 2024-05-21T01:20:10.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:10.181+0000 7f4bb1400640 1 -- start start 2024-05-21T01:20:10.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:10.181+0000 7f4bb1400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f4bac155e10 0x7f4bac15c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:10.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:10.181+0000 7f4bb1400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4bac074620 0x7f4bac0738a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:10.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:10.181+0000 7f4bb1400640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4bac15cbd0 con 0x7f4bac15d130 2024-05-21T01:20:10.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:10.181+0000 7f4bb1400640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f4bac06ded0 con 0x7f4bac074620 2024-05-21T01:20:10.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:10.181+0000 7f4bb1400640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f4bac06d650 con 0x7f4bac155e10 2024-05-21T01:20:10.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:10.181+0000 7f4bb0a00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4bac074620 0x7f4bac0738a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:10.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:10.181+0000 7f4ba3400640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f4bac15d130 0x7f4bac15fbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:55852/0 (socket says 172.21.15.63:55852) 2024-05-21T01:20:10.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:10.181+0000 7f4ba3400640 1 -- 172.21.15.63:0/1501923207 learned_addr learned my addr 172.21.15.63:0/1501923207 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-05-21T01:20:10.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:10.181+0000 7f4babe00640 1 --2- 172.21.15.63:0/1501923207 >> v2:172.21.15.131:3300/0 conn(0x7f4bac155e10 0x7f4bac15c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:10.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:10.181+0000 7f4bb0a00640 1 -- 172.21.15.63:0/1501923207 >> v2:172.21.15.131:3300/0 conn(0x7f4bac155e10 msgr2=0x7f4bac15c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:10.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:10.181+0000 7f4bb0a00640 1 --2- 172.21.15.63:0/1501923207 >> v2:172.21.15.131:3300/0 conn(0x7f4bac155e10 0x7f4bac15c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:10.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:10.181+0000 7f4bb0a00640 1 -- 172.21.15.63:0/1501923207 >> v1:172.21.15.63:6789/0 conn(0x7f4bac15d130 legacy=0x7f4bac15fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:10.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:10.181+0000 7f4bab400640 1 -- 172.21.15.63:0/1501923207 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 626247563 0 0) 0x7f4bac15cbd0 con 0x7f4bac15d130 2024-05-21T01:20:10.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:10.181+0000 7f4bb0a00640 1 -- 172.21.15.63:0/1501923207 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bac06d910 con 0x7f4bac074620 2024-05-21T01:20:10.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:10.185+0000 7f4bb0a00640 1 --2- 172.21.15.63:0/1501923207 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4bac074620 0x7f4bac0738a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4bac06cfe0 tx=0x7f4ba401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c24af7a78669a4b4 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:10.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:10.185+0000 7f4bab400640 1 -- 172.21.15.63:0/1501923207 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba40b2070 con 0x7f4bac074620 2024-05-21T01:20:10.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:10.185+0000 7f4bab400640 1 -- 172.21.15.63:0/1501923207 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ba40a57f0 con 0x7f4bac074620 2024-05-21T01:20:10.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:10.185+0000 7f4bab400640 1 -- 172.21.15.63:0/1501923207 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba40a5bc0 con 0x7f4bac074620 2024-05-21T01:20:10.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:10.185+0000 7f4bb1400640 1 -- 172.21.15.63:0/1501923207 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4bac074620 msgr2=0x7f4bac0738a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:10.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:10.185+0000 7f4bb1400640 1 --2- 172.21.15.63:0/1501923207 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4bac074620 0x7f4bac0738a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4bac06cfe0 tx=0x7f4ba401c930 comp rx=0 tx=0).stop 2024-05-21T01:20:10.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:10.185+0000 7f4bb1400640 1 -- 172.21.15.63:0/1501923207 shutdown_connections 2024-05-21T01:20:10.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:10.185+0000 7f4bb1400640 1 --2- 172.21.15.63:0/1501923207 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4bac074620 0x7f4bac0738a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:10.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:10.185+0000 7f4bb1400640 1 --2- 172.21.15.63:0/1501923207 >> v2:172.21.15.131:3300/0 conn(0x7f4bac155e10 0x7f4bac15c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:10.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:10.185+0000 7f4bb1400640 1 -- 172.21.15.63:0/1501923207 >> 172.21.15.63:0/1501923207 conn(0x7f4bac06caa0 msgr2=0x7f4bac068290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:10.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:10.185+0000 7f4bb1400640 1 -- 172.21.15.63:0/1501923207 shutdown_connections 2024-05-21T01:20:10.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:10.185+0000 7f4bb1400640 1 -- 172.21.15.63:0/1501923207 wait complete. 2024-05-21T01:20:10.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:10.185+0000 7f4bb1400640 1 Processor -- start 2024-05-21T01:20:10.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:10.185+0000 7f4bb1400640 1 -- start start 2024-05-21T01:20:10.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:10.189+0000 7f4bb1400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4bac074620 0x7f4bac0cd850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:10.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:10.189+0000 7f4bb1400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4bac155e10 0x7f4bac14ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:10.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:10.189+0000 7f4bb1400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4bac15d130 0x7f4bac14f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:10.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:10.189+0000 7f4bb1400640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f4bac169170 con 0x7f4bac155e10 2024-05-21T01:20:10.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:10.189+0000 7f4bb1400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f4bac168ff0 con 0x7f4bac15d130 2024-05-21T01:20:10.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:10.189+0000 7f4bb1400640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f4bac1692f0 con 0x7f4bac074620 2024-05-21T01:20:10.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:10.189+0000 7f4ba3400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4bac155e10 0x7f4bac14ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:10.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:10.189+0000 7f4ba3400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4bac155e10 0x7f4bac14ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:49422/0 (socket says 172.21.15.63:49422) 2024-05-21T01:20:10.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:10.189+0000 7f4ba3400640 1 -- 172.21.15.63:0/2012159294 learned_addr learned my addr 172.21.15.63:0/2012159294 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:10.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:10.189+0000 7f4babe00640 1 --2- 172.21.15.63:0/2012159294 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4bac074620 0x7f4bac0cd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:10.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:10.189+0000 7f4bb0a00640 1 --2- 172.21.15.63:0/2012159294 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4bac15d130 0x7f4bac14f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:10.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:10.189+0000 7f4ba3400640 1 -- 172.21.15.63:0/2012159294 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4bac074620 msgr2=0x7f4bac0cd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:10.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:10.189+0000 7f4ba3400640 1 --2- 172.21.15.63:0/2012159294 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4bac074620 0x7f4bac0cd850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:10.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:10.189+0000 7f4ba3400640 1 -- 172.21.15.63:0/2012159294 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4bac15d130 msgr2=0x7f4bac14f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:10.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:10.189+0000 7f4ba3400640 1 --2- 172.21.15.63:0/2012159294 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4bac15d130 0x7f4bac14f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:10.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:10.189+0000 7f4ba3400640 1 -- 172.21.15.63:0/2012159294 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bac1591a0 con 0x7f4bac155e10 2024-05-21T01:20:10.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:10.189+0000 7f4bb0a00640 1 --2- 172.21.15.63:0/2012159294 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4bac15d130 0x7f4bac14f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T01:20:10.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:10.189+0000 7f4babe00640 1 --2- 172.21.15.63:0/2012159294 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4bac074620 0x7f4bac0cd850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T01:20:10.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:10.189+0000 7f4ba3400640 1 --2- 172.21.15.63:0/2012159294 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4bac155e10 0x7f4bac14ef00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4b9400c530 tx=0x7f4b9400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:10.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:10.189+0000 7f4ba8c00640 1 -- 172.21.15.63:0/2012159294 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b94018070 con 0x7f4bac155e10 2024-05-21T01:20:10.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:10.189+0000 7f4ba8c00640 1 -- 172.21.15.63:0/2012159294 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b94007580 con 0x7f4bac155e10 2024-05-21T01:20:10.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:10.189+0000 7f4ba8c00640 1 -- 172.21.15.63:0/2012159294 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b94004a30 con 0x7f4bac155e10 2024-05-21T01:20:10.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:10.189+0000 7f4bb1400640 1 -- 172.21.15.63:0/2012159294 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bac151b60 con 0x7f4bac155e10 2024-05-21T01:20:10.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:10.189+0000 7f4bb1400640 1 -- 172.21.15.63:0/2012159294 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bac152120 con 0x7f4bac155e10 2024-05-21T01:20:10.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:10.189+0000 7f4bb1400640 1 -- 172.21.15.63:0/2012159294 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bac06c0c0 con 0x7f4bac155e10 2024-05-21T01:20:10.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:10.189+0000 7f4ba8c00640 1 -- 172.21.15.63:0/2012159294 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7f4b9401b070 con 0x7f4bac155e10 2024-05-21T01:20:10.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:10.193+0000 7f4ba8c00640 1 --2- 172.21.15.63:0/2012159294 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f4b8806f400 0x7f4b880718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:10.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:10.193+0000 7f4ba8c00640 1 -- 172.21.15.63:0/2012159294 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f4b9408e840 con 0x7f4bac155e10 2024-05-21T01:20:10.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:10.193+0000 7f4babe00640 1 --2- 172.21.15.63:0/2012159294 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f4b8806f400 0x7f4b880718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:10.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:10.193+0000 7f4babe00640 1 --2- 172.21.15.63:0/2012159294 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f4b8806f400 0x7f4b880718c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c009bb0 tx=0x7f4b9c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:10.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:10.197+0000 7f4ba8c00640 1 -- 172.21.15.63:0/2012159294 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f4b9405b470 con 0x7f4bac155e10 2024-05-21T01:20:10.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:10.373+0000 7f4bb1400640 1 -- 172.21.15.63:0/2012159294 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f4bac074400 con 0x7f4bac155e10 2024-05-21T01:20:10.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:10.373+0000 7f4ba8c00640 1 -- 172.21.15.63:0/2012159294 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7f4b9405ad70 con 0x7f4bac155e10 2024-05-21T01:20:10.378 INFO:teuthology.orchestra.run.smithi063.stderr:listed 0 entries 2024-05-21T01:20:10.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:10.373+0000 7f4bb1400640 1 -- 172.21.15.63:0/2012159294 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f4b8806f400 msgr2=0x7f4b880718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:10.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:10.373+0000 7f4bb1400640 1 --2- 172.21.15.63:0/2012159294 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f4b8806f400 0x7f4b880718c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c009bb0 tx=0x7f4b9c008040 comp rx=0 tx=0).stop 2024-05-21T01:20:10.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:10.377+0000 7f4bb1400640 1 -- 172.21.15.63:0/2012159294 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4bac155e10 msgr2=0x7f4bac14ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:10.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:10.377+0000 7f4bb1400640 1 --2- 172.21.15.63:0/2012159294 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4bac155e10 0x7f4bac14ef00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4b9400c530 tx=0x7f4b9400c9f0 comp rx=0 tx=0).stop 2024-05-21T01:20:10.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:10.377+0000 7f4bb1400640 1 -- 172.21.15.63:0/2012159294 shutdown_connections 2024-05-21T01:20:10.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:10.377+0000 7f4bb1400640 1 --2- 172.21.15.63:0/2012159294 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f4b8806f400 0x7f4b880718c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:10.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:10.377+0000 7f4bb1400640 1 --2- 172.21.15.63:0/2012159294 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4bac15d130 0x7f4bac14f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:10.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:10.377+0000 7f4bb1400640 1 --2- 172.21.15.63:0/2012159294 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4bac155e10 0x7f4bac14ef00 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:10.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:10.377+0000 7f4bb1400640 1 --2- 172.21.15.63:0/2012159294 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4bac074620 0x7f4bac0cd850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:10.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:10.377+0000 7f4bb1400640 1 -- 172.21.15.63:0/2012159294 >> 172.21.15.63:0/2012159294 conn(0x7f4bac06caa0 msgr2=0x7f4bac153050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:10.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:10.377+0000 7f4bb1400640 1 -- 172.21.15.63:0/2012159294 shutdown_connections 2024-05-21T01:20:10.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:10.377+0000 7f4bb1400640 1 -- 172.21.15.63:0/2012159294 wait complete. 2024-05-21T01:20:10.400 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi063.front.sepia.ceph.com... 2024-05-21T01:20:10.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-21T01:20:10.400 DEBUG:teuthology.orchestra.run.smithi063:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-05-21T01:20:10.430 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi063.stderr:ceph-fuse[32124]: fuse finished with error 0 and tester_r 0 2024-05-21T01:20:10.433 INFO:teuthology.orchestra.run:waiting for 300 2024-05-21T01:20:16.534 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi063.front.sepia.ceph.com 2024-05-21T01:20:16.534 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-21T01:20:16.534 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-05-21T01:20:16.565 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-21T01:20:16.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:16.757+0000 7f60b1400640 1 Processor -- start 2024-05-21T01:20:16.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:16.757+0000 7f60b1400640 1 -- start start 2024-05-21T01:20:16.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:16.757+0000 7f60b1400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f60ac153e00 0x7f60ac06c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:16.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:16.757+0000 7f60b1400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f60ac06e940 0x7f60ac0c7650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:16.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:16.757+0000 7f60b1400640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60ac06eea0 con 0x7f60ac06e4f0 2024-05-21T01:20:16.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:16.757+0000 7f60b1400640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f60ac06ca50 con 0x7f60ac153e00 2024-05-21T01:20:16.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:16.757+0000 7f60b1400640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f60ac159ec0 con 0x7f60ac06e940 2024-05-21T01:20:16.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:16.757+0000 7f60aa800640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f60ac153e00 0x7f60ac06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:16.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:16.757+0000 7f60aa800640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f60ac153e00 0x7f60ac06c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:49436/0 (socket says 172.21.15.63:49436) 2024-05-21T01:20:16.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:16.757+0000 7f60aa800640 1 -- 172.21.15.63:0/1309401736 learned_addr learned my addr 172.21.15.63:0/1309401736 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:16.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:16.757+0000 7f60ab200640 1 --2- 172.21.15.63:0/1309401736 >> v2:172.21.15.131:3300/0 conn(0x7f60ac06e940 0x7f60ac0c7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:16.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:16.757+0000 7f60aa800640 1 -- 172.21.15.63:0/1309401736 >> v2:172.21.15.131:3300/0 conn(0x7f60ac06e940 msgr2=0x7f60ac0c7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:16.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:16.757+0000 7f60aa800640 1 --2- 172.21.15.63:0/1309401736 >> v2:172.21.15.131:3300/0 conn(0x7f60ac06e940 0x7f60ac0c7650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:16.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:16.757+0000 7f60aa800640 1 -- 172.21.15.63:0/1309401736 >> v1:172.21.15.131:6789/0 conn(0x7f60ac06e4f0 legacy=0x7f60ac06d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:16.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:16.757+0000 7f60aa800640 1 -- 172.21.15.63:0/1309401736 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60ac15a1a0 con 0x7f60ac153e00 2024-05-21T01:20:16.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:16.761+0000 7f60aa800640 1 --2- 172.21.15.63:0/1309401736 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f60ac153e00 0x7f60ac06c510 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f60ac0cdde0 tx=0x7f609c01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de42c7006b263c1e server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:16.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:16.761+0000 7f60a9400640 1 -- 172.21.15.63:0/1309401736 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f609c0ab600 con 0x7f60ac153e00 2024-05-21T01:20:16.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:16.761+0000 7f60a9400640 1 -- 172.21.15.63:0/1309401736 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f609c0b0070 con 0x7f60ac153e00 2024-05-21T01:20:16.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:16.761+0000 7f60a9400640 1 -- 172.21.15.63:0/1309401736 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f609c0ab9c0 con 0x7f60ac153e00 2024-05-21T01:20:16.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:16.761+0000 7f60b1400640 1 -- 172.21.15.63:0/1309401736 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f60ac153e00 msgr2=0x7f60ac06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:16.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:16.761+0000 7f60b1400640 1 --2- 172.21.15.63:0/1309401736 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f60ac153e00 0x7f60ac06c510 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f60ac0cdde0 tx=0x7f609c01c4f0 comp rx=0 tx=0).stop 2024-05-21T01:20:16.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:16.761+0000 7f60b1400640 1 -- 172.21.15.63:0/1309401736 shutdown_connections 2024-05-21T01:20:16.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:16.761+0000 7f60b1400640 1 --2- 172.21.15.63:0/1309401736 >> v2:172.21.15.131:3300/0 conn(0x7f60ac06e940 0x7f60ac0c7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:16.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:16.761+0000 7f60b1400640 1 --2- 172.21.15.63:0/1309401736 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f60ac153e00 0x7f60ac06c510 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:16.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:16.761+0000 7f60b1400640 1 -- 172.21.15.63:0/1309401736 >> 172.21.15.63:0/1309401736 conn(0x7f60ac0cae00 msgr2=0x7f60ac0cb210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:16.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:16.761+0000 7f60b1400640 1 -- 172.21.15.63:0/1309401736 shutdown_connections 2024-05-21T01:20:16.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:16.761+0000 7f60b1400640 1 -- 172.21.15.63:0/1309401736 wait complete. 2024-05-21T01:20:16.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:16.761+0000 7f60b1400640 1 Processor -- start 2024-05-21T01:20:16.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:16.765+0000 7f60b1400640 1 -- start start 2024-05-21T01:20:16.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:16.765+0000 7f60b1400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f60ac06e4f0 0x7f60ac1f52f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:16.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:16.765+0000 7f60b1400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f60ac06e940 0x7f60ac0728b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:16.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:16.765+0000 7f60b1400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f60ac153e00 0x7f60ac1515b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:16.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:16.765+0000 7f60b1400640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f60ac06e0c0 con 0x7f60ac153e00 2024-05-21T01:20:16.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:16.765+0000 7f60b1400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f60ac1541e0 con 0x7f60ac06e940 2024-05-21T01:20:16.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:16.765+0000 7f60b1400640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f60ac06e240 con 0x7f60ac06e4f0 2024-05-21T01:20:16.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:16.765+0000 7f60ab200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f60ac153e00 0x7f60ac1515b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:16.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:16.765+0000 7f60ab200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f60ac153e00 0x7f60ac1515b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:49446/0 (socket says 172.21.15.63:49446) 2024-05-21T01:20:16.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:16.765+0000 7f60ab200640 1 -- 172.21.15.63:0/122326288 learned_addr learned my addr 172.21.15.63:0/122326288 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:16.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:16.765+0000 7f60a9e00640 1 --2- 172.21.15.63:0/122326288 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f60ac06e940 0x7f60ac0728b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:16.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:16.765+0000 7f60aa800640 1 --2- 172.21.15.63:0/122326288 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f60ac06e4f0 0x7f60ac1f52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:16.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:16.765+0000 7f60ab200640 1 -- 172.21.15.63:0/122326288 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f60ac06e4f0 msgr2=0x7f60ac1f52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:16.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:16.765+0000 7f60ab200640 1 --2- 172.21.15.63:0/122326288 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f60ac06e4f0 0x7f60ac1f52f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:16.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:16.765+0000 7f60ab200640 1 -- 172.21.15.63:0/122326288 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f60ac06e940 msgr2=0x7f60ac0728b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:16.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:16.765+0000 7f60ab200640 1 --2- 172.21.15.63:0/122326288 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f60ac06e940 0x7f60ac0728b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:16.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:16.765+0000 7f60ab200640 1 -- 172.21.15.63:0/122326288 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60ac074090 con 0x7f60ac153e00 2024-05-21T01:20:16.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:16.765+0000 7f60a9e00640 1 --2- 172.21.15.63:0/122326288 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f60ac06e940 0x7f60ac0728b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T01:20:16.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:16.765+0000 7f60ab200640 1 --2- 172.21.15.63:0/122326288 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f60ac153e00 0x7f60ac1515b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f60a4007e40 tx=0x7f60a400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:16.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:16.765+0000 7f60a2a00640 1 -- 172.21.15.63:0/122326288 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60a4014620 con 0x7f60ac153e00 2024-05-21T01:20:16.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:16.765+0000 7f60a2a00640 1 -- 172.21.15.63:0/122326288 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60a4019070 con 0x7f60ac153e00 2024-05-21T01:20:16.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:16.765+0000 7f60a2a00640 1 -- 172.21.15.63:0/122326288 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60a4014a20 con 0x7f60ac153e00 2024-05-21T01:20:16.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:16.765+0000 7f60b1400640 1 -- 172.21.15.63:0/122326288 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60ac073ad0 con 0x7f60ac153e00 2024-05-21T01:20:16.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:16.765+0000 7f60b1400640 1 -- 172.21.15.63:0/122326288 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60ac073180 con 0x7f60ac153e00 2024-05-21T01:20:16.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:16.765+0000 7f60b1400640 1 -- 172.21.15.63:0/122326288 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60ac0507f0 con 0x7f60ac153e00 2024-05-21T01:20:16.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:16.769+0000 7f60a2a00640 1 -- 172.21.15.63:0/122326288 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7f60a4014bc0 con 0x7f60ac153e00 2024-05-21T01:20:16.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:16.769+0000 7f60a2a00640 1 --2- 172.21.15.63:0/122326288 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f608c06f400 0x7f608c0718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:16.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:16.769+0000 7f60a2a00640 1 -- 172.21.15.63:0/122326288 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f60a408ffe0 con 0x7f60ac153e00 2024-05-21T01:20:16.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:16.769+0000 7f60aa800640 1 --2- 172.21.15.63:0/122326288 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f608c06f400 0x7f608c0718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:16.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:16.769+0000 7f60aa800640 1 --2- 172.21.15.63:0/122326288 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f608c06f400 0x7f608c0718c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f609c0af000 tx=0x7f609c0a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:16.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:16.773+0000 7f60a2a00640 1 -- 172.21.15.63:0/122326288 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f60a405caf0 con 0x7f60ac153e00 2024-05-21T01:20:16.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:16.937+0000 7f60b1400640 1 -- 172.21.15.63:0/122326288 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f60ac06cc50 con 0x7f60ac153e00 2024-05-21T01:20:16.944 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:16.937+0000 7f60a2a00640 1 -- 172.21.15.63:0/122326288 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18482 (secure 0 0 0) 0x7f60a405c3f0 con 0x7f60ac153e00 2024-05-21T01:20:16.944 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-05-21T01:20:16.944 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":25,"fsid":"9a7cbd84-ceb2-41c8-8b6e-ab931f86c51a","created":"2024-05-21T01:19:37.688082+0000","modified":"2024-05-21T01:19:58.978125+0000","last_up_change":"2024-05-21T01:19:48.472107+0000","last_in_change":"2024-05-21T01:19:39.973975+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-21T01:19:46.485266+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-21T01:19:52.032741+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-21T01:19:52.867322+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-21T01:19:56.562363+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cda28135-00bb-4194-adcb-e0abf3ae43f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":3740454920},{"type":"v1","addr":"172.21.15.63:6801","nonce":3740454920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":3740454920},{"type":"v1","addr":"172.21.15.63:6804","nonce":3740454920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":3740454920},{"type":"v1","addr":"172.21.15.63:6812","nonce":3740454920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":3740454920},{"type":"v1","addr":"172.21.15.63:6808","nonce":3740454920}]},"public_addr":"172.21.15.63:6801/3740454920","cluster_addr":"172.21.15.63:6804/3740454920","heartbeat_back_addr":"172.21.15.63:6812/3740454920","heartbeat_front_addr":"172.21.15.63:6808/3740454920","state":["exists","up"]},{"osd":1,"uuid":"4aeb370d-ec2f-4a91-b17b-035fd72bdaea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6803","nonce":896993303},{"type":"v1","addr":"172.21.15.63:6805","nonce":896993303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6807","nonce":896993303},{"type":"v1","addr":"172.21.15.63:6809","nonce":896993303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":896993303},{"type":"v1","addr":"172.21.15.63:6816","nonce":896993303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6811","nonce":896993303},{"type":"v1","addr":"172.21.15.63:6813","nonce":896993303}]},"public_addr":"172.21.15.63:6805/896993303","cluster_addr":"172.21.15.63:6809/896993303","heartbeat_back_addr":"172.21.15.63:6816/896993303","heartbeat_front_addr":"172.21.15.63:6813/896993303","state":["exists","up"]},{"osd":2,"uuid":"8368b112-35a3-43cf-ad1c-803f05708091","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":845807419},{"type":"v1","addr":"172.21.15.63:6817","nonce":845807419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":845807419},{"type":"v1","addr":"172.21.15.63:6819","nonce":845807419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":845807419},{"type":"v1","addr":"172.21.15.63:6823","nonce":845807419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":845807419},{"type":"v1","addr":"172.21.15.63:6821","nonce":845807419}]},"public_addr":"172.21.15.63:6817/845807419","cluster_addr":"172.21.15.63:6819/845807419","heartbeat_back_addr":"172.21.15.63:6823/845807419","heartbeat_front_addr":"172.21.15.63:6821/845807419","state":["exists","up"]},{"osd":3,"uuid":"26208950-e3ca-4b9a-94cd-c159453a5dfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":521563809},{"type":"v1","addr":"172.21.15.63:6825","nonce":521563809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":521563809},{"type":"v1","addr":"172.21.15.63:6827","nonce":521563809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":521563809},{"type":"v1","addr":"172.21.15.63:6831","nonce":521563809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":521563809},{"type":"v1","addr":"172.21.15.63:6829","nonce":521563809}]},"public_addr":"172.21.15.63:6825/521563809","cluster_addr":"172.21.15.63:6827/521563809","heartbeat_back_addr":"172.21.15.63:6831/521563809","heartbeat_front_addr":"172.21.15.63:6829/521563809","state":["exists","up"]},{"osd":4,"uuid":"d8c93283-1e10-4419-9934-d5048c5d0ad1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":2660673588},{"type":"v1","addr":"172.21.15.131:6801","nonce":2660673588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":2660673588},{"type":"v1","addr":"172.21.15.131:6803","nonce":2660673588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":2660673588},{"type":"v1","addr":"172.21.15.131:6807","nonce":2660673588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":2660673588},{"type":"v1","addr":"172.21.15.131:6805","nonce":2660673588}]},"public_addr":"172.21.15.131:6801/2660673588","cluster_addr":"172.21.15.131:6803/2660673588","heartbeat_back_addr":"172.21.15.131:6807/2660673588","heartbeat_front_addr":"172.21.15.131:6805/2660673588","state":["exists","up"]},{"osd":5,"uuid":"93a6fe9b-eaa6-4474-bf9b-ae0571feacf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6809","nonce":2508702891},{"type":"v1","addr":"172.21.15.131:6811","nonce":2508702891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6813","nonce":2508702891},{"type":"v1","addr":"172.21.15.131:6815","nonce":2508702891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6821","nonce":2508702891},{"type":"v1","addr":"172.21.15.131:6823","nonce":2508702891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6817","nonce":2508702891},{"type":"v1","addr":"172.21.15.131:6819","nonce":2508702891}]},"public_addr":"172.21.15.131:6811/2508702891","cluster_addr":"172.21.15.131:6815/2508702891","heartbeat_back_addr":"172.21.15.131:6823/2508702891","heartbeat_front_addr":"172.21.15.131:6819/2508702891","state":["exists","up"]},{"osd":6,"uuid":"e05e6c8c-2dda-49ab-8116-5ea9038d0f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":614380392},{"type":"v1","addr":"172.21.15.131:6810","nonce":614380392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":614380392},{"type":"v1","addr":"172.21.15.131:6814","nonce":614380392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":614380392},{"type":"v1","addr":"172.21.15.131:6822","nonce":614380392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":614380392},{"type":"v1","addr":"172.21.15.131:6818","nonce":614380392}]},"public_addr":"172.21.15.131:6810/614380392","cluster_addr":"172.21.15.131:6814/614380392","heartbeat_back_addr":"172.21.15.131:6822/614380392","heartbeat_front_addr":"172.21.15.131:6818/614380392","state":["exists","up"]},{"osd":7,"uuid":"0b393e5e-eeef-4e32-b23a-d405a8b0e7b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":4219797450},{"type":"v1","addr":"172.21.15.131:6825","nonce":4219797450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":4219797450},{"type":"v1","addr":"172.21.15.131:6827","nonce":4219797450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":4219797450},{"type":"v1","addr":"172.21.15.131:6831","nonce":4219797450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":4219797450},{"type":"v1","addr":"172.21.15.131:6829","nonce":4219797450}]},"public_addr":"172.21.15.131:6825/4219797450","cluster_addr":"172.21.15.131:6827/4219797450","heartbeat_back_addr":"172.21.15.131:6831/4219797450","heartbeat_front_addr":"172.21.15.131:6829/4219797450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.647841+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.912560+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.684614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.936286+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.380500+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.553497+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.517866+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.310320+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-21T01:20:16.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:16.941+0000 7f60b1400640 1 -- 172.21.15.63:0/122326288 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f608c06f400 msgr2=0x7f608c0718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:16.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:16.941+0000 7f60b1400640 1 --2- 172.21.15.63:0/122326288 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f608c06f400 0x7f608c0718c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f609c0af000 tx=0x7f609c0a7000 comp rx=0 tx=0).stop 2024-05-21T01:20:16.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:16.941+0000 7f60b1400640 1 -- 172.21.15.63:0/122326288 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f60ac153e00 msgr2=0x7f60ac1515b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:16.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:16.941+0000 7f60b1400640 1 --2- 172.21.15.63:0/122326288 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f60ac153e00 0x7f60ac1515b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f60a4007e40 tx=0x7f60a400e4b0 comp rx=0 tx=0).stop 2024-05-21T01:20:16.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:16.941+0000 7f60b1400640 1 -- 172.21.15.63:0/122326288 shutdown_connections 2024-05-21T01:20:16.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:16.941+0000 7f60b1400640 1 --2- 172.21.15.63:0/122326288 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f608c06f400 0x7f608c0718c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:16.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:16.941+0000 7f60b1400640 1 --2- 172.21.15.63:0/122326288 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f60ac153e00 0x7f60ac1515b0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:16.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:16.941+0000 7f60b1400640 1 --2- 172.21.15.63:0/122326288 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f60ac06e940 0x7f60ac0728b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:16.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:16.941+0000 7f60b1400640 1 --2- 172.21.15.63:0/122326288 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f60ac06e4f0 0x7f60ac1f52f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:16.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:16.941+0000 7f60b1400640 1 -- 172.21.15.63:0/122326288 >> 172.21.15.63:0/122326288 conn(0x7f60ac0cae00 msgr2=0x7f60ac0cb1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:16.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:16.941+0000 7f60b1400640 1 -- 172.21.15.63:0/122326288 shutdown_connections 2024-05-21T01:20:16.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:16.941+0000 7f60b1400640 1 -- 172.21.15.63:0/122326288 wait complete. 2024-05-21T01:20:16.966 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-21T01:20:17.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.101+0000 7f9ba3000640 1 Processor -- start 2024-05-21T01:20:17.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.101+0000 7f9ba3000640 1 -- start start 2024-05-21T01:20:17.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.101+0000 7f9ba3000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f9b9c06f5d0 0x7f9b9c0c8a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:17.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.101+0000 7f9ba3000640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9b9c15ce40 0x7f9b9c072d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:17.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.101+0000 7f9ba3000640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b9c072550 con 0x7f9b9c06f9b0 2024-05-21T01:20:17.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.101+0000 7f9ba3000640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f9b9c159100 con 0x7f9b9c15ce40 2024-05-21T01:20:17.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.101+0000 7f9ba3000640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f9b9c1593e0 con 0x7f9b9c06f5d0 2024-05-21T01:20:17.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.101+0000 7f9ba1000640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9b9c15ce40 0x7f9b9c072d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:17.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.101+0000 7f9b93e00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f9b9c06f9b0 0x7f9b9c152a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:55866/0 (socket says 172.21.15.63:55866) 2024-05-21T01:20:17.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.101+0000 7f9b93e00640 1 -- 172.21.15.63:0/2099742730 learned_addr learned my addr 172.21.15.63:0/2099742730 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-05-21T01:20:17.109 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.101+0000 7f9b9be00640 1 --2- 172.21.15.63:0/2099742730 >> v2:172.21.15.131:3300/0 conn(0x7f9b9c06f5d0 0x7f9b9c0c8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:17.109 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.105+0000 7f9ba1000640 1 -- 172.21.15.63:0/2099742730 >> v2:172.21.15.131:3300/0 conn(0x7f9b9c06f5d0 msgr2=0x7f9b9c0c8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:17.109 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.105+0000 7f9ba1000640 1 --2- 172.21.15.63:0/2099742730 >> v2:172.21.15.131:3300/0 conn(0x7f9b9c06f5d0 0x7f9b9c0c8a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:17.109 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.105+0000 7f9ba1000640 1 -- 172.21.15.63:0/2099742730 >> v1:172.21.15.63:6789/0 conn(0x7f9b9c06f9b0 legacy=0x7f9b9c152a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:17.109 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.105+0000 7f9b9b400640 1 -- 172.21.15.63:0/2099742730 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1622787848 0 0) 0x7f9b9c072550 con 0x7f9b9c06f9b0 2024-05-21T01:20:17.109 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.105+0000 7f9ba1000640 1 -- 172.21.15.63:0/2099742730 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b9c1596c0 con 0x7f9b9c15ce40 2024-05-21T01:20:17.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.105+0000 7f9ba1000640 1 --2- 172.21.15.63:0/2099742730 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9b9c15ce40 0x7f9b9c072d20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c0caef0 tx=0x7f9b9401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f1f9ec64d65331c server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:17.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.105+0000 7f9b9b400640 1 -- 172.21.15.63:0/2099742730 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b940b2070 con 0x7f9b9c15ce40 2024-05-21T01:20:17.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.105+0000 7f9b9b400640 1 -- 172.21.15.63:0/2099742730 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b940a58e0 con 0x7f9b9c15ce40 2024-05-21T01:20:17.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.105+0000 7f9b9b400640 1 -- 172.21.15.63:0/2099742730 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b940a5cb0 con 0x7f9b9c15ce40 2024-05-21T01:20:17.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.105+0000 7f9ba3000640 1 -- 172.21.15.63:0/2099742730 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9b9c15ce40 msgr2=0x7f9b9c072d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:17.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.105+0000 7f9ba3000640 1 --2- 172.21.15.63:0/2099742730 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9b9c15ce40 0x7f9b9c072d20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c0caef0 tx=0x7f9b9401c930 comp rx=0 tx=0).stop 2024-05-21T01:20:17.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.105+0000 7f9ba3000640 1 -- 172.21.15.63:0/2099742730 shutdown_connections 2024-05-21T01:20:17.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.105+0000 7f9ba3000640 1 --2- 172.21.15.63:0/2099742730 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9b9c15ce40 0x7f9b9c072d20 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:17.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.105+0000 7f9ba3000640 1 --2- 172.21.15.63:0/2099742730 >> v2:172.21.15.131:3300/0 conn(0x7f9b9c06f5d0 0x7f9b9c0c8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:17.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.105+0000 7f9ba3000640 1 -- 172.21.15.63:0/2099742730 >> 172.21.15.63:0/2099742730 conn(0x7f9b9c068460 msgr2=0x7f9b9c068870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:17.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.105+0000 7f9ba3000640 1 -- 172.21.15.63:0/2099742730 shutdown_connections 2024-05-21T01:20:17.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.105+0000 7f9ba3000640 1 -- 172.21.15.63:0/2099742730 wait complete. 2024-05-21T01:20:17.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.109+0000 7f9ba3000640 1 Processor -- start 2024-05-21T01:20:17.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.109+0000 7f9ba3000640 1 -- start start 2024-05-21T01:20:17.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.109+0000 7f9ba3000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9b9c06f5d0 0x7f9b9c1f8890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:17.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.109+0000 7f9ba3000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9b9c06f9b0 0x7f9b9c14f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:17.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.109+0000 7f9ba3000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9b9c15ce40 0x7f9b9c0cb210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:17.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.109+0000 7f9ba3000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f9b9c153150 con 0x7f9b9c06f5d0 2024-05-21T01:20:17.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.109+0000 7f9ba3000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f9b9c073670 con 0x7f9b9c15ce40 2024-05-21T01:20:17.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.109+0000 7f9ba3000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f9b9c1532d0 con 0x7f9b9c06f9b0 2024-05-21T01:20:17.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.109+0000 7f9b9be00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9b9c06f5d0 0x7f9b9c1f8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:17.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.109+0000 7f9b9be00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9b9c06f5d0 0x7f9b9c1f8890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:49466/0 (socket says 172.21.15.63:49466) 2024-05-21T01:20:17.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.109+0000 7f9b9be00640 1 -- 172.21.15.63:0/966054433 learned_addr learned my addr 172.21.15.63:0/966054433 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:17.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.109+0000 7f9ba1000640 1 --2- 172.21.15.63:0/966054433 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9b9c15ce40 0x7f9b9c0cb210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:17.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.109+0000 7f9b93e00640 1 --2- 172.21.15.63:0/966054433 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9b9c06f9b0 0x7f9b9c14f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:17.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.109+0000 7f9b9be00640 1 -- 172.21.15.63:0/966054433 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9b9c06f9b0 msgr2=0x7f9b9c14f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:17.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.109+0000 7f9b9be00640 1 --2- 172.21.15.63:0/966054433 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9b9c06f9b0 0x7f9b9c14f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:17.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.109+0000 7f9b9be00640 1 -- 172.21.15.63:0/966054433 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9b9c15ce40 msgr2=0x7f9b9c0cb210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:17.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.109+0000 7f9b9be00640 1 --2- 172.21.15.63:0/966054433 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9b9c15ce40 0x7f9b9c0cb210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:17.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.109+0000 7f9b9be00640 1 -- 172.21.15.63:0/966054433 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b9c14d260 con 0x7f9b9c06f5d0 2024-05-21T01:20:17.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.109+0000 7f9b9be00640 1 --2- 172.21.15.63:0/966054433 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9b9c06f5d0 0x7f9b9c1f8890 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c00d5f0 tx=0x7f9b8c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:17.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.109+0000 7f9b98c00640 1 -- 172.21.15.63:0/966054433 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b8c0125f0 con 0x7f9b9c06f5d0 2024-05-21T01:20:17.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.109+0000 7f9b98c00640 1 -- 172.21.15.63:0/966054433 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b8c019070 con 0x7f9b9c06f5d0 2024-05-21T01:20:17.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.109+0000 7f9b98c00640 1 -- 172.21.15.63:0/966054433 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b8c0129b0 con 0x7f9b9c06f5d0 2024-05-21T01:20:17.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.109+0000 7f9ba3000640 1 -- 172.21.15.63:0/966054433 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b9c14d520 con 0x7f9b9c06f5d0 2024-05-21T01:20:17.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.109+0000 7f9ba3000640 1 -- 172.21.15.63:0/966054433 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b9c14dae0 con 0x7f9b9c06f5d0 2024-05-21T01:20:17.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.113+0000 7f9ba3000640 1 -- 172.21.15.63:0/966054433 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b9c0507f0 con 0x7f9b9c06f5d0 2024-05-21T01:20:17.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.113+0000 7f9b98c00640 1 -- 172.21.15.63:0/966054433 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7f9b8c012b50 con 0x7f9b9c06f5d0 2024-05-21T01:20:17.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.113+0000 7f9b98c00640 1 --2- 172.21.15.63:0/966054433 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f9b7806f430 0x7f9b780718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:17.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.113+0000 7f9b98c00640 1 -- 172.21.15.63:0/966054433 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f9b8c08f990 con 0x7f9b9c06f5d0 2024-05-21T01:20:17.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.113+0000 7f9b93e00640 1 --2- 172.21.15.63:0/966054433 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f9b7806f430 0x7f9b780718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:17.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.113+0000 7f9b93e00640 1 --2- 172.21.15.63:0/966054433 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f9b7806f430 0x7f9b780718f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9b84007fd0 tx=0x7f9b84007b20 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:17.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.117+0000 7f9b98c00640 1 -- 172.21.15.63:0/966054433 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f9b8c05c5c0 con 0x7f9b9c06f5d0 2024-05-21T01:20:17.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.285+0000 7f9ba3000640 1 -- 172.21.15.63:0/966054433 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9b9c0c4990 con 0x7f9b9c06f5d0 2024-05-21T01:20:17.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.285+0000 7f9b98c00640 1 -- 172.21.15.63:0/966054433 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18482 (secure 0 0 0) 0x7f9b8c05bec0 con 0x7f9b9c06f5d0 2024-05-21T01:20:17.291 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-05-21T01:20:17.291 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":25,"fsid":"9a7cbd84-ceb2-41c8-8b6e-ab931f86c51a","created":"2024-05-21T01:19:37.688082+0000","modified":"2024-05-21T01:19:58.978125+0000","last_up_change":"2024-05-21T01:19:48.472107+0000","last_in_change":"2024-05-21T01:19:39.973975+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-21T01:19:46.485266+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-21T01:19:52.032741+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-21T01:19:52.867322+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-21T01:19:56.562363+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cda28135-00bb-4194-adcb-e0abf3ae43f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":3740454920},{"type":"v1","addr":"172.21.15.63:6801","nonce":3740454920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":3740454920},{"type":"v1","addr":"172.21.15.63:6804","nonce":3740454920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":3740454920},{"type":"v1","addr":"172.21.15.63:6812","nonce":3740454920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":3740454920},{"type":"v1","addr":"172.21.15.63:6808","nonce":3740454920}]},"public_addr":"172.21.15.63:6801/3740454920","cluster_addr":"172.21.15.63:6804/3740454920","heartbeat_back_addr":"172.21.15.63:6812/3740454920","heartbeat_front_addr":"172.21.15.63:6808/3740454920","state":["exists","up"]},{"osd":1,"uuid":"4aeb370d-ec2f-4a91-b17b-035fd72bdaea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6803","nonce":896993303},{"type":"v1","addr":"172.21.15.63:6805","nonce":896993303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6807","nonce":896993303},{"type":"v1","addr":"172.21.15.63:6809","nonce":896993303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":896993303},{"type":"v1","addr":"172.21.15.63:6816","nonce":896993303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6811","nonce":896993303},{"type":"v1","addr":"172.21.15.63:6813","nonce":896993303}]},"public_addr":"172.21.15.63:6805/896993303","cluster_addr":"172.21.15.63:6809/896993303","heartbeat_back_addr":"172.21.15.63:6816/896993303","heartbeat_front_addr":"172.21.15.63:6813/896993303","state":["exists","up"]},{"osd":2,"uuid":"8368b112-35a3-43cf-ad1c-803f05708091","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":845807419},{"type":"v1","addr":"172.21.15.63:6817","nonce":845807419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":845807419},{"type":"v1","addr":"172.21.15.63:6819","nonce":845807419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":845807419},{"type":"v1","addr":"172.21.15.63:6823","nonce":845807419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":845807419},{"type":"v1","addr":"172.21.15.63:6821","nonce":845807419}]},"public_addr":"172.21.15.63:6817/845807419","cluster_addr":"172.21.15.63:6819/845807419","heartbeat_back_addr":"172.21.15.63:6823/845807419","heartbeat_front_addr":"172.21.15.63:6821/845807419","state":["exists","up"]},{"osd":3,"uuid":"26208950-e3ca-4b9a-94cd-c159453a5dfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":521563809},{"type":"v1","addr":"172.21.15.63:6825","nonce":521563809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":521563809},{"type":"v1","addr":"172.21.15.63:6827","nonce":521563809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":521563809},{"type":"v1","addr":"172.21.15.63:6831","nonce":521563809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":521563809},{"type":"v1","addr":"172.21.15.63:6829","nonce":521563809}]},"public_addr":"172.21.15.63:6825/521563809","cluster_addr":"172.21.15.63:6827/521563809","heartbeat_back_addr":"172.21.15.63:6831/521563809","heartbeat_front_addr":"172.21.15.63:6829/521563809","state":["exists","up"]},{"osd":4,"uuid":"d8c93283-1e10-4419-9934-d5048c5d0ad1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":2660673588},{"type":"v1","addr":"172.21.15.131:6801","nonce":2660673588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":2660673588},{"type":"v1","addr":"172.21.15.131:6803","nonce":2660673588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":2660673588},{"type":"v1","addr":"172.21.15.131:6807","nonce":2660673588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":2660673588},{"type":"v1","addr":"172.21.15.131:6805","nonce":2660673588}]},"public_addr":"172.21.15.131:6801/2660673588","cluster_addr":"172.21.15.131:6803/2660673588","heartbeat_back_addr":"172.21.15.131:6807/2660673588","heartbeat_front_addr":"172.21.15.131:6805/2660673588","state":["exists","up"]},{"osd":5,"uuid":"93a6fe9b-eaa6-4474-bf9b-ae0571feacf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6809","nonce":2508702891},{"type":"v1","addr":"172.21.15.131:6811","nonce":2508702891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6813","nonce":2508702891},{"type":"v1","addr":"172.21.15.131:6815","nonce":2508702891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6821","nonce":2508702891},{"type":"v1","addr":"172.21.15.131:6823","nonce":2508702891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6817","nonce":2508702891},{"type":"v1","addr":"172.21.15.131:6819","nonce":2508702891}]},"public_addr":"172.21.15.131:6811/2508702891","cluster_addr":"172.21.15.131:6815/2508702891","heartbeat_back_addr":"172.21.15.131:6823/2508702891","heartbeat_front_addr":"172.21.15.131:6819/2508702891","state":["exists","up"]},{"osd":6,"uuid":"e05e6c8c-2dda-49ab-8116-5ea9038d0f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":614380392},{"type":"v1","addr":"172.21.15.131:6810","nonce":614380392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":614380392},{"type":"v1","addr":"172.21.15.131:6814","nonce":614380392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":614380392},{"type":"v1","addr":"172.21.15.131:6822","nonce":614380392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":614380392},{"type":"v1","addr":"172.21.15.131:6818","nonce":614380392}]},"public_addr":"172.21.15.131:6810/614380392","cluster_addr":"172.21.15.131:6814/614380392","heartbeat_back_addr":"172.21.15.131:6822/614380392","heartbeat_front_addr":"172.21.15.131:6818/614380392","state":["exists","up"]},{"osd":7,"uuid":"0b393e5e-eeef-4e32-b23a-d405a8b0e7b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":4219797450},{"type":"v1","addr":"172.21.15.131:6825","nonce":4219797450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":4219797450},{"type":"v1","addr":"172.21.15.131:6827","nonce":4219797450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":4219797450},{"type":"v1","addr":"172.21.15.131:6831","nonce":4219797450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":4219797450},{"type":"v1","addr":"172.21.15.131:6829","nonce":4219797450}]},"public_addr":"172.21.15.131:6825/4219797450","cluster_addr":"172.21.15.131:6827/4219797450","heartbeat_back_addr":"172.21.15.131:6831/4219797450","heartbeat_front_addr":"172.21.15.131:6829/4219797450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.647841+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.912560+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.684614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.936286+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.380500+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.553497+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.517866+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.310320+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-21T01:20:17.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.289+0000 7f9ba3000640 1 -- 172.21.15.63:0/966054433 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f9b7806f430 msgr2=0x7f9b780718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:17.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.289+0000 7f9ba3000640 1 --2- 172.21.15.63:0/966054433 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f9b7806f430 0x7f9b780718f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9b84007fd0 tx=0x7f9b84007b20 comp rx=0 tx=0).stop 2024-05-21T01:20:17.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.289+0000 7f9ba3000640 1 -- 172.21.15.63:0/966054433 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9b9c06f5d0 msgr2=0x7f9b9c1f8890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:17.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.289+0000 7f9ba3000640 1 --2- 172.21.15.63:0/966054433 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9b9c06f5d0 0x7f9b9c1f8890 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c00d5f0 tx=0x7f9b8c00dab0 comp rx=0 tx=0).stop 2024-05-21T01:20:17.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.289+0000 7f9ba3000640 1 -- 172.21.15.63:0/966054433 shutdown_connections 2024-05-21T01:20:17.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.289+0000 7f9ba3000640 1 --2- 172.21.15.63:0/966054433 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f9b7806f430 0x7f9b780718f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:17.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.289+0000 7f9ba3000640 1 --2- 172.21.15.63:0/966054433 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9b9c15ce40 0x7f9b9c0cb210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:17.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.289+0000 7f9ba3000640 1 --2- 172.21.15.63:0/966054433 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9b9c06f9b0 0x7f9b9c14f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:17.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.289+0000 7f9ba3000640 1 --2- 172.21.15.63:0/966054433 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9b9c06f5d0 0x7f9b9c1f8890 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:17.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.289+0000 7f9ba3000640 1 -- 172.21.15.63:0/966054433 >> 172.21.15.63:0/966054433 conn(0x7f9b9c068460 msgr2=0x7f9b9c0c9a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:17.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.289+0000 7f9ba3000640 1 -- 172.21.15.63:0/966054433 shutdown_connections 2024-05-21T01:20:17.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.289+0000 7f9ba3000640 1 -- 172.21.15.63:0/966054433 wait complete. 2024-05-21T01:20:17.314 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-21T01:20:17.457 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.453+0000 7f41ca600640 1 Processor -- start 2024-05-21T01:20:17.457 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.453+0000 7f41ca600640 1 -- start start 2024-05-21T01:20:17.458 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.453+0000 7f41ca600640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f41c4156070 0x7f41c4071640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:17.458 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.453+0000 7f41ca600640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41c415bf20 con 0x7f41c406f080 2024-05-21T01:20:17.459 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.453+0000 7f41ca600640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41c415c1e0 con 0x7f41c4071b80 2024-05-21T01:20:17.459 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.453+0000 7f41ca600640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f41c415c4c0 con 0x7f41c4156070 2024-05-21T01:20:17.459 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.453+0000 7f41c3e00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f41c406f080 0x7f41c415d9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:55874/0 (socket says 172.21.15.63:55874) 2024-05-21T01:20:17.459 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.453+0000 7f41c3e00640 1 -- 172.21.15.63:0/2848805234 learned_addr learned my addr 172.21.15.63:0/2848805234 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-05-21T01:20:17.460 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.453+0000 7f41c3400640 1 --2- 172.21.15.63:0/2848805234 >> v2:172.21.15.131:3300/0 conn(0x7f41c4156070 0x7f41c4071640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:17.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.453+0000 7f41c2a00640 1 -- 172.21.15.63:0/2848805234 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 151568819 0 0) 0x7f41c415bf20 con 0x7f41c406f080 2024-05-21T01:20:17.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.453+0000 7f41c2a00640 1 -- 172.21.15.63:0/2848805234 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41a8003530 con 0x7f41c406f080 2024-05-21T01:20:17.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.453+0000 7f41c2a00640 1 -- 172.21.15.63:0/2848805234 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2214635610 0 0) 0x7f41a8003530 con 0x7f41c406f080 2024-05-21T01:20:17.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.453+0000 7f41c2a00640 1 -- 172.21.15.63:0/2848805234 >> v2:172.21.15.131:3300/0 conn(0x7f41c4156070 msgr2=0x7f41c4071640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:17.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.453+0000 7f41c2a00640 1 --2- 172.21.15.63:0/2848805234 >> v2:172.21.15.131:3300/0 conn(0x7f41c4156070 0x7f41c4071640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:17.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.453+0000 7f41c2a00640 1 -- 172.21.15.63:0/2848805234 >> v1:172.21.15.131:6789/0 conn(0x7f41c4071b80 legacy=0x7f41c40cf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:17.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.453+0000 7f41c2a00640 1 -- 172.21.15.63:0/2848805234 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41c415c7a0 con 0x7f41c406f080 2024-05-21T01:20:17.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.453+0000 7f41c2a00640 1 -- 172.21.15.63:0/2848805234 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 466403955 0 0) 0x7f41bc001a80 con 0x7f41c406f080 2024-05-21T01:20:17.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.453+0000 7f41c2a00640 1 -- 172.21.15.63:0/2848805234 >> v1:172.21.15.63:6789/0 conn(0x7f41c406f080 legacy=0x7f41c415d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:17.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.453+0000 7f41c2a00640 1 --2- 172.21.15.63:0/2848805234 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f41a8003a60 0x7f41a8003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:17.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.453+0000 7f41c2a00640 1 --2- 172.21.15.63:0/2848805234 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f41a8004810 0x7f41a8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:17.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.453+0000 7f41c2a00640 1 --2- 172.21.15.63:0/2848805234 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f41a80051d0 0x7f41a800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:17.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.453+0000 7f41c2a00640 1 -- 172.21.15.63:0/2848805234 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f41c415c4c0 con 0x7f41a8004810 2024-05-21T01:20:17.461 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.453+0000 7f41c2a00640 1 -- 172.21.15.63:0/2848805234 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f41a800c170 con 0x7f41a8003a60 2024-05-21T01:20:17.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.453+0000 7f41c2a00640 1 -- 172.21.15.63:0/2848805234 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f41a800c370 con 0x7f41a80051d0 2024-05-21T01:20:17.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.453+0000 7f41c3400640 1 --2- 172.21.15.63:0/2848805234 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f41a8003a60 0x7f41a8003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:17.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.453+0000 7f41baa00640 1 --2- 172.21.15.63:0/2848805234 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f41a8004810 0x7f41a8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:17.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.453+0000 7f41c3e00640 1 --2- 172.21.15.63:0/2848805234 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f41a80051d0 0x7f41a800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:17.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.457+0000 7f41baa00640 1 -- 172.21.15.63:0/2848805234 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f41a80051d0 msgr2=0x7f41a800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:17.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.457+0000 7f41baa00640 1 --2- 172.21.15.63:0/2848805234 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f41a80051d0 0x7f41a800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:17.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.457+0000 7f41baa00640 1 -- 172.21.15.63:0/2848805234 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f41a8003a60 msgr2=0x7f41a8003e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:17.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.457+0000 7f41baa00640 1 --2- 172.21.15.63:0/2848805234 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f41a8003a60 0x7f41a8003e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:17.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.457+0000 7f41baa00640 1 -- 172.21.15.63:0/2848805234 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41a8003530 con 0x7f41a8004810 2024-05-21T01:20:17.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.457+0000 7f41c3e00640 1 -- 172.21.15.63:0/2848805234 reap_dead start 2024-05-21T01:20:17.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.457+0000 7f41baa00640 1 --2- 172.21.15.63:0/2848805234 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f41a8004810 0x7f41a8004c90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f41ac001790 tx=0x7f41ac01c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bea25579acacf400 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:17.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.457+0000 7f41c2a00640 1 -- 172.21.15.63:0/2848805234 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41ac0013e0 con 0x7f41a8004810 2024-05-21T01:20:17.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.457+0000 7f41c2a00640 1 -- 172.21.15.63:0/2848805234 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41ac0052d0 con 0x7f41a8004810 2024-05-21T01:20:17.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.457+0000 7f41c2a00640 1 -- 172.21.15.63:0/2848805234 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41ac003840 con 0x7f41a8004810 2024-05-21T01:20:17.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.457+0000 7f41ca600640 1 -- 172.21.15.63:0/2848805234 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f41a8004810 msgr2=0x7f41a8004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:17.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.457+0000 7f41ca600640 1 --2- 172.21.15.63:0/2848805234 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f41a8004810 0x7f41a8004c90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f41ac001790 tx=0x7f41ac01c390 comp rx=0 tx=0).stop 2024-05-21T01:20:17.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.457+0000 7f41ca600640 1 -- 172.21.15.63:0/2848805234 shutdown_connections 2024-05-21T01:20:17.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.457+0000 7f41ca600640 1 --2- 172.21.15.63:0/2848805234 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f41a8004810 0x7f41a8004c90 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:17.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.457+0000 7f41ca600640 1 -- 172.21.15.63:0/2848805234 >> 172.21.15.63:0/2848805234 conn(0x7f41c40735f0 msgr2=0x7f41c4073a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:17.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.461+0000 7f41ca600640 1 -- 172.21.15.63:0/2848805234 shutdown_connections 2024-05-21T01:20:17.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.461+0000 7f41ca600640 1 -- 172.21.15.63:0/2848805234 wait complete. 2024-05-21T01:20:17.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.461+0000 7f41ca600640 1 Processor -- start 2024-05-21T01:20:17.466 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.461+0000 7f41ca600640 1 -- start start 2024-05-21T01:20:17.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.461+0000 7f41ca600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f41a8004810 0x7f41c41e5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:17.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.461+0000 7f41ca600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f41c40cfc80 0x7f41c414fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:17.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.461+0000 7f41ca600640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f41c414ff80 0x7f41c414b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:17.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.461+0000 7f41ca600640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f41c406dfc0 con 0x7f41c40cfc80 2024-05-21T01:20:17.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.461+0000 7f41ca600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f41c415cd60 con 0x7f41a8004810 2024-05-21T01:20:17.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.461+0000 7f41ca600640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f41c406e140 con 0x7f41c414ff80 2024-05-21T01:20:17.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.461+0000 7f41baa00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f41c40cfc80 0x7f41c414fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:17.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.461+0000 7f41baa00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f41c40cfc80 0x7f41c414fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:49490/0 (socket says 172.21.15.63:49490) 2024-05-21T01:20:17.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.461+0000 7f41baa00640 1 -- 172.21.15.63:0/3474160116 learned_addr learned my addr 172.21.15.63:0/3474160116 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:17.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.461+0000 7f41c3400640 1 --2- 172.21.15.63:0/3474160116 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f41a8004810 0x7f41c41e5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:17.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.461+0000 7f41c3e00640 1 --2- 172.21.15.63:0/3474160116 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f41c414ff80 0x7f41c414b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:17.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.461+0000 7f41baa00640 1 -- 172.21.15.63:0/3474160116 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f41c414ff80 msgr2=0x7f41c414b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:17.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.461+0000 7f41baa00640 1 --2- 172.21.15.63:0/3474160116 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f41c414ff80 0x7f41c414b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:17.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.461+0000 7f41baa00640 1 -- 172.21.15.63:0/3474160116 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f41a8004810 msgr2=0x7f41c41e5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:17.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.461+0000 7f41baa00640 1 --2- 172.21.15.63:0/3474160116 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f41a8004810 0x7f41c41e5590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:17.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.461+0000 7f41baa00640 1 -- 172.21.15.63:0/3474160116 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41c4150400 con 0x7f41c40cfc80 2024-05-21T01:20:17.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.461+0000 7f41c3e00640 1 --2- 172.21.15.63:0/3474160116 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f41c414ff80 0x7f41c414b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T01:20:17.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.461+0000 7f41baa00640 1 --2- 172.21.15.63:0/3474160116 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f41c40cfc80 0x7f41c414fa40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f41ac01aa90 tx=0x7f41a8005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:17.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.465+0000 7f41bbe00640 1 -- 172.21.15.63:0/3474160116 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41ac0013c0 con 0x7f41c40cfc80 2024-05-21T01:20:17.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.465+0000 7f41bbe00640 1 -- 172.21.15.63:0/3474160116 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41ac0bc070 con 0x7f41c40cfc80 2024-05-21T01:20:17.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.465+0000 7f41bbe00640 1 -- 172.21.15.63:0/3474160116 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41ac0b4840 con 0x7f41c40cfc80 2024-05-21T01:20:17.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.465+0000 7f41ca600640 1 -- 172.21.15.63:0/3474160116 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41c41f1fd0 con 0x7f41c40cfc80 2024-05-21T01:20:17.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.465+0000 7f41ca600640 1 -- 172.21.15.63:0/3474160116 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41c41f2590 con 0x7f41c40cfc80 2024-05-21T01:20:17.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.465+0000 7f41ca600640 1 -- 172.21.15.63:0/3474160116 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41c40507f0 con 0x7f41c40cfc80 2024-05-21T01:20:17.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.465+0000 7f41bbe00640 1 -- 172.21.15.63:0/3474160116 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7f41ac005270 con 0x7f41c40cfc80 2024-05-21T01:20:17.471 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.465+0000 7f41bbe00640 1 --2- 172.21.15.63:0/3474160116 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f41a006f430 0x7f41a00718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:17.472 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.465+0000 7f41bbe00640 1 -- 172.21.15.63:0/3474160116 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f41ac129a20 con 0x7f41c40cfc80 2024-05-21T01:20:17.472 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.465+0000 7f41c3400640 1 --2- 172.21.15.63:0/3474160116 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f41a006f430 0x7f41a00718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:17.472 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.469+0000 7f41c3400640 1 --2- 172.21.15.63:0/3474160116 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f41a006f430 0x7f41a00718f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f41b4009be0 tx=0x7f41b4009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:17.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.469+0000 7f41bbe00640 1 -- 172.21.15.63:0/3474160116 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f41c4150400 con 0x7f41c40cfc80 2024-05-21T01:20:17.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:17.677+0000 7f41ca600640 1 -- 172.21.15.63:0/3474160116 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f41c4071f60 con 0x7f41c40cfc80 2024-05-21T01:20:18.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:18.621+0000 7f41bbe00640 1 -- 172.21.15.63:0/3474160116 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) ==== 118+0+0 (secure 0 0 0) 0x7f41ac0160f0 con 0x7f41c40cfc80 2024-05-21T01:20:18.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:18.625+0000 7f41ca600640 1 -- 172.21.15.63:0/3474160116 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f41a006f430 msgr2=0x7f41a00718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:18.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:18.625+0000 7f41ca600640 1 --2- 172.21.15.63:0/3474160116 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f41a006f430 0x7f41a00718f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f41b4009be0 tx=0x7f41b4009190 comp rx=0 tx=0).stop 2024-05-21T01:20:18.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:18.625+0000 7f41ca600640 1 -- 172.21.15.63:0/3474160116 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f41c40cfc80 msgr2=0x7f41c414fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:18.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:18.625+0000 7f41ca600640 1 --2- 172.21.15.63:0/3474160116 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f41c40cfc80 0x7f41c414fa40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f41ac01aa90 tx=0x7f41a8005840 comp rx=0 tx=0).stop 2024-05-21T01:20:18.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:18.625+0000 7f41ca600640 1 -- 172.21.15.63:0/3474160116 shutdown_connections 2024-05-21T01:20:18.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:18.625+0000 7f41ca600640 1 --2- 172.21.15.63:0/3474160116 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f41a006f430 0x7f41a00718f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:18.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:18.625+0000 7f41ca600640 1 --2- 172.21.15.63:0/3474160116 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f41c414ff80 0x7f41c414b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:18.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:18.625+0000 7f41ca600640 1 --2- 172.21.15.63:0/3474160116 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f41c40cfc80 0x7f41c414fa40 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:18.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:18.625+0000 7f41ca600640 1 --2- 172.21.15.63:0/3474160116 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f41a8004810 0x7f41c41e5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:18.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:18.625+0000 7f41ca600640 1 -- 172.21.15.63:0/3474160116 >> 172.21.15.63:0/3474160116 conn(0x7f41c40735f0 msgr2=0x7f41c40739d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:18.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:18.625+0000 7f41ca600640 1 -- 172.21.15.63:0/3474160116 shutdown_connections 2024-05-21T01:20:18.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:18.625+0000 7f41ca600640 1 -- 172.21.15.63:0/3474160116 wait complete. 2024-05-21T01:20:18.654 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300} 2024-05-21T01:20:18.654 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2024-05-21T01:20:18.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:18.797+0000 7f244a600640 1 Processor -- start 2024-05-21T01:20:18.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:18.797+0000 7f244a600640 1 -- start start 2024-05-21T01:20:18.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:18.801+0000 7f244a600640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f244415bd30 0x7f2444073480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:18.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:18.801+0000 7f244a600640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f244406f510 con 0x7f2444156150 2024-05-21T01:20:18.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:18.801+0000 7f244a600640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2444073ac0 con 0x7f244406d5b0 2024-05-21T01:20:18.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:18.801+0000 7f244a600640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f2444070a20 con 0x7f244415bd30 2024-05-21T01:20:18.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:18.801+0000 7f2443400640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f2444156150 0x7f2444071190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:40042/0 (socket says 172.21.15.63:40042) 2024-05-21T01:20:18.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:18.801+0000 7f2443400640 1 -- 172.21.15.63:0/3107306425 learned_addr learned my addr 172.21.15.63:0/3107306425 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-05-21T01:20:18.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:18.801+0000 7f243aa00640 1 --2- 172.21.15.63:0/3107306425 >> v2:172.21.15.131:3300/0 conn(0x7f244415bd30 0x7f2444073480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:18.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:18.801+0000 7f2442a00640 1 -- 172.21.15.63:0/3107306425 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1393874497 0 0) 0x7f244406f510 con 0x7f2444156150 2024-05-21T01:20:18.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:18.801+0000 7f2442a00640 1 -- 172.21.15.63:0/3107306425 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2428003530 con 0x7f2444156150 2024-05-21T01:20:18.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:18.801+0000 7f2442a00640 1 -- 172.21.15.63:0/3107306425 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3034961517 0 0) 0x7f2428003530 con 0x7f2444156150 2024-05-21T01:20:18.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:18.801+0000 7f2442a00640 1 -- 172.21.15.63:0/3107306425 >> v2:172.21.15.131:3300/0 conn(0x7f244415bd30 msgr2=0x7f2444073480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:18.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:18.801+0000 7f2442a00640 1 --2- 172.21.15.63:0/3107306425 >> v2:172.21.15.131:3300/0 conn(0x7f244415bd30 0x7f2444073480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:18.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:18.801+0000 7f2442a00640 1 -- 172.21.15.63:0/3107306425 >> v1:172.21.15.131:6789/0 conn(0x7f244406d5b0 legacy=0x7f24441666b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:18.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:18.801+0000 7f2442a00640 1 -- 172.21.15.63:0/3107306425 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2444073da0 con 0x7f2444156150 2024-05-21T01:20:18.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:18.801+0000 7f2442a00640 1 -- 172.21.15.63:0/3107306425 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 466403955 0 0) 0x7f2434001a80 con 0x7f2444156150 2024-05-21T01:20:18.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:18.801+0000 7f2442a00640 1 -- 172.21.15.63:0/3107306425 >> v1:172.21.15.63:6789/0 conn(0x7f2444156150 legacy=0x7f2444071190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:18.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:18.801+0000 7f2442a00640 1 --2- 172.21.15.63:0/3107306425 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2428003a60 0x7f2428003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:18.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:18.801+0000 7f2442a00640 1 --2- 172.21.15.63:0/3107306425 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2428004810 0x7f2428004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:18.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:18.801+0000 7f2442a00640 1 --2- 172.21.15.63:0/3107306425 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f24280052f0 0x7f242800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:18.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:18.801+0000 7f2442a00640 1 -- 172.21.15.63:0/3107306425 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f2444070a20 con 0x7f24280052f0 2024-05-21T01:20:18.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:18.801+0000 7f2442a00640 1 -- 172.21.15.63:0/3107306425 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f242800c1c0 con 0x7f2428004810 2024-05-21T01:20:18.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:18.801+0000 7f2442a00640 1 -- 172.21.15.63:0/3107306425 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f242800c3c0 con 0x7f2428003a60 2024-05-21T01:20:18.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:18.801+0000 7f2443e00640 1 --2- 172.21.15.63:0/3107306425 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f24280052f0 0x7f242800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:18.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:18.801+0000 7f243aa00640 1 --2- 172.21.15.63:0/3107306425 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2428004810 0x7f2428004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:18.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:18.801+0000 7f2443400640 1 --2- 172.21.15.63:0/3107306425 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2428003a60 0x7f2428003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:18.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:18.801+0000 7f2443e00640 1 -- 172.21.15.63:0/3107306425 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2428003a60 msgr2=0x7f2428003e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:18.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:18.801+0000 7f2443e00640 1 --2- 172.21.15.63:0/3107306425 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2428003a60 0x7f2428003e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:18.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:18.801+0000 7f2443e00640 1 -- 172.21.15.63:0/3107306425 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2428004810 msgr2=0x7f2428004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:18.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:18.801+0000 7f2443e00640 1 --2- 172.21.15.63:0/3107306425 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2428004810 0x7f2428004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:18.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:18.801+0000 7f2443e00640 1 -- 172.21.15.63:0/3107306425 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2428003530 con 0x7f24280052f0 2024-05-21T01:20:18.810 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:18.805+0000 7f2443e00640 1 -- 172.21.15.63:0/3107306425 reap_dead start 2024-05-21T01:20:18.810 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:18.805+0000 7f2443e00640 1 --2- 172.21.15.63:0/3107306425 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f24280052f0 0x7f242800b9d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f243c007fd0 tx=0x7f243c01c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7569050cae1f3aa server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:18.810 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:18.805+0000 7f2442a00640 1 -- 172.21.15.63:0/3107306425 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f243c0013e0 con 0x7f24280052f0 2024-05-21T01:20:18.810 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:18.805+0000 7f2442a00640 1 -- 172.21.15.63:0/3107306425 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f243c0052d0 con 0x7f24280052f0 2024-05-21T01:20:18.810 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:18.805+0000 7f2442a00640 1 -- 172.21.15.63:0/3107306425 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f243c003840 con 0x7f24280052f0 2024-05-21T01:20:18.811 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:18.805+0000 7f244a600640 1 -- 172.21.15.63:0/3107306425 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f24280052f0 msgr2=0x7f242800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:18.811 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:18.805+0000 7f244a600640 1 --2- 172.21.15.63:0/3107306425 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f24280052f0 0x7f242800b9d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f243c007fd0 tx=0x7f243c01c3d0 comp rx=0 tx=0).stop 2024-05-21T01:20:18.811 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:18.805+0000 7f244a600640 1 -- 172.21.15.63:0/3107306425 shutdown_connections 2024-05-21T01:20:18.811 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:18.805+0000 7f244a600640 1 --2- 172.21.15.63:0/3107306425 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f24280052f0 0x7f242800b9d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:18.811 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:18.805+0000 7f244a600640 1 -- 172.21.15.63:0/3107306425 >> 172.21.15.63:0/3107306425 conn(0x7f24440cbf10 msgr2=0x7f24440cc320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:18.811 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:18.805+0000 7f244a600640 1 -- 172.21.15.63:0/3107306425 shutdown_connections 2024-05-21T01:20:18.811 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:18.805+0000 7f244a600640 1 -- 172.21.15.63:0/3107306425 wait complete. 2024-05-21T01:20:18.812 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:18.809+0000 7f244a600640 1 Processor -- start 2024-05-21T01:20:18.812 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:18.809+0000 7f244a600640 1 -- start start 2024-05-21T01:20:18.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:18.809+0000 7f244a600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f24280052f0 0x7f2444158cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:18.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:18.809+0000 7f244a600640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f24441529b0 0x7f2444144d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:18.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:18.809+0000 7f244a600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2444145250 0x7f2444156be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:18.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:18.809+0000 7f244a600640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f24440748d0 con 0x7f2444145250 2024-05-21T01:20:18.816 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:18.809+0000 7f244a600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f2444074360 con 0x7f24280052f0 2024-05-21T01:20:18.816 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:18.809+0000 7f244a600640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f2444074a50 con 0x7f24441529b0 2024-05-21T01:20:18.816 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:18.809+0000 7f2443e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2444145250 0x7f2444156be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:18.816 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:18.809+0000 7f2443e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2444145250 0x7f2444156be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:49092/0 (socket says 172.21.15.63:49092) 2024-05-21T01:20:18.816 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:18.809+0000 7f2443e00640 1 -- 172.21.15.63:0/4251790383 learned_addr learned my addr 172.21.15.63:0/4251790383 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:18.816 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:18.809+0000 7f2443400640 1 --2- 172.21.15.63:0/4251790383 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f24280052f0 0x7f2444158cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:18.816 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:18.809+0000 7f243aa00640 1 --2- 172.21.15.63:0/4251790383 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f24441529b0 0x7f2444144d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:18.816 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:18.809+0000 7f2443e00640 1 -- 172.21.15.63:0/4251790383 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f24441529b0 msgr2=0x7f2444144d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:18.816 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:18.809+0000 7f2443e00640 1 --2- 172.21.15.63:0/4251790383 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f24441529b0 0x7f2444144d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:18.816 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:18.809+0000 7f2443e00640 1 -- 172.21.15.63:0/4251790383 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f24280052f0 msgr2=0x7f2444158cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:18.816 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:18.809+0000 7f2443e00640 1 --2- 172.21.15.63:0/4251790383 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f24280052f0 0x7f2444158cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:18.816 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:18.809+0000 7f2443e00640 1 -- 172.21.15.63:0/4251790383 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2444146f20 con 0x7f2444145250 2024-05-21T01:20:18.816 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:18.809+0000 7f243aa00640 1 --2- 172.21.15.63:0/4251790383 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f24441529b0 0x7f2444144d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T01:20:18.817 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:18.809+0000 7f2443e00640 1 --2- 172.21.15.63:0/4251790383 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2444145250 0x7f2444156be0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f243c01cc70 tx=0x7f2428005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:18.817 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:18.809+0000 7f243be00640 1 -- 172.21.15.63:0/4251790383 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f243c0013c0 con 0x7f2444145250 2024-05-21T01:20:18.817 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:18.809+0000 7f243be00640 1 -- 172.21.15.63:0/4251790383 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f243c005480 con 0x7f2444145250 2024-05-21T01:20:18.817 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:18.809+0000 7f243be00640 1 -- 172.21.15.63:0/4251790383 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f243c0067e0 con 0x7f2444145250 2024-05-21T01:20:18.817 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:18.809+0000 7f244a600640 1 -- 172.21.15.63:0/4251790383 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2444146680 con 0x7f2444145250 2024-05-21T01:20:18.817 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:18.809+0000 7f244a600640 1 -- 172.21.15.63:0/4251790383 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2444146c40 con 0x7f2444145250 2024-05-21T01:20:18.818 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:18.809+0000 7f244a600640 1 -- 172.21.15.63:0/4251790383 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24440507f0 con 0x7f2444145250 2024-05-21T01:20:18.818 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:18.813+0000 7f243be00640 1 -- 172.21.15.63:0/4251790383 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7f243c0069a0 con 0x7f2444145250 2024-05-21T01:20:18.818 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:18.813+0000 7f243be00640 1 --2- 172.21.15.63:0/4251790383 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f242006f430 0x7f24200718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:18.818 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:18.813+0000 7f243be00640 1 -- 172.21.15.63:0/4251790383 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f243c1287b0 con 0x7f2444145250 2024-05-21T01:20:18.818 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:18.813+0000 7f2443400640 1 --2- 172.21.15.63:0/4251790383 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f242006f430 0x7f24200718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:18.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:18.813+0000 7f2443400640 1 --2- 172.21.15.63:0/4251790383 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f242006f430 0x7f24200718f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2434001340 tx=0x7f2434001550 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:18.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:18.817+0000 7f243be00640 1 -- 172.21.15.63:0/4251790383 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f243c0bd030 con 0x7f2444145250 2024-05-21T01:20:19.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:19.017+0000 7f244a600640 1 -- 172.21.15.63:0/4251790383 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7f2444154ca0 con 0x7f2444145250 2024-05-21T01:20:19.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:19.625+0000 7f243be00640 1 -- 172.21.15.63:0/4251790383 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v9) ==== 105+0+0 (secure 0 0 0) 0x7f243c016130 con 0x7f2444145250 2024-05-21T01:20:19.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:19.625+0000 7f244a600640 1 -- 172.21.15.63:0/4251790383 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f242006f430 msgr2=0x7f24200718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:19.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:19.625+0000 7f244a600640 1 --2- 172.21.15.63:0/4251790383 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f242006f430 0x7f24200718f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2434001340 tx=0x7f2434001550 comp rx=0 tx=0).stop 2024-05-21T01:20:19.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:19.625+0000 7f244a600640 1 -- 172.21.15.63:0/4251790383 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2444145250 msgr2=0x7f2444156be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:19.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:19.625+0000 7f244a600640 1 --2- 172.21.15.63:0/4251790383 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2444145250 0x7f2444156be0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f243c01cc70 tx=0x7f2428005840 comp rx=0 tx=0).stop 2024-05-21T01:20:19.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:19.625+0000 7f244a600640 1 -- 172.21.15.63:0/4251790383 shutdown_connections 2024-05-21T01:20:19.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:19.625+0000 7f244a600640 1 --2- 172.21.15.63:0/4251790383 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f242006f430 0x7f24200718f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:19.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:19.625+0000 7f244a600640 1 --2- 172.21.15.63:0/4251790383 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2444145250 0x7f2444156be0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:19.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:19.625+0000 7f244a600640 1 --2- 172.21.15.63:0/4251790383 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f24441529b0 0x7f2444144d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:19.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:19.625+0000 7f244a600640 1 --2- 172.21.15.63:0/4251790383 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f24280052f0 0x7f2444158cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:19.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:19.625+0000 7f244a600640 1 -- 172.21.15.63:0/4251790383 >> 172.21.15.63:0/4251790383 conn(0x7f24440cbf10 msgr2=0x7f244415c580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:19.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:19.629+0000 7f244a600640 1 -- 172.21.15.63:0/4251790383 shutdown_connections 2024-05-21T01:20:19.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:19.629+0000 7f244a600640 1 -- 172.21.15.63:0/4251790383 wait complete. 2024-05-21T01:20:19.653 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-21T01:20:19.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:19.797+0000 7f845e200640 1 Processor -- start 2024-05-21T01:20:19.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:19.797+0000 7f845e200640 1 -- start start 2024-05-21T01:20:19.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:19.797+0000 7f845e200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8458156150 0x7f845815bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:19.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:19.797+0000 7f845e200640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f845806f510 con 0x7f8458073480 2024-05-21T01:20:19.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:19.797+0000 7f845e200640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8458073ac0 con 0x7f845806d5b0 2024-05-21T01:20:19.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:19.797+0000 7f845e200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f8458070a20 con 0x7f8458156150 2024-05-21T01:20:19.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:19.797+0000 7f844fe00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f8458073480 0x7f8458071190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:40054/0 (socket says 172.21.15.63:40054) 2024-05-21T01:20:19.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:19.797+0000 7f844fe00640 1 -- 172.21.15.63:0/1283108534 learned_addr learned my addr 172.21.15.63:0/1283108534 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-05-21T01:20:19.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:19.797+0000 7f8457400640 1 --2- 172.21.15.63:0/1283108534 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8458156150 0x7f845815bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:19.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:19.797+0000 7f8456a00640 1 -- 172.21.15.63:0/1283108534 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2188156187 0 0) 0x7f845806f510 con 0x7f8458073480 2024-05-21T01:20:19.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:19.797+0000 7f8456a00640 1 -- 172.21.15.63:0/1283108534 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f843c003530 con 0x7f8458073480 2024-05-21T01:20:19.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:19.797+0000 7f8456a00640 1 -- 172.21.15.63:0/1283108534 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3132987257 0 0) 0x7f8458073ac0 con 0x7f845806d5b0 2024-05-21T01:20:19.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:19.797+0000 7f8456a00640 1 -- 172.21.15.63:0/1283108534 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f845806f510 con 0x7f845806d5b0 2024-05-21T01:20:19.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:19.797+0000 7f8456a00640 1 -- 172.21.15.63:0/1283108534 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 778204031 0 0) 0x7f843c003530 con 0x7f8458073480 2024-05-21T01:20:19.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:19.797+0000 7f8457400640 1 -- 172.21.15.63:0/1283108534 >> v1:172.21.15.131:6789/0 conn(0x7f845806d5b0 legacy=0x7f84581666b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:19.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:19.797+0000 7f8457400640 1 -- 172.21.15.63:0/1283108534 >> v1:172.21.15.63:6789/0 conn(0x7f8458073480 legacy=0x7f8458071190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:19.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:19.797+0000 7f8457400640 1 -- 172.21.15.63:0/1283108534 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8458073da0 con 0x7f8458156150 2024-05-21T01:20:19.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:19.801+0000 7f8457400640 1 --2- 172.21.15.63:0/1283108534 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8458156150 0x7f845815bd30 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f84480097f0 tx=0x7f844801c370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=82954f6226ca69d1 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:19.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:19.801+0000 7f8456a00640 1 -- 172.21.15.63:0/1283108534 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84480b0070 con 0x7f8458156150 2024-05-21T01:20:19.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:19.801+0000 7f8456a00640 1 -- 172.21.15.63:0/1283108534 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84480ab400 con 0x7f8458156150 2024-05-21T01:20:19.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:19.801+0000 7f8456a00640 1 -- 172.21.15.63:0/1283108534 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8440001700 con 0x7f8458156150 2024-05-21T01:20:19.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:19.801+0000 7f845e200640 1 -- 172.21.15.63:0/1283108534 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8458156150 msgr2=0x7f845815bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:19.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:19.801+0000 7f845e200640 1 --2- 172.21.15.63:0/1283108534 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8458156150 0x7f845815bd30 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f84480097f0 tx=0x7f844801c370 comp rx=0 tx=0).stop 2024-05-21T01:20:19.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:19.801+0000 7f845e200640 1 -- 172.21.15.63:0/1283108534 shutdown_connections 2024-05-21T01:20:19.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:19.801+0000 7f845e200640 1 --2- 172.21.15.63:0/1283108534 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8458156150 0x7f845815bd30 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:19.807 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:19.801+0000 7f845e200640 1 -- 172.21.15.63:0/1283108534 >> 172.21.15.63:0/1283108534 conn(0x7f84580cbf10 msgr2=0x7f84580cc320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:19.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:19.801+0000 7f845e200640 1 -- 172.21.15.63:0/1283108534 shutdown_connections 2024-05-21T01:20:19.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:19.801+0000 7f845e200640 1 -- 172.21.15.63:0/1283108534 wait complete. 2024-05-21T01:20:19.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:19.805+0000 7f845e200640 1 Processor -- start 2024-05-21T01:20:19.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:19.805+0000 7f845e200640 1 -- start start 2024-05-21T01:20:19.811 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:19.805+0000 7f845e200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f845806d5b0 0x7f84580cf590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:19.811 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:19.805+0000 7f845e200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8458073480 0x7f84581f55e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:19.811 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:19.805+0000 7f845e200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8458156150 0x7f84581f8b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:19.811 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:19.805+0000 7f845e200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f8458074a50 con 0x7f8458073480 2024-05-21T01:20:19.811 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:19.805+0000 7f845e200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f84580748d0 con 0x7f845806d5b0 2024-05-21T01:20:19.811 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:19.805+0000 7f845e200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f84580718a0 con 0x7f8458156150 2024-05-21T01:20:19.811 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:19.805+0000 7f844fe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8458073480 0x7f84581f55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:19.811 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:19.805+0000 7f844fe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8458073480 0x7f84581f55e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:49096/0 (socket says 172.21.15.63:49096) 2024-05-21T01:20:19.811 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:19.805+0000 7f844fe00640 1 -- 172.21.15.63:0/2002760865 learned_addr learned my addr 172.21.15.63:0/2002760865 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:19.811 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:19.805+0000 7f8457e00640 1 --2- 172.21.15.63:0/2002760865 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8458156150 0x7f84581f8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:19.811 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:19.805+0000 7f8457400640 1 --2- 172.21.15.63:0/2002760865 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f845806d5b0 0x7f84580cf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:19.811 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:19.805+0000 7f844fe00640 1 -- 172.21.15.63:0/2002760865 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8458156150 msgr2=0x7f84581f8b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:19.812 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:19.805+0000 7f844fe00640 1 --2- 172.21.15.63:0/2002760865 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8458156150 0x7f84581f8b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:19.812 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:19.805+0000 7f844fe00640 1 -- 172.21.15.63:0/2002760865 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f845806d5b0 msgr2=0x7f84580cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:19.812 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:19.805+0000 7f844fe00640 1 --2- 172.21.15.63:0/2002760865 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f845806d5b0 0x7f84580cf590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:19.812 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:19.805+0000 7f844fe00640 1 -- 172.21.15.63:0/2002760865 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8458145730 con 0x7f8458073480 2024-05-21T01:20:19.812 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:19.805+0000 7f844fe00640 1 --2- 172.21.15.63:0/2002760865 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8458073480 0x7f84581f55e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f844000c730 tx=0x7f844000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:19.812 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:19.805+0000 7f844f400640 1 -- 172.21.15.63:0/2002760865 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8440017070 con 0x7f8458073480 2024-05-21T01:20:19.813 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:19.805+0000 7f844f400640 1 -- 172.21.15.63:0/2002760865 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8440005ae0 con 0x7f8458073480 2024-05-21T01:20:19.813 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:19.805+0000 7f845e200640 1 -- 172.21.15.63:0/2002760865 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8458145d90 con 0x7f8458073480 2024-05-21T01:20:19.813 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:19.805+0000 7f844f400640 1 -- 172.21.15.63:0/2002760865 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8440007070 con 0x7f8458073480 2024-05-21T01:20:19.813 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:19.805+0000 7f845e200640 1 -- 172.21.15.63:0/2002760865 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8458146050 con 0x7f8458073480 2024-05-21T01:20:19.813 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:19.805+0000 7f845e200640 1 -- 172.21.15.63:0/2002760865 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8458146380 con 0x7f8458073480 2024-05-21T01:20:19.813 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:19.809+0000 7f844f400640 1 -- 172.21.15.63:0/2002760865 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7f844001a070 con 0x7f8458073480 2024-05-21T01:20:19.814 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:19.809+0000 7f844f400640 1 --2- 172.21.15.63:0/2002760865 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f843406f400 0x7f84340718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:19.814 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:19.809+0000 7f844f400640 1 -- 172.21.15.63:0/2002760865 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f844008ead0 con 0x7f8458073480 2024-05-21T01:20:19.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:19.809+0000 7f8457400640 1 --2- 172.21.15.63:0/2002760865 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f843406f400 0x7f84340718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:19.815 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:19.809+0000 7f8457400640 1 --2- 172.21.15.63:0/2002760865 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f843406f400 0x7f84340718c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f84480ad000 tx=0x7f8448008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:19.818 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:19.813+0000 7f844f400640 1 -- 172.21.15.63:0/2002760865 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f844005b670 con 0x7f8458073480 2024-05-21T01:20:20.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:20.017+0000 7f845e200640 1 -- 172.21.15.63:0/2002760865 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f84580507f0 con 0x7f8458073480 2024-05-21T01:20:20.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:20.641+0000 7f844f400640 1 -- 172.21.15.63:0/2002760865 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v11) ==== 122+0+0 (secure 0 0 0) 0x7f844005af70 con 0x7f8458073480 2024-05-21T01:20:20.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:20.641+0000 7f845e200640 1 -- 172.21.15.63:0/2002760865 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f843406f400 msgr2=0x7f84340718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:20.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:20.641+0000 7f845e200640 1 --2- 172.21.15.63:0/2002760865 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f843406f400 0x7f84340718c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f84480ad000 tx=0x7f8448008040 comp rx=0 tx=0).stop 2024-05-21T01:20:20.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:20.641+0000 7f845e200640 1 -- 172.21.15.63:0/2002760865 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8458073480 msgr2=0x7f84581f55e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:20.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:20.641+0000 7f845e200640 1 --2- 172.21.15.63:0/2002760865 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8458073480 0x7f84581f55e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f844000c730 tx=0x7f844000cbf0 comp rx=0 tx=0).stop 2024-05-21T01:20:20.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:20.641+0000 7f845e200640 1 -- 172.21.15.63:0/2002760865 shutdown_connections 2024-05-21T01:20:20.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:20.641+0000 7f845e200640 1 --2- 172.21.15.63:0/2002760865 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f843406f400 0x7f84340718c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:20.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:20.641+0000 7f845e200640 1 --2- 172.21.15.63:0/2002760865 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8458156150 0x7f84581f8b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:20.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:20.641+0000 7f845e200640 1 --2- 172.21.15.63:0/2002760865 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8458073480 0x7f84581f55e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:20.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:20.641+0000 7f845e200640 1 --2- 172.21.15.63:0/2002760865 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f845806d5b0 0x7f84580cf590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:20.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:20.641+0000 7f845e200640 1 -- 172.21.15.63:0/2002760865 >> 172.21.15.63:0/2002760865 conn(0x7f84580cbf10 msgr2=0x7f845815b640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:20.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:20.641+0000 7f845e200640 1 -- 172.21.15.63:0/2002760865 shutdown_connections 2024-05-21T01:20:20.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:20.641+0000 7f845e200640 1 -- 172.21.15.63:0/2002760865 wait complete. 2024-05-21T01:20:20.672 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-05-21T01:20:20.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:20.817+0000 7f6f8ae00640 1 Processor -- start 2024-05-21T01:20:20.820 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:20.817+0000 7f6f8ae00640 1 -- start start 2024-05-21T01:20:20.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:20.817+0000 7f6f8ae00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f6f840c69c0 0x7f6f840c6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:20.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:20.817+0000 7f6f8ae00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f840c7310 con 0x7f6f8406f9b0 2024-05-21T01:20:20.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:20.817+0000 7f6f8ae00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f840c4fc0 con 0x7f6f8406f5d0 2024-05-21T01:20:20.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:20.817+0000 7f6f8ae00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f6f840c52a0 con 0x7f6f840c69c0 2024-05-21T01:20:20.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:20.817+0000 7f6f7b400640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f6f8406f9b0 0x7f6f840c94f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:40058/0 (socket says 172.21.15.63:40058) 2024-05-21T01:20:20.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:20.817+0000 7f6f7b400640 1 -- 172.21.15.63:0/1498269389 learned_addr learned my addr 172.21.15.63:0/1498269389 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-05-21T01:20:20.822 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:20.817+0000 7f6f88e00640 1 --2- 172.21.15.63:0/1498269389 >> v2:172.21.15.131:3300/0 conn(0x7f6f840c69c0 0x7f6f840c6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:20.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:20.817+0000 7f6f83400640 1 -- 172.21.15.63:0/1498269389 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2871744015 0 0) 0x7f6f840c7310 con 0x7f6f8406f9b0 2024-05-21T01:20:20.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:20.817+0000 7f6f83400640 1 -- 172.21.15.63:0/1498269389 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f68003530 con 0x7f6f8406f9b0 2024-05-21T01:20:20.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:20.817+0000 7f6f83400640 1 -- 172.21.15.63:0/1498269389 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1594898821 0 0) 0x7f6f68003530 con 0x7f6f8406f9b0 2024-05-21T01:20:20.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:20.817+0000 7f6f83400640 1 -- 172.21.15.63:0/1498269389 >> v2:172.21.15.131:3300/0 conn(0x7f6f840c69c0 msgr2=0x7f6f840c6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:20.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:20.817+0000 7f6f83400640 1 --2- 172.21.15.63:0/1498269389 >> v2:172.21.15.131:3300/0 conn(0x7f6f840c69c0 0x7f6f840c6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:20.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:20.817+0000 7f6f83400640 1 -- 172.21.15.63:0/1498269389 >> v1:172.21.15.131:6789/0 conn(0x7f6f8406f5d0 legacy=0x7f6f840c47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:20.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:20.817+0000 7f6f83400640 1 -- 172.21.15.63:0/1498269389 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f840ca240 con 0x7f6f8406f9b0 2024-05-21T01:20:20.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:20.817+0000 7f6f83400640 1 -- 172.21.15.63:0/1498269389 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 466403955 0 0) 0x7f6f6c001700 con 0x7f6f8406f9b0 2024-05-21T01:20:20.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:20.817+0000 7f6f83400640 1 -- 172.21.15.63:0/1498269389 >> v1:172.21.15.63:6789/0 conn(0x7f6f8406f9b0 legacy=0x7f6f840c94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:20.824 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:20.817+0000 7f6f83400640 1 --2- 172.21.15.63:0/1498269389 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6f68003a10 0x7f6f68003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:20.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:20.817+0000 7f6f83400640 1 --2- 172.21.15.63:0/1498269389 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f68004810 0x7f6f68004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:20.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:20.817+0000 7f6f83400640 1 --2- 172.21.15.63:0/1498269389 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6f680051d0 0x7f6f6800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:20.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:20.817+0000 7f6f83400640 1 -- 172.21.15.63:0/1498269389 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f6f840c52a0 con 0x7f6f68004810 2024-05-21T01:20:20.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:20.817+0000 7f6f83400640 1 -- 172.21.15.63:0/1498269389 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f6f6800c070 con 0x7f6f68003a10 2024-05-21T01:20:20.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:20.817+0000 7f6f83400640 1 -- 172.21.15.63:0/1498269389 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f6f6800c270 con 0x7f6f680051d0 2024-05-21T01:20:20.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:20.817+0000 7f6f7b400640 1 --2- 172.21.15.63:0/1498269389 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f68004810 0x7f6f68004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:20.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:20.817+0000 7f6f83e00640 1 --2- 172.21.15.63:0/1498269389 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6f68003a10 0x7f6f68003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:20.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:20.817+0000 7f6f88e00640 1 --2- 172.21.15.63:0/1498269389 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6f680051d0 0x7f6f6800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:20.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:20.817+0000 7f6f7b400640 1 -- 172.21.15.63:0/1498269389 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6f680051d0 msgr2=0x7f6f6800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:20.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:20.817+0000 7f6f7b400640 1 --2- 172.21.15.63:0/1498269389 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6f680051d0 0x7f6f6800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:20.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:20.817+0000 7f6f7b400640 1 -- 172.21.15.63:0/1498269389 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6f68003a10 msgr2=0x7f6f68003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:20.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:20.817+0000 7f6f7b400640 1 --2- 172.21.15.63:0/1498269389 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6f68003a10 0x7f6f68003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:20.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:20.817+0000 7f6f7b400640 1 -- 172.21.15.63:0/1498269389 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f68003530 con 0x7f6f68004810 2024-05-21T01:20:20.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:20.817+0000 7f6f88e00640 1 -- 172.21.15.63:0/1498269389 reap_dead start 2024-05-21T01:20:20.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:20.821+0000 7f6f7b400640 1 --2- 172.21.15.63:0/1498269389 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f68004810 0x7f6f68004c90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c00c160 tx=0x7f6f6c01cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bcf87e5bc895f5 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:20.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:20.821+0000 7f6f83400640 1 -- 172.21.15.63:0/1498269389 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f6c007cb0 con 0x7f6f68004810 2024-05-21T01:20:20.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:20.821+0000 7f6f83400640 1 -- 172.21.15.63:0/1498269389 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f6c0a9020 con 0x7f6f68004810 2024-05-21T01:20:20.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:20.821+0000 7f6f83400640 1 -- 172.21.15.63:0/1498269389 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f6c005b00 con 0x7f6f68004810 2024-05-21T01:20:20.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:20.821+0000 7f6f8ae00640 1 -- 172.21.15.63:0/1498269389 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f68004810 msgr2=0x7f6f68004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:20.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:20.821+0000 7f6f8ae00640 1 --2- 172.21.15.63:0/1498269389 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f68004810 0x7f6f68004c90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c00c160 tx=0x7f6f6c01cac0 comp rx=0 tx=0).stop 2024-05-21T01:20:20.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:20.821+0000 7f6f8ae00640 1 -- 172.21.15.63:0/1498269389 shutdown_connections 2024-05-21T01:20:20.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:20.821+0000 7f6f8ae00640 1 --2- 172.21.15.63:0/1498269389 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f68004810 0x7f6f68004c90 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:20.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:20.821+0000 7f6f8ae00640 1 -- 172.21.15.63:0/1498269389 >> 172.21.15.63:0/1498269389 conn(0x7f6f84068460 msgr2=0x7f6f84068870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:20.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:20.821+0000 7f6f8ae00640 1 -- 172.21.15.63:0/1498269389 shutdown_connections 2024-05-21T01:20:20.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:20.821+0000 7f6f8ae00640 1 -- 172.21.15.63:0/1498269389 wait complete. 2024-05-21T01:20:20.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:20.825+0000 7f6f8ae00640 1 Processor -- start 2024-05-21T01:20:20.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:20.825+0000 7f6f8ae00640 1 -- start start 2024-05-21T01:20:20.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:20.825+0000 7f6f8ae00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f68004810 0x7f6f84159b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:20.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:20.825+0000 7f6f8ae00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6f8414da30 0x7f6f84158780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:20.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:20.825+0000 7f6f8ae00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6f84148910 0x7f6f8415a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:20.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:20.825+0000 7f6f8ae00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f6f840caae0 con 0x7f6f68004810 2024-05-21T01:20:20.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:20.825+0000 7f6f8ae00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f6f840ca800 con 0x7f6f84148910 2024-05-21T01:20:20.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:20.825+0000 7f6f8ae00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f6f840c6dd0 con 0x7f6f8414da30 2024-05-21T01:20:20.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:20.825+0000 7f6f83e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f68004810 0x7f6f84159b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:20.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:20.825+0000 7f6f83e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f68004810 0x7f6f84159b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:49112/0 (socket says 172.21.15.63:49112) 2024-05-21T01:20:20.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:20.825+0000 7f6f83e00640 1 -- 172.21.15.63:0/638507855 learned_addr learned my addr 172.21.15.63:0/638507855 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:20.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:20.825+0000 7f6f88e00640 1 --2- 172.21.15.63:0/638507855 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6f84148910 0x7f6f8415a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:20.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:20.825+0000 7f6f7b400640 1 --2- 172.21.15.63:0/638507855 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6f8414da30 0x7f6f84158780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:20.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:20.825+0000 7f6f83e00640 1 -- 172.21.15.63:0/638507855 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6f8414da30 msgr2=0x7f6f84158780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:20.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:20.825+0000 7f6f83e00640 1 --2- 172.21.15.63:0/638507855 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6f8414da30 0x7f6f84158780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:20.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:20.825+0000 7f6f83e00640 1 -- 172.21.15.63:0/638507855 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6f84148910 msgr2=0x7f6f8415a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:20.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:20.825+0000 7f6f83e00640 1 --2- 172.21.15.63:0/638507855 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6f84148910 0x7f6f8415a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:20.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:20.825+0000 7f6f83e00640 1 -- 172.21.15.63:0/638507855 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f84158cc0 con 0x7f6f68004810 2024-05-21T01:20:20.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:20.825+0000 7f6f83e00640 1 --2- 172.21.15.63:0/638507855 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f68004810 0x7f6f84159b20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6f740129a0 tx=0x7f6f74012e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:20.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:20.825+0000 7f6f80c00640 1 -- 172.21.15.63:0/638507855 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f74010c30 con 0x7f6f68004810 2024-05-21T01:20:20.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:20.825+0000 7f6f80c00640 1 -- 172.21.15.63:0/638507855 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f7401b070 con 0x7f6f68004810 2024-05-21T01:20:20.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:20.825+0000 7f6f80c00640 1 -- 172.21.15.63:0/638507855 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f74016480 con 0x7f6f68004810 2024-05-21T01:20:20.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:20.825+0000 7f6f8ae00640 1 -- 172.21.15.63:0/638507855 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f84157c40 con 0x7f6f68004810 2024-05-21T01:20:20.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:20.825+0000 7f6f8ae00640 1 -- 172.21.15.63:0/638507855 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f841477e0 con 0x7f6f68004810 2024-05-21T01:20:20.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:20.825+0000 7f6f8ae00640 1 -- 172.21.15.63:0/638507855 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f840507f0 con 0x7f6f68004810 2024-05-21T01:20:20.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:20.829+0000 7f6f80c00640 1 -- 172.21.15.63:0/638507855 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7f6f74016620 con 0x7f6f68004810 2024-05-21T01:20:20.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:20.829+0000 7f6f80c00640 1 --2- 172.21.15.63:0/638507855 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f6f6006f430 0x7f6f600718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:20.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:20.829+0000 7f6f80c00640 1 -- 172.21.15.63:0/638507855 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f6f74092e70 con 0x7f6f68004810 2024-05-21T01:20:20.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:20.829+0000 7f6f7b400640 1 --2- 172.21.15.63:0/638507855 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f6f6006f430 0x7f6f600718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:20.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:20.829+0000 7f6f7b400640 1 --2- 172.21.15.63:0/638507855 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f6f6006f430 0x7f6f600718f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c0aa000 tx=0x7f6f6c001940 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:20.838 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:20.833+0000 7f6f80c00640 1 -- 172.21.15.63:0/638507855 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f6f7405fa10 con 0x7f6f68004810 2024-05-21T01:20:21.037 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:21.033+0000 7f6f8ae00640 1 -- 172.21.15.63:0/638507855 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f6f840c5540 con 0x7f6f68004810 2024-05-21T01:20:21.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:21.641+0000 7f6f80c00640 1 -- 172.21.15.63:0/638507855 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v12) ==== 115+0+0 (secure 0 0 0) 0x7f6f7405f310 con 0x7f6f68004810 2024-05-21T01:20:21.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:21.645+0000 7f6f8ae00640 1 -- 172.21.15.63:0/638507855 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f6f6006f430 msgr2=0x7f6f600718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:21.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:21.645+0000 7f6f8ae00640 1 --2- 172.21.15.63:0/638507855 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f6f6006f430 0x7f6f600718f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c0aa000 tx=0x7f6f6c001940 comp rx=0 tx=0).stop 2024-05-21T01:20:21.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:21.645+0000 7f6f8ae00640 1 -- 172.21.15.63:0/638507855 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f68004810 msgr2=0x7f6f84159b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:21.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:21.645+0000 7f6f8ae00640 1 --2- 172.21.15.63:0/638507855 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f68004810 0x7f6f84159b20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6f740129a0 tx=0x7f6f74012e60 comp rx=0 tx=0).stop 2024-05-21T01:20:21.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:21.645+0000 7f6f8ae00640 1 -- 172.21.15.63:0/638507855 shutdown_connections 2024-05-21T01:20:21.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:21.645+0000 7f6f8ae00640 1 --2- 172.21.15.63:0/638507855 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f6f6006f430 0x7f6f600718f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:21.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:21.645+0000 7f6f8ae00640 1 --2- 172.21.15.63:0/638507855 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6f84148910 0x7f6f8415a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:21.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:21.645+0000 7f6f8ae00640 1 --2- 172.21.15.63:0/638507855 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6f8414da30 0x7f6f84158780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:21.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:21.645+0000 7f6f8ae00640 1 --2- 172.21.15.63:0/638507855 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f68004810 0x7f6f84159b20 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:21.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:21.645+0000 7f6f8ae00640 1 -- 172.21.15.63:0/638507855 >> 172.21.15.63:0/638507855 conn(0x7f6f84068460 msgr2=0x7f6f84151f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:21.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:21.645+0000 7f6f8ae00640 1 -- 172.21.15.63:0/638507855 shutdown_connections 2024-05-21T01:20:21.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:21.645+0000 7f6f8ae00640 1 -- 172.21.15.63:0/638507855 wait complete. 2024-05-21T01:20:21.676 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-21T01:20:21.676 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-21T01:20:21.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:21.817+0000 7f633b000640 1 Processor -- start 2024-05-21T01:20:21.821 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:21.817+0000 7f633b000640 1 -- start start 2024-05-21T01:20:21.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:21.817+0000 7f633b000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6334155d00 0x7f633406d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:21.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:21.817+0000 7f633b000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f63340731b0 0x7f6334073640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:21.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:21.817+0000 7f633b000640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6334072920 con 0x7f6334073cf0 2024-05-21T01:20:21.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:21.817+0000 7f633b000640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f633415cd30 con 0x7f63340731b0 2024-05-21T01:20:21.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:21.817+0000 7f633b000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f633415be60 con 0x7f6334155d00 2024-05-21T01:20:21.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:21.817+0000 7f632b400640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f6334073cf0 0x7f633415c620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:40074/0 (socket says 172.21.15.63:40074) 2024-05-21T01:20:21.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:21.817+0000 7f632b400640 1 -- 172.21.15.63:0/141093522 learned_addr learned my addr 172.21.15.63:0/141093522 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-05-21T01:20:21.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:21.817+0000 7f6339000640 1 --2- 172.21.15.63:0/141093522 >> v2:172.21.15.131:3300/0 conn(0x7f63340731b0 0x7f6334073640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:21.823 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:21.817+0000 7f6333e00640 1 --2- 172.21.15.63:0/141093522 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6334155d00 0x7f633406d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:21.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:21.817+0000 7f6333400640 1 -- 172.21.15.63:0/141093522 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4122782896 0 0) 0x7f6334072920 con 0x7f6334073cf0 2024-05-21T01:20:21.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:21.817+0000 7f6333400640 1 -- 172.21.15.63:0/141093522 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6318003530 con 0x7f6334073cf0 2024-05-21T01:20:21.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:21.817+0000 7f6333400640 1 -- 172.21.15.63:0/141093522 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1069710034 0 0) 0x7f6318003530 con 0x7f6334073cf0 2024-05-21T01:20:21.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:21.817+0000 7f6333400640 1 -- 172.21.15.63:0/141093522 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6334155d00 msgr2=0x7f633406d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:21.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:21.817+0000 7f6333400640 1 --2- 172.21.15.63:0/141093522 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6334155d00 0x7f633406d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:21.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:21.817+0000 7f6333400640 1 -- 172.21.15.63:0/141093522 >> v2:172.21.15.131:3300/0 conn(0x7f63340731b0 msgr2=0x7f6334073640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:21.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:21.817+0000 7f6333400640 1 --2- 172.21.15.63:0/141093522 >> v2:172.21.15.131:3300/0 conn(0x7f63340731b0 0x7f6334073640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:21.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:21.817+0000 7f6333400640 1 -- 172.21.15.63:0/141093522 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6334074310 con 0x7f6334073cf0 2024-05-21T01:20:21.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:21.817+0000 7f6333400640 1 -- 172.21.15.63:0/141093522 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 466403955 0 0) 0x7f631c001700 con 0x7f6334073cf0 2024-05-21T01:20:21.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:21.817+0000 7f6333400640 1 -- 172.21.15.63:0/141093522 >> v1:172.21.15.63:6789/0 conn(0x7f6334073cf0 legacy=0x7f633415c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:21.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:21.817+0000 7f6333400640 1 --2- 172.21.15.63:0/141093522 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6318003a10 0x7f6318003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:21.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:21.817+0000 7f6333400640 1 --2- 172.21.15.63:0/141093522 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6318004810 0x7f6318004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:21.825 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:21.817+0000 7f6333400640 1 --2- 172.21.15.63:0/141093522 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6334155d00 0x7f63180051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:21.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:21.817+0000 7f6333400640 1 -- 172.21.15.63:0/141093522 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f633415cd30 con 0x7f6318004810 2024-05-21T01:20:21.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:21.817+0000 7f6333400640 1 -- 172.21.15.63:0/141093522 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f633415be60 con 0x7f6318003a10 2024-05-21T01:20:21.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:21.817+0000 7f6333400640 1 -- 172.21.15.63:0/141093522 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f631800ba50 con 0x7f6334155d00 2024-05-21T01:20:21.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:21.817+0000 7f632b400640 1 --2- 172.21.15.63:0/141093522 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6318004810 0x7f6318004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:21.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:21.817+0000 7f6333e00640 1 --2- 172.21.15.63:0/141093522 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6318003a10 0x7f6318003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:21.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:21.821+0000 7f6339000640 1 --2- 172.21.15.63:0/141093522 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6334155d00 0x7f63180051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:21.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:21.821+0000 7f632b400640 1 -- 172.21.15.63:0/141093522 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6334155d00 msgr2=0x7f63180051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:21.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:21.821+0000 7f632b400640 1 --2- 172.21.15.63:0/141093522 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6334155d00 0x7f63180051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:21.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:21.821+0000 7f632b400640 1 -- 172.21.15.63:0/141093522 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6318003a10 msgr2=0x7f6318003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:21.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:21.821+0000 7f632b400640 1 --2- 172.21.15.63:0/141093522 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6318003a10 0x7f6318003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:21.826 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:21.821+0000 7f632b400640 1 -- 172.21.15.63:0/141093522 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6318003530 con 0x7f6318004810 2024-05-21T01:20:21.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:21.821+0000 7f632b400640 1 --2- 172.21.15.63:0/141093522 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6318004810 0x7f6318004c90 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6334074150 tx=0x7f631c01cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d59583b73fa2651e server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:21.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:21.821+0000 7f6333400640 1 -- 172.21.15.63:0/141093522 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f631c007d40 con 0x7f6318004810 2024-05-21T01:20:21.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:21.821+0000 7f6333400640 1 -- 172.21.15.63:0/141093522 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f631c0a9020 con 0x7f6318004810 2024-05-21T01:20:21.827 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:21.821+0000 7f6333400640 1 -- 172.21.15.63:0/141093522 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f631c005b00 con 0x7f6318004810 2024-05-21T01:20:21.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:21.821+0000 7f633b000640 1 -- 172.21.15.63:0/141093522 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6318004810 msgr2=0x7f6318004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:21.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:21.821+0000 7f633b000640 1 --2- 172.21.15.63:0/141093522 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6318004810 0x7f6318004c90 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6334074150 tx=0x7f631c01cbc0 comp rx=0 tx=0).stop 2024-05-21T01:20:21.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:21.821+0000 7f6339000640 1 -- 172.21.15.63:0/141093522 reap_dead start 2024-05-21T01:20:21.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:21.821+0000 7f633b000640 1 -- 172.21.15.63:0/141093522 shutdown_connections 2024-05-21T01:20:21.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:21.821+0000 7f633b000640 1 -- 172.21.15.63:0/141093522 >> 172.21.15.63:0/141093522 conn(0x7f63340cae00 msgr2=0x7f63340cb210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:21.828 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:21.821+0000 7f633b000640 1 -- 172.21.15.63:0/141093522 shutdown_connections 2024-05-21T01:20:21.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:21.821+0000 7f633b000640 1 -- 172.21.15.63:0/141093522 wait complete. 2024-05-21T01:20:21.829 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:21.825+0000 7f633b000640 1 Processor -- start 2024-05-21T01:20:21.830 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:21.825+0000 7f633b000640 1 -- start start 2024-05-21T01:20:21.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:21.825+0000 7f633b000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6318004810 0x7f633415fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:21.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:21.825+0000 7f633b000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f633414f3c0 0x7f63341f1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:21.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:21.825+0000 7f633b000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f63340ca8d0 0x7f633414ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:21.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:21.825+0000 7f633b000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f63340748d0 con 0x7f6318004810 2024-05-21T01:20:21.831 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:21.825+0000 7f633b000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f633415c100 con 0x7f633414f3c0 2024-05-21T01:20:21.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:21.825+0000 7f633b000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f63340725e0 con 0x7f63340ca8d0 2024-05-21T01:20:21.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:21.825+0000 7f6333e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6318004810 0x7f633415fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:21.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:21.825+0000 7f6333e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6318004810 0x7f633415fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:49118/0 (socket says 172.21.15.63:49118) 2024-05-21T01:20:21.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:21.825+0000 7f6333e00640 1 -- 172.21.15.63:0/751606636 learned_addr learned my addr 172.21.15.63:0/751606636 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:21.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:21.825+0000 7f6339000640 1 --2- 172.21.15.63:0/751606636 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f63340ca8d0 0x7f633414ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:21.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:21.825+0000 7f632b400640 1 --2- 172.21.15.63:0/751606636 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f633414f3c0 0x7f63341f1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:21.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:21.825+0000 7f6333e00640 1 -- 172.21.15.63:0/751606636 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f63340ca8d0 msgr2=0x7f633414ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:21.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:21.825+0000 7f6333e00640 1 --2- 172.21.15.63:0/751606636 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f63340ca8d0 0x7f633414ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:21.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:21.825+0000 7f6333e00640 1 -- 172.21.15.63:0/751606636 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f633414f3c0 msgr2=0x7f63341f1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:21.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:21.825+0000 7f6333e00640 1 --2- 172.21.15.63:0/751606636 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f633414f3c0 0x7f63341f1760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:21.832 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:21.825+0000 7f6333e00640 1 -- 172.21.15.63:0/751606636 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f633415e060 con 0x7f6318004810 2024-05-21T01:20:21.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:21.825+0000 7f6333e00640 1 --2- 172.21.15.63:0/751606636 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6318004810 0x7f633415fcb0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6324011590 tx=0x7f6324011a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:21.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:21.825+0000 7f6330c00640 1 -- 172.21.15.63:0/751606636 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6324015930 con 0x7f6318004810 2024-05-21T01:20:21.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:21.825+0000 7f6330c00640 1 -- 172.21.15.63:0/751606636 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6324015ad0 con 0x7f6318004810 2024-05-21T01:20:21.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:21.825+0000 7f633b000640 1 -- 172.21.15.63:0/751606636 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f633415e330 con 0x7f6318004810 2024-05-21T01:20:21.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:21.825+0000 7f6330c00640 1 -- 172.21.15.63:0/751606636 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f632400f460 con 0x7f6318004810 2024-05-21T01:20:21.833 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:21.825+0000 7f633b000640 1 -- 172.21.15.63:0/751606636 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f633415e8f0 con 0x7f6318004810 2024-05-21T01:20:21.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:21.829+0000 7f633b000640 1 -- 172.21.15.63:0/751606636 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63340507f0 con 0x7f6318004810 2024-05-21T01:20:21.834 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:21.829+0000 7f6330c00640 1 -- 172.21.15.63:0/751606636 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7f632400f600 con 0x7f6318004810 2024-05-21T01:20:21.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:21.829+0000 7f6330c00640 1 --2- 172.21.15.63:0/751606636 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f631006f400 0x7f63100718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:21.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:21.829+0000 7f6330c00640 1 -- 172.21.15.63:0/751606636 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f632408fe30 con 0x7f6318004810 2024-05-21T01:20:21.835 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:21.829+0000 7f632b400640 1 --2- 172.21.15.63:0/751606636 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f631006f400 0x7f63100718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:21.836 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:21.833+0000 7f632b400640 1 --2- 172.21.15.63:0/751606636 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f631006f400 0x7f63100718c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f631c0aa000 tx=0x7f63340c8740 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:21.839 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:21.833+0000 7f6330c00640 1 -- 172.21.15.63:0/751606636 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f6324019030 con 0x7f6318004810 2024-05-21T01:20:22.041 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.037+0000 7f633b000640 1 -- 172.21.15.63:0/751606636 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6334072f90 con 0x7f6318004810 2024-05-21T01:20:22.042 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.037+0000 7f6330c00640 1 -- 172.21.15.63:0/751606636 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+6851 (secure 0 0 0) 0x7f632405c380 con 0x7f6318004810 2024-05-21T01:20:22.042 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-05-21T01:20:22.042 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6839/3045714273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6837","nonce":3045714273},{"type":"v1","addr":"172.21.15.131:6839","nonce":3045714273}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/2978367338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":2978367338},{"type":"v1","addr":"172.21.15.131:6835","nonce":2978367338}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/3005995321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6835","nonce":3005995321},{"type":"v1","addr":"172.21.15.63:6837","nonce":3005995321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4267,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6833/574189772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":574189772},{"type":"v1","addr":"172.21.15.63:6833","nonce":574189772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-21T01:19:53.915775+0000","modified":"2024-05-21T01:20:21.038299+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1],"up":{"mds_0":4276,"mds_1":4270},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4270":{"gid":4270,"name":"f","rank":1,"incarnation":10,"state":"up:creating","state_seq":1,"addr":"172.21.15.131:6838/3071941741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":3071941741},{"type":"v1","addr":"172.21.15.131:6838","nonce":3071941741}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.63:6836/2892727989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":2892727989},{"type":"v1","addr":"172.21.15.63:6836","nonce":2892727989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4276,"qdb_cluster":[4276]},"id":1}]} 2024-05-21T01:20:22.043 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 12 2024-05-21T01:20:22.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.037+0000 7f633b000640 1 -- 172.21.15.63:0/751606636 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f631006f400 msgr2=0x7f63100718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:22.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.037+0000 7f633b000640 1 --2- 172.21.15.63:0/751606636 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f631006f400 0x7f63100718c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f631c0aa000 tx=0x7f63340c8740 comp rx=0 tx=0).stop 2024-05-21T01:20:22.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.037+0000 7f633b000640 1 -- 172.21.15.63:0/751606636 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6318004810 msgr2=0x7f633415fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:22.044 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.037+0000 7f633b000640 1 --2- 172.21.15.63:0/751606636 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6318004810 0x7f633415fcb0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6324011590 tx=0x7f6324011a50 comp rx=0 tx=0).stop 2024-05-21T01:20:22.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.041+0000 7f633b000640 1 -- 172.21.15.63:0/751606636 shutdown_connections 2024-05-21T01:20:22.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.041+0000 7f633b000640 1 --2- 172.21.15.63:0/751606636 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f631006f400 0x7f63100718c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:22.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.041+0000 7f633b000640 1 --2- 172.21.15.63:0/751606636 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f63340ca8d0 0x7f633414ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:22.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.041+0000 7f633b000640 1 --2- 172.21.15.63:0/751606636 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f633414f3c0 0x7f63341f1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:22.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.041+0000 7f633b000640 1 --2- 172.21.15.63:0/751606636 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6318004810 0x7f633415fcb0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:22.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.041+0000 7f633b000640 1 -- 172.21.15.63:0/751606636 >> 172.21.15.63:0/751606636 conn(0x7f63340cae00 msgr2=0x7f63340c7540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:22.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.041+0000 7f633b000640 1 -- 172.21.15.63:0/751606636 shutdown_connections 2024-05-21T01:20:22.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.041+0000 7f633b000640 1 -- 172.21.15.63:0/751606636 wait complete. 2024-05-21T01:20:22.064 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-21T01:20:22.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.197+0000 7f83da800640 1 Processor -- start 2024-05-21T01:20:22.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.197+0000 7f83da800640 1 -- start start 2024-05-21T01:20:22.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.201+0000 7f83da800640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f83d415bd30 0x7f83d4073480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:22.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.201+0000 7f83da800640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f83d406d5b0 0x7f83d406d990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:22.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.201+0000 7f83da800640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83d406f510 con 0x7f83d4156150 2024-05-21T01:20:22.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.201+0000 7f83da800640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f83d4070a20 con 0x7f83d415bd30 2024-05-21T01:20:22.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.201+0000 7f83da800640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f83d4073ac0 con 0x7f83d406d5b0 2024-05-21T01:20:22.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.201+0000 7f83cbe00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f83d415bd30 0x7f83d4073480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:22.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.201+0000 7f83d3400640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f83d4156150 0x7f83d4071190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:40082/0 (socket says 172.21.15.63:40082) 2024-05-21T01:20:22.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.201+0000 7f83cbe00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f83d415bd30 0x7f83d4073480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:49134/0 (socket says 172.21.15.63:49134) 2024-05-21T01:20:22.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.201+0000 7f83d3400640 1 -- 172.21.15.63:0/428235238 learned_addr learned my addr 172.21.15.63:0/428235238 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-05-21T01:20:22.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.201+0000 7f83d3e00640 1 --2- 172.21.15.63:0/428235238 >> v2:172.21.15.131:3300/0 conn(0x7f83d406d5b0 0x7f83d406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:22.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.201+0000 7f83cbe00640 1 -- 172.21.15.63:0/428235238 >> v2:172.21.15.131:3300/0 conn(0x7f83d406d5b0 msgr2=0x7f83d406d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:22.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.201+0000 7f83cbe00640 1 --2- 172.21.15.63:0/428235238 >> v2:172.21.15.131:3300/0 conn(0x7f83d406d5b0 0x7f83d406d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:22.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.201+0000 7f83cbe00640 1 -- 172.21.15.63:0/428235238 >> v1:172.21.15.63:6789/0 conn(0x7f83d4156150 legacy=0x7f83d4071190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:22.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.201+0000 7f83cbe00640 1 -- 172.21.15.63:0/428235238 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83d4073da0 con 0x7f83d415bd30 2024-05-21T01:20:22.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.201+0000 7f83d2a00640 1 -- 172.21.15.63:0/428235238 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4039263625 0 0) 0x7f83d406f510 con 0x7f83d4156150 2024-05-21T01:20:22.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.205+0000 7f83cbe00640 1 --2- 172.21.15.63:0/428235238 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f83d415bd30 0x7f83d4073480 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f83d4070ba0 tx=0x7f83bc01c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=498c079bea605922 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:22.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.205+0000 7f83d2a00640 1 -- 172.21.15.63:0/428235238 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83bc0b0070 con 0x7f83d415bd30 2024-05-21T01:20:22.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.205+0000 7f83d2a00640 1 -- 172.21.15.63:0/428235238 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83bc0ab600 con 0x7f83d415bd30 2024-05-21T01:20:22.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.205+0000 7f83d2a00640 1 -- 172.21.15.63:0/428235238 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83bc0a4e60 con 0x7f83d415bd30 2024-05-21T01:20:22.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.205+0000 7f83da800640 1 -- 172.21.15.63:0/428235238 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f83d415bd30 msgr2=0x7f83d4073480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:22.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.205+0000 7f83da800640 1 --2- 172.21.15.63:0/428235238 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f83d415bd30 0x7f83d4073480 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f83d4070ba0 tx=0x7f83bc01c3d0 comp rx=0 tx=0).stop 2024-05-21T01:20:22.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.205+0000 7f83da800640 1 -- 172.21.15.63:0/428235238 shutdown_connections 2024-05-21T01:20:22.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.205+0000 7f83da800640 1 --2- 172.21.15.63:0/428235238 >> v2:172.21.15.131:3300/0 conn(0x7f83d406d5b0 0x7f83d406d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:22.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.205+0000 7f83da800640 1 --2- 172.21.15.63:0/428235238 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f83d415bd30 0x7f83d4073480 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:22.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.205+0000 7f83da800640 1 -- 172.21.15.63:0/428235238 >> 172.21.15.63:0/428235238 conn(0x7f83d40cbf10 msgr2=0x7f83d40cc320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:22.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.205+0000 7f83da800640 1 -- 172.21.15.63:0/428235238 shutdown_connections 2024-05-21T01:20:22.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.205+0000 7f83da800640 1 -- 172.21.15.63:0/428235238 wait complete. 2024-05-21T01:20:22.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.205+0000 7f83da800640 1 Processor -- start 2024-05-21T01:20:22.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.205+0000 7f83da800640 1 -- start start 2024-05-21T01:20:22.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.209+0000 7f83da800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f83d406d5b0 0x7f83d4144dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:22.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.209+0000 7f83da800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f83d4156150 0x7f83d41f60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:22.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.209+0000 7f83da800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f83d415bd30 0x7f83d41f6630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:22.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.209+0000 7f83da800640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f83d4071a20 con 0x7f83d406d5b0 2024-05-21T01:20:22.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.209+0000 7f83da800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f83d40718a0 con 0x7f83d4156150 2024-05-21T01:20:22.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.209+0000 7f83da800640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f83d4168ed0 con 0x7f83d415bd30 2024-05-21T01:20:22.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.209+0000 7f83d3400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f83d406d5b0 0x7f83d4144dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:22.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.209+0000 7f83d3400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f83d406d5b0 0x7f83d4144dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:49136/0 (socket says 172.21.15.63:49136) 2024-05-21T01:20:22.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.209+0000 7f83d3400640 1 -- 172.21.15.63:0/3163342406 learned_addr learned my addr 172.21.15.63:0/3163342406 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:22.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.209+0000 7f83d3e00640 1 --2- 172.21.15.63:0/3163342406 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f83d415bd30 0x7f83d41f6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:22.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.209+0000 7f83cbe00640 1 --2- 172.21.15.63:0/3163342406 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f83d4156150 0x7f83d41f60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:22.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.209+0000 7f83d3400640 1 -- 172.21.15.63:0/3163342406 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f83d415bd30 msgr2=0x7f83d41f6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:22.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.209+0000 7f83d3400640 1 --2- 172.21.15.63:0/3163342406 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f83d415bd30 0x7f83d41f6630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:22.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.209+0000 7f83d3400640 1 -- 172.21.15.63:0/3163342406 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f83d4156150 msgr2=0x7f83d41f60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:22.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.209+0000 7f83d3400640 1 --2- 172.21.15.63:0/3163342406 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f83d4156150 0x7f83d41f60f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:22.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.209+0000 7f83d3400640 1 -- 172.21.15.63:0/3163342406 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83d413fd10 con 0x7f83d406d5b0 2024-05-21T01:20:22.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.209+0000 7f83d3400640 1 --2- 172.21.15.63:0/3163342406 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f83d406d5b0 0x7f83d4144dd0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f83c400c430 tx=0x7f83c400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:22.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.209+0000 7f83cb400640 1 -- 172.21.15.63:0/3163342406 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83c40074e0 con 0x7f83d406d5b0 2024-05-21T01:20:22.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.209+0000 7f83cb400640 1 -- 172.21.15.63:0/3163342406 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83c40047f0 con 0x7f83d406d5b0 2024-05-21T01:20:22.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.209+0000 7f83cb400640 1 -- 172.21.15.63:0/3163342406 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83c4004be0 con 0x7f83d406d5b0 2024-05-21T01:20:22.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.209+0000 7f83da800640 1 -- 172.21.15.63:0/3163342406 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83d4155cc0 con 0x7f83d406d5b0 2024-05-21T01:20:22.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.209+0000 7f83da800640 1 -- 172.21.15.63:0/3163342406 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83d4152ff0 con 0x7f83d406d5b0 2024-05-21T01:20:22.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.209+0000 7f83da800640 1 -- 172.21.15.63:0/3163342406 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83d40507f0 con 0x7f83d406d5b0 2024-05-21T01:20:22.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.209+0000 7f83cb400640 1 -- 172.21.15.63:0/3163342406 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7f83c4011070 con 0x7f83d406d5b0 2024-05-21T01:20:22.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.213+0000 7f83cb400640 1 --2- 172.21.15.63:0/3163342406 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f83b006f400 0x7f83b00718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:22.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.213+0000 7f83cb400640 1 -- 172.21.15.63:0/3163342406 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f83c408f210 con 0x7f83d406d5b0 2024-05-21T01:20:22.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.213+0000 7f83cbe00640 1 --2- 172.21.15.63:0/3163342406 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f83b006f400 0x7f83b00718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:22.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.213+0000 7f83cbe00640 1 --2- 172.21.15.63:0/3163342406 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f83b006f400 0x7f83b00718c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f83bc0ad000 tx=0x7f83bc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:22.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.217+0000 7f83cb400640 1 -- 172.21.15.63:0/3163342406 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f83c405bdb0 con 0x7f83d406d5b0 2024-05-21T01:20:22.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.381+0000 7f83da800640 1 -- 172.21.15.63:0/3163342406 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f83d40ca260 con 0x7f83d406d5b0 2024-05-21T01:20:22.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.381+0000 7f83cb400640 1 -- 172.21.15.63:0/3163342406 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18482 (secure 0 0 0) 0x7f83c405b6b0 con 0x7f83d406d5b0 2024-05-21T01:20:22.388 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-05-21T01:20:22.388 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":25,"fsid":"9a7cbd84-ceb2-41c8-8b6e-ab931f86c51a","created":"2024-05-21T01:19:37.688082+0000","modified":"2024-05-21T01:19:58.978125+0000","last_up_change":"2024-05-21T01:19:48.472107+0000","last_in_change":"2024-05-21T01:19:39.973975+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-21T01:19:46.485266+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-21T01:19:52.032741+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-21T01:19:52.867322+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-21T01:19:56.562363+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cda28135-00bb-4194-adcb-e0abf3ae43f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":3740454920},{"type":"v1","addr":"172.21.15.63:6801","nonce":3740454920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":3740454920},{"type":"v1","addr":"172.21.15.63:6804","nonce":3740454920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":3740454920},{"type":"v1","addr":"172.21.15.63:6812","nonce":3740454920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":3740454920},{"type":"v1","addr":"172.21.15.63:6808","nonce":3740454920}]},"public_addr":"172.21.15.63:6801/3740454920","cluster_addr":"172.21.15.63:6804/3740454920","heartbeat_back_addr":"172.21.15.63:6812/3740454920","heartbeat_front_addr":"172.21.15.63:6808/3740454920","state":["exists","up"]},{"osd":1,"uuid":"4aeb370d-ec2f-4a91-b17b-035fd72bdaea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6803","nonce":896993303},{"type":"v1","addr":"172.21.15.63:6805","nonce":896993303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6807","nonce":896993303},{"type":"v1","addr":"172.21.15.63:6809","nonce":896993303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":896993303},{"type":"v1","addr":"172.21.15.63:6816","nonce":896993303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6811","nonce":896993303},{"type":"v1","addr":"172.21.15.63:6813","nonce":896993303}]},"public_addr":"172.21.15.63:6805/896993303","cluster_addr":"172.21.15.63:6809/896993303","heartbeat_back_addr":"172.21.15.63:6816/896993303","heartbeat_front_addr":"172.21.15.63:6813/896993303","state":["exists","up"]},{"osd":2,"uuid":"8368b112-35a3-43cf-ad1c-803f05708091","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":845807419},{"type":"v1","addr":"172.21.15.63:6817","nonce":845807419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":845807419},{"type":"v1","addr":"172.21.15.63:6819","nonce":845807419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":845807419},{"type":"v1","addr":"172.21.15.63:6823","nonce":845807419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":845807419},{"type":"v1","addr":"172.21.15.63:6821","nonce":845807419}]},"public_addr":"172.21.15.63:6817/845807419","cluster_addr":"172.21.15.63:6819/845807419","heartbeat_back_addr":"172.21.15.63:6823/845807419","heartbeat_front_addr":"172.21.15.63:6821/845807419","state":["exists","up"]},{"osd":3,"uuid":"26208950-e3ca-4b9a-94cd-c159453a5dfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":521563809},{"type":"v1","addr":"172.21.15.63:6825","nonce":521563809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":521563809},{"type":"v1","addr":"172.21.15.63:6827","nonce":521563809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":521563809},{"type":"v1","addr":"172.21.15.63:6831","nonce":521563809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":521563809},{"type":"v1","addr":"172.21.15.63:6829","nonce":521563809}]},"public_addr":"172.21.15.63:6825/521563809","cluster_addr":"172.21.15.63:6827/521563809","heartbeat_back_addr":"172.21.15.63:6831/521563809","heartbeat_front_addr":"172.21.15.63:6829/521563809","state":["exists","up"]},{"osd":4,"uuid":"d8c93283-1e10-4419-9934-d5048c5d0ad1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":2660673588},{"type":"v1","addr":"172.21.15.131:6801","nonce":2660673588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":2660673588},{"type":"v1","addr":"172.21.15.131:6803","nonce":2660673588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":2660673588},{"type":"v1","addr":"172.21.15.131:6807","nonce":2660673588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":2660673588},{"type":"v1","addr":"172.21.15.131:6805","nonce":2660673588}]},"public_addr":"172.21.15.131:6801/2660673588","cluster_addr":"172.21.15.131:6803/2660673588","heartbeat_back_addr":"172.21.15.131:6807/2660673588","heartbeat_front_addr":"172.21.15.131:6805/2660673588","state":["exists","up"]},{"osd":5,"uuid":"93a6fe9b-eaa6-4474-bf9b-ae0571feacf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6809","nonce":2508702891},{"type":"v1","addr":"172.21.15.131:6811","nonce":2508702891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6813","nonce":2508702891},{"type":"v1","addr":"172.21.15.131:6815","nonce":2508702891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6821","nonce":2508702891},{"type":"v1","addr":"172.21.15.131:6823","nonce":2508702891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6817","nonce":2508702891},{"type":"v1","addr":"172.21.15.131:6819","nonce":2508702891}]},"public_addr":"172.21.15.131:6811/2508702891","cluster_addr":"172.21.15.131:6815/2508702891","heartbeat_back_addr":"172.21.15.131:6823/2508702891","heartbeat_front_addr":"172.21.15.131:6819/2508702891","state":["exists","up"]},{"osd":6,"uuid":"e05e6c8c-2dda-49ab-8116-5ea9038d0f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":614380392},{"type":"v1","addr":"172.21.15.131:6810","nonce":614380392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":614380392},{"type":"v1","addr":"172.21.15.131:6814","nonce":614380392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":614380392},{"type":"v1","addr":"172.21.15.131:6822","nonce":614380392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":614380392},{"type":"v1","addr":"172.21.15.131:6818","nonce":614380392}]},"public_addr":"172.21.15.131:6810/614380392","cluster_addr":"172.21.15.131:6814/614380392","heartbeat_back_addr":"172.21.15.131:6822/614380392","heartbeat_front_addr":"172.21.15.131:6818/614380392","state":["exists","up"]},{"osd":7,"uuid":"0b393e5e-eeef-4e32-b23a-d405a8b0e7b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":4219797450},{"type":"v1","addr":"172.21.15.131:6825","nonce":4219797450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":4219797450},{"type":"v1","addr":"172.21.15.131:6827","nonce":4219797450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":4219797450},{"type":"v1","addr":"172.21.15.131:6831","nonce":4219797450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":4219797450},{"type":"v1","addr":"172.21.15.131:6829","nonce":4219797450}]},"public_addr":"172.21.15.131:6825/4219797450","cluster_addr":"172.21.15.131:6827/4219797450","heartbeat_back_addr":"172.21.15.131:6831/4219797450","heartbeat_front_addr":"172.21.15.131:6829/4219797450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.647841+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.912560+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.684614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.936286+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.380500+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.553497+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.517866+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.310320+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-21T01:20:22.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.385+0000 7f83da800640 1 -- 172.21.15.63:0/3163342406 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f83b006f400 msgr2=0x7f83b00718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:22.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.385+0000 7f83da800640 1 --2- 172.21.15.63:0/3163342406 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f83b006f400 0x7f83b00718c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f83bc0ad000 tx=0x7f83bc008040 comp rx=0 tx=0).stop 2024-05-21T01:20:22.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.385+0000 7f83da800640 1 -- 172.21.15.63:0/3163342406 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f83d406d5b0 msgr2=0x7f83d4144dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:22.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.385+0000 7f83da800640 1 --2- 172.21.15.63:0/3163342406 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f83d406d5b0 0x7f83d4144dd0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f83c400c430 tx=0x7f83c400c8f0 comp rx=0 tx=0).stop 2024-05-21T01:20:22.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.385+0000 7f83da800640 1 -- 172.21.15.63:0/3163342406 shutdown_connections 2024-05-21T01:20:22.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.385+0000 7f83da800640 1 --2- 172.21.15.63:0/3163342406 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f83b006f400 0x7f83b00718c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:22.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.385+0000 7f83da800640 1 --2- 172.21.15.63:0/3163342406 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f83d415bd30 0x7f83d41f6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:22.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.385+0000 7f83da800640 1 --2- 172.21.15.63:0/3163342406 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f83d4156150 0x7f83d41f60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:22.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.385+0000 7f83da800640 1 --2- 172.21.15.63:0/3163342406 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f83d406d5b0 0x7f83d4144dd0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:22.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.385+0000 7f83da800640 1 -- 172.21.15.63:0/3163342406 >> 172.21.15.63:0/3163342406 conn(0x7f83d40cbf10 msgr2=0x7f83d4153750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:22.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.385+0000 7f83da800640 1 -- 172.21.15.63:0/3163342406 shutdown_connections 2024-05-21T01:20:22.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.385+0000 7f83da800640 1 -- 172.21.15.63:0/3163342406 wait complete. 2024-05-21T01:20:22.409 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-21T01:20:22.409 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-21T01:20:22.551 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.545+0000 7f4739000640 1 Processor -- start 2024-05-21T01:20:22.552 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.545+0000 7f4739000640 1 -- start start 2024-05-21T01:20:22.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.549+0000 7f4739000640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f473406f5d0 0x7f47340c8a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:22.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.549+0000 7f4739000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f473406f9b0 0x7f4734152a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:22.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.549+0000 7f4739000640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4734072550 con 0x7f473415ce40 2024-05-21T01:20:22.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.549+0000 7f4739000640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f4734159100 con 0x7f473406f5d0 2024-05-21T01:20:22.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.549+0000 7f4739000640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f47341593e0 con 0x7f473406f9b0 2024-05-21T01:20:22.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.549+0000 7f4731e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f473406f5d0 0x7f47340c8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:22.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.549+0000 7f4731e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f473406f5d0 0x7f47340c8a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:49150/0 (socket says 172.21.15.63:49150) 2024-05-21T01:20:22.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.549+0000 7f4731e00640 1 -- 172.21.15.63:0/4026404676 learned_addr learned my addr 172.21.15.63:0/4026404676 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:22.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.549+0000 7f472be00640 1 --2- 172.21.15.63:0/4026404676 >> v2:172.21.15.131:3300/0 conn(0x7f473406f9b0 0x7f4734152a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:22.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.549+0000 7f4731e00640 1 -- 172.21.15.63:0/4026404676 >> v2:172.21.15.131:3300/0 conn(0x7f473406f9b0 msgr2=0x7f4734152a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:22.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.549+0000 7f4731e00640 1 --2- 172.21.15.63:0/4026404676 >> v2:172.21.15.131:3300/0 conn(0x7f473406f9b0 0x7f4734152a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:22.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.549+0000 7f4731e00640 1 -- 172.21.15.63:0/4026404676 >> v1:172.21.15.131:6789/0 conn(0x7f473415ce40 legacy=0x7f4734072d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:22.554 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.549+0000 7f4731e00640 1 -- 172.21.15.63:0/4026404676 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47341596c0 con 0x7f473406f5d0 2024-05-21T01:20:22.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.553+0000 7f4731e00640 1 --2- 172.21.15.63:0/4026404676 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f473406f5d0 0x7f47340c8a20 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f473406d540 tx=0x7f472401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb0bed4e2be597d7 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:22.556 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.553+0000 7f4731400640 1 -- 172.21.15.63:0/4026404676 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47240b1070 con 0x7f473406f5d0 2024-05-21T01:20:22.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.553+0000 7f4731400640 1 -- 172.21.15.63:0/4026404676 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47240ac630 con 0x7f473406f5d0 2024-05-21T01:20:22.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.553+0000 7f4731400640 1 -- 172.21.15.63:0/4026404676 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47240a8050 con 0x7f473406f5d0 2024-05-21T01:20:22.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.553+0000 7f4739000640 1 -- 172.21.15.63:0/4026404676 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f473406f5d0 msgr2=0x7f47340c8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:22.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.553+0000 7f4739000640 1 --2- 172.21.15.63:0/4026404676 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f473406f5d0 0x7f47340c8a20 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f473406d540 tx=0x7f472401c520 comp rx=0 tx=0).stop 2024-05-21T01:20:22.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.553+0000 7f4739000640 1 -- 172.21.15.63:0/4026404676 shutdown_connections 2024-05-21T01:20:22.557 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.553+0000 7f4739000640 1 --2- 172.21.15.63:0/4026404676 >> v2:172.21.15.131:3300/0 conn(0x7f473406f9b0 0x7f4734152a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:22.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.553+0000 7f4739000640 1 --2- 172.21.15.63:0/4026404676 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f473406f5d0 0x7f47340c8a20 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:22.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.553+0000 7f4739000640 1 -- 172.21.15.63:0/4026404676 >> 172.21.15.63:0/4026404676 conn(0x7f4734068460 msgr2=0x7f4734068870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:22.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.553+0000 7f4739000640 1 -- 172.21.15.63:0/4026404676 shutdown_connections 2024-05-21T01:20:22.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.553+0000 7f4739000640 1 -- 172.21.15.63:0/4026404676 wait complete. 2024-05-21T01:20:22.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.553+0000 7f4739000640 1 Processor -- start 2024-05-21T01:20:22.559 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.553+0000 7f4739000640 1 -- start start 2024-05-21T01:20:22.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.553+0000 7f4739000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f473406f5d0 0x7f473414e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:22.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.553+0000 7f4739000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f473406f9b0 0x7f47341f7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:22.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.553+0000 7f4739000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f473415ce40 0x7f473414c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:22.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.553+0000 7f4739000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f4734153100 con 0x7f473406f5d0 2024-05-21T01:20:22.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.553+0000 7f4739000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f4734152f80 con 0x7f473415ce40 2024-05-21T01:20:22.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.553+0000 7f4739000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f4734153280 con 0x7f473406f9b0 2024-05-21T01:20:22.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.553+0000 7f4731e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f473406f5d0 0x7f473414e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:22.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.557+0000 7f4731e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f473406f5d0 0x7f473414e0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:49152/0 (socket says 172.21.15.63:49152) 2024-05-21T01:20:22.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.557+0000 7f4731e00640 1 -- 172.21.15.63:0/3021258707 learned_addr learned my addr 172.21.15.63:0/3021258707 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:22.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.557+0000 7f472be00640 1 --2- 172.21.15.63:0/3021258707 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f473406f9b0 0x7f47341f7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:22.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.557+0000 7f4732800640 1 --2- 172.21.15.63:0/3021258707 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f473415ce40 0x7f473414c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:22.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.557+0000 7f4731e00640 1 -- 172.21.15.63:0/3021258707 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f473406f9b0 msgr2=0x7f47341f7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:22.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.557+0000 7f4731e00640 1 --2- 172.21.15.63:0/3021258707 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f473406f9b0 0x7f47341f7c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:22.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.557+0000 7f4731e00640 1 -- 172.21.15.63:0/3021258707 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f473415ce40 msgr2=0x7f473414c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:22.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.557+0000 7f4731e00640 1 --2- 172.21.15.63:0/3021258707 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f473415ce40 0x7f473414c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:22.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.557+0000 7f4731e00640 1 -- 172.21.15.63:0/3021258707 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4734157d20 con 0x7f473406f5d0 2024-05-21T01:20:22.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.557+0000 7f4731e00640 1 --2- 172.21.15.63:0/3021258707 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f473406f5d0 0x7f473414e0d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f47240af040 tx=0x7f47240192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:22.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.557+0000 7f472a000640 1 -- 172.21.15.63:0/3021258707 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47240bc070 con 0x7f473406f5d0 2024-05-21T01:20:22.562 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.557+0000 7f472a000640 1 -- 172.21.15.63:0/3021258707 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47240ab5e0 con 0x7f473406f5d0 2024-05-21T01:20:22.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.557+0000 7f4739000640 1 -- 172.21.15.63:0/3021258707 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47341f6eb0 con 0x7f473406f5d0 2024-05-21T01:20:22.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.557+0000 7f472a000640 1 -- 172.21.15.63:0/3021258707 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47240b1070 con 0x7f473406f5d0 2024-05-21T01:20:22.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.557+0000 7f4739000640 1 -- 172.21.15.63:0/3021258707 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47341f7470 con 0x7f473406f5d0 2024-05-21T01:20:22.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.557+0000 7f4739000640 1 -- 172.21.15.63:0/3021258707 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47340507f0 con 0x7f473406f5d0 2024-05-21T01:20:22.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.557+0000 7f472a000640 1 -- 172.21.15.63:0/3021258707 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7f47240ab9d0 con 0x7f473406f5d0 2024-05-21T01:20:22.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.561+0000 7f472a000640 1 --2- 172.21.15.63:0/3021258707 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f471006f400 0x7f47100718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:22.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.561+0000 7f472a000640 1 -- 172.21.15.63:0/3021258707 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f4724129130 con 0x7f473406f5d0 2024-05-21T01:20:22.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.561+0000 7f472be00640 1 --2- 172.21.15.63:0/3021258707 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f471006f400 0x7f47100718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:22.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.561+0000 7f472be00640 1 --2- 172.21.15.63:0/3021258707 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f471006f400 0x7f47100718c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4734072fd0 tx=0x7f471c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:22.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.561+0000 7f472a000640 1 -- 172.21.15.63:0/3021258707 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f47240c5080 con 0x7f473406f5d0 2024-05-21T01:20:22.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.733+0000 7f4739000640 1 -- 172.21.15.63:0/3021258707 --> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f47341f6c60 con 0x7f471006f400 2024-05-21T01:20:22.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.761+0000 7f472a000640 1 -- 172.21.15.63:0/3021258707 <== mgr.4103 v2:172.21.15.131:6832/921953667 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332596 (secure 0 0 0) 0x7f47341f6c60 con 0x7f471006f400 2024-05-21T01:20:22.766 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-05-21T01:20:22.771 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-05-21T01:20:22.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.765+0000 7f4739000640 1 -- 172.21.15.63:0/3021258707 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f471006f400 msgr2=0x7f47100718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:22.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.765+0000 7f4739000640 1 --2- 172.21.15.63:0/3021258707 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f471006f400 0x7f47100718c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4734072fd0 tx=0x7f471c008040 comp rx=0 tx=0).stop 2024-05-21T01:20:22.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.765+0000 7f4739000640 1 -- 172.21.15.63:0/3021258707 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f473406f5d0 msgr2=0x7f473414e0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:22.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.765+0000 7f4739000640 1 --2- 172.21.15.63:0/3021258707 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f473406f5d0 0x7f473414e0d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f47240af040 tx=0x7f47240192c0 comp rx=0 tx=0).stop 2024-05-21T01:20:22.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.765+0000 7f4739000640 1 -- 172.21.15.63:0/3021258707 shutdown_connections 2024-05-21T01:20:22.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.765+0000 7f4739000640 1 --2- 172.21.15.63:0/3021258707 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f471006f400 0x7f47100718c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:22.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.765+0000 7f4739000640 1 --2- 172.21.15.63:0/3021258707 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f473415ce40 0x7f473414c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:22.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.765+0000 7f4739000640 1 --2- 172.21.15.63:0/3021258707 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f473406f9b0 0x7f47341f7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:22.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.765+0000 7f4739000640 1 --2- 172.21.15.63:0/3021258707 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f473406f5d0 0x7f473414e0d0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:22.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.765+0000 7f4739000640 1 -- 172.21.15.63:0/3021258707 >> 172.21.15.63:0/3021258707 conn(0x7f4734068460 msgr2=0x7f4734150b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:22.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.765+0000 7f4739000640 1 -- 172.21.15.63:0/3021258707 shutdown_connections 2024-05-21T01:20:22.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.765+0000 7f4739000640 1 -- 172.21.15.63:0/3021258707 wait complete. 2024-05-21T01:20:22.789 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2024-05-21T01:20:22.441993+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218376,"kb_used_data":2208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756344,"statfs":{"total":773094113280,"available":772870496256,"internally_reserved":0,"allocated":2260992,"data_stored":2012504,"data_compressed":66932,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1781,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005451"},"pg_stats":[{"pgid":"2.1f","version":"24'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.573917+0000","last_change":"2024-05-21T01:19:53.545236+0000","last_active":"2024-05-21T01:19:59.573917+0000","last_peered":"2024-05-21T01:19:59.573917+0000","last_clean":"2024-05-21T01:19:59.573917+0000","last_became_active":"2024-05-21T01:19:53.544469+0000","last_became_peered":"2024-05-21T01:19:53.544469+0000","last_unstale":"2024-05-21T01:19:59.573917+0000","last_undegraded":"2024-05-21T01:19:59.573917+0000","last_fullsized":"2024-05-21T01:19:59.573917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:33:09.421287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.211552+0000","last_change":"2024-05-21T01:19:54.568235+0000","last_active":"2024-05-21T01:20:00.211552+0000","last_peered":"2024-05-21T01:20:00.211552+0000","last_clean":"2024-05-21T01:20:00.211552+0000","last_became_active":"2024-05-21T01:19:54.567245+0000","last_became_peered":"2024-05-21T01:19:54.567245+0000","last_unstale":"2024-05-21T01:20:00.211552+0000","last_undegraded":"2024-05-21T01:20:00.211552+0000","last_fullsized":"2024-05-21T01:20:00.211552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:39:51.222819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207912+0000","last_change":"2024-05-21T01:19:58.618772+0000","last_active":"2024-05-21T01:20:00.207912+0000","last_peered":"2024-05-21T01:20:00.207912+0000","last_clean":"2024-05-21T01:20:00.207912+0000","last_became_active":"2024-05-21T01:19:58.617757+0000","last_became_peered":"2024-05-21T01:19:58.617757+0000","last_unstale":"2024-05-21T01:20:00.207912+0000","last_undegraded":"2024-05-21T01:20:00.207912+0000","last_fullsized":"2024-05-21T01:20:00.207912+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T13:07:31.666521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.211893+0000","last_change":"2024-05-21T01:19:53.551775+0000","last_active":"2024-05-21T01:20:00.211893+0000","last_peered":"2024-05-21T01:20:00.211893+0000","last_clean":"2024-05-21T01:20:00.211893+0000","last_became_active":"2024-05-21T01:19:53.551049+0000","last_became_peered":"2024-05-21T01:19:53.551049+0000","last_unstale":"2024-05-21T01:20:00.211893+0000","last_undegraded":"2024-05-21T01:20:00.211893+0000","last_fullsized":"2024-05-21T01:20:00.211893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:49:02.289202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.211755+0000","last_change":"2024-05-21T01:19:54.573420+0000","last_active":"2024-05-21T01:20:00.211755+0000","last_peered":"2024-05-21T01:20:00.211755+0000","last_clean":"2024-05-21T01:20:00.211755+0000","last_became_active":"2024-05-21T01:19:54.569573+0000","last_became_peered":"2024-05-21T01:19:54.569573+0000","last_unstale":"2024-05-21T01:20:00.211755+0000","last_undegraded":"2024-05-21T01:20:00.211755+0000","last_fullsized":"2024-05-21T01:20:00.211755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:00:12.257816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.206470+0000","last_change":"2024-05-21T01:19:58.604490+0000","last_active":"2024-05-21T01:20:00.206470+0000","last_peered":"2024-05-21T01:20:00.206470+0000","last_clean":"2024-05-21T01:20:00.206470+0000","last_became_active":"2024-05-21T01:19:58.604108+0000","last_became_peered":"2024-05-21T01:19:58.604108+0000","last_unstale":"2024-05-21T01:20:00.206470+0000","last_undegraded":"2024-05-21T01:20:00.206470+0000","last_fullsized":"2024-05-21T01:20:00.206470+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:11:10.963073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207737+0000","last_change":"2024-05-21T01:19:53.525403+0000","last_active":"2024-05-21T01:20:00.207737+0000","last_peered":"2024-05-21T01:20:00.207737+0000","last_clean":"2024-05-21T01:20:00.207737+0000","last_became_active":"2024-05-21T01:19:53.521265+0000","last_became_peered":"2024-05-21T01:19:53.521265+0000","last_unstale":"2024-05-21T01:20:00.207737+0000","last_undegraded":"2024-05-21T01:20:00.207737+0000","last_fullsized":"2024-05-21T01:20:00.207737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:52:16.488269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.209201+0000","last_change":"2024-05-21T01:19:54.536436+0000","last_active":"2024-05-21T01:20:00.209201+0000","last_peered":"2024-05-21T01:20:00.209201+0000","last_clean":"2024-05-21T01:20:00.209201+0000","last_became_active":"2024-05-21T01:19:54.536061+0000","last_became_peered":"2024-05-21T01:19:54.536061+0000","last_unstale":"2024-05-21T01:20:00.209201+0000","last_undegraded":"2024-05-21T01:20:00.209201+0000","last_fullsized":"2024-05-21T01:20:00.209201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:48:23.811712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.206960+0000","last_change":"2024-05-21T01:19:58.623087+0000","last_active":"2024-05-21T01:20:00.206960+0000","last_peered":"2024-05-21T01:20:00.206960+0000","last_clean":"2024-05-21T01:20:00.206960+0000","last_became_active":"2024-05-21T01:19:58.622672+0000","last_became_peered":"2024-05-21T01:19:58.622672+0000","last_unstale":"2024-05-21T01:20:00.206960+0000","last_undegraded":"2024-05-21T01:20:00.206960+0000","last_fullsized":"2024-05-21T01:20:00.206960+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:45:49.241750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207109+0000","last_change":"2024-05-21T01:19:53.522497+0000","last_active":"2024-05-21T01:20:00.207109+0000","last_peered":"2024-05-21T01:20:00.207109+0000","last_clean":"2024-05-21T01:20:00.207109+0000","last_became_active":"2024-05-21T01:19:53.521684+0000","last_became_peered":"2024-05-21T01:19:53.521684+0000","last_unstale":"2024-05-21T01:20:00.207109+0000","last_undegraded":"2024-05-21T01:20:00.207109+0000","last_fullsized":"2024-05-21T01:20:00.207109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:18:17.808255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.567660+0000","last_change":"2024-05-21T01:19:54.549512+0000","last_active":"2024-05-21T01:19:59.567660+0000","last_peered":"2024-05-21T01:19:59.567660+0000","last_clean":"2024-05-21T01:19:59.567660+0000","last_became_active":"2024-05-21T01:19:54.549291+0000","last_became_peered":"2024-05-21T01:19:54.549291+0000","last_unstale":"2024-05-21T01:19:59.567660+0000","last_undegraded":"2024-05-21T01:19:59.567660+0000","last_fullsized":"2024-05-21T01:19:59.567660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:48:34.571236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.206754+0000","last_change":"2024-05-21T01:19:58.614748+0000","last_active":"2024-05-21T01:20:00.206754+0000","last_peered":"2024-05-21T01:20:00.206754+0000","last_clean":"2024-05-21T01:20:00.206754+0000","last_became_active":"2024-05-21T01:19:58.614313+0000","last_became_peered":"2024-05-21T01:19:58.614313+0000","last_unstale":"2024-05-21T01:20:00.206754+0000","last_undegraded":"2024-05-21T01:20:00.206754+0000","last_fullsized":"2024-05-21T01:20:00.206754+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:45:34.204591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.567029+0000","last_change":"2024-05-21T01:19:54.545467+0000","last_active":"2024-05-21T01:19:59.567029+0000","last_peered":"2024-05-21T01:19:59.567029+0000","last_clean":"2024-05-21T01:19:59.567029+0000","last_became_active":"2024-05-21T01:19:54.545181+0000","last_became_peered":"2024-05-21T01:19:54.545181+0000","last_unstale":"2024-05-21T01:19:59.567029+0000","last_undegraded":"2024-05-21T01:19:59.567029+0000","last_fullsized":"2024-05-21T01:19:59.567029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:43:15.387067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.567246+0000","last_change":"2024-05-21T01:19:53.536139+0000","last_active":"2024-05-21T01:19:59.567246+0000","last_peered":"2024-05-21T01:19:59.567246+0000","last_clean":"2024-05-21T01:19:59.567246+0000","last_became_active":"2024-05-21T01:19:53.535899+0000","last_became_peered":"2024-05-21T01:19:53.535899+0000","last_unstale":"2024-05-21T01:19:59.567246+0000","last_undegraded":"2024-05-21T01:19:59.567246+0000","last_fullsized":"2024-05-21T01:19:59.567246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:40:12.033744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.567390+0000","last_change":"2024-05-21T01:19:58.621487+0000","last_active":"2024-05-21T01:19:59.567390+0000","last_peered":"2024-05-21T01:19:59.567390+0000","last_clean":"2024-05-21T01:19:59.567390+0000","last_became_active":"2024-05-21T01:19:58.621083+0000","last_became_peered":"2024-05-21T01:19:58.621083+0000","last_unstale":"2024-05-21T01:19:59.567390+0000","last_undegraded":"2024-05-21T01:19:59.567390+0000","last_fullsized":"2024-05-21T01:19:59.567390+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:18:44.587274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.208662+0000","last_change":"2024-05-21T01:19:54.572420+0000","last_active":"2024-05-21T01:20:00.208662+0000","last_peered":"2024-05-21T01:20:00.208662+0000","last_clean":"2024-05-21T01:20:00.208662+0000","last_became_active":"2024-05-21T01:19:54.571863+0000","last_became_peered":"2024-05-21T01:19:54.571863+0000","last_unstale":"2024-05-21T01:20:00.208662+0000","last_undegraded":"2024-05-21T01:20:00.208662+0000","last_fullsized":"2024-05-21T01:20:00.208662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:13:52.491903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.575374+0000","last_change":"2024-05-21T01:19:53.553351+0000","last_active":"2024-05-21T01:19:59.575374+0000","last_peered":"2024-05-21T01:19:59.575374+0000","last_clean":"2024-05-21T01:19:59.575374+0000","last_became_active":"2024-05-21T01:19:53.552694+0000","last_became_peered":"2024-05-21T01:19:53.552694+0000","last_unstale":"2024-05-21T01:19:59.575374+0000","last_undegraded":"2024-05-21T01:19:59.575374+0000","last_fullsized":"2024-05-21T01:19:59.575374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:46:55.273278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.206544+0000","last_change":"2024-05-21T01:19:58.594904+0000","last_active":"2024-05-21T01:20:00.206544+0000","last_peered":"2024-05-21T01:20:00.206544+0000","last_clean":"2024-05-21T01:20:00.206544+0000","last_became_active":"2024-05-21T01:19:58.594450+0000","last_became_peered":"2024-05-21T01:19:58.594450+0000","last_unstale":"2024-05-21T01:20:00.206544+0000","last_undegraded":"2024-05-21T01:20:00.206544+0000","last_fullsized":"2024-05-21T01:20:00.206544+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:37:30.286986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.571649+0000","last_change":"2024-05-21T01:19:54.554750+0000","last_active":"2024-05-21T01:19:59.571649+0000","last_peered":"2024-05-21T01:19:59.571649+0000","last_clean":"2024-05-21T01:19:59.571649+0000","last_became_active":"2024-05-21T01:19:54.551583+0000","last_became_peered":"2024-05-21T01:19:54.551583+0000","last_unstale":"2024-05-21T01:19:59.571649+0000","last_undegraded":"2024-05-21T01:19:59.571649+0000","last_fullsized":"2024-05-21T01:19:59.571649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:37:19.564099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.572553+0000","last_change":"2024-05-21T01:19:53.523277+0000","last_active":"2024-05-21T01:19:59.572553+0000","last_peered":"2024-05-21T01:19:59.572553+0000","last_clean":"2024-05-21T01:19:59.572553+0000","last_became_active":"2024-05-21T01:19:53.522525+0000","last_became_peered":"2024-05-21T01:19:53.522525+0000","last_unstale":"2024-05-21T01:19:59.572553+0000","last_undegraded":"2024-05-21T01:19:59.572553+0000","last_fullsized":"2024-05-21T01:19:59.572553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:23:59.949781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.209007+0000","last_change":"2024-05-21T01:19:58.615575+0000","last_active":"2024-05-21T01:20:00.209007+0000","last_peered":"2024-05-21T01:20:00.209007+0000","last_clean":"2024-05-21T01:20:00.209007+0000","last_became_active":"2024-05-21T01:19:58.614401+0000","last_became_peered":"2024-05-21T01:19:58.614401+0000","last_unstale":"2024-05-21T01:20:00.209007+0000","last_undegraded":"2024-05-21T01:20:00.209007+0000","last_fullsized":"2024-05-21T01:20:00.209007+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:51:09.839503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.566770+0000","last_change":"2024-05-21T01:19:54.555489+0000","last_active":"2024-05-21T01:19:59.566770+0000","last_peered":"2024-05-21T01:19:59.566770+0000","last_clean":"2024-05-21T01:19:59.566770+0000","last_became_active":"2024-05-21T01:19:54.555227+0000","last_became_peered":"2024-05-21T01:19:54.555227+0000","last_unstale":"2024-05-21T01:19:59.566770+0000","last_undegraded":"2024-05-21T01:19:59.566770+0000","last_fullsized":"2024-05-21T01:19:59.566770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:00:22.873520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.205893+0000","last_change":"2024-05-21T01:19:53.520840+0000","last_active":"2024-05-21T01:20:00.205893+0000","last_peered":"2024-05-21T01:20:00.205893+0000","last_clean":"2024-05-21T01:20:00.205893+0000","last_became_active":"2024-05-21T01:19:53.520540+0000","last_became_peered":"2024-05-21T01:19:53.520540+0000","last_unstale":"2024-05-21T01:20:00.205893+0000","last_undegraded":"2024-05-21T01:20:00.205893+0000","last_fullsized":"2024-05-21T01:20:00.205893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:08:36.426465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207823+0000","last_change":"2024-05-21T01:19:58.604357+0000","last_active":"2024-05-21T01:20:00.207823+0000","last_peered":"2024-05-21T01:20:00.207823+0000","last_clean":"2024-05-21T01:20:00.207823+0000","last_became_active":"2024-05-21T01:19:58.603922+0000","last_became_peered":"2024-05-21T01:19:58.603922+0000","last_unstale":"2024-05-21T01:20:00.207823+0000","last_undegraded":"2024-05-21T01:20:00.207823+0000","last_fullsized":"2024-05-21T01:20:00.207823+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:55:18.226031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.572430+0000","last_change":"2024-05-21T01:19:54.569315+0000","last_active":"2024-05-21T01:19:59.572430+0000","last_peered":"2024-05-21T01:19:59.572430+0000","last_clean":"2024-05-21T01:19:59.572430+0000","last_became_active":"2024-05-21T01:19:54.568232+0000","last_became_peered":"2024-05-21T01:19:54.568232+0000","last_unstale":"2024-05-21T01:19:59.572430+0000","last_undegraded":"2024-05-21T01:19:59.572430+0000","last_fullsized":"2024-05-21T01:19:59.572430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:19:01.819418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.568118+0000","last_change":"2024-05-21T01:19:53.525301+0000","last_active":"2024-05-21T01:19:59.568118+0000","last_peered":"2024-05-21T01:19:59.568118+0000","last_clean":"2024-05-21T01:19:59.568118+0000","last_became_active":"2024-05-21T01:19:53.525010+0000","last_became_peered":"2024-05-21T01:19:53.525010+0000","last_unstale":"2024-05-21T01:19:59.568118+0000","last_undegraded":"2024-05-21T01:19:59.568118+0000","last_fullsized":"2024-05-21T01:19:59.568118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:53:11.316975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.206622+0000","last_change":"2024-05-21T01:19:58.590354+0000","last_active":"2024-05-21T01:20:00.206622+0000","last_peered":"2024-05-21T01:20:00.206622+0000","last_clean":"2024-05-21T01:20:00.206622+0000","last_became_active":"2024-05-21T01:19:58.589985+0000","last_became_peered":"2024-05-21T01:19:58.589985+0000","last_unstale":"2024-05-21T01:20:00.206622+0000","last_undegraded":"2024-05-21T01:20:00.206622+0000","last_fullsized":"2024-05-21T01:20:00.206622+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:08:09.222858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.573671+0000","last_change":"2024-05-21T01:19:54.555318+0000","last_active":"2024-05-21T01:19:59.573671+0000","last_peered":"2024-05-21T01:19:59.573671+0000","last_clean":"2024-05-21T01:19:59.573671+0000","last_became_active":"2024-05-21T01:19:54.552947+0000","last_became_peered":"2024-05-21T01:19:54.552947+0000","last_unstale":"2024-05-21T01:19:59.573671+0000","last_undegraded":"2024-05-21T01:19:59.573671+0000","last_fullsized":"2024-05-21T01:19:59.573671+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:29:24.153986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.572949+0000","last_change":"2024-05-21T01:19:53.525004+0000","last_active":"2024-05-21T01:19:59.572949+0000","last_peered":"2024-05-21T01:19:59.572949+0000","last_clean":"2024-05-21T01:19:59.572949+0000","last_became_active":"2024-05-21T01:19:53.521014+0000","last_became_peered":"2024-05-21T01:19:53.521014+0000","last_unstale":"2024-05-21T01:19:59.572949+0000","last_undegraded":"2024-05-21T01:19:59.572949+0000","last_fullsized":"2024-05-21T01:19:59.572949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:02:46.668320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.571502+0000","last_change":"2024-05-21T01:19:58.599880+0000","last_active":"2024-05-21T01:19:59.571502+0000","last_peered":"2024-05-21T01:19:59.571502+0000","last_clean":"2024-05-21T01:19:59.571502+0000","last_became_active":"2024-05-21T01:19:58.598712+0000","last_became_peered":"2024-05-21T01:19:58.598712+0000","last_unstale":"2024-05-21T01:19:59.571502+0000","last_undegraded":"2024-05-21T01:19:59.571502+0000","last_fullsized":"2024-05-21T01:19:59.571502+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:43:05.995986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.577134+0000","last_change":"2024-05-21T01:19:54.576044+0000","last_active":"2024-05-21T01:19:59.577134+0000","last_peered":"2024-05-21T01:19:59.577134+0000","last_clean":"2024-05-21T01:19:59.577134+0000","last_became_active":"2024-05-21T01:19:54.575543+0000","last_became_peered":"2024-05-21T01:19:54.575543+0000","last_unstale":"2024-05-21T01:19:59.577134+0000","last_undegraded":"2024-05-21T01:19:59.577134+0000","last_fullsized":"2024-05-21T01:19:59.577134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T09:33:07.188470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.568161+0000","last_change":"2024-05-21T01:19:53.543705+0000","last_active":"2024-05-21T01:19:59.568161+0000","last_peered":"2024-05-21T01:19:59.568161+0000","last_clean":"2024-05-21T01:19:59.568161+0000","last_became_active":"2024-05-21T01:19:53.543450+0000","last_became_peered":"2024-05-21T01:19:53.543450+0000","last_unstale":"2024-05-21T01:19:59.568161+0000","last_undegraded":"2024-05-21T01:19:59.568161+0000","last_fullsized":"2024-05-21T01:19:59.568161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:05:49.465156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.575415+0000","last_change":"2024-05-21T01:19:58.612049+0000","last_active":"2024-05-21T01:19:59.575415+0000","last_peered":"2024-05-21T01:19:59.575415+0000","last_clean":"2024-05-21T01:19:59.575415+0000","last_became_active":"2024-05-21T01:19:58.610837+0000","last_became_peered":"2024-05-21T01:19:58.610837+0000","last_unstale":"2024-05-21T01:19:59.575415+0000","last_undegraded":"2024-05-21T01:19:59.575415+0000","last_fullsized":"2024-05-21T01:19:59.575415+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:24:14.332056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207496+0000","last_change":"2024-05-21T01:19:54.553083+0000","last_active":"2024-05-21T01:20:00.207496+0000","last_peered":"2024-05-21T01:20:00.207496+0000","last_clean":"2024-05-21T01:20:00.207496+0000","last_became_active":"2024-05-21T01:19:54.552812+0000","last_became_peered":"2024-05-21T01:19:54.552812+0000","last_unstale":"2024-05-21T01:20:00.207496+0000","last_undegraded":"2024-05-21T01:20:00.207496+0000","last_fullsized":"2024-05-21T01:20:00.207496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:37:25.835345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.210838+0000","last_change":"2024-05-21T01:19:53.551697+0000","last_active":"2024-05-21T01:20:00.210838+0000","last_peered":"2024-05-21T01:20:00.210838+0000","last_clean":"2024-05-21T01:20:00.210838+0000","last_became_active":"2024-05-21T01:19:53.550921+0000","last_became_peered":"2024-05-21T01:19:53.550921+0000","last_unstale":"2024-05-21T01:20:00.210838+0000","last_undegraded":"2024-05-21T01:20:00.210838+0000","last_fullsized":"2024-05-21T01:20:00.210838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T09:31:31.996638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.571559+0000","last_change":"2024-05-21T01:19:58.626472+0000","last_active":"2024-05-21T01:19:59.571559+0000","last_peered":"2024-05-21T01:19:59.571559+0000","last_clean":"2024-05-21T01:19:59.571559+0000","last_became_active":"2024-05-21T01:19:58.625720+0000","last_became_peered":"2024-05-21T01:19:58.625720+0000","last_unstale":"2024-05-21T01:19:59.571559+0000","last_undegraded":"2024-05-21T01:19:59.571559+0000","last_fullsized":"2024-05-21T01:19:59.571559+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:16:03.911585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207190+0000","last_change":"2024-05-21T01:19:54.547947+0000","last_active":"2024-05-21T01:20:00.207190+0000","last_peered":"2024-05-21T01:20:00.207190+0000","last_clean":"2024-05-21T01:20:00.207190+0000","last_became_active":"2024-05-21T01:19:54.547689+0000","last_became_peered":"2024-05-21T01:19:54.547689+0000","last_unstale":"2024-05-21T01:20:00.207190+0000","last_undegraded":"2024-05-21T01:20:00.207190+0000","last_fullsized":"2024-05-21T01:20:00.207190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:40:55.985899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.567365+0000","last_change":"2024-05-21T01:19:53.540973+0000","last_active":"2024-05-21T01:19:59.567365+0000","last_peered":"2024-05-21T01:19:59.567365+0000","last_clean":"2024-05-21T01:19:59.567365+0000","last_became_active":"2024-05-21T01:19:53.540670+0000","last_became_peered":"2024-05-21T01:19:53.540670+0000","last_unstale":"2024-05-21T01:19:59.567365+0000","last_undegraded":"2024-05-21T01:19:59.567365+0000","last_fullsized":"2024-05-21T01:19:59.567365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:08:21.802284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.576864+0000","last_change":"2024-05-21T01:19:58.611280+0000","last_active":"2024-05-21T01:19:59.576864+0000","last_peered":"2024-05-21T01:19:59.576864+0000","last_clean":"2024-05-21T01:19:59.576864+0000","last_became_active":"2024-05-21T01:19:58.610511+0000","last_became_peered":"2024-05-21T01:19:58.610511+0000","last_unstale":"2024-05-21T01:19:59.576864+0000","last_undegraded":"2024-05-21T01:19:59.576864+0000","last_fullsized":"2024-05-21T01:19:59.576864+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:49:19.660422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.209521+0000","last_change":"2024-05-21T01:19:54.572546+0000","last_active":"2024-05-21T01:20:00.209521+0000","last_peered":"2024-05-21T01:20:00.209521+0000","last_clean":"2024-05-21T01:20:00.209521+0000","last_became_active":"2024-05-21T01:19:54.572022+0000","last_became_peered":"2024-05-21T01:19:54.572022+0000","last_unstale":"2024-05-21T01:20:00.209521+0000","last_undegraded":"2024-05-21T01:20:00.209521+0000","last_fullsized":"2024-05-21T01:20:00.209521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:50:08.351383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.208164+0000","last_change":"2024-05-21T01:19:53.556786+0000","last_active":"2024-05-21T01:20:00.208164+0000","last_peered":"2024-05-21T01:20:00.208164+0000","last_clean":"2024-05-21T01:20:00.208164+0000","last_became_active":"2024-05-21T01:19:53.556143+0000","last_became_peered":"2024-05-21T01:19:53.556143+0000","last_unstale":"2024-05-21T01:20:00.208164+0000","last_undegraded":"2024-05-21T01:20:00.208164+0000","last_fullsized":"2024-05-21T01:20:00.208164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:02:17.391701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.577698+0000","last_change":"2024-05-21T01:19:58.599203+0000","last_active":"2024-05-21T01:19:59.577698+0000","last_peered":"2024-05-21T01:19:59.577698+0000","last_clean":"2024-05-21T01:19:59.577698+0000","last_became_active":"2024-05-21T01:19:58.598175+0000","last_became_peered":"2024-05-21T01:19:58.598175+0000","last_unstale":"2024-05-21T01:19:59.577698+0000","last_undegraded":"2024-05-21T01:19:59.577698+0000","last_fullsized":"2024-05-21T01:19:59.577698+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:45:17.138090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.574222+0000","last_change":"2024-05-21T01:19:54.551092+0000","last_active":"2024-05-21T01:19:59.574222+0000","last_peered":"2024-05-21T01:19:59.574222+0000","last_clean":"2024-05-21T01:19:59.574222+0000","last_became_active":"2024-05-21T01:19:54.550338+0000","last_became_peered":"2024-05-21T01:19:54.550338+0000","last_unstale":"2024-05-21T01:19:59.574222+0000","last_undegraded":"2024-05-21T01:19:59.574222+0000","last_fullsized":"2024-05-21T01:19:59.574222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:29:13.540719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.566856+0000","last_change":"2024-05-21T01:19:53.554835+0000","last_active":"2024-05-21T01:19:59.566856+0000","last_peered":"2024-05-21T01:19:59.566856+0000","last_clean":"2024-05-21T01:19:59.566856+0000","last_became_active":"2024-05-21T01:19:53.554598+0000","last_became_peered":"2024-05-21T01:19:53.554598+0000","last_unstale":"2024-05-21T01:19:59.566856+0000","last_undegraded":"2024-05-21T01:19:59.566856+0000","last_fullsized":"2024-05-21T01:19:59.566856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:28:43.940978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.211238+0000","last_change":"2024-05-21T01:19:58.629747+0000","last_active":"2024-05-21T01:20:00.211238+0000","last_peered":"2024-05-21T01:20:00.211238+0000","last_clean":"2024-05-21T01:20:00.211238+0000","last_became_active":"2024-05-21T01:19:58.622106+0000","last_became_peered":"2024-05-21T01:19:58.622106+0000","last_unstale":"2024-05-21T01:20:00.211238+0000","last_undegraded":"2024-05-21T01:20:00.211238+0000","last_fullsized":"2024-05-21T01:20:00.211238+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:22:07.047914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.571255+0000","last_change":"2024-05-21T01:19:54.554303+0000","last_active":"2024-05-21T01:19:59.571255+0000","last_peered":"2024-05-21T01:19:59.571255+0000","last_clean":"2024-05-21T01:19:59.571255+0000","last_became_active":"2024-05-21T01:19:54.552126+0000","last_became_peered":"2024-05-21T01:19:54.552126+0000","last_unstale":"2024-05-21T01:19:59.571255+0000","last_undegraded":"2024-05-21T01:19:59.571255+0000","last_fullsized":"2024-05-21T01:19:59.571255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:59:46.383359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.567302+0000","last_change":"2024-05-21T01:19:53.536580+0000","last_active":"2024-05-21T01:19:59.567302+0000","last_peered":"2024-05-21T01:19:59.567302+0000","last_clean":"2024-05-21T01:19:59.567302+0000","last_became_active":"2024-05-21T01:19:53.535105+0000","last_became_peered":"2024-05-21T01:19:53.535105+0000","last_unstale":"2024-05-21T01:19:59.567302+0000","last_undegraded":"2024-05-21T01:19:59.567302+0000","last_fullsized":"2024-05-21T01:19:59.567302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:58:05.019025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":118,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207611+0000","last_change":"2024-05-21T01:19:49.490062+0000","last_active":"2024-05-21T01:20:00.207611+0000","last_peered":"2024-05-21T01:20:00.207611+0000","last_clean":"2024-05-21T01:20:00.207611+0000","last_became_active":"2024-05-21T01:19:49.488796+0000","last_became_peered":"2024-05-21T01:19:49.488796+0000","last_unstale":"2024-05-21T01:20:00.207611+0000","last_undegraded":"2024-05-21T01:20:00.207611+0000","last_fullsized":"2024-05-21T01:20:00.207611+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:47.457865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:47.457865+0000","last_clean_scrub_stamp":"2024-05-21T01:19:47.457865+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T09:37:06.199150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.568012+0000","last_change":"2024-05-21T01:19:58.590851+0000","last_active":"2024-05-21T01:19:59.568012+0000","last_peered":"2024-05-21T01:19:59.568012+0000","last_clean":"2024-05-21T01:19:59.568012+0000","last_became_active":"2024-05-21T01:19:58.589288+0000","last_became_peered":"2024-05-21T01:19:58.589288+0000","last_unstale":"2024-05-21T01:19:59.568012+0000","last_undegraded":"2024-05-21T01:19:59.568012+0000","last_fullsized":"2024-05-21T01:19:59.568012+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:36:46.992834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.567741+0000","last_change":"2024-05-21T01:19:54.543894+0000","last_active":"2024-05-21T01:19:59.567741+0000","last_peered":"2024-05-21T01:19:59.567741+0000","last_clean":"2024-05-21T01:19:59.567741+0000","last_became_active":"2024-05-21T01:19:54.543586+0000","last_became_peered":"2024-05-21T01:19:54.543586+0000","last_unstale":"2024-05-21T01:19:59.567741+0000","last_undegraded":"2024-05-21T01:19:59.567741+0000","last_fullsized":"2024-05-21T01:19:59.567741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:33:02.756634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.577243+0000","last_change":"2024-05-21T01:19:53.532115+0000","last_active":"2024-05-21T01:19:59.577243+0000","last_peered":"2024-05-21T01:19:59.577243+0000","last_clean":"2024-05-21T01:19:59.577243+0000","last_became_active":"2024-05-21T01:19:53.529879+0000","last_became_peered":"2024-05-21T01:19:53.529879+0000","last_unstale":"2024-05-21T01:19:59.577243+0000","last_undegraded":"2024-05-21T01:19:59.577243+0000","last_fullsized":"2024-05-21T01:19:59.577243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:42:07.436243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.206924+0000","last_change":"2024-05-21T01:19:58.604417+0000","last_active":"2024-05-21T01:20:00.206924+0000","last_peered":"2024-05-21T01:20:00.206924+0000","last_clean":"2024-05-21T01:20:00.206924+0000","last_became_active":"2024-05-21T01:19:58.603929+0000","last_became_peered":"2024-05-21T01:19:58.603929+0000","last_unstale":"2024-05-21T01:20:00.206924+0000","last_undegraded":"2024-05-21T01:20:00.206924+0000","last_fullsized":"2024-05-21T01:20:00.206924+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:15:59.031738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207029+0000","last_change":"2024-05-21T01:19:54.542096+0000","last_active":"2024-05-21T01:20:00.207029+0000","last_peered":"2024-05-21T01:20:00.207029+0000","last_clean":"2024-05-21T01:20:00.207029+0000","last_became_active":"2024-05-21T01:19:54.541837+0000","last_became_peered":"2024-05-21T01:19:54.541837+0000","last_unstale":"2024-05-21T01:20:00.207029+0000","last_undegraded":"2024-05-21T01:20:00.207029+0000","last_fullsized":"2024-05-21T01:20:00.207029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:55:30.807311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.211049+0000","last_change":"2024-05-21T01:19:53.551697+0000","last_active":"2024-05-21T01:20:00.211049+0000","last_peered":"2024-05-21T01:20:00.211049+0000","last_clean":"2024-05-21T01:20:00.211049+0000","last_became_active":"2024-05-21T01:19:53.550893+0000","last_became_peered":"2024-05-21T01:19:53.550893+0000","last_unstale":"2024-05-21T01:20:00.211049+0000","last_undegraded":"2024-05-21T01:20:00.211049+0000","last_fullsized":"2024-05-21T01:20:00.211049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:42:20.295229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.210457+0000","last_change":"2024-05-21T01:19:58.628526+0000","last_active":"2024-05-21T01:20:00.210457+0000","last_peered":"2024-05-21T01:20:00.210457+0000","last_clean":"2024-05-21T01:20:00.210457+0000","last_became_active":"2024-05-21T01:19:58.620667+0000","last_became_peered":"2024-05-21T01:19:58.620667+0000","last_unstale":"2024-05-21T01:20:00.210457+0000","last_undegraded":"2024-05-21T01:20:00.210457+0000","last_fullsized":"2024-05-21T01:20:00.210457+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:46:22.396063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.208496+0000","last_change":"2024-05-21T01:19:54.532551+0000","last_active":"2024-05-21T01:20:00.208496+0000","last_peered":"2024-05-21T01:20:00.208496+0000","last_clean":"2024-05-21T01:20:00.208496+0000","last_became_active":"2024-05-21T01:19:54.532251+0000","last_became_peered":"2024-05-21T01:19:54.532251+0000","last_unstale":"2024-05-21T01:20:00.208496+0000","last_undegraded":"2024-05-21T01:20:00.208496+0000","last_fullsized":"2024-05-21T01:20:00.208496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:00:30.042781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.572555+0000","last_change":"2024-05-21T01:19:53.554659+0000","last_active":"2024-05-21T01:19:59.572555+0000","last_peered":"2024-05-21T01:19:59.572555+0000","last_clean":"2024-05-21T01:19:59.572555+0000","last_became_active":"2024-05-21T01:19:53.553953+0000","last_became_peered":"2024-05-21T01:19:53.553953+0000","last_unstale":"2024-05-21T01:19:59.572555+0000","last_undegraded":"2024-05-21T01:19:59.572555+0000","last_fullsized":"2024-05-21T01:19:59.572555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:31:13.091061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.566596+0000","last_change":"2024-05-21T01:19:58.593243+0000","last_active":"2024-05-21T01:19:59.566596+0000","last_peered":"2024-05-21T01:19:59.566596+0000","last_clean":"2024-05-21T01:19:59.566596+0000","last_became_active":"2024-05-21T01:19:58.592758+0000","last_became_peered":"2024-05-21T01:19:58.592758+0000","last_unstale":"2024-05-21T01:19:59.566596+0000","last_undegraded":"2024-05-21T01:19:59.566596+0000","last_fullsized":"2024-05-21T01:19:59.566596+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:46:17.877736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207962+0000","last_change":"2024-05-21T01:19:54.538391+0000","last_active":"2024-05-21T01:20:00.207962+0000","last_peered":"2024-05-21T01:20:00.207962+0000","last_clean":"2024-05-21T01:20:00.207962+0000","last_became_active":"2024-05-21T01:19:54.538106+0000","last_became_peered":"2024-05-21T01:19:54.538106+0000","last_unstale":"2024-05-21T01:20:00.207962+0000","last_undegraded":"2024-05-21T01:20:00.207962+0000","last_fullsized":"2024-05-21T01:20:00.207962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:36:07.297496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.208540+0000","last_change":"2024-05-21T01:19:53.551917+0000","last_active":"2024-05-21T01:20:00.208540+0000","last_peered":"2024-05-21T01:20:00.208540+0000","last_clean":"2024-05-21T01:20:00.208540+0000","last_became_active":"2024-05-21T01:19:53.551608+0000","last_became_peered":"2024-05-21T01:19:53.551608+0000","last_unstale":"2024-05-21T01:20:00.208540+0000","last_undegraded":"2024-05-21T01:20:00.208540+0000","last_fullsized":"2024-05-21T01:20:00.208540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:20:54.093966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.208119+0000","last_change":"2024-05-21T01:19:58.613367+0000","last_active":"2024-05-21T01:20:00.208119+0000","last_peered":"2024-05-21T01:20:00.208119+0000","last_clean":"2024-05-21T01:20:00.208119+0000","last_became_active":"2024-05-21T01:19:58.612950+0000","last_became_peered":"2024-05-21T01:19:58.612950+0000","last_unstale":"2024-05-21T01:20:00.208119+0000","last_undegraded":"2024-05-21T01:20:00.208119+0000","last_fullsized":"2024-05-21T01:20:00.208119+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:32:12.365734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.566761+0000","last_change":"2024-05-21T01:19:54.548979+0000","last_active":"2024-05-21T01:19:59.566761+0000","last_peered":"2024-05-21T01:19:59.566761+0000","last_clean":"2024-05-21T01:19:59.566761+0000","last_became_active":"2024-05-21T01:19:54.548704+0000","last_became_peered":"2024-05-21T01:19:54.548704+0000","last_unstale":"2024-05-21T01:19:59.566761+0000","last_undegraded":"2024-05-21T01:19:59.566761+0000","last_fullsized":"2024-05-21T01:19:59.566761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:57:09.076705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"24'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.571911+0000","last_change":"2024-05-21T01:19:53.542425+0000","last_active":"2024-05-21T01:19:59.571911+0000","last_peered":"2024-05-21T01:19:59.571911+0000","last_clean":"2024-05-21T01:19:59.571911+0000","last_became_active":"2024-05-21T01:19:53.541577+0000","last_became_peered":"2024-05-21T01:19:53.541577+0000","last_unstale":"2024-05-21T01:19:59.571911+0000","last_undegraded":"2024-05-21T01:19:59.571911+0000","last_fullsized":"2024-05-21T01:19:59.571911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:47:54.892789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.211663+0000","last_change":"2024-05-21T01:19:58.630293+0000","last_active":"2024-05-21T01:20:00.211663+0000","last_peered":"2024-05-21T01:20:00.211663+0000","last_clean":"2024-05-21T01:20:00.211663+0000","last_became_active":"2024-05-21T01:19:58.629119+0000","last_became_peered":"2024-05-21T01:19:58.629119+0000","last_unstale":"2024-05-21T01:20:00.211663+0000","last_undegraded":"2024-05-21T01:20:00.211663+0000","last_fullsized":"2024-05-21T01:20:00.211663+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:10:45.318517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207523+0000","last_change":"2024-05-21T01:19:54.575541+0000","last_active":"2024-05-21T01:20:00.207523+0000","last_peered":"2024-05-21T01:20:00.207523+0000","last_clean":"2024-05-21T01:20:00.207523+0000","last_became_active":"2024-05-21T01:19:54.575314+0000","last_became_peered":"2024-05-21T01:19:54.575314+0000","last_unstale":"2024-05-21T01:20:00.207523+0000","last_undegraded":"2024-05-21T01:20:00.207523+0000","last_fullsized":"2024-05-21T01:20:00.207523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:02:36.840590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.206224+0000","last_change":"2024-05-21T01:19:53.523758+0000","last_active":"2024-05-21T01:20:00.206224+0000","last_peered":"2024-05-21T01:20:00.206224+0000","last_clean":"2024-05-21T01:20:00.206224+0000","last_became_active":"2024-05-21T01:19:53.523273+0000","last_became_peered":"2024-05-21T01:19:53.523273+0000","last_unstale":"2024-05-21T01:20:00.206224+0000","last_undegraded":"2024-05-21T01:20:00.206224+0000","last_fullsized":"2024-05-21T01:20:00.206224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:05:47.275193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.211601+0000","last_change":"2024-05-21T01:19:58.621996+0000","last_active":"2024-05-21T01:20:00.211601+0000","last_peered":"2024-05-21T01:20:00.211601+0000","last_clean":"2024-05-21T01:20:00.211601+0000","last_became_active":"2024-05-21T01:19:58.620552+0000","last_became_peered":"2024-05-21T01:19:58.620552+0000","last_unstale":"2024-05-21T01:20:00.211601+0000","last_undegraded":"2024-05-21T01:20:00.211601+0000","last_fullsized":"2024-05-21T01:20:00.211601+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:58:32.635003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.567139+0000","last_change":"2024-05-21T01:19:54.557379+0000","last_active":"2024-05-21T01:19:59.567139+0000","last_peered":"2024-05-21T01:19:59.567139+0000","last_clean":"2024-05-21T01:19:59.567139+0000","last_became_active":"2024-05-21T01:19:54.550335+0000","last_became_peered":"2024-05-21T01:19:54.550335+0000","last_unstale":"2024-05-21T01:19:59.567139+0000","last_undegraded":"2024-05-21T01:19:59.567139+0000","last_fullsized":"2024-05-21T01:19:59.567139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:24:52.297888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.567280+0000","last_change":"2024-05-21T01:19:53.534431+0000","last_active":"2024-05-21T01:19:59.567280+0000","last_peered":"2024-05-21T01:19:59.567280+0000","last_clean":"2024-05-21T01:19:59.567280+0000","last_became_active":"2024-05-21T01:19:53.534174+0000","last_became_peered":"2024-05-21T01:19:53.534174+0000","last_unstale":"2024-05-21T01:19:59.567280+0000","last_undegraded":"2024-05-21T01:19:59.567280+0000","last_fullsized":"2024-05-21T01:19:59.567280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:42:04.743914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.576325+0000","last_change":"2024-05-21T01:19:58.609289+0000","last_active":"2024-05-21T01:19:59.576325+0000","last_peered":"2024-05-21T01:19:59.576325+0000","last_clean":"2024-05-21T01:19:59.576325+0000","last_became_active":"2024-05-21T01:19:58.608371+0000","last_became_peered":"2024-05-21T01:19:58.608371+0000","last_unstale":"2024-05-21T01:19:59.576325+0000","last_undegraded":"2024-05-21T01:19:59.576325+0000","last_fullsized":"2024-05-21T01:19:59.576325+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:27:36.997803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.575122+0000","last_change":"2024-05-21T01:19:54.551617+0000","last_active":"2024-05-21T01:19:59.575122+0000","last_peered":"2024-05-21T01:19:59.575122+0000","last_clean":"2024-05-21T01:19:59.575122+0000","last_became_active":"2024-05-21T01:19:54.550865+0000","last_became_peered":"2024-05-21T01:19:54.550865+0000","last_unstale":"2024-05-21T01:19:59.575122+0000","last_undegraded":"2024-05-21T01:19:59.575122+0000","last_fullsized":"2024-05-21T01:19:59.575122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:32:44.168265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.208932+0000","last_change":"2024-05-21T01:19:53.535936+0000","last_active":"2024-05-21T01:20:00.208932+0000","last_peered":"2024-05-21T01:20:00.208932+0000","last_clean":"2024-05-21T01:20:00.208932+0000","last_became_active":"2024-05-21T01:19:53.535143+0000","last_became_peered":"2024-05-21T01:19:53.535143+0000","last_unstale":"2024-05-21T01:20:00.208932+0000","last_undegraded":"2024-05-21T01:20:00.208932+0000","last_fullsized":"2024-05-21T01:20:00.208932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:50:51.433726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.567570+0000","last_change":"2024-05-21T01:19:58.622615+0000","last_active":"2024-05-21T01:19:59.567570+0000","last_peered":"2024-05-21T01:19:59.567570+0000","last_clean":"2024-05-21T01:19:59.567570+0000","last_became_active":"2024-05-21T01:19:58.622250+0000","last_became_peered":"2024-05-21T01:19:58.622250+0000","last_unstale":"2024-05-21T01:19:59.567570+0000","last_undegraded":"2024-05-21T01:19:59.567570+0000","last_fullsized":"2024-05-21T01:19:59.567570+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:05:22.913945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207577+0000","last_change":"2024-05-21T01:19:54.558348+0000","last_active":"2024-05-21T01:20:00.207577+0000","last_peered":"2024-05-21T01:20:00.207577+0000","last_clean":"2024-05-21T01:20:00.207577+0000","last_became_active":"2024-05-21T01:19:54.558095+0000","last_became_peered":"2024-05-21T01:19:54.558095+0000","last_unstale":"2024-05-21T01:20:00.207577+0000","last_undegraded":"2024-05-21T01:20:00.207577+0000","last_fullsized":"2024-05-21T01:20:00.207577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:43:48.625583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:09.561570+0000","last_change":"2024-05-21T01:19:53.534947+0000","last_active":"2024-05-21T01:20:09.561570+0000","last_peered":"2024-05-21T01:20:09.561570+0000","last_clean":"2024-05-21T01:20:09.561570+0000","last_became_active":"2024-05-21T01:19:53.534616+0000","last_became_peered":"2024-05-21T01:19:53.534616+0000","last_unstale":"2024-05-21T01:20:09.561570+0000","last_undegraded":"2024-05-21T01:20:09.561570+0000","last_fullsized":"2024-05-21T01:20:09.561570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:01:25.372035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.571116+0000","last_change":"2024-05-21T01:19:58.617970+0000","last_active":"2024-05-21T01:19:59.571116+0000","last_peered":"2024-05-21T01:19:59.571116+0000","last_clean":"2024-05-21T01:19:59.571116+0000","last_became_active":"2024-05-21T01:19:58.617061+0000","last_became_peered":"2024-05-21T01:19:58.617061+0000","last_unstale":"2024-05-21T01:19:59.571116+0000","last_undegraded":"2024-05-21T01:19:59.571116+0000","last_fullsized":"2024-05-21T01:19:59.571116+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:48:50.703577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.567205+0000","last_change":"2024-05-21T01:19:54.557175+0000","last_active":"2024-05-21T01:19:59.567205+0000","last_peered":"2024-05-21T01:19:59.567205+0000","last_clean":"2024-05-21T01:19:59.567205+0000","last_became_active":"2024-05-21T01:19:54.556933+0000","last_became_peered":"2024-05-21T01:19:54.556933+0000","last_unstale":"2024-05-21T01:19:59.567205+0000","last_undegraded":"2024-05-21T01:19:59.567205+0000","last_fullsized":"2024-05-21T01:19:59.567205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:15:44.089544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"24'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.208820+0000","last_change":"2024-05-21T01:19:53.536780+0000","last_active":"2024-05-21T01:20:00.208820+0000","last_peered":"2024-05-21T01:20:00.208820+0000","last_clean":"2024-05-21T01:20:00.208820+0000","last_became_active":"2024-05-21T01:19:53.535768+0000","last_became_peered":"2024-05-21T01:19:53.535768+0000","last_unstale":"2024-05-21T01:20:00.208820+0000","last_undegraded":"2024-05-21T01:20:00.208820+0000","last_fullsized":"2024-05-21T01:20:00.208820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:04:14.732801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207120+0000","last_change":"2024-05-21T01:19:58.606532+0000","last_active":"2024-05-21T01:20:00.207120+0000","last_peered":"2024-05-21T01:20:00.207120+0000","last_clean":"2024-05-21T01:20:00.207120+0000","last_became_active":"2024-05-21T01:19:58.606180+0000","last_became_peered":"2024-05-21T01:19:58.606180+0000","last_unstale":"2024-05-21T01:20:00.207120+0000","last_undegraded":"2024-05-21T01:20:00.207120+0000","last_fullsized":"2024-05-21T01:20:00.207120+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:25:31.161427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.211807+0000","last_change":"2024-05-21T01:19:54.571280+0000","last_active":"2024-05-21T01:20:00.211807+0000","last_peered":"2024-05-21T01:20:00.211807+0000","last_clean":"2024-05-21T01:20:00.211807+0000","last_became_active":"2024-05-21T01:19:54.568778+0000","last_became_peered":"2024-05-21T01:19:54.568778+0000","last_unstale":"2024-05-21T01:20:00.211807+0000","last_undegraded":"2024-05-21T01:20:00.211807+0000","last_fullsized":"2024-05-21T01:20:00.211807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:43:16.583632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.208476+0000","last_change":"2024-05-21T01:19:53.530770+0000","last_active":"2024-05-21T01:20:00.208476+0000","last_peered":"2024-05-21T01:20:00.208476+0000","last_clean":"2024-05-21T01:20:00.208476+0000","last_became_active":"2024-05-21T01:19:53.526431+0000","last_became_peered":"2024-05-21T01:19:53.526431+0000","last_unstale":"2024-05-21T01:20:00.208476+0000","last_undegraded":"2024-05-21T01:20:00.208476+0000","last_fullsized":"2024-05-21T01:20:00.208476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:08:59.892029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.208009+0000","last_change":"2024-05-21T01:19:58.611576+0000","last_active":"2024-05-21T01:20:00.208009+0000","last_peered":"2024-05-21T01:20:00.208009+0000","last_clean":"2024-05-21T01:20:00.208009+0000","last_became_active":"2024-05-21T01:19:58.610838+0000","last_became_peered":"2024-05-21T01:19:58.610838+0000","last_unstale":"2024-05-21T01:20:00.208009+0000","last_undegraded":"2024-05-21T01:20:00.208009+0000","last_fullsized":"2024-05-21T01:20:00.208009+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:07:31.736640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207957+0000","last_change":"2024-05-21T01:19:54.552709+0000","last_active":"2024-05-21T01:20:00.207957+0000","last_peered":"2024-05-21T01:20:00.207957+0000","last_clean":"2024-05-21T01:20:00.207957+0000","last_became_active":"2024-05-21T01:19:54.547898+0000","last_became_peered":"2024-05-21T01:19:54.547898+0000","last_unstale":"2024-05-21T01:20:00.207957+0000","last_undegraded":"2024-05-21T01:20:00.207957+0000","last_fullsized":"2024-05-21T01:20:00.207957+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:20:17.933506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.209704+0000","last_change":"2024-05-21T01:19:53.534507+0000","last_active":"2024-05-21T01:20:00.209704+0000","last_peered":"2024-05-21T01:20:00.209704+0000","last_clean":"2024-05-21T01:20:00.209704+0000","last_became_active":"2024-05-21T01:19:53.534036+0000","last_became_peered":"2024-05-21T01:19:53.534036+0000","last_unstale":"2024-05-21T01:20:00.209704+0000","last_undegraded":"2024-05-21T01:20:00.209704+0000","last_fullsized":"2024-05-21T01:20:00.209704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:01:08.218098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.572286+0000","last_change":"2024-05-21T01:19:58.608135+0000","last_active":"2024-05-21T01:19:59.572286+0000","last_peered":"2024-05-21T01:19:59.572286+0000","last_clean":"2024-05-21T01:19:59.572286+0000","last_became_active":"2024-05-21T01:19:58.607242+0000","last_became_peered":"2024-05-21T01:19:58.607242+0000","last_unstale":"2024-05-21T01:19:59.572286+0000","last_undegraded":"2024-05-21T01:19:59.572286+0000","last_fullsized":"2024-05-21T01:19:59.572286+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:05:26.197876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.572239+0000","last_change":"2024-05-21T01:19:58.624883+0000","last_active":"2024-05-21T01:19:59.572239+0000","last_peered":"2024-05-21T01:19:59.572239+0000","last_clean":"2024-05-21T01:19:59.572239+0000","last_became_active":"2024-05-21T01:19:58.623991+0000","last_became_peered":"2024-05-21T01:19:58.623991+0000","last_unstale":"2024-05-21T01:19:59.572239+0000","last_undegraded":"2024-05-21T01:19:59.572239+0000","last_fullsized":"2024-05-21T01:19:59.572239+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:29:26.251376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.572416+0000","last_change":"2024-05-21T01:19:54.549215+0000","last_active":"2024-05-21T01:19:59.572416+0000","last_peered":"2024-05-21T01:19:59.572416+0000","last_clean":"2024-05-21T01:19:59.572416+0000","last_became_active":"2024-05-21T01:19:54.548426+0000","last_became_peered":"2024-05-21T01:19:54.548426+0000","last_unstale":"2024-05-21T01:19:59.572416+0000","last_undegraded":"2024-05-21T01:19:59.572416+0000","last_fullsized":"2024-05-21T01:19:59.572416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:10:10.800391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.566822+0000","last_change":"2024-05-21T01:19:53.526106+0000","last_active":"2024-05-21T01:19:59.566822+0000","last_peered":"2024-05-21T01:19:59.566822+0000","last_clean":"2024-05-21T01:19:59.566822+0000","last_became_active":"2024-05-21T01:19:53.525786+0000","last_became_peered":"2024-05-21T01:19:53.525786+0000","last_unstale":"2024-05-21T01:19:59.566822+0000","last_undegraded":"2024-05-21T01:19:59.566822+0000","last_fullsized":"2024-05-21T01:19:59.566822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:01:05.180803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.567758+0000","last_change":"2024-05-21T01:19:58.615481+0000","last_active":"2024-05-21T01:19:59.567758+0000","last_peered":"2024-05-21T01:19:59.567758+0000","last_clean":"2024-05-21T01:19:59.567758+0000","last_became_active":"2024-05-21T01:19:58.614879+0000","last_became_peered":"2024-05-21T01:19:58.614879+0000","last_unstale":"2024-05-21T01:19:59.567758+0000","last_undegraded":"2024-05-21T01:19:59.567758+0000","last_fullsized":"2024-05-21T01:19:59.567758+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:45:57.208342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.209731+0000","last_change":"2024-05-21T01:19:54.570650+0000","last_active":"2024-05-21T01:20:00.209731+0000","last_peered":"2024-05-21T01:20:00.209731+0000","last_clean":"2024-05-21T01:20:00.209731+0000","last_became_active":"2024-05-21T01:19:54.570034+0000","last_became_peered":"2024-05-21T01:19:54.570034+0000","last_unstale":"2024-05-21T01:20:00.209731+0000","last_undegraded":"2024-05-21T01:20:00.209731+0000","last_fullsized":"2024-05-21T01:20:00.209731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:01:05.887729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.574517+0000","last_change":"2024-05-21T01:19:53.532017+0000","last_active":"2024-05-21T01:19:59.574517+0000","last_peered":"2024-05-21T01:19:59.574517+0000","last_clean":"2024-05-21T01:19:59.574517+0000","last_became_active":"2024-05-21T01:19:53.529457+0000","last_became_peered":"2024-05-21T01:19:53.529457+0000","last_unstale":"2024-05-21T01:19:59.574517+0000","last_undegraded":"2024-05-21T01:19:59.574517+0000","last_fullsized":"2024-05-21T01:19:59.574517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:58:03.979929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.567307+0000","last_change":"2024-05-21T01:19:53.525620+0000","last_active":"2024-05-21T01:19:59.567307+0000","last_peered":"2024-05-21T01:19:59.567307+0000","last_clean":"2024-05-21T01:19:59.567307+0000","last_became_active":"2024-05-21T01:19:53.525315+0000","last_became_peered":"2024-05-21T01:19:53.525315+0000","last_unstale":"2024-05-21T01:19:59.567307+0000","last_undegraded":"2024-05-21T01:19:59.567307+0000","last_fullsized":"2024-05-21T01:19:59.567307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:30:38.075463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.571359+0000","last_change":"2024-05-21T01:19:54.555344+0000","last_active":"2024-05-21T01:19:59.571359+0000","last_peered":"2024-05-21T01:19:59.571359+0000","last_clean":"2024-05-21T01:19:59.571359+0000","last_became_active":"2024-05-21T01:19:54.552817+0000","last_became_peered":"2024-05-21T01:19:54.552817+0000","last_unstale":"2024-05-21T01:19:59.571359+0000","last_undegraded":"2024-05-21T01:19:59.571359+0000","last_fullsized":"2024-05-21T01:19:59.571359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:10:03.810064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.572198+0000","last_change":"2024-05-21T01:19:58.619520+0000","last_active":"2024-05-21T01:19:59.572198+0000","last_peered":"2024-05-21T01:19:59.572198+0000","last_clean":"2024-05-21T01:19:59.572198+0000","last_became_active":"2024-05-21T01:19:58.617165+0000","last_became_peered":"2024-05-21T01:19:58.617165+0000","last_unstale":"2024-05-21T01:19:59.572198+0000","last_undegraded":"2024-05-21T01:19:59.572198+0000","last_fullsized":"2024-05-21T01:19:59.572198+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T13:07:51.530746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.210590+0000","last_change":"2024-05-21T01:19:53.551547+0000","last_active":"2024-05-21T01:20:00.210590+0000","last_peered":"2024-05-21T01:20:00.210590+0000","last_clean":"2024-05-21T01:20:00.210590+0000","last_became_active":"2024-05-21T01:19:53.550931+0000","last_became_peered":"2024-05-21T01:19:53.550931+0000","last_unstale":"2024-05-21T01:20:00.210590+0000","last_undegraded":"2024-05-21T01:20:00.210590+0000","last_fullsized":"2024-05-21T01:20:00.210590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:13:47.329230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.208939+0000","last_change":"2024-05-21T01:19:54.574552+0000","last_active":"2024-05-21T01:20:00.208939+0000","last_peered":"2024-05-21T01:20:00.208939+0000","last_clean":"2024-05-21T01:20:00.208939+0000","last_became_active":"2024-05-21T01:19:54.574246+0000","last_became_peered":"2024-05-21T01:19:54.574246+0000","last_unstale":"2024-05-21T01:20:00.208939+0000","last_undegraded":"2024-05-21T01:20:00.208939+0000","last_fullsized":"2024-05-21T01:20:00.208939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:23:33.685798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.208672+0000","last_change":"2024-05-21T01:19:58.624400+0000","last_active":"2024-05-21T01:20:00.208672+0000","last_peered":"2024-05-21T01:20:00.208672+0000","last_clean":"2024-05-21T01:20:00.208672+0000","last_became_active":"2024-05-21T01:19:58.623388+0000","last_became_peered":"2024-05-21T01:19:58.623388+0000","last_unstale":"2024-05-21T01:20:00.208672+0000","last_undegraded":"2024-05-21T01:20:00.208672+0000","last_fullsized":"2024-05-21T01:20:00.208672+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:59:30.019393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.206641+0000","last_change":"2024-05-21T01:19:54.553262+0000","last_active":"2024-05-21T01:20:00.206641+0000","last_peered":"2024-05-21T01:20:00.206641+0000","last_clean":"2024-05-21T01:20:00.206641+0000","last_became_active":"2024-05-21T01:19:54.553060+0000","last_became_peered":"2024-05-21T01:19:54.553060+0000","last_unstale":"2024-05-21T01:20:00.206641+0000","last_undegraded":"2024-05-21T01:20:00.206641+0000","last_fullsized":"2024-05-21T01:20:00.206641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:18:14.077480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207978+0000","last_change":"2024-05-21T01:19:54.566851+0000","last_active":"2024-05-21T01:20:00.207978+0000","last_peered":"2024-05-21T01:20:00.207978+0000","last_clean":"2024-05-21T01:20:00.207978+0000","last_became_active":"2024-05-21T01:19:54.565573+0000","last_became_peered":"2024-05-21T01:19:54.565573+0000","last_unstale":"2024-05-21T01:20:00.207978+0000","last_undegraded":"2024-05-21T01:20:00.207978+0000","last_fullsized":"2024-05-21T01:20:00.207978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:51:30.883954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.566981+0000","last_change":"2024-05-21T01:19:54.566934+0000","last_active":"2024-05-21T01:19:59.566981+0000","last_peered":"2024-05-21T01:19:59.566981+0000","last_clean":"2024-05-21T01:19:59.566981+0000","last_became_active":"2024-05-21T01:19:54.566503+0000","last_became_peered":"2024-05-21T01:19:54.566503+0000","last_unstale":"2024-05-21T01:19:59.566981+0000","last_undegraded":"2024-05-21T01:19:59.566981+0000","last_fullsized":"2024-05-21T01:19:59.566981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:14:54.262165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.210361+0000","last_change":"2024-05-21T01:19:54.573091+0000","last_active":"2024-05-21T01:20:00.210361+0000","last_peered":"2024-05-21T01:20:00.210361+0000","last_clean":"2024-05-21T01:20:00.210361+0000","last_became_active":"2024-05-21T01:19:54.572366+0000","last_became_peered":"2024-05-21T01:19:54.572366+0000","last_unstale":"2024-05-21T01:20:00.210361+0000","last_undegraded":"2024-05-21T01:20:00.210361+0000","last_fullsized":"2024-05-21T01:20:00.210361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:10:09.353807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.576980+0000","last_change":"2024-05-21T01:19:54.563339+0000","last_active":"2024-05-21T01:19:59.576980+0000","last_peered":"2024-05-21T01:19:59.576980+0000","last_clean":"2024-05-21T01:19:59.576980+0000","last_became_active":"2024-05-21T01:19:54.557934+0000","last_became_peered":"2024-05-21T01:19:54.557934+0000","last_unstale":"2024-05-21T01:19:59.576980+0000","last_undegraded":"2024-05-21T01:19:59.576980+0000","last_fullsized":"2024-05-21T01:19:59.576980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:46:21.598689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.577198+0000","last_change":"2024-05-21T01:19:54.553551+0000","last_active":"2024-05-21T01:19:59.577198+0000","last_peered":"2024-05-21T01:19:59.577198+0000","last_clean":"2024-05-21T01:19:59.577198+0000","last_became_active":"2024-05-21T01:19:54.552812+0000","last_became_peered":"2024-05-21T01:19:54.552812+0000","last_unstale":"2024-05-21T01:19:59.577198+0000","last_undegraded":"2024-05-21T01:19:59.577198+0000","last_fullsized":"2024-05-21T01:19:59.577198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:27:41.166606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207853+0000","last_change":"2024-05-21T01:19:54.548604+0000","last_active":"2024-05-21T01:20:00.207853+0000","last_peered":"2024-05-21T01:20:00.207853+0000","last_clean":"2024-05-21T01:20:00.207853+0000","last_became_active":"2024-05-21T01:19:54.548263+0000","last_became_peered":"2024-05-21T01:19:54.548263+0000","last_unstale":"2024-05-21T01:20:00.207853+0000","last_undegraded":"2024-05-21T01:20:00.207853+0000","last_fullsized":"2024-05-21T01:20:00.207853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:33:55.302088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.211381+0000","last_change":"2024-05-21T01:19:54.573995+0000","last_active":"2024-05-21T01:20:00.211381+0000","last_peered":"2024-05-21T01:20:00.211381+0000","last_clean":"2024-05-21T01:20:00.211381+0000","last_became_active":"2024-05-21T01:19:54.570373+0000","last_became_peered":"2024-05-21T01:19:54.570373+0000","last_unstale":"2024-05-21T01:20:00.211381+0000","last_undegraded":"2024-05-21T01:20:00.211381+0000","last_fullsized":"2024-05-21T01:20:00.211381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:44:23.194713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.566746+0000","last_change":"2024-05-21T01:19:54.575196+0000","last_active":"2024-05-21T01:19:59.566746+0000","last_peered":"2024-05-21T01:19:59.566746+0000","last_clean":"2024-05-21T01:19:59.566746+0000","last_became_active":"2024-05-21T01:19:54.574945+0000","last_became_peered":"2024-05-21T01:19:54.574945+0000","last_unstale":"2024-05-21T01:19:59.566746+0000","last_undegraded":"2024-05-21T01:19:59.566746+0000","last_fullsized":"2024-05-21T01:19:59.566746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:52:56.244771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.209915+0000","last_change":"2024-05-21T01:19:54.566719+0000","last_active":"2024-05-21T01:20:00.209915+0000","last_peered":"2024-05-21T01:20:00.209915+0000","last_clean":"2024-05-21T01:20:00.209915+0000","last_became_active":"2024-05-21T01:19:54.565922+0000","last_became_peered":"2024-05-21T01:19:54.565922+0000","last_unstale":"2024-05-21T01:20:00.209915+0000","last_undegraded":"2024-05-21T01:20:00.209915+0000","last_fullsized":"2024-05-21T01:20:00.209915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:39:19.454688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.208888+0000","last_change":"2024-05-21T01:19:54.536815+0000","last_active":"2024-05-21T01:20:00.208888+0000","last_peered":"2024-05-21T01:20:00.208888+0000","last_clean":"2024-05-21T01:20:00.208888+0000","last_became_active":"2024-05-21T01:19:54.535957+0000","last_became_peered":"2024-05-21T01:19:54.535957+0000","last_unstale":"2024-05-21T01:20:00.208888+0000","last_undegraded":"2024-05-21T01:20:00.208888+0000","last_fullsized":"2024-05-21T01:20:00.208888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:24:53.906256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.571247+0000","last_change":"2024-05-21T01:19:54.552466+0000","last_active":"2024-05-21T01:19:59.571247+0000","last_peered":"2024-05-21T01:19:59.571247+0000","last_clean":"2024-05-21T01:19:59.571247+0000","last_became_active":"2024-05-21T01:19:54.551790+0000","last_became_peered":"2024-05-21T01:19:54.551790+0000","last_unstale":"2024-05-21T01:19:59.571247+0000","last_undegraded":"2024-05-21T01:19:59.571247+0000","last_fullsized":"2024-05-21T01:19:59.571247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:24:34.737707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.206948+0000","last_change":"2024-05-21T01:19:54.535314+0000","last_active":"2024-05-21T01:20:00.206948+0000","last_peered":"2024-05-21T01:20:00.206948+0000","last_clean":"2024-05-21T01:20:00.206948+0000","last_became_active":"2024-05-21T01:19:54.534793+0000","last_became_peered":"2024-05-21T01:19:54.534793+0000","last_unstale":"2024-05-21T01:20:00.206948+0000","last_undegraded":"2024-05-21T01:20:00.206948+0000","last_fullsized":"2024-05-21T01:20:00.206948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:52:35.492250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.568120+0000","last_change":"2024-05-21T01:19:54.556323+0000","last_active":"2024-05-21T01:19:59.568120+0000","last_peered":"2024-05-21T01:19:59.568120+0000","last_clean":"2024-05-21T01:19:59.568120+0000","last_became_active":"2024-05-21T01:19:54.556043+0000","last_became_peered":"2024-05-21T01:19:54.556043+0000","last_unstale":"2024-05-21T01:19:59.568120+0000","last_undegraded":"2024-05-21T01:19:59.568120+0000","last_fullsized":"2024-05-21T01:19:59.568120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:34:02.068527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.209056+0000","last_change":"2024-05-21T01:19:54.567457+0000","last_active":"2024-05-21T01:20:00.209056+0000","last_peered":"2024-05-21T01:20:00.209056+0000","last_clean":"2024-05-21T01:20:00.209056+0000","last_became_active":"2024-05-21T01:19:54.565326+0000","last_became_peered":"2024-05-21T01:19:54.565326+0000","last_unstale":"2024-05-21T01:20:00.209056+0000","last_undegraded":"2024-05-21T01:20:00.209056+0000","last_fullsized":"2024-05-21T01:20:00.209056+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:11:05.775389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.568111+0000","last_change":"2024-05-21T01:19:54.562078+0000","last_active":"2024-05-21T01:19:59.568111+0000","last_peered":"2024-05-21T01:19:59.568111+0000","last_clean":"2024-05-21T01:19:59.568111+0000","last_became_active":"2024-05-21T01:19:54.558286+0000","last_became_peered":"2024-05-21T01:19:54.558286+0000","last_unstale":"2024-05-21T01:19:59.568111+0000","last_undegraded":"2024-05-21T01:19:59.568111+0000","last_fullsized":"2024-05-21T01:19:59.568111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T09:09:58.360014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.566714+0000","last_change":"2024-05-21T01:19:54.548274+0000","last_active":"2024-05-21T01:19:59.566714+0000","last_peered":"2024-05-21T01:19:59.566714+0000","last_clean":"2024-05-21T01:19:59.566714+0000","last_became_active":"2024-05-21T01:19:54.548079+0000","last_became_peered":"2024-05-21T01:19:54.548079+0000","last_unstale":"2024-05-21T01:19:59.566714+0000","last_undegraded":"2024-05-21T01:19:59.566714+0000","last_fullsized":"2024-05-21T01:19:59.566714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:49:03.296571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.209656+0000","last_change":"2024-05-21T01:19:54.568211+0000","last_active":"2024-05-21T01:20:00.209656+0000","last_peered":"2024-05-21T01:20:00.209656+0000","last_clean":"2024-05-21T01:20:00.209656+0000","last_became_active":"2024-05-21T01:19:54.567512+0000","last_became_peered":"2024-05-21T01:19:54.567512+0000","last_unstale":"2024-05-21T01:20:00.209656+0000","last_undegraded":"2024-05-21T01:20:00.209656+0000","last_fullsized":"2024-05-21T01:20:00.209656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:32:18.004763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.575120+0000","last_change":"2024-05-21T01:19:54.556683+0000","last_active":"2024-05-21T01:19:59.575120+0000","last_peered":"2024-05-21T01:19:59.575120+0000","last_clean":"2024-05-21T01:19:59.575120+0000","last_became_active":"2024-05-21T01:19:54.555947+0000","last_became_peered":"2024-05-21T01:19:54.555947+0000","last_unstale":"2024-05-21T01:19:59.575120+0000","last_undegraded":"2024-05-21T01:19:59.575120+0000","last_fullsized":"2024-05-21T01:19:59.575120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:59:04.593946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.575926+0000","last_change":"2024-05-21T01:19:54.560218+0000","last_active":"2024-05-21T01:19:59.575926+0000","last_peered":"2024-05-21T01:19:59.575926+0000","last_clean":"2024-05-21T01:19:59.575926+0000","last_became_active":"2024-05-21T01:19:54.557787+0000","last_became_peered":"2024-05-21T01:19:54.557787+0000","last_unstale":"2024-05-21T01:19:59.575926+0000","last_undegraded":"2024-05-21T01:19:59.575926+0000","last_fullsized":"2024-05-21T01:19:59.575926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:05:48.282563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.206865+0000","last_change":"2024-05-21T01:19:54.535096+0000","last_active":"2024-05-21T01:20:00.206865+0000","last_peered":"2024-05-21T01:20:00.206865+0000","last_clean":"2024-05-21T01:20:00.206865+0000","last_became_active":"2024-05-21T01:19:54.534472+0000","last_became_peered":"2024-05-21T01:19:54.534472+0000","last_unstale":"2024-05-21T01:20:00.206865+0000","last_undegraded":"2024-05-21T01:20:00.206865+0000","last_fullsized":"2024-05-21T01:20:00.206865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:05:40.018457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207495+0000","last_change":"2024-05-21T01:19:54.546352+0000","last_active":"2024-05-21T01:20:00.207495+0000","last_peered":"2024-05-21T01:20:00.207495+0000","last_clean":"2024-05-21T01:20:00.207495+0000","last_became_active":"2024-05-21T01:19:54.546055+0000","last_became_peered":"2024-05-21T01:19:54.546055+0000","last_unstale":"2024-05-21T01:20:00.207495+0000","last_undegraded":"2024-05-21T01:20:00.207495+0000","last_fullsized":"2024-05-21T01:20:00.207495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:14:56.268312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.208385+0000","last_change":"2024-05-21T01:19:54.539886+0000","last_active":"2024-05-21T01:20:00.208385+0000","last_peered":"2024-05-21T01:20:00.208385+0000","last_clean":"2024-05-21T01:20:00.208385+0000","last_became_active":"2024-05-21T01:19:54.539599+0000","last_became_peered":"2024-05-21T01:19:54.539599+0000","last_unstale":"2024-05-21T01:20:00.208385+0000","last_undegraded":"2024-05-21T01:20:00.208385+0000","last_fullsized":"2024-05-21T01:20:00.208385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:08:51.107275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.209668+0000","last_change":"2024-05-21T01:19:54.548954+0000","last_active":"2024-05-21T01:20:00.209668+0000","last_peered":"2024-05-21T01:20:00.209668+0000","last_clean":"2024-05-21T01:20:00.209668+0000","last_became_active":"2024-05-21T01:19:54.547528+0000","last_became_peered":"2024-05-21T01:19:54.547528+0000","last_unstale":"2024-05-21T01:20:00.209668+0000","last_undegraded":"2024-05-21T01:20:00.209668+0000","last_fullsized":"2024-05-21T01:20:00.209668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:47:24.598610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.209472+0000","last_change":"2024-05-21T01:19:54.575256+0000","last_active":"2024-05-21T01:20:00.209472+0000","last_peered":"2024-05-21T01:20:00.209472+0000","last_clean":"2024-05-21T01:20:00.209472+0000","last_became_active":"2024-05-21T01:19:54.570119+0000","last_became_peered":"2024-05-21T01:19:54.570119+0000","last_unstale":"2024-05-21T01:20:00.209472+0000","last_undegraded":"2024-05-21T01:20:00.209472+0000","last_fullsized":"2024-05-21T01:20:00.209472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:10:02.800110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.206200+0000","last_change":"2024-05-21T01:19:54.550134+0000","last_active":"2024-05-21T01:20:00.206200+0000","last_peered":"2024-05-21T01:20:00.206200+0000","last_clean":"2024-05-21T01:20:00.206200+0000","last_became_active":"2024-05-21T01:19:54.549617+0000","last_became_peered":"2024-05-21T01:19:54.549617+0000","last_unstale":"2024-05-21T01:20:00.206200+0000","last_undegraded":"2024-05-21T01:20:00.206200+0000","last_fullsized":"2024-05-21T01:20:00.206200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:34:59.845458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207085+0000","last_change":"2024-05-21T01:19:54.555653+0000","last_active":"2024-05-21T01:20:00.207085+0000","last_peered":"2024-05-21T01:20:00.207085+0000","last_clean":"2024-05-21T01:20:00.207085+0000","last_became_active":"2024-05-21T01:19:54.555274+0000","last_became_peered":"2024-05-21T01:19:54.555274+0000","last_unstale":"2024-05-21T01:20:00.207085+0000","last_undegraded":"2024-05-21T01:20:00.207085+0000","last_fullsized":"2024-05-21T01:20:00.207085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:43:43.237853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207101+0000","last_change":"2024-05-21T01:19:54.568866+0000","last_active":"2024-05-21T01:20:00.207101+0000","last_peered":"2024-05-21T01:20:00.207101+0000","last_clean":"2024-05-21T01:20:00.207101+0000","last_became_active":"2024-05-21T01:19:54.568605+0000","last_became_peered":"2024-05-21T01:19:54.568605+0000","last_unstale":"2024-05-21T01:20:00.207101+0000","last_undegraded":"2024-05-21T01:20:00.207101+0000","last_fullsized":"2024-05-21T01:20:00.207101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:21:20.820620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207281+0000","last_change":"2024-05-21T01:19:54.557468+0000","last_active":"2024-05-21T01:20:00.207281+0000","last_peered":"2024-05-21T01:20:00.207281+0000","last_clean":"2024-05-21T01:20:00.207281+0000","last_became_active":"2024-05-21T01:19:54.554976+0000","last_became_peered":"2024-05-21T01:19:54.554976+0000","last_unstale":"2024-05-21T01:20:00.207281+0000","last_undegraded":"2024-05-21T01:20:00.207281+0000","last_fullsized":"2024-05-21T01:20:00.207281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:25:08.737348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.210942+0000","last_change":"2024-05-21T01:19:54.566991+0000","last_active":"2024-05-21T01:20:00.210942+0000","last_peered":"2024-05-21T01:20:00.210942+0000","last_clean":"2024-05-21T01:20:00.210942+0000","last_became_active":"2024-05-21T01:19:54.566349+0000","last_became_peered":"2024-05-21T01:19:54.566349+0000","last_unstale":"2024-05-21T01:20:00.210942+0000","last_undegraded":"2024-05-21T01:20:00.210942+0000","last_fullsized":"2024-05-21T01:20:00.210942+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:25:43.468081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.211304+0000","last_change":"2024-05-21T01:19:54.576100+0000","last_active":"2024-05-21T01:20:00.211304+0000","last_peered":"2024-05-21T01:20:00.211304+0000","last_clean":"2024-05-21T01:20:00.211304+0000","last_became_active":"2024-05-21T01:19:54.574914+0000","last_became_peered":"2024-05-21T01:19:54.574914+0000","last_unstale":"2024-05-21T01:20:00.211304+0000","last_undegraded":"2024-05-21T01:20:00.211304+0000","last_fullsized":"2024-05-21T01:20:00.211304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:29:30.730283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.208436+0000","last_change":"2024-05-21T01:19:54.546570+0000","last_active":"2024-05-21T01:20:00.208436+0000","last_peered":"2024-05-21T01:20:00.208436+0000","last_clean":"2024-05-21T01:20:00.208436+0000","last_became_active":"2024-05-21T01:19:54.546284+0000","last_became_peered":"2024-05-21T01:19:54.546284+0000","last_unstale":"2024-05-21T01:20:00.208436+0000","last_undegraded":"2024-05-21T01:20:00.208436+0000","last_fullsized":"2024-05-21T01:20:00.208436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:36:30.219522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66932,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509450,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":103393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509449,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":270336,"data_stored":106653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509448,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":327680,"data_stored":693249,"data_compressed":33466,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509448,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":102867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542153,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":102811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542152,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":331776,"data_stored":693271,"data_compressed":33466,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":102935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":107325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33466,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33466,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-21T01:20:22.794 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-21T01:20:22.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.969+0000 7fd895200640 1 Processor -- start 2024-05-21T01:20:22.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.969+0000 7fd895200640 1 -- start start 2024-05-21T01:20:22.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.969+0000 7fd895200640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd89006f5d0 0x7fd8900c47f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:22.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.969+0000 7fd895200640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd89006f9b0 0x7fd8900c94f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:22.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.969+0000 7fd895200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd8900c69c0 0x7fd8900c6df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:22.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.969+0000 7fd895200640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7fd8900c52a0 con 0x7fd89006f5d0 2024-05-21T01:20:22.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.973+0000 7fd895200640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fd8900c4d30 con 0x7fd89006f9b0 2024-05-21T01:20:22.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.973+0000 7fd895200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fd8900c7330 con 0x7fd8900c69c0 2024-05-21T01:20:22.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.973+0000 7fd88de00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd89006f5d0 0x7fd8900c47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:22.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.973+0000 7fd88de00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd89006f5d0 0x7fd8900c47f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:49156/0 (socket says 172.21.15.63:49156) 2024-05-21T01:20:22.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.973+0000 7fd88de00640 1 -- 172.21.15.63:0/1371040049 learned_addr learned my addr 172.21.15.63:0/1371040049 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:22.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.973+0000 7fd88e800640 1 --2- 172.21.15.63:0/1371040049 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd8900c69c0 0x7fd8900c6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:22.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.973+0000 7fd885400640 1 --2- 172.21.15.63:0/1371040049 >> v2:172.21.15.131:3300/0 conn(0x7fd89006f9b0 0x7fd8900c94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:22.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.973+0000 7fd88de00640 1 -- 172.21.15.63:0/1371040049 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd8900c69c0 msgr2=0x7fd8900c6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:22.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.973+0000 7fd88de00640 1 --2- 172.21.15.63:0/1371040049 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd8900c69c0 0x7fd8900c6df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:22.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.973+0000 7fd88de00640 1 -- 172.21.15.63:0/1371040049 >> v2:172.21.15.131:3300/0 conn(0x7fd89006f9b0 msgr2=0x7fd8900c94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:22.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.973+0000 7fd88de00640 1 --2- 172.21.15.63:0/1371040049 >> v2:172.21.15.131:3300/0 conn(0x7fd89006f9b0 0x7fd8900c94f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:22.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.973+0000 7fd88de00640 1 -- 172.21.15.63:0/1371040049 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8900c4fc0 con 0x7fd89006f5d0 2024-05-21T01:20:22.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.973+0000 7fd88de00640 1 --2- 172.21.15.63:0/1371040049 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd89006f5d0 0x7fd8900c47f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd890074b30 tx=0x7fd88001c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9cd6f19553ffc3e server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:22.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.973+0000 7fd88d400640 1 -- 172.21.15.63:0/1371040049 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8800a5840 con 0x7fd89006f5d0 2024-05-21T01:20:22.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.973+0000 7fd88d400640 1 -- 172.21.15.63:0/1371040049 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8800a59e0 con 0x7fd89006f5d0 2024-05-21T01:20:22.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.973+0000 7fd88d400640 1 -- 172.21.15.63:0/1371040049 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8800a5db0 con 0x7fd89006f5d0 2024-05-21T01:20:22.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.977+0000 7fd895200640 1 -- 172.21.15.63:0/1371040049 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd89006f5d0 msgr2=0x7fd8900c47f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:22.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.977+0000 7fd895200640 1 --2- 172.21.15.63:0/1371040049 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd89006f5d0 0x7fd8900c47f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd890074b30 tx=0x7fd88001c9c0 comp rx=0 tx=0).stop 2024-05-21T01:20:22.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.977+0000 7fd895200640 1 -- 172.21.15.63:0/1371040049 shutdown_connections 2024-05-21T01:20:22.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.977+0000 7fd895200640 1 --2- 172.21.15.63:0/1371040049 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd8900c69c0 0x7fd8900c6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:22.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.977+0000 7fd895200640 1 --2- 172.21.15.63:0/1371040049 >> v2:172.21.15.131:3300/0 conn(0x7fd89006f9b0 0x7fd8900c94f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:22.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.977+0000 7fd895200640 1 --2- 172.21.15.63:0/1371040049 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd89006f5d0 0x7fd8900c47f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:22.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.977+0000 7fd895200640 1 -- 172.21.15.63:0/1371040049 >> 172.21.15.63:0/1371040049 conn(0x7fd890068460 msgr2=0x7fd890068870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:22.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.977+0000 7fd895200640 1 -- 172.21.15.63:0/1371040049 shutdown_connections 2024-05-21T01:20:22.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.977+0000 7fd895200640 1 -- 172.21.15.63:0/1371040049 wait complete. 2024-05-21T01:20:22.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.977+0000 7fd895200640 1 Processor -- start 2024-05-21T01:20:22.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.977+0000 7fd895200640 1 -- start start 2024-05-21T01:20:22.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.977+0000 7fd895200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd89006f5d0 0x7fd89014d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:22.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.977+0000 7fd895200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd89006f9b0 0x7fd890157ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:22.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.977+0000 7fd895200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd8900c69c0 0x7fd8900722a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:22.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.977+0000 7fd895200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fd8900c9a30 con 0x7fd89006f5d0 2024-05-21T01:20:22.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.977+0000 7fd895200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd8900caae0 con 0x7fd8900c69c0 2024-05-21T01:20:22.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.977+0000 7fd895200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fd8900c9bb0 con 0x7fd89006f9b0 2024-05-21T01:20:22.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.977+0000 7fd88de00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd89006f5d0 0x7fd89014d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:22.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.977+0000 7fd88de00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd89006f5d0 0x7fd89014d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:49172/0 (socket says 172.21.15.63:49172) 2024-05-21T01:20:22.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.977+0000 7fd88de00640 1 -- 172.21.15.63:0/2981705107 learned_addr learned my addr 172.21.15.63:0/2981705107 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:22.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.977+0000 7fd885400640 1 --2- 172.21.15.63:0/2981705107 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd89006f9b0 0x7fd890157ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:22.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.977+0000 7fd88e800640 1 --2- 172.21.15.63:0/2981705107 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd8900c69c0 0x7fd8900722a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:22.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.977+0000 7fd88de00640 1 -- 172.21.15.63:0/2981705107 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd89006f9b0 msgr2=0x7fd890157ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:22.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.977+0000 7fd88de00640 1 --2- 172.21.15.63:0/2981705107 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd89006f9b0 0x7fd890157ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:22.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.977+0000 7fd88de00640 1 -- 172.21.15.63:0/2981705107 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd8900c69c0 msgr2=0x7fd8900722a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:22.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.977+0000 7fd88de00640 1 --2- 172.21.15.63:0/2981705107 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd8900c69c0 0x7fd8900722a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:22.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.977+0000 7fd88de00640 1 -- 172.21.15.63:0/2981705107 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd890071550 con 0x7fd89006f5d0 2024-05-21T01:20:22.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.977+0000 7fd885400640 1 --2- 172.21.15.63:0/2981705107 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd89006f9b0 0x7fd890157ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T01:20:22.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.981+0000 7fd88de00640 1 --2- 172.21.15.63:0/2981705107 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd89006f5d0 0x7fd89014d890 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd88001b070 tx=0x7fd880019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:22.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.981+0000 7fd886a00640 1 -- 172.21.15.63:0/2981705107 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8800b8670 con 0x7fd89006f5d0 2024-05-21T01:20:22.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.981+0000 7fd886a00640 1 -- 172.21.15.63:0/2981705107 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8800be070 con 0x7fd89006f5d0 2024-05-21T01:20:22.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.981+0000 7fd886a00640 1 -- 172.21.15.63:0/2981705107 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8800b8a90 con 0x7fd89006f5d0 2024-05-21T01:20:22.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.981+0000 7fd895200640 1 -- 172.21.15.63:0/2981705107 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8900c3520 con 0x7fd89006f5d0 2024-05-21T01:20:22.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.981+0000 7fd895200640 1 -- 172.21.15.63:0/2981705107 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd890071aa0 con 0x7fd89006f5d0 2024-05-21T01:20:22.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.981+0000 7fd895200640 1 -- 172.21.15.63:0/2981705107 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8900507f0 con 0x7fd89006f5d0 2024-05-21T01:20:22.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.981+0000 7fd886a00640 1 -- 172.21.15.63:0/2981705107 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7fd8800b8c30 con 0x7fd89006f5d0 2024-05-21T01:20:22.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.981+0000 7fd886a00640 1 --2- 172.21.15.63:0/2981705107 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fd86c06f430 0x7fd86c0718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:22.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.985+0000 7fd886a00640 1 -- 172.21.15.63:0/2981705107 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fd88012a8c0 con 0x7fd89006f5d0 2024-05-21T01:20:22.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.985+0000 7fd885400640 1 --2- 172.21.15.63:0/2981705107 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fd86c06f430 0x7fd86c0718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:22.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.985+0000 7fd885400640 1 --2- 172.21.15.63:0/2981705107 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fd86c06f430 0x7fd86c0718f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd878004660 tx=0x7fd878008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:22.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:22.989+0000 7fd886a00640 1 -- 172.21.15.63:0/2981705107 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fd8800165e0 con 0x7fd89006f5d0 2024-05-21T01:20:23.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.145+0000 7fd895200640 1 -- 172.21.15.63:0/2981705107 --> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd890068bc0 con 0x7fd86c06f430 2024-05-21T01:20:23.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.169+0000 7fd886a00640 1 -- 172.21.15.63:0/2981705107 <== mgr.4103 v2:172.21.15.131:6832/921953667 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332596 (secure 0 0 0) 0x7fd890068bc0 con 0x7fd86c06f430 2024-05-21T01:20:23.178 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-05-21T01:20:23.180 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-05-21T01:20:23.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.173+0000 7fd895200640 1 -- 172.21.15.63:0/2981705107 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fd86c06f430 msgr2=0x7fd86c0718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:23.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.173+0000 7fd895200640 1 --2- 172.21.15.63:0/2981705107 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fd86c06f430 0x7fd86c0718f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd878004660 tx=0x7fd878008040 comp rx=0 tx=0).stop 2024-05-21T01:20:23.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.173+0000 7fd895200640 1 -- 172.21.15.63:0/2981705107 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd89006f5d0 msgr2=0x7fd89014d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:23.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.173+0000 7fd895200640 1 --2- 172.21.15.63:0/2981705107 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd89006f5d0 0x7fd89014d890 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd88001b070 tx=0x7fd880019760 comp rx=0 tx=0).stop 2024-05-21T01:20:23.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.173+0000 7fd895200640 1 -- 172.21.15.63:0/2981705107 shutdown_connections 2024-05-21T01:20:23.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.173+0000 7fd895200640 1 --2- 172.21.15.63:0/2981705107 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fd86c06f430 0x7fd86c0718f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:23.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.173+0000 7fd895200640 1 --2- 172.21.15.63:0/2981705107 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd8900c69c0 0x7fd8900722a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:23.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.173+0000 7fd895200640 1 --2- 172.21.15.63:0/2981705107 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd89006f9b0 0x7fd890157ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:23.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.173+0000 7fd895200640 1 --2- 172.21.15.63:0/2981705107 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd89006f5d0 0x7fd89014d890 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:23.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.173+0000 7fd895200640 1 -- 172.21.15.63:0/2981705107 >> 172.21.15.63:0/2981705107 conn(0x7fd890068460 msgr2=0x7fd89014e3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:23.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.173+0000 7fd895200640 1 -- 172.21.15.63:0/2981705107 shutdown_connections 2024-05-21T01:20:23.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.173+0000 7fd895200640 1 -- 172.21.15.63:0/2981705107 wait complete. 2024-05-21T01:20:23.197 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2024-05-21T01:20:22.441993+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218376,"kb_used_data":2208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756344,"statfs":{"total":773094113280,"available":772870496256,"internally_reserved":0,"allocated":2260992,"data_stored":2012504,"data_compressed":66932,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1781,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005451"},"pg_stats":[{"pgid":"2.1f","version":"24'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.573917+0000","last_change":"2024-05-21T01:19:53.545236+0000","last_active":"2024-05-21T01:19:59.573917+0000","last_peered":"2024-05-21T01:19:59.573917+0000","last_clean":"2024-05-21T01:19:59.573917+0000","last_became_active":"2024-05-21T01:19:53.544469+0000","last_became_peered":"2024-05-21T01:19:53.544469+0000","last_unstale":"2024-05-21T01:19:59.573917+0000","last_undegraded":"2024-05-21T01:19:59.573917+0000","last_fullsized":"2024-05-21T01:19:59.573917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:33:09.421287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.211552+0000","last_change":"2024-05-21T01:19:54.568235+0000","last_active":"2024-05-21T01:20:00.211552+0000","last_peered":"2024-05-21T01:20:00.211552+0000","last_clean":"2024-05-21T01:20:00.211552+0000","last_became_active":"2024-05-21T01:19:54.567245+0000","last_became_peered":"2024-05-21T01:19:54.567245+0000","last_unstale":"2024-05-21T01:20:00.211552+0000","last_undegraded":"2024-05-21T01:20:00.211552+0000","last_fullsized":"2024-05-21T01:20:00.211552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:39:51.222819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207912+0000","last_change":"2024-05-21T01:19:58.618772+0000","last_active":"2024-05-21T01:20:00.207912+0000","last_peered":"2024-05-21T01:20:00.207912+0000","last_clean":"2024-05-21T01:20:00.207912+0000","last_became_active":"2024-05-21T01:19:58.617757+0000","last_became_peered":"2024-05-21T01:19:58.617757+0000","last_unstale":"2024-05-21T01:20:00.207912+0000","last_undegraded":"2024-05-21T01:20:00.207912+0000","last_fullsized":"2024-05-21T01:20:00.207912+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T13:07:31.666521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.211893+0000","last_change":"2024-05-21T01:19:53.551775+0000","last_active":"2024-05-21T01:20:00.211893+0000","last_peered":"2024-05-21T01:20:00.211893+0000","last_clean":"2024-05-21T01:20:00.211893+0000","last_became_active":"2024-05-21T01:19:53.551049+0000","last_became_peered":"2024-05-21T01:19:53.551049+0000","last_unstale":"2024-05-21T01:20:00.211893+0000","last_undegraded":"2024-05-21T01:20:00.211893+0000","last_fullsized":"2024-05-21T01:20:00.211893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:49:02.289202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.211755+0000","last_change":"2024-05-21T01:19:54.573420+0000","last_active":"2024-05-21T01:20:00.211755+0000","last_peered":"2024-05-21T01:20:00.211755+0000","last_clean":"2024-05-21T01:20:00.211755+0000","last_became_active":"2024-05-21T01:19:54.569573+0000","last_became_peered":"2024-05-21T01:19:54.569573+0000","last_unstale":"2024-05-21T01:20:00.211755+0000","last_undegraded":"2024-05-21T01:20:00.211755+0000","last_fullsized":"2024-05-21T01:20:00.211755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:00:12.257816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.206470+0000","last_change":"2024-05-21T01:19:58.604490+0000","last_active":"2024-05-21T01:20:00.206470+0000","last_peered":"2024-05-21T01:20:00.206470+0000","last_clean":"2024-05-21T01:20:00.206470+0000","last_became_active":"2024-05-21T01:19:58.604108+0000","last_became_peered":"2024-05-21T01:19:58.604108+0000","last_unstale":"2024-05-21T01:20:00.206470+0000","last_undegraded":"2024-05-21T01:20:00.206470+0000","last_fullsized":"2024-05-21T01:20:00.206470+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:11:10.963073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207737+0000","last_change":"2024-05-21T01:19:53.525403+0000","last_active":"2024-05-21T01:20:00.207737+0000","last_peered":"2024-05-21T01:20:00.207737+0000","last_clean":"2024-05-21T01:20:00.207737+0000","last_became_active":"2024-05-21T01:19:53.521265+0000","last_became_peered":"2024-05-21T01:19:53.521265+0000","last_unstale":"2024-05-21T01:20:00.207737+0000","last_undegraded":"2024-05-21T01:20:00.207737+0000","last_fullsized":"2024-05-21T01:20:00.207737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:52:16.488269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.209201+0000","last_change":"2024-05-21T01:19:54.536436+0000","last_active":"2024-05-21T01:20:00.209201+0000","last_peered":"2024-05-21T01:20:00.209201+0000","last_clean":"2024-05-21T01:20:00.209201+0000","last_became_active":"2024-05-21T01:19:54.536061+0000","last_became_peered":"2024-05-21T01:19:54.536061+0000","last_unstale":"2024-05-21T01:20:00.209201+0000","last_undegraded":"2024-05-21T01:20:00.209201+0000","last_fullsized":"2024-05-21T01:20:00.209201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:48:23.811712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.206960+0000","last_change":"2024-05-21T01:19:58.623087+0000","last_active":"2024-05-21T01:20:00.206960+0000","last_peered":"2024-05-21T01:20:00.206960+0000","last_clean":"2024-05-21T01:20:00.206960+0000","last_became_active":"2024-05-21T01:19:58.622672+0000","last_became_peered":"2024-05-21T01:19:58.622672+0000","last_unstale":"2024-05-21T01:20:00.206960+0000","last_undegraded":"2024-05-21T01:20:00.206960+0000","last_fullsized":"2024-05-21T01:20:00.206960+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:45:49.241750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207109+0000","last_change":"2024-05-21T01:19:53.522497+0000","last_active":"2024-05-21T01:20:00.207109+0000","last_peered":"2024-05-21T01:20:00.207109+0000","last_clean":"2024-05-21T01:20:00.207109+0000","last_became_active":"2024-05-21T01:19:53.521684+0000","last_became_peered":"2024-05-21T01:19:53.521684+0000","last_unstale":"2024-05-21T01:20:00.207109+0000","last_undegraded":"2024-05-21T01:20:00.207109+0000","last_fullsized":"2024-05-21T01:20:00.207109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:18:17.808255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.567660+0000","last_change":"2024-05-21T01:19:54.549512+0000","last_active":"2024-05-21T01:19:59.567660+0000","last_peered":"2024-05-21T01:19:59.567660+0000","last_clean":"2024-05-21T01:19:59.567660+0000","last_became_active":"2024-05-21T01:19:54.549291+0000","last_became_peered":"2024-05-21T01:19:54.549291+0000","last_unstale":"2024-05-21T01:19:59.567660+0000","last_undegraded":"2024-05-21T01:19:59.567660+0000","last_fullsized":"2024-05-21T01:19:59.567660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:48:34.571236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.206754+0000","last_change":"2024-05-21T01:19:58.614748+0000","last_active":"2024-05-21T01:20:00.206754+0000","last_peered":"2024-05-21T01:20:00.206754+0000","last_clean":"2024-05-21T01:20:00.206754+0000","last_became_active":"2024-05-21T01:19:58.614313+0000","last_became_peered":"2024-05-21T01:19:58.614313+0000","last_unstale":"2024-05-21T01:20:00.206754+0000","last_undegraded":"2024-05-21T01:20:00.206754+0000","last_fullsized":"2024-05-21T01:20:00.206754+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:45:34.204591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.567029+0000","last_change":"2024-05-21T01:19:54.545467+0000","last_active":"2024-05-21T01:19:59.567029+0000","last_peered":"2024-05-21T01:19:59.567029+0000","last_clean":"2024-05-21T01:19:59.567029+0000","last_became_active":"2024-05-21T01:19:54.545181+0000","last_became_peered":"2024-05-21T01:19:54.545181+0000","last_unstale":"2024-05-21T01:19:59.567029+0000","last_undegraded":"2024-05-21T01:19:59.567029+0000","last_fullsized":"2024-05-21T01:19:59.567029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:43:15.387067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.567246+0000","last_change":"2024-05-21T01:19:53.536139+0000","last_active":"2024-05-21T01:19:59.567246+0000","last_peered":"2024-05-21T01:19:59.567246+0000","last_clean":"2024-05-21T01:19:59.567246+0000","last_became_active":"2024-05-21T01:19:53.535899+0000","last_became_peered":"2024-05-21T01:19:53.535899+0000","last_unstale":"2024-05-21T01:19:59.567246+0000","last_undegraded":"2024-05-21T01:19:59.567246+0000","last_fullsized":"2024-05-21T01:19:59.567246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:40:12.033744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.567390+0000","last_change":"2024-05-21T01:19:58.621487+0000","last_active":"2024-05-21T01:19:59.567390+0000","last_peered":"2024-05-21T01:19:59.567390+0000","last_clean":"2024-05-21T01:19:59.567390+0000","last_became_active":"2024-05-21T01:19:58.621083+0000","last_became_peered":"2024-05-21T01:19:58.621083+0000","last_unstale":"2024-05-21T01:19:59.567390+0000","last_undegraded":"2024-05-21T01:19:59.567390+0000","last_fullsized":"2024-05-21T01:19:59.567390+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:18:44.587274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.208662+0000","last_change":"2024-05-21T01:19:54.572420+0000","last_active":"2024-05-21T01:20:00.208662+0000","last_peered":"2024-05-21T01:20:00.208662+0000","last_clean":"2024-05-21T01:20:00.208662+0000","last_became_active":"2024-05-21T01:19:54.571863+0000","last_became_peered":"2024-05-21T01:19:54.571863+0000","last_unstale":"2024-05-21T01:20:00.208662+0000","last_undegraded":"2024-05-21T01:20:00.208662+0000","last_fullsized":"2024-05-21T01:20:00.208662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:13:52.491903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.575374+0000","last_change":"2024-05-21T01:19:53.553351+0000","last_active":"2024-05-21T01:19:59.575374+0000","last_peered":"2024-05-21T01:19:59.575374+0000","last_clean":"2024-05-21T01:19:59.575374+0000","last_became_active":"2024-05-21T01:19:53.552694+0000","last_became_peered":"2024-05-21T01:19:53.552694+0000","last_unstale":"2024-05-21T01:19:59.575374+0000","last_undegraded":"2024-05-21T01:19:59.575374+0000","last_fullsized":"2024-05-21T01:19:59.575374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:46:55.273278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.206544+0000","last_change":"2024-05-21T01:19:58.594904+0000","last_active":"2024-05-21T01:20:00.206544+0000","last_peered":"2024-05-21T01:20:00.206544+0000","last_clean":"2024-05-21T01:20:00.206544+0000","last_became_active":"2024-05-21T01:19:58.594450+0000","last_became_peered":"2024-05-21T01:19:58.594450+0000","last_unstale":"2024-05-21T01:20:00.206544+0000","last_undegraded":"2024-05-21T01:20:00.206544+0000","last_fullsized":"2024-05-21T01:20:00.206544+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:37:30.286986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.571649+0000","last_change":"2024-05-21T01:19:54.554750+0000","last_active":"2024-05-21T01:19:59.571649+0000","last_peered":"2024-05-21T01:19:59.571649+0000","last_clean":"2024-05-21T01:19:59.571649+0000","last_became_active":"2024-05-21T01:19:54.551583+0000","last_became_peered":"2024-05-21T01:19:54.551583+0000","last_unstale":"2024-05-21T01:19:59.571649+0000","last_undegraded":"2024-05-21T01:19:59.571649+0000","last_fullsized":"2024-05-21T01:19:59.571649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:37:19.564099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.572553+0000","last_change":"2024-05-21T01:19:53.523277+0000","last_active":"2024-05-21T01:19:59.572553+0000","last_peered":"2024-05-21T01:19:59.572553+0000","last_clean":"2024-05-21T01:19:59.572553+0000","last_became_active":"2024-05-21T01:19:53.522525+0000","last_became_peered":"2024-05-21T01:19:53.522525+0000","last_unstale":"2024-05-21T01:19:59.572553+0000","last_undegraded":"2024-05-21T01:19:59.572553+0000","last_fullsized":"2024-05-21T01:19:59.572553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:23:59.949781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.209007+0000","last_change":"2024-05-21T01:19:58.615575+0000","last_active":"2024-05-21T01:20:00.209007+0000","last_peered":"2024-05-21T01:20:00.209007+0000","last_clean":"2024-05-21T01:20:00.209007+0000","last_became_active":"2024-05-21T01:19:58.614401+0000","last_became_peered":"2024-05-21T01:19:58.614401+0000","last_unstale":"2024-05-21T01:20:00.209007+0000","last_undegraded":"2024-05-21T01:20:00.209007+0000","last_fullsized":"2024-05-21T01:20:00.209007+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:51:09.839503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.566770+0000","last_change":"2024-05-21T01:19:54.555489+0000","last_active":"2024-05-21T01:19:59.566770+0000","last_peered":"2024-05-21T01:19:59.566770+0000","last_clean":"2024-05-21T01:19:59.566770+0000","last_became_active":"2024-05-21T01:19:54.555227+0000","last_became_peered":"2024-05-21T01:19:54.555227+0000","last_unstale":"2024-05-21T01:19:59.566770+0000","last_undegraded":"2024-05-21T01:19:59.566770+0000","last_fullsized":"2024-05-21T01:19:59.566770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:00:22.873520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.205893+0000","last_change":"2024-05-21T01:19:53.520840+0000","last_active":"2024-05-21T01:20:00.205893+0000","last_peered":"2024-05-21T01:20:00.205893+0000","last_clean":"2024-05-21T01:20:00.205893+0000","last_became_active":"2024-05-21T01:19:53.520540+0000","last_became_peered":"2024-05-21T01:19:53.520540+0000","last_unstale":"2024-05-21T01:20:00.205893+0000","last_undegraded":"2024-05-21T01:20:00.205893+0000","last_fullsized":"2024-05-21T01:20:00.205893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:08:36.426465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207823+0000","last_change":"2024-05-21T01:19:58.604357+0000","last_active":"2024-05-21T01:20:00.207823+0000","last_peered":"2024-05-21T01:20:00.207823+0000","last_clean":"2024-05-21T01:20:00.207823+0000","last_became_active":"2024-05-21T01:19:58.603922+0000","last_became_peered":"2024-05-21T01:19:58.603922+0000","last_unstale":"2024-05-21T01:20:00.207823+0000","last_undegraded":"2024-05-21T01:20:00.207823+0000","last_fullsized":"2024-05-21T01:20:00.207823+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:55:18.226031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.572430+0000","last_change":"2024-05-21T01:19:54.569315+0000","last_active":"2024-05-21T01:19:59.572430+0000","last_peered":"2024-05-21T01:19:59.572430+0000","last_clean":"2024-05-21T01:19:59.572430+0000","last_became_active":"2024-05-21T01:19:54.568232+0000","last_became_peered":"2024-05-21T01:19:54.568232+0000","last_unstale":"2024-05-21T01:19:59.572430+0000","last_undegraded":"2024-05-21T01:19:59.572430+0000","last_fullsized":"2024-05-21T01:19:59.572430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:19:01.819418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.568118+0000","last_change":"2024-05-21T01:19:53.525301+0000","last_active":"2024-05-21T01:19:59.568118+0000","last_peered":"2024-05-21T01:19:59.568118+0000","last_clean":"2024-05-21T01:19:59.568118+0000","last_became_active":"2024-05-21T01:19:53.525010+0000","last_became_peered":"2024-05-21T01:19:53.525010+0000","last_unstale":"2024-05-21T01:19:59.568118+0000","last_undegraded":"2024-05-21T01:19:59.568118+0000","last_fullsized":"2024-05-21T01:19:59.568118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:53:11.316975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.206622+0000","last_change":"2024-05-21T01:19:58.590354+0000","last_active":"2024-05-21T01:20:00.206622+0000","last_peered":"2024-05-21T01:20:00.206622+0000","last_clean":"2024-05-21T01:20:00.206622+0000","last_became_active":"2024-05-21T01:19:58.589985+0000","last_became_peered":"2024-05-21T01:19:58.589985+0000","last_unstale":"2024-05-21T01:20:00.206622+0000","last_undegraded":"2024-05-21T01:20:00.206622+0000","last_fullsized":"2024-05-21T01:20:00.206622+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:08:09.222858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.573671+0000","last_change":"2024-05-21T01:19:54.555318+0000","last_active":"2024-05-21T01:19:59.573671+0000","last_peered":"2024-05-21T01:19:59.573671+0000","last_clean":"2024-05-21T01:19:59.573671+0000","last_became_active":"2024-05-21T01:19:54.552947+0000","last_became_peered":"2024-05-21T01:19:54.552947+0000","last_unstale":"2024-05-21T01:19:59.573671+0000","last_undegraded":"2024-05-21T01:19:59.573671+0000","last_fullsized":"2024-05-21T01:19:59.573671+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:29:24.153986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.572949+0000","last_change":"2024-05-21T01:19:53.525004+0000","last_active":"2024-05-21T01:19:59.572949+0000","last_peered":"2024-05-21T01:19:59.572949+0000","last_clean":"2024-05-21T01:19:59.572949+0000","last_became_active":"2024-05-21T01:19:53.521014+0000","last_became_peered":"2024-05-21T01:19:53.521014+0000","last_unstale":"2024-05-21T01:19:59.572949+0000","last_undegraded":"2024-05-21T01:19:59.572949+0000","last_fullsized":"2024-05-21T01:19:59.572949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:02:46.668320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.571502+0000","last_change":"2024-05-21T01:19:58.599880+0000","last_active":"2024-05-21T01:19:59.571502+0000","last_peered":"2024-05-21T01:19:59.571502+0000","last_clean":"2024-05-21T01:19:59.571502+0000","last_became_active":"2024-05-21T01:19:58.598712+0000","last_became_peered":"2024-05-21T01:19:58.598712+0000","last_unstale":"2024-05-21T01:19:59.571502+0000","last_undegraded":"2024-05-21T01:19:59.571502+0000","last_fullsized":"2024-05-21T01:19:59.571502+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:43:05.995986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.577134+0000","last_change":"2024-05-21T01:19:54.576044+0000","last_active":"2024-05-21T01:19:59.577134+0000","last_peered":"2024-05-21T01:19:59.577134+0000","last_clean":"2024-05-21T01:19:59.577134+0000","last_became_active":"2024-05-21T01:19:54.575543+0000","last_became_peered":"2024-05-21T01:19:54.575543+0000","last_unstale":"2024-05-21T01:19:59.577134+0000","last_undegraded":"2024-05-21T01:19:59.577134+0000","last_fullsized":"2024-05-21T01:19:59.577134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T09:33:07.188470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.568161+0000","last_change":"2024-05-21T01:19:53.543705+0000","last_active":"2024-05-21T01:19:59.568161+0000","last_peered":"2024-05-21T01:19:59.568161+0000","last_clean":"2024-05-21T01:19:59.568161+0000","last_became_active":"2024-05-21T01:19:53.543450+0000","last_became_peered":"2024-05-21T01:19:53.543450+0000","last_unstale":"2024-05-21T01:19:59.568161+0000","last_undegraded":"2024-05-21T01:19:59.568161+0000","last_fullsized":"2024-05-21T01:19:59.568161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:05:49.465156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.575415+0000","last_change":"2024-05-21T01:19:58.612049+0000","last_active":"2024-05-21T01:19:59.575415+0000","last_peered":"2024-05-21T01:19:59.575415+0000","last_clean":"2024-05-21T01:19:59.575415+0000","last_became_active":"2024-05-21T01:19:58.610837+0000","last_became_peered":"2024-05-21T01:19:58.610837+0000","last_unstale":"2024-05-21T01:19:59.575415+0000","last_undegraded":"2024-05-21T01:19:59.575415+0000","last_fullsized":"2024-05-21T01:19:59.575415+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:24:14.332056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207496+0000","last_change":"2024-05-21T01:19:54.553083+0000","last_active":"2024-05-21T01:20:00.207496+0000","last_peered":"2024-05-21T01:20:00.207496+0000","last_clean":"2024-05-21T01:20:00.207496+0000","last_became_active":"2024-05-21T01:19:54.552812+0000","last_became_peered":"2024-05-21T01:19:54.552812+0000","last_unstale":"2024-05-21T01:20:00.207496+0000","last_undegraded":"2024-05-21T01:20:00.207496+0000","last_fullsized":"2024-05-21T01:20:00.207496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:37:25.835345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.210838+0000","last_change":"2024-05-21T01:19:53.551697+0000","last_active":"2024-05-21T01:20:00.210838+0000","last_peered":"2024-05-21T01:20:00.210838+0000","last_clean":"2024-05-21T01:20:00.210838+0000","last_became_active":"2024-05-21T01:19:53.550921+0000","last_became_peered":"2024-05-21T01:19:53.550921+0000","last_unstale":"2024-05-21T01:20:00.210838+0000","last_undegraded":"2024-05-21T01:20:00.210838+0000","last_fullsized":"2024-05-21T01:20:00.210838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T09:31:31.996638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.571559+0000","last_change":"2024-05-21T01:19:58.626472+0000","last_active":"2024-05-21T01:19:59.571559+0000","last_peered":"2024-05-21T01:19:59.571559+0000","last_clean":"2024-05-21T01:19:59.571559+0000","last_became_active":"2024-05-21T01:19:58.625720+0000","last_became_peered":"2024-05-21T01:19:58.625720+0000","last_unstale":"2024-05-21T01:19:59.571559+0000","last_undegraded":"2024-05-21T01:19:59.571559+0000","last_fullsized":"2024-05-21T01:19:59.571559+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:16:03.911585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207190+0000","last_change":"2024-05-21T01:19:54.547947+0000","last_active":"2024-05-21T01:20:00.207190+0000","last_peered":"2024-05-21T01:20:00.207190+0000","last_clean":"2024-05-21T01:20:00.207190+0000","last_became_active":"2024-05-21T01:19:54.547689+0000","last_became_peered":"2024-05-21T01:19:54.547689+0000","last_unstale":"2024-05-21T01:20:00.207190+0000","last_undegraded":"2024-05-21T01:20:00.207190+0000","last_fullsized":"2024-05-21T01:20:00.207190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:40:55.985899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.567365+0000","last_change":"2024-05-21T01:19:53.540973+0000","last_active":"2024-05-21T01:19:59.567365+0000","last_peered":"2024-05-21T01:19:59.567365+0000","last_clean":"2024-05-21T01:19:59.567365+0000","last_became_active":"2024-05-21T01:19:53.540670+0000","last_became_peered":"2024-05-21T01:19:53.540670+0000","last_unstale":"2024-05-21T01:19:59.567365+0000","last_undegraded":"2024-05-21T01:19:59.567365+0000","last_fullsized":"2024-05-21T01:19:59.567365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:08:21.802284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.576864+0000","last_change":"2024-05-21T01:19:58.611280+0000","last_active":"2024-05-21T01:19:59.576864+0000","last_peered":"2024-05-21T01:19:59.576864+0000","last_clean":"2024-05-21T01:19:59.576864+0000","last_became_active":"2024-05-21T01:19:58.610511+0000","last_became_peered":"2024-05-21T01:19:58.610511+0000","last_unstale":"2024-05-21T01:19:59.576864+0000","last_undegraded":"2024-05-21T01:19:59.576864+0000","last_fullsized":"2024-05-21T01:19:59.576864+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:49:19.660422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.209521+0000","last_change":"2024-05-21T01:19:54.572546+0000","last_active":"2024-05-21T01:20:00.209521+0000","last_peered":"2024-05-21T01:20:00.209521+0000","last_clean":"2024-05-21T01:20:00.209521+0000","last_became_active":"2024-05-21T01:19:54.572022+0000","last_became_peered":"2024-05-21T01:19:54.572022+0000","last_unstale":"2024-05-21T01:20:00.209521+0000","last_undegraded":"2024-05-21T01:20:00.209521+0000","last_fullsized":"2024-05-21T01:20:00.209521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:50:08.351383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.208164+0000","last_change":"2024-05-21T01:19:53.556786+0000","last_active":"2024-05-21T01:20:00.208164+0000","last_peered":"2024-05-21T01:20:00.208164+0000","last_clean":"2024-05-21T01:20:00.208164+0000","last_became_active":"2024-05-21T01:19:53.556143+0000","last_became_peered":"2024-05-21T01:19:53.556143+0000","last_unstale":"2024-05-21T01:20:00.208164+0000","last_undegraded":"2024-05-21T01:20:00.208164+0000","last_fullsized":"2024-05-21T01:20:00.208164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:02:17.391701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.577698+0000","last_change":"2024-05-21T01:19:58.599203+0000","last_active":"2024-05-21T01:19:59.577698+0000","last_peered":"2024-05-21T01:19:59.577698+0000","last_clean":"2024-05-21T01:19:59.577698+0000","last_became_active":"2024-05-21T01:19:58.598175+0000","last_became_peered":"2024-05-21T01:19:58.598175+0000","last_unstale":"2024-05-21T01:19:59.577698+0000","last_undegraded":"2024-05-21T01:19:59.577698+0000","last_fullsized":"2024-05-21T01:19:59.577698+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:45:17.138090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.574222+0000","last_change":"2024-05-21T01:19:54.551092+0000","last_active":"2024-05-21T01:19:59.574222+0000","last_peered":"2024-05-21T01:19:59.574222+0000","last_clean":"2024-05-21T01:19:59.574222+0000","last_became_active":"2024-05-21T01:19:54.550338+0000","last_became_peered":"2024-05-21T01:19:54.550338+0000","last_unstale":"2024-05-21T01:19:59.574222+0000","last_undegraded":"2024-05-21T01:19:59.574222+0000","last_fullsized":"2024-05-21T01:19:59.574222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:29:13.540719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.566856+0000","last_change":"2024-05-21T01:19:53.554835+0000","last_active":"2024-05-21T01:19:59.566856+0000","last_peered":"2024-05-21T01:19:59.566856+0000","last_clean":"2024-05-21T01:19:59.566856+0000","last_became_active":"2024-05-21T01:19:53.554598+0000","last_became_peered":"2024-05-21T01:19:53.554598+0000","last_unstale":"2024-05-21T01:19:59.566856+0000","last_undegraded":"2024-05-21T01:19:59.566856+0000","last_fullsized":"2024-05-21T01:19:59.566856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:28:43.940978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.211238+0000","last_change":"2024-05-21T01:19:58.629747+0000","last_active":"2024-05-21T01:20:00.211238+0000","last_peered":"2024-05-21T01:20:00.211238+0000","last_clean":"2024-05-21T01:20:00.211238+0000","last_became_active":"2024-05-21T01:19:58.622106+0000","last_became_peered":"2024-05-21T01:19:58.622106+0000","last_unstale":"2024-05-21T01:20:00.211238+0000","last_undegraded":"2024-05-21T01:20:00.211238+0000","last_fullsized":"2024-05-21T01:20:00.211238+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:22:07.047914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.571255+0000","last_change":"2024-05-21T01:19:54.554303+0000","last_active":"2024-05-21T01:19:59.571255+0000","last_peered":"2024-05-21T01:19:59.571255+0000","last_clean":"2024-05-21T01:19:59.571255+0000","last_became_active":"2024-05-21T01:19:54.552126+0000","last_became_peered":"2024-05-21T01:19:54.552126+0000","last_unstale":"2024-05-21T01:19:59.571255+0000","last_undegraded":"2024-05-21T01:19:59.571255+0000","last_fullsized":"2024-05-21T01:19:59.571255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:59:46.383359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.567302+0000","last_change":"2024-05-21T01:19:53.536580+0000","last_active":"2024-05-21T01:19:59.567302+0000","last_peered":"2024-05-21T01:19:59.567302+0000","last_clean":"2024-05-21T01:19:59.567302+0000","last_became_active":"2024-05-21T01:19:53.535105+0000","last_became_peered":"2024-05-21T01:19:53.535105+0000","last_unstale":"2024-05-21T01:19:59.567302+0000","last_undegraded":"2024-05-21T01:19:59.567302+0000","last_fullsized":"2024-05-21T01:19:59.567302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:58:05.019025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":118,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207611+0000","last_change":"2024-05-21T01:19:49.490062+0000","last_active":"2024-05-21T01:20:00.207611+0000","last_peered":"2024-05-21T01:20:00.207611+0000","last_clean":"2024-05-21T01:20:00.207611+0000","last_became_active":"2024-05-21T01:19:49.488796+0000","last_became_peered":"2024-05-21T01:19:49.488796+0000","last_unstale":"2024-05-21T01:20:00.207611+0000","last_undegraded":"2024-05-21T01:20:00.207611+0000","last_fullsized":"2024-05-21T01:20:00.207611+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:47.457865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:47.457865+0000","last_clean_scrub_stamp":"2024-05-21T01:19:47.457865+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T09:37:06.199150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.568012+0000","last_change":"2024-05-21T01:19:58.590851+0000","last_active":"2024-05-21T01:19:59.568012+0000","last_peered":"2024-05-21T01:19:59.568012+0000","last_clean":"2024-05-21T01:19:59.568012+0000","last_became_active":"2024-05-21T01:19:58.589288+0000","last_became_peered":"2024-05-21T01:19:58.589288+0000","last_unstale":"2024-05-21T01:19:59.568012+0000","last_undegraded":"2024-05-21T01:19:59.568012+0000","last_fullsized":"2024-05-21T01:19:59.568012+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:36:46.992834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.567741+0000","last_change":"2024-05-21T01:19:54.543894+0000","last_active":"2024-05-21T01:19:59.567741+0000","last_peered":"2024-05-21T01:19:59.567741+0000","last_clean":"2024-05-21T01:19:59.567741+0000","last_became_active":"2024-05-21T01:19:54.543586+0000","last_became_peered":"2024-05-21T01:19:54.543586+0000","last_unstale":"2024-05-21T01:19:59.567741+0000","last_undegraded":"2024-05-21T01:19:59.567741+0000","last_fullsized":"2024-05-21T01:19:59.567741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:33:02.756634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.577243+0000","last_change":"2024-05-21T01:19:53.532115+0000","last_active":"2024-05-21T01:19:59.577243+0000","last_peered":"2024-05-21T01:19:59.577243+0000","last_clean":"2024-05-21T01:19:59.577243+0000","last_became_active":"2024-05-21T01:19:53.529879+0000","last_became_peered":"2024-05-21T01:19:53.529879+0000","last_unstale":"2024-05-21T01:19:59.577243+0000","last_undegraded":"2024-05-21T01:19:59.577243+0000","last_fullsized":"2024-05-21T01:19:59.577243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:42:07.436243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.206924+0000","last_change":"2024-05-21T01:19:58.604417+0000","last_active":"2024-05-21T01:20:00.206924+0000","last_peered":"2024-05-21T01:20:00.206924+0000","last_clean":"2024-05-21T01:20:00.206924+0000","last_became_active":"2024-05-21T01:19:58.603929+0000","last_became_peered":"2024-05-21T01:19:58.603929+0000","last_unstale":"2024-05-21T01:20:00.206924+0000","last_undegraded":"2024-05-21T01:20:00.206924+0000","last_fullsized":"2024-05-21T01:20:00.206924+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:15:59.031738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207029+0000","last_change":"2024-05-21T01:19:54.542096+0000","last_active":"2024-05-21T01:20:00.207029+0000","last_peered":"2024-05-21T01:20:00.207029+0000","last_clean":"2024-05-21T01:20:00.207029+0000","last_became_active":"2024-05-21T01:19:54.541837+0000","last_became_peered":"2024-05-21T01:19:54.541837+0000","last_unstale":"2024-05-21T01:20:00.207029+0000","last_undegraded":"2024-05-21T01:20:00.207029+0000","last_fullsized":"2024-05-21T01:20:00.207029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:55:30.807311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.211049+0000","last_change":"2024-05-21T01:19:53.551697+0000","last_active":"2024-05-21T01:20:00.211049+0000","last_peered":"2024-05-21T01:20:00.211049+0000","last_clean":"2024-05-21T01:20:00.211049+0000","last_became_active":"2024-05-21T01:19:53.550893+0000","last_became_peered":"2024-05-21T01:19:53.550893+0000","last_unstale":"2024-05-21T01:20:00.211049+0000","last_undegraded":"2024-05-21T01:20:00.211049+0000","last_fullsized":"2024-05-21T01:20:00.211049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:42:20.295229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.210457+0000","last_change":"2024-05-21T01:19:58.628526+0000","last_active":"2024-05-21T01:20:00.210457+0000","last_peered":"2024-05-21T01:20:00.210457+0000","last_clean":"2024-05-21T01:20:00.210457+0000","last_became_active":"2024-05-21T01:19:58.620667+0000","last_became_peered":"2024-05-21T01:19:58.620667+0000","last_unstale":"2024-05-21T01:20:00.210457+0000","last_undegraded":"2024-05-21T01:20:00.210457+0000","last_fullsized":"2024-05-21T01:20:00.210457+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:46:22.396063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.208496+0000","last_change":"2024-05-21T01:19:54.532551+0000","last_active":"2024-05-21T01:20:00.208496+0000","last_peered":"2024-05-21T01:20:00.208496+0000","last_clean":"2024-05-21T01:20:00.208496+0000","last_became_active":"2024-05-21T01:19:54.532251+0000","last_became_peered":"2024-05-21T01:19:54.532251+0000","last_unstale":"2024-05-21T01:20:00.208496+0000","last_undegraded":"2024-05-21T01:20:00.208496+0000","last_fullsized":"2024-05-21T01:20:00.208496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:00:30.042781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.572555+0000","last_change":"2024-05-21T01:19:53.554659+0000","last_active":"2024-05-21T01:19:59.572555+0000","last_peered":"2024-05-21T01:19:59.572555+0000","last_clean":"2024-05-21T01:19:59.572555+0000","last_became_active":"2024-05-21T01:19:53.553953+0000","last_became_peered":"2024-05-21T01:19:53.553953+0000","last_unstale":"2024-05-21T01:19:59.572555+0000","last_undegraded":"2024-05-21T01:19:59.572555+0000","last_fullsized":"2024-05-21T01:19:59.572555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:31:13.091061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.566596+0000","last_change":"2024-05-21T01:19:58.593243+0000","last_active":"2024-05-21T01:19:59.566596+0000","last_peered":"2024-05-21T01:19:59.566596+0000","last_clean":"2024-05-21T01:19:59.566596+0000","last_became_active":"2024-05-21T01:19:58.592758+0000","last_became_peered":"2024-05-21T01:19:58.592758+0000","last_unstale":"2024-05-21T01:19:59.566596+0000","last_undegraded":"2024-05-21T01:19:59.566596+0000","last_fullsized":"2024-05-21T01:19:59.566596+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:46:17.877736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207962+0000","last_change":"2024-05-21T01:19:54.538391+0000","last_active":"2024-05-21T01:20:00.207962+0000","last_peered":"2024-05-21T01:20:00.207962+0000","last_clean":"2024-05-21T01:20:00.207962+0000","last_became_active":"2024-05-21T01:19:54.538106+0000","last_became_peered":"2024-05-21T01:19:54.538106+0000","last_unstale":"2024-05-21T01:20:00.207962+0000","last_undegraded":"2024-05-21T01:20:00.207962+0000","last_fullsized":"2024-05-21T01:20:00.207962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:36:07.297496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.208540+0000","last_change":"2024-05-21T01:19:53.551917+0000","last_active":"2024-05-21T01:20:00.208540+0000","last_peered":"2024-05-21T01:20:00.208540+0000","last_clean":"2024-05-21T01:20:00.208540+0000","last_became_active":"2024-05-21T01:19:53.551608+0000","last_became_peered":"2024-05-21T01:19:53.551608+0000","last_unstale":"2024-05-21T01:20:00.208540+0000","last_undegraded":"2024-05-21T01:20:00.208540+0000","last_fullsized":"2024-05-21T01:20:00.208540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:20:54.093966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.208119+0000","last_change":"2024-05-21T01:19:58.613367+0000","last_active":"2024-05-21T01:20:00.208119+0000","last_peered":"2024-05-21T01:20:00.208119+0000","last_clean":"2024-05-21T01:20:00.208119+0000","last_became_active":"2024-05-21T01:19:58.612950+0000","last_became_peered":"2024-05-21T01:19:58.612950+0000","last_unstale":"2024-05-21T01:20:00.208119+0000","last_undegraded":"2024-05-21T01:20:00.208119+0000","last_fullsized":"2024-05-21T01:20:00.208119+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:32:12.365734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.566761+0000","last_change":"2024-05-21T01:19:54.548979+0000","last_active":"2024-05-21T01:19:59.566761+0000","last_peered":"2024-05-21T01:19:59.566761+0000","last_clean":"2024-05-21T01:19:59.566761+0000","last_became_active":"2024-05-21T01:19:54.548704+0000","last_became_peered":"2024-05-21T01:19:54.548704+0000","last_unstale":"2024-05-21T01:19:59.566761+0000","last_undegraded":"2024-05-21T01:19:59.566761+0000","last_fullsized":"2024-05-21T01:19:59.566761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:57:09.076705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"24'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.571911+0000","last_change":"2024-05-21T01:19:53.542425+0000","last_active":"2024-05-21T01:19:59.571911+0000","last_peered":"2024-05-21T01:19:59.571911+0000","last_clean":"2024-05-21T01:19:59.571911+0000","last_became_active":"2024-05-21T01:19:53.541577+0000","last_became_peered":"2024-05-21T01:19:53.541577+0000","last_unstale":"2024-05-21T01:19:59.571911+0000","last_undegraded":"2024-05-21T01:19:59.571911+0000","last_fullsized":"2024-05-21T01:19:59.571911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:47:54.892789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.211663+0000","last_change":"2024-05-21T01:19:58.630293+0000","last_active":"2024-05-21T01:20:00.211663+0000","last_peered":"2024-05-21T01:20:00.211663+0000","last_clean":"2024-05-21T01:20:00.211663+0000","last_became_active":"2024-05-21T01:19:58.629119+0000","last_became_peered":"2024-05-21T01:19:58.629119+0000","last_unstale":"2024-05-21T01:20:00.211663+0000","last_undegraded":"2024-05-21T01:20:00.211663+0000","last_fullsized":"2024-05-21T01:20:00.211663+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:10:45.318517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207523+0000","last_change":"2024-05-21T01:19:54.575541+0000","last_active":"2024-05-21T01:20:00.207523+0000","last_peered":"2024-05-21T01:20:00.207523+0000","last_clean":"2024-05-21T01:20:00.207523+0000","last_became_active":"2024-05-21T01:19:54.575314+0000","last_became_peered":"2024-05-21T01:19:54.575314+0000","last_unstale":"2024-05-21T01:20:00.207523+0000","last_undegraded":"2024-05-21T01:20:00.207523+0000","last_fullsized":"2024-05-21T01:20:00.207523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:02:36.840590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.206224+0000","last_change":"2024-05-21T01:19:53.523758+0000","last_active":"2024-05-21T01:20:00.206224+0000","last_peered":"2024-05-21T01:20:00.206224+0000","last_clean":"2024-05-21T01:20:00.206224+0000","last_became_active":"2024-05-21T01:19:53.523273+0000","last_became_peered":"2024-05-21T01:19:53.523273+0000","last_unstale":"2024-05-21T01:20:00.206224+0000","last_undegraded":"2024-05-21T01:20:00.206224+0000","last_fullsized":"2024-05-21T01:20:00.206224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:05:47.275193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.211601+0000","last_change":"2024-05-21T01:19:58.621996+0000","last_active":"2024-05-21T01:20:00.211601+0000","last_peered":"2024-05-21T01:20:00.211601+0000","last_clean":"2024-05-21T01:20:00.211601+0000","last_became_active":"2024-05-21T01:19:58.620552+0000","last_became_peered":"2024-05-21T01:19:58.620552+0000","last_unstale":"2024-05-21T01:20:00.211601+0000","last_undegraded":"2024-05-21T01:20:00.211601+0000","last_fullsized":"2024-05-21T01:20:00.211601+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:58:32.635003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.567139+0000","last_change":"2024-05-21T01:19:54.557379+0000","last_active":"2024-05-21T01:19:59.567139+0000","last_peered":"2024-05-21T01:19:59.567139+0000","last_clean":"2024-05-21T01:19:59.567139+0000","last_became_active":"2024-05-21T01:19:54.550335+0000","last_became_peered":"2024-05-21T01:19:54.550335+0000","last_unstale":"2024-05-21T01:19:59.567139+0000","last_undegraded":"2024-05-21T01:19:59.567139+0000","last_fullsized":"2024-05-21T01:19:59.567139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:24:52.297888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.567280+0000","last_change":"2024-05-21T01:19:53.534431+0000","last_active":"2024-05-21T01:19:59.567280+0000","last_peered":"2024-05-21T01:19:59.567280+0000","last_clean":"2024-05-21T01:19:59.567280+0000","last_became_active":"2024-05-21T01:19:53.534174+0000","last_became_peered":"2024-05-21T01:19:53.534174+0000","last_unstale":"2024-05-21T01:19:59.567280+0000","last_undegraded":"2024-05-21T01:19:59.567280+0000","last_fullsized":"2024-05-21T01:19:59.567280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:42:04.743914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.576325+0000","last_change":"2024-05-21T01:19:58.609289+0000","last_active":"2024-05-21T01:19:59.576325+0000","last_peered":"2024-05-21T01:19:59.576325+0000","last_clean":"2024-05-21T01:19:59.576325+0000","last_became_active":"2024-05-21T01:19:58.608371+0000","last_became_peered":"2024-05-21T01:19:58.608371+0000","last_unstale":"2024-05-21T01:19:59.576325+0000","last_undegraded":"2024-05-21T01:19:59.576325+0000","last_fullsized":"2024-05-21T01:19:59.576325+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:27:36.997803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.575122+0000","last_change":"2024-05-21T01:19:54.551617+0000","last_active":"2024-05-21T01:19:59.575122+0000","last_peered":"2024-05-21T01:19:59.575122+0000","last_clean":"2024-05-21T01:19:59.575122+0000","last_became_active":"2024-05-21T01:19:54.550865+0000","last_became_peered":"2024-05-21T01:19:54.550865+0000","last_unstale":"2024-05-21T01:19:59.575122+0000","last_undegraded":"2024-05-21T01:19:59.575122+0000","last_fullsized":"2024-05-21T01:19:59.575122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:32:44.168265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.208932+0000","last_change":"2024-05-21T01:19:53.535936+0000","last_active":"2024-05-21T01:20:00.208932+0000","last_peered":"2024-05-21T01:20:00.208932+0000","last_clean":"2024-05-21T01:20:00.208932+0000","last_became_active":"2024-05-21T01:19:53.535143+0000","last_became_peered":"2024-05-21T01:19:53.535143+0000","last_unstale":"2024-05-21T01:20:00.208932+0000","last_undegraded":"2024-05-21T01:20:00.208932+0000","last_fullsized":"2024-05-21T01:20:00.208932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:50:51.433726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.567570+0000","last_change":"2024-05-21T01:19:58.622615+0000","last_active":"2024-05-21T01:19:59.567570+0000","last_peered":"2024-05-21T01:19:59.567570+0000","last_clean":"2024-05-21T01:19:59.567570+0000","last_became_active":"2024-05-21T01:19:58.622250+0000","last_became_peered":"2024-05-21T01:19:58.622250+0000","last_unstale":"2024-05-21T01:19:59.567570+0000","last_undegraded":"2024-05-21T01:19:59.567570+0000","last_fullsized":"2024-05-21T01:19:59.567570+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:05:22.913945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207577+0000","last_change":"2024-05-21T01:19:54.558348+0000","last_active":"2024-05-21T01:20:00.207577+0000","last_peered":"2024-05-21T01:20:00.207577+0000","last_clean":"2024-05-21T01:20:00.207577+0000","last_became_active":"2024-05-21T01:19:54.558095+0000","last_became_peered":"2024-05-21T01:19:54.558095+0000","last_unstale":"2024-05-21T01:20:00.207577+0000","last_undegraded":"2024-05-21T01:20:00.207577+0000","last_fullsized":"2024-05-21T01:20:00.207577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:43:48.625583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:09.561570+0000","last_change":"2024-05-21T01:19:53.534947+0000","last_active":"2024-05-21T01:20:09.561570+0000","last_peered":"2024-05-21T01:20:09.561570+0000","last_clean":"2024-05-21T01:20:09.561570+0000","last_became_active":"2024-05-21T01:19:53.534616+0000","last_became_peered":"2024-05-21T01:19:53.534616+0000","last_unstale":"2024-05-21T01:20:09.561570+0000","last_undegraded":"2024-05-21T01:20:09.561570+0000","last_fullsized":"2024-05-21T01:20:09.561570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:01:25.372035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.571116+0000","last_change":"2024-05-21T01:19:58.617970+0000","last_active":"2024-05-21T01:19:59.571116+0000","last_peered":"2024-05-21T01:19:59.571116+0000","last_clean":"2024-05-21T01:19:59.571116+0000","last_became_active":"2024-05-21T01:19:58.617061+0000","last_became_peered":"2024-05-21T01:19:58.617061+0000","last_unstale":"2024-05-21T01:19:59.571116+0000","last_undegraded":"2024-05-21T01:19:59.571116+0000","last_fullsized":"2024-05-21T01:19:59.571116+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:48:50.703577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.567205+0000","last_change":"2024-05-21T01:19:54.557175+0000","last_active":"2024-05-21T01:19:59.567205+0000","last_peered":"2024-05-21T01:19:59.567205+0000","last_clean":"2024-05-21T01:19:59.567205+0000","last_became_active":"2024-05-21T01:19:54.556933+0000","last_became_peered":"2024-05-21T01:19:54.556933+0000","last_unstale":"2024-05-21T01:19:59.567205+0000","last_undegraded":"2024-05-21T01:19:59.567205+0000","last_fullsized":"2024-05-21T01:19:59.567205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:15:44.089544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"24'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.208820+0000","last_change":"2024-05-21T01:19:53.536780+0000","last_active":"2024-05-21T01:20:00.208820+0000","last_peered":"2024-05-21T01:20:00.208820+0000","last_clean":"2024-05-21T01:20:00.208820+0000","last_became_active":"2024-05-21T01:19:53.535768+0000","last_became_peered":"2024-05-21T01:19:53.535768+0000","last_unstale":"2024-05-21T01:20:00.208820+0000","last_undegraded":"2024-05-21T01:20:00.208820+0000","last_fullsized":"2024-05-21T01:20:00.208820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:04:14.732801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207120+0000","last_change":"2024-05-21T01:19:58.606532+0000","last_active":"2024-05-21T01:20:00.207120+0000","last_peered":"2024-05-21T01:20:00.207120+0000","last_clean":"2024-05-21T01:20:00.207120+0000","last_became_active":"2024-05-21T01:19:58.606180+0000","last_became_peered":"2024-05-21T01:19:58.606180+0000","last_unstale":"2024-05-21T01:20:00.207120+0000","last_undegraded":"2024-05-21T01:20:00.207120+0000","last_fullsized":"2024-05-21T01:20:00.207120+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:25:31.161427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.211807+0000","last_change":"2024-05-21T01:19:54.571280+0000","last_active":"2024-05-21T01:20:00.211807+0000","last_peered":"2024-05-21T01:20:00.211807+0000","last_clean":"2024-05-21T01:20:00.211807+0000","last_became_active":"2024-05-21T01:19:54.568778+0000","last_became_peered":"2024-05-21T01:19:54.568778+0000","last_unstale":"2024-05-21T01:20:00.211807+0000","last_undegraded":"2024-05-21T01:20:00.211807+0000","last_fullsized":"2024-05-21T01:20:00.211807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:43:16.583632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.208476+0000","last_change":"2024-05-21T01:19:53.530770+0000","last_active":"2024-05-21T01:20:00.208476+0000","last_peered":"2024-05-21T01:20:00.208476+0000","last_clean":"2024-05-21T01:20:00.208476+0000","last_became_active":"2024-05-21T01:19:53.526431+0000","last_became_peered":"2024-05-21T01:19:53.526431+0000","last_unstale":"2024-05-21T01:20:00.208476+0000","last_undegraded":"2024-05-21T01:20:00.208476+0000","last_fullsized":"2024-05-21T01:20:00.208476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:08:59.892029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.208009+0000","last_change":"2024-05-21T01:19:58.611576+0000","last_active":"2024-05-21T01:20:00.208009+0000","last_peered":"2024-05-21T01:20:00.208009+0000","last_clean":"2024-05-21T01:20:00.208009+0000","last_became_active":"2024-05-21T01:19:58.610838+0000","last_became_peered":"2024-05-21T01:19:58.610838+0000","last_unstale":"2024-05-21T01:20:00.208009+0000","last_undegraded":"2024-05-21T01:20:00.208009+0000","last_fullsized":"2024-05-21T01:20:00.208009+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:07:31.736640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207957+0000","last_change":"2024-05-21T01:19:54.552709+0000","last_active":"2024-05-21T01:20:00.207957+0000","last_peered":"2024-05-21T01:20:00.207957+0000","last_clean":"2024-05-21T01:20:00.207957+0000","last_became_active":"2024-05-21T01:19:54.547898+0000","last_became_peered":"2024-05-21T01:19:54.547898+0000","last_unstale":"2024-05-21T01:20:00.207957+0000","last_undegraded":"2024-05-21T01:20:00.207957+0000","last_fullsized":"2024-05-21T01:20:00.207957+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:20:17.933506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.209704+0000","last_change":"2024-05-21T01:19:53.534507+0000","last_active":"2024-05-21T01:20:00.209704+0000","last_peered":"2024-05-21T01:20:00.209704+0000","last_clean":"2024-05-21T01:20:00.209704+0000","last_became_active":"2024-05-21T01:19:53.534036+0000","last_became_peered":"2024-05-21T01:19:53.534036+0000","last_unstale":"2024-05-21T01:20:00.209704+0000","last_undegraded":"2024-05-21T01:20:00.209704+0000","last_fullsized":"2024-05-21T01:20:00.209704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:01:08.218098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.572286+0000","last_change":"2024-05-21T01:19:58.608135+0000","last_active":"2024-05-21T01:19:59.572286+0000","last_peered":"2024-05-21T01:19:59.572286+0000","last_clean":"2024-05-21T01:19:59.572286+0000","last_became_active":"2024-05-21T01:19:58.607242+0000","last_became_peered":"2024-05-21T01:19:58.607242+0000","last_unstale":"2024-05-21T01:19:59.572286+0000","last_undegraded":"2024-05-21T01:19:59.572286+0000","last_fullsized":"2024-05-21T01:19:59.572286+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:05:26.197876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.572239+0000","last_change":"2024-05-21T01:19:58.624883+0000","last_active":"2024-05-21T01:19:59.572239+0000","last_peered":"2024-05-21T01:19:59.572239+0000","last_clean":"2024-05-21T01:19:59.572239+0000","last_became_active":"2024-05-21T01:19:58.623991+0000","last_became_peered":"2024-05-21T01:19:58.623991+0000","last_unstale":"2024-05-21T01:19:59.572239+0000","last_undegraded":"2024-05-21T01:19:59.572239+0000","last_fullsized":"2024-05-21T01:19:59.572239+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:29:26.251376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.572416+0000","last_change":"2024-05-21T01:19:54.549215+0000","last_active":"2024-05-21T01:19:59.572416+0000","last_peered":"2024-05-21T01:19:59.572416+0000","last_clean":"2024-05-21T01:19:59.572416+0000","last_became_active":"2024-05-21T01:19:54.548426+0000","last_became_peered":"2024-05-21T01:19:54.548426+0000","last_unstale":"2024-05-21T01:19:59.572416+0000","last_undegraded":"2024-05-21T01:19:59.572416+0000","last_fullsized":"2024-05-21T01:19:59.572416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:10:10.800391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.566822+0000","last_change":"2024-05-21T01:19:53.526106+0000","last_active":"2024-05-21T01:19:59.566822+0000","last_peered":"2024-05-21T01:19:59.566822+0000","last_clean":"2024-05-21T01:19:59.566822+0000","last_became_active":"2024-05-21T01:19:53.525786+0000","last_became_peered":"2024-05-21T01:19:53.525786+0000","last_unstale":"2024-05-21T01:19:59.566822+0000","last_undegraded":"2024-05-21T01:19:59.566822+0000","last_fullsized":"2024-05-21T01:19:59.566822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:01:05.180803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.567758+0000","last_change":"2024-05-21T01:19:58.615481+0000","last_active":"2024-05-21T01:19:59.567758+0000","last_peered":"2024-05-21T01:19:59.567758+0000","last_clean":"2024-05-21T01:19:59.567758+0000","last_became_active":"2024-05-21T01:19:58.614879+0000","last_became_peered":"2024-05-21T01:19:58.614879+0000","last_unstale":"2024-05-21T01:19:59.567758+0000","last_undegraded":"2024-05-21T01:19:59.567758+0000","last_fullsized":"2024-05-21T01:19:59.567758+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:45:57.208342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.209731+0000","last_change":"2024-05-21T01:19:54.570650+0000","last_active":"2024-05-21T01:20:00.209731+0000","last_peered":"2024-05-21T01:20:00.209731+0000","last_clean":"2024-05-21T01:20:00.209731+0000","last_became_active":"2024-05-21T01:19:54.570034+0000","last_became_peered":"2024-05-21T01:19:54.570034+0000","last_unstale":"2024-05-21T01:20:00.209731+0000","last_undegraded":"2024-05-21T01:20:00.209731+0000","last_fullsized":"2024-05-21T01:20:00.209731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:01:05.887729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.574517+0000","last_change":"2024-05-21T01:19:53.532017+0000","last_active":"2024-05-21T01:19:59.574517+0000","last_peered":"2024-05-21T01:19:59.574517+0000","last_clean":"2024-05-21T01:19:59.574517+0000","last_became_active":"2024-05-21T01:19:53.529457+0000","last_became_peered":"2024-05-21T01:19:53.529457+0000","last_unstale":"2024-05-21T01:19:59.574517+0000","last_undegraded":"2024-05-21T01:19:59.574517+0000","last_fullsized":"2024-05-21T01:19:59.574517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:58:03.979929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.567307+0000","last_change":"2024-05-21T01:19:53.525620+0000","last_active":"2024-05-21T01:19:59.567307+0000","last_peered":"2024-05-21T01:19:59.567307+0000","last_clean":"2024-05-21T01:19:59.567307+0000","last_became_active":"2024-05-21T01:19:53.525315+0000","last_became_peered":"2024-05-21T01:19:53.525315+0000","last_unstale":"2024-05-21T01:19:59.567307+0000","last_undegraded":"2024-05-21T01:19:59.567307+0000","last_fullsized":"2024-05-21T01:19:59.567307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:30:38.075463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.571359+0000","last_change":"2024-05-21T01:19:54.555344+0000","last_active":"2024-05-21T01:19:59.571359+0000","last_peered":"2024-05-21T01:19:59.571359+0000","last_clean":"2024-05-21T01:19:59.571359+0000","last_became_active":"2024-05-21T01:19:54.552817+0000","last_became_peered":"2024-05-21T01:19:54.552817+0000","last_unstale":"2024-05-21T01:19:59.571359+0000","last_undegraded":"2024-05-21T01:19:59.571359+0000","last_fullsized":"2024-05-21T01:19:59.571359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:10:03.810064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.572198+0000","last_change":"2024-05-21T01:19:58.619520+0000","last_active":"2024-05-21T01:19:59.572198+0000","last_peered":"2024-05-21T01:19:59.572198+0000","last_clean":"2024-05-21T01:19:59.572198+0000","last_became_active":"2024-05-21T01:19:58.617165+0000","last_became_peered":"2024-05-21T01:19:58.617165+0000","last_unstale":"2024-05-21T01:19:59.572198+0000","last_undegraded":"2024-05-21T01:19:59.572198+0000","last_fullsized":"2024-05-21T01:19:59.572198+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T13:07:51.530746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.210590+0000","last_change":"2024-05-21T01:19:53.551547+0000","last_active":"2024-05-21T01:20:00.210590+0000","last_peered":"2024-05-21T01:20:00.210590+0000","last_clean":"2024-05-21T01:20:00.210590+0000","last_became_active":"2024-05-21T01:19:53.550931+0000","last_became_peered":"2024-05-21T01:19:53.550931+0000","last_unstale":"2024-05-21T01:20:00.210590+0000","last_undegraded":"2024-05-21T01:20:00.210590+0000","last_fullsized":"2024-05-21T01:20:00.210590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:13:47.329230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.208939+0000","last_change":"2024-05-21T01:19:54.574552+0000","last_active":"2024-05-21T01:20:00.208939+0000","last_peered":"2024-05-21T01:20:00.208939+0000","last_clean":"2024-05-21T01:20:00.208939+0000","last_became_active":"2024-05-21T01:19:54.574246+0000","last_became_peered":"2024-05-21T01:19:54.574246+0000","last_unstale":"2024-05-21T01:20:00.208939+0000","last_undegraded":"2024-05-21T01:20:00.208939+0000","last_fullsized":"2024-05-21T01:20:00.208939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:23:33.685798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.208672+0000","last_change":"2024-05-21T01:19:58.624400+0000","last_active":"2024-05-21T01:20:00.208672+0000","last_peered":"2024-05-21T01:20:00.208672+0000","last_clean":"2024-05-21T01:20:00.208672+0000","last_became_active":"2024-05-21T01:19:58.623388+0000","last_became_peered":"2024-05-21T01:19:58.623388+0000","last_unstale":"2024-05-21T01:20:00.208672+0000","last_undegraded":"2024-05-21T01:20:00.208672+0000","last_fullsized":"2024-05-21T01:20:00.208672+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:59:30.019393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.206641+0000","last_change":"2024-05-21T01:19:54.553262+0000","last_active":"2024-05-21T01:20:00.206641+0000","last_peered":"2024-05-21T01:20:00.206641+0000","last_clean":"2024-05-21T01:20:00.206641+0000","last_became_active":"2024-05-21T01:19:54.553060+0000","last_became_peered":"2024-05-21T01:19:54.553060+0000","last_unstale":"2024-05-21T01:20:00.206641+0000","last_undegraded":"2024-05-21T01:20:00.206641+0000","last_fullsized":"2024-05-21T01:20:00.206641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:18:14.077480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207978+0000","last_change":"2024-05-21T01:19:54.566851+0000","last_active":"2024-05-21T01:20:00.207978+0000","last_peered":"2024-05-21T01:20:00.207978+0000","last_clean":"2024-05-21T01:20:00.207978+0000","last_became_active":"2024-05-21T01:19:54.565573+0000","last_became_peered":"2024-05-21T01:19:54.565573+0000","last_unstale":"2024-05-21T01:20:00.207978+0000","last_undegraded":"2024-05-21T01:20:00.207978+0000","last_fullsized":"2024-05-21T01:20:00.207978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:51:30.883954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.566981+0000","last_change":"2024-05-21T01:19:54.566934+0000","last_active":"2024-05-21T01:19:59.566981+0000","last_peered":"2024-05-21T01:19:59.566981+0000","last_clean":"2024-05-21T01:19:59.566981+0000","last_became_active":"2024-05-21T01:19:54.566503+0000","last_became_peered":"2024-05-21T01:19:54.566503+0000","last_unstale":"2024-05-21T01:19:59.566981+0000","last_undegraded":"2024-05-21T01:19:59.566981+0000","last_fullsized":"2024-05-21T01:19:59.566981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:14:54.262165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.210361+0000","last_change":"2024-05-21T01:19:54.573091+0000","last_active":"2024-05-21T01:20:00.210361+0000","last_peered":"2024-05-21T01:20:00.210361+0000","last_clean":"2024-05-21T01:20:00.210361+0000","last_became_active":"2024-05-21T01:19:54.572366+0000","last_became_peered":"2024-05-21T01:19:54.572366+0000","last_unstale":"2024-05-21T01:20:00.210361+0000","last_undegraded":"2024-05-21T01:20:00.210361+0000","last_fullsized":"2024-05-21T01:20:00.210361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:10:09.353807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.576980+0000","last_change":"2024-05-21T01:19:54.563339+0000","last_active":"2024-05-21T01:19:59.576980+0000","last_peered":"2024-05-21T01:19:59.576980+0000","last_clean":"2024-05-21T01:19:59.576980+0000","last_became_active":"2024-05-21T01:19:54.557934+0000","last_became_peered":"2024-05-21T01:19:54.557934+0000","last_unstale":"2024-05-21T01:19:59.576980+0000","last_undegraded":"2024-05-21T01:19:59.576980+0000","last_fullsized":"2024-05-21T01:19:59.576980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:46:21.598689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.577198+0000","last_change":"2024-05-21T01:19:54.553551+0000","last_active":"2024-05-21T01:19:59.577198+0000","last_peered":"2024-05-21T01:19:59.577198+0000","last_clean":"2024-05-21T01:19:59.577198+0000","last_became_active":"2024-05-21T01:19:54.552812+0000","last_became_peered":"2024-05-21T01:19:54.552812+0000","last_unstale":"2024-05-21T01:19:59.577198+0000","last_undegraded":"2024-05-21T01:19:59.577198+0000","last_fullsized":"2024-05-21T01:19:59.577198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:27:41.166606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207853+0000","last_change":"2024-05-21T01:19:54.548604+0000","last_active":"2024-05-21T01:20:00.207853+0000","last_peered":"2024-05-21T01:20:00.207853+0000","last_clean":"2024-05-21T01:20:00.207853+0000","last_became_active":"2024-05-21T01:19:54.548263+0000","last_became_peered":"2024-05-21T01:19:54.548263+0000","last_unstale":"2024-05-21T01:20:00.207853+0000","last_undegraded":"2024-05-21T01:20:00.207853+0000","last_fullsized":"2024-05-21T01:20:00.207853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:33:55.302088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.211381+0000","last_change":"2024-05-21T01:19:54.573995+0000","last_active":"2024-05-21T01:20:00.211381+0000","last_peered":"2024-05-21T01:20:00.211381+0000","last_clean":"2024-05-21T01:20:00.211381+0000","last_became_active":"2024-05-21T01:19:54.570373+0000","last_became_peered":"2024-05-21T01:19:54.570373+0000","last_unstale":"2024-05-21T01:20:00.211381+0000","last_undegraded":"2024-05-21T01:20:00.211381+0000","last_fullsized":"2024-05-21T01:20:00.211381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:44:23.194713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.566746+0000","last_change":"2024-05-21T01:19:54.575196+0000","last_active":"2024-05-21T01:19:59.566746+0000","last_peered":"2024-05-21T01:19:59.566746+0000","last_clean":"2024-05-21T01:19:59.566746+0000","last_became_active":"2024-05-21T01:19:54.574945+0000","last_became_peered":"2024-05-21T01:19:54.574945+0000","last_unstale":"2024-05-21T01:19:59.566746+0000","last_undegraded":"2024-05-21T01:19:59.566746+0000","last_fullsized":"2024-05-21T01:19:59.566746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:52:56.244771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.209915+0000","last_change":"2024-05-21T01:19:54.566719+0000","last_active":"2024-05-21T01:20:00.209915+0000","last_peered":"2024-05-21T01:20:00.209915+0000","last_clean":"2024-05-21T01:20:00.209915+0000","last_became_active":"2024-05-21T01:19:54.565922+0000","last_became_peered":"2024-05-21T01:19:54.565922+0000","last_unstale":"2024-05-21T01:20:00.209915+0000","last_undegraded":"2024-05-21T01:20:00.209915+0000","last_fullsized":"2024-05-21T01:20:00.209915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:39:19.454688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.208888+0000","last_change":"2024-05-21T01:19:54.536815+0000","last_active":"2024-05-21T01:20:00.208888+0000","last_peered":"2024-05-21T01:20:00.208888+0000","last_clean":"2024-05-21T01:20:00.208888+0000","last_became_active":"2024-05-21T01:19:54.535957+0000","last_became_peered":"2024-05-21T01:19:54.535957+0000","last_unstale":"2024-05-21T01:20:00.208888+0000","last_undegraded":"2024-05-21T01:20:00.208888+0000","last_fullsized":"2024-05-21T01:20:00.208888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:24:53.906256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.571247+0000","last_change":"2024-05-21T01:19:54.552466+0000","last_active":"2024-05-21T01:19:59.571247+0000","last_peered":"2024-05-21T01:19:59.571247+0000","last_clean":"2024-05-21T01:19:59.571247+0000","last_became_active":"2024-05-21T01:19:54.551790+0000","last_became_peered":"2024-05-21T01:19:54.551790+0000","last_unstale":"2024-05-21T01:19:59.571247+0000","last_undegraded":"2024-05-21T01:19:59.571247+0000","last_fullsized":"2024-05-21T01:19:59.571247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:24:34.737707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.206948+0000","last_change":"2024-05-21T01:19:54.535314+0000","last_active":"2024-05-21T01:20:00.206948+0000","last_peered":"2024-05-21T01:20:00.206948+0000","last_clean":"2024-05-21T01:20:00.206948+0000","last_became_active":"2024-05-21T01:19:54.534793+0000","last_became_peered":"2024-05-21T01:19:54.534793+0000","last_unstale":"2024-05-21T01:20:00.206948+0000","last_undegraded":"2024-05-21T01:20:00.206948+0000","last_fullsized":"2024-05-21T01:20:00.206948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:52:35.492250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.568120+0000","last_change":"2024-05-21T01:19:54.556323+0000","last_active":"2024-05-21T01:19:59.568120+0000","last_peered":"2024-05-21T01:19:59.568120+0000","last_clean":"2024-05-21T01:19:59.568120+0000","last_became_active":"2024-05-21T01:19:54.556043+0000","last_became_peered":"2024-05-21T01:19:54.556043+0000","last_unstale":"2024-05-21T01:19:59.568120+0000","last_undegraded":"2024-05-21T01:19:59.568120+0000","last_fullsized":"2024-05-21T01:19:59.568120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:34:02.068527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.209056+0000","last_change":"2024-05-21T01:19:54.567457+0000","last_active":"2024-05-21T01:20:00.209056+0000","last_peered":"2024-05-21T01:20:00.209056+0000","last_clean":"2024-05-21T01:20:00.209056+0000","last_became_active":"2024-05-21T01:19:54.565326+0000","last_became_peered":"2024-05-21T01:19:54.565326+0000","last_unstale":"2024-05-21T01:20:00.209056+0000","last_undegraded":"2024-05-21T01:20:00.209056+0000","last_fullsized":"2024-05-21T01:20:00.209056+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:11:05.775389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.568111+0000","last_change":"2024-05-21T01:19:54.562078+0000","last_active":"2024-05-21T01:19:59.568111+0000","last_peered":"2024-05-21T01:19:59.568111+0000","last_clean":"2024-05-21T01:19:59.568111+0000","last_became_active":"2024-05-21T01:19:54.558286+0000","last_became_peered":"2024-05-21T01:19:54.558286+0000","last_unstale":"2024-05-21T01:19:59.568111+0000","last_undegraded":"2024-05-21T01:19:59.568111+0000","last_fullsized":"2024-05-21T01:19:59.568111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T09:09:58.360014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.566714+0000","last_change":"2024-05-21T01:19:54.548274+0000","last_active":"2024-05-21T01:19:59.566714+0000","last_peered":"2024-05-21T01:19:59.566714+0000","last_clean":"2024-05-21T01:19:59.566714+0000","last_became_active":"2024-05-21T01:19:54.548079+0000","last_became_peered":"2024-05-21T01:19:54.548079+0000","last_unstale":"2024-05-21T01:19:59.566714+0000","last_undegraded":"2024-05-21T01:19:59.566714+0000","last_fullsized":"2024-05-21T01:19:59.566714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:49:03.296571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.209656+0000","last_change":"2024-05-21T01:19:54.568211+0000","last_active":"2024-05-21T01:20:00.209656+0000","last_peered":"2024-05-21T01:20:00.209656+0000","last_clean":"2024-05-21T01:20:00.209656+0000","last_became_active":"2024-05-21T01:19:54.567512+0000","last_became_peered":"2024-05-21T01:19:54.567512+0000","last_unstale":"2024-05-21T01:20:00.209656+0000","last_undegraded":"2024-05-21T01:20:00.209656+0000","last_fullsized":"2024-05-21T01:20:00.209656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:32:18.004763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.575120+0000","last_change":"2024-05-21T01:19:54.556683+0000","last_active":"2024-05-21T01:19:59.575120+0000","last_peered":"2024-05-21T01:19:59.575120+0000","last_clean":"2024-05-21T01:19:59.575120+0000","last_became_active":"2024-05-21T01:19:54.555947+0000","last_became_peered":"2024-05-21T01:19:54.555947+0000","last_unstale":"2024-05-21T01:19:59.575120+0000","last_undegraded":"2024-05-21T01:19:59.575120+0000","last_fullsized":"2024-05-21T01:19:59.575120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:59:04.593946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.575926+0000","last_change":"2024-05-21T01:19:54.560218+0000","last_active":"2024-05-21T01:19:59.575926+0000","last_peered":"2024-05-21T01:19:59.575926+0000","last_clean":"2024-05-21T01:19:59.575926+0000","last_became_active":"2024-05-21T01:19:54.557787+0000","last_became_peered":"2024-05-21T01:19:54.557787+0000","last_unstale":"2024-05-21T01:19:59.575926+0000","last_undegraded":"2024-05-21T01:19:59.575926+0000","last_fullsized":"2024-05-21T01:19:59.575926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:05:48.282563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.206865+0000","last_change":"2024-05-21T01:19:54.535096+0000","last_active":"2024-05-21T01:20:00.206865+0000","last_peered":"2024-05-21T01:20:00.206865+0000","last_clean":"2024-05-21T01:20:00.206865+0000","last_became_active":"2024-05-21T01:19:54.534472+0000","last_became_peered":"2024-05-21T01:19:54.534472+0000","last_unstale":"2024-05-21T01:20:00.206865+0000","last_undegraded":"2024-05-21T01:20:00.206865+0000","last_fullsized":"2024-05-21T01:20:00.206865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:05:40.018457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207495+0000","last_change":"2024-05-21T01:19:54.546352+0000","last_active":"2024-05-21T01:20:00.207495+0000","last_peered":"2024-05-21T01:20:00.207495+0000","last_clean":"2024-05-21T01:20:00.207495+0000","last_became_active":"2024-05-21T01:19:54.546055+0000","last_became_peered":"2024-05-21T01:19:54.546055+0000","last_unstale":"2024-05-21T01:20:00.207495+0000","last_undegraded":"2024-05-21T01:20:00.207495+0000","last_fullsized":"2024-05-21T01:20:00.207495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:14:56.268312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.208385+0000","last_change":"2024-05-21T01:19:54.539886+0000","last_active":"2024-05-21T01:20:00.208385+0000","last_peered":"2024-05-21T01:20:00.208385+0000","last_clean":"2024-05-21T01:20:00.208385+0000","last_became_active":"2024-05-21T01:19:54.539599+0000","last_became_peered":"2024-05-21T01:19:54.539599+0000","last_unstale":"2024-05-21T01:20:00.208385+0000","last_undegraded":"2024-05-21T01:20:00.208385+0000","last_fullsized":"2024-05-21T01:20:00.208385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:08:51.107275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.209668+0000","last_change":"2024-05-21T01:19:54.548954+0000","last_active":"2024-05-21T01:20:00.209668+0000","last_peered":"2024-05-21T01:20:00.209668+0000","last_clean":"2024-05-21T01:20:00.209668+0000","last_became_active":"2024-05-21T01:19:54.547528+0000","last_became_peered":"2024-05-21T01:19:54.547528+0000","last_unstale":"2024-05-21T01:20:00.209668+0000","last_undegraded":"2024-05-21T01:20:00.209668+0000","last_fullsized":"2024-05-21T01:20:00.209668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:47:24.598610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.209472+0000","last_change":"2024-05-21T01:19:54.575256+0000","last_active":"2024-05-21T01:20:00.209472+0000","last_peered":"2024-05-21T01:20:00.209472+0000","last_clean":"2024-05-21T01:20:00.209472+0000","last_became_active":"2024-05-21T01:19:54.570119+0000","last_became_peered":"2024-05-21T01:19:54.570119+0000","last_unstale":"2024-05-21T01:20:00.209472+0000","last_undegraded":"2024-05-21T01:20:00.209472+0000","last_fullsized":"2024-05-21T01:20:00.209472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:10:02.800110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.206200+0000","last_change":"2024-05-21T01:19:54.550134+0000","last_active":"2024-05-21T01:20:00.206200+0000","last_peered":"2024-05-21T01:20:00.206200+0000","last_clean":"2024-05-21T01:20:00.206200+0000","last_became_active":"2024-05-21T01:19:54.549617+0000","last_became_peered":"2024-05-21T01:19:54.549617+0000","last_unstale":"2024-05-21T01:20:00.206200+0000","last_undegraded":"2024-05-21T01:20:00.206200+0000","last_fullsized":"2024-05-21T01:20:00.206200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:34:59.845458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207085+0000","last_change":"2024-05-21T01:19:54.555653+0000","last_active":"2024-05-21T01:20:00.207085+0000","last_peered":"2024-05-21T01:20:00.207085+0000","last_clean":"2024-05-21T01:20:00.207085+0000","last_became_active":"2024-05-21T01:19:54.555274+0000","last_became_peered":"2024-05-21T01:19:54.555274+0000","last_unstale":"2024-05-21T01:20:00.207085+0000","last_undegraded":"2024-05-21T01:20:00.207085+0000","last_fullsized":"2024-05-21T01:20:00.207085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:43:43.237853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207101+0000","last_change":"2024-05-21T01:19:54.568866+0000","last_active":"2024-05-21T01:20:00.207101+0000","last_peered":"2024-05-21T01:20:00.207101+0000","last_clean":"2024-05-21T01:20:00.207101+0000","last_became_active":"2024-05-21T01:19:54.568605+0000","last_became_peered":"2024-05-21T01:19:54.568605+0000","last_unstale":"2024-05-21T01:20:00.207101+0000","last_undegraded":"2024-05-21T01:20:00.207101+0000","last_fullsized":"2024-05-21T01:20:00.207101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:21:20.820620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207281+0000","last_change":"2024-05-21T01:19:54.557468+0000","last_active":"2024-05-21T01:20:00.207281+0000","last_peered":"2024-05-21T01:20:00.207281+0000","last_clean":"2024-05-21T01:20:00.207281+0000","last_became_active":"2024-05-21T01:19:54.554976+0000","last_became_peered":"2024-05-21T01:19:54.554976+0000","last_unstale":"2024-05-21T01:20:00.207281+0000","last_undegraded":"2024-05-21T01:20:00.207281+0000","last_fullsized":"2024-05-21T01:20:00.207281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:25:08.737348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.210942+0000","last_change":"2024-05-21T01:19:54.566991+0000","last_active":"2024-05-21T01:20:00.210942+0000","last_peered":"2024-05-21T01:20:00.210942+0000","last_clean":"2024-05-21T01:20:00.210942+0000","last_became_active":"2024-05-21T01:19:54.566349+0000","last_became_peered":"2024-05-21T01:19:54.566349+0000","last_unstale":"2024-05-21T01:20:00.210942+0000","last_undegraded":"2024-05-21T01:20:00.210942+0000","last_fullsized":"2024-05-21T01:20:00.210942+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:25:43.468081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.211304+0000","last_change":"2024-05-21T01:19:54.576100+0000","last_active":"2024-05-21T01:20:00.211304+0000","last_peered":"2024-05-21T01:20:00.211304+0000","last_clean":"2024-05-21T01:20:00.211304+0000","last_became_active":"2024-05-21T01:19:54.574914+0000","last_became_peered":"2024-05-21T01:19:54.574914+0000","last_unstale":"2024-05-21T01:20:00.211304+0000","last_undegraded":"2024-05-21T01:20:00.211304+0000","last_fullsized":"2024-05-21T01:20:00.211304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:29:30.730283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.208436+0000","last_change":"2024-05-21T01:19:54.546570+0000","last_active":"2024-05-21T01:20:00.208436+0000","last_peered":"2024-05-21T01:20:00.208436+0000","last_clean":"2024-05-21T01:20:00.208436+0000","last_became_active":"2024-05-21T01:19:54.546284+0000","last_became_peered":"2024-05-21T01:19:54.546284+0000","last_unstale":"2024-05-21T01:20:00.208436+0000","last_undegraded":"2024-05-21T01:20:00.208436+0000","last_fullsized":"2024-05-21T01:20:00.208436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:36:30.219522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66932,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509450,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":103393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509449,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":270336,"data_stored":106653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509448,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":327680,"data_stored":693249,"data_compressed":33466,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509448,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":102867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542153,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":102811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542152,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":331776,"data_stored":693271,"data_compressed":33466,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":102935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":107325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33466,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33466,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-21T01:20:23.202 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-21T01:20:23.203 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-21T01:20:23.203 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-05-21T01:20:23.203 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-05-21T01:20:23.203 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-05-21T01:20:23.379 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.373+0000 7f8b9a200640 1 Processor -- start 2024-05-21T01:20:23.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.373+0000 7f8b9a200640 1 -- start start 2024-05-21T01:20:23.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.377+0000 7f8b9a200640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8b94156150 0x7f8b9415bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:23.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.377+0000 7f8b9a200640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f8b94073480 0x7f8b94071190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:23.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.377+0000 7f8b9a200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8b940716d0 0x7f8b9406d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:23.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.377+0000 7f8b9a200640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f8b94070a20 con 0x7f8b94156150 2024-05-21T01:20:23.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.377+0000 7f8b9a200640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f8b9406f510 con 0x7f8b94073480 2024-05-21T01:20:23.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.377+0000 7f8b9a200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f8b94073ac0 con 0x7f8b940716d0 2024-05-21T01:20:23.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.377+0000 7f8b93400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8b94156150 0x7f8b9415bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:23.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.377+0000 7f8b93400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8b94156150 0x7f8b9415bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:49180/0 (socket says 172.21.15.63:49180) 2024-05-21T01:20:23.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.377+0000 7f8b93400640 1 -- 172.21.15.63:0/2957630730 learned_addr learned my addr 172.21.15.63:0/2957630730 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:23.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.377+0000 7f8b93e00640 1 --2- 172.21.15.63:0/2957630730 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8b940716d0 0x7f8b9406d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:23.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.377+0000 7f8b8aa00640 1 --2- 172.21.15.63:0/2957630730 >> v2:172.21.15.131:3300/0 conn(0x7f8b94073480 0x7f8b94071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:23.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.377+0000 7f8b93400640 1 -- 172.21.15.63:0/2957630730 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8b940716d0 msgr2=0x7f8b9406d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:23.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.377+0000 7f8b93400640 1 --2- 172.21.15.63:0/2957630730 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8b940716d0 0x7f8b9406d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:23.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.377+0000 7f8b93400640 1 -- 172.21.15.63:0/2957630730 >> v2:172.21.15.131:3300/0 conn(0x7f8b94073480 msgr2=0x7f8b94071190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:23.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.377+0000 7f8b93400640 1 --2- 172.21.15.63:0/2957630730 >> v2:172.21.15.131:3300/0 conn(0x7f8b94073480 0x7f8b94071190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:23.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.377+0000 7f8b93400640 1 -- 172.21.15.63:0/2957630730 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b94073da0 con 0x7f8b94156150 2024-05-21T01:20:23.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.377+0000 7f8b93e00640 1 --2- 172.21.15.63:0/2957630730 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8b940716d0 0x7f8b9406d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T01:20:23.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.381+0000 7f8b93400640 1 --2- 172.21.15.63:0/2957630730 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b94156150 0x7f8b9415bd30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8b94072ec0 tx=0x7f8b8401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d64aaeab28fbac60 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:23.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.381+0000 7f8b92a00640 1 -- 172.21.15.63:0/2957630730 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b840b0070 con 0x7f8b94156150 2024-05-21T01:20:23.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.381+0000 7f8b92a00640 1 -- 172.21.15.63:0/2957630730 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b840ab600 con 0x7f8b94156150 2024-05-21T01:20:23.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.381+0000 7f8b92a00640 1 -- 172.21.15.63:0/2957630730 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b840ab9d0 con 0x7f8b94156150 2024-05-21T01:20:23.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.381+0000 7f8b9a200640 1 -- 172.21.15.63:0/2957630730 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b94156150 msgr2=0x7f8b9415bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:23.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.381+0000 7f8b9a200640 1 --2- 172.21.15.63:0/2957630730 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b94156150 0x7f8b9415bd30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8b94072ec0 tx=0x7f8b8401c490 comp rx=0 tx=0).stop 2024-05-21T01:20:23.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.381+0000 7f8b9a200640 1 -- 172.21.15.63:0/2957630730 shutdown_connections 2024-05-21T01:20:23.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.381+0000 7f8b9a200640 1 --2- 172.21.15.63:0/2957630730 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8b940716d0 0x7f8b9406d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:23.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.381+0000 7f8b9a200640 1 --2- 172.21.15.63:0/2957630730 >> v2:172.21.15.131:3300/0 conn(0x7f8b94073480 0x7f8b94071190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:23.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.381+0000 7f8b9a200640 1 --2- 172.21.15.63:0/2957630730 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b94156150 0x7f8b9415bd30 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:23.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.381+0000 7f8b9a200640 1 -- 172.21.15.63:0/2957630730 >> 172.21.15.63:0/2957630730 conn(0x7f8b940cbf10 msgr2=0x7f8b940cc320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:23.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.381+0000 7f8b9a200640 1 -- 172.21.15.63:0/2957630730 shutdown_connections 2024-05-21T01:20:23.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.381+0000 7f8b9a200640 1 -- 172.21.15.63:0/2957630730 wait complete. 2024-05-21T01:20:23.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.381+0000 7f8b9a200640 1 Processor -- start 2024-05-21T01:20:23.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.381+0000 7f8b9a200640 1 -- start start 2024-05-21T01:20:23.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.381+0000 7f8b9a200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8b940716d0 0x7f8b94157060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:23.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.381+0000 7f8b9a200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8b94073480 0x7f8b941577d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:23.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.381+0000 7f8b9a200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b94156150 0x7f8b94146b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:23.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.381+0000 7f8b9a200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f8b9415fae0 con 0x7f8b94156150 2024-05-21T01:20:23.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.381+0000 7f8b9a200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f8b9415fc60 con 0x7f8b940716d0 2024-05-21T01:20:23.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.381+0000 7f8b9a200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f8b9415fde0 con 0x7f8b94073480 2024-05-21T01:20:23.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.385+0000 7f8b93e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b94156150 0x7f8b94146b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:23.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.385+0000 7f8b93e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b94156150 0x7f8b94146b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:49182/0 (socket says 172.21.15.63:49182) 2024-05-21T01:20:23.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.385+0000 7f8b93e00640 1 -- 172.21.15.63:0/829667589 learned_addr learned my addr 172.21.15.63:0/829667589 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:23.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.385+0000 7f8b8aa00640 1 --2- 172.21.15.63:0/829667589 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8b94073480 0x7f8b941577d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:23.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.385+0000 7f8b93400640 1 --2- 172.21.15.63:0/829667589 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8b940716d0 0x7f8b94157060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:23.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.385+0000 7f8b93e00640 1 -- 172.21.15.63:0/829667589 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8b94073480 msgr2=0x7f8b941577d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:23.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.385+0000 7f8b93e00640 1 --2- 172.21.15.63:0/829667589 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8b94073480 0x7f8b941577d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:23.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.385+0000 7f8b93e00640 1 -- 172.21.15.63:0/829667589 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8b940716d0 msgr2=0x7f8b94157060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:23.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.385+0000 7f8b93e00640 1 --2- 172.21.15.63:0/829667589 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8b940716d0 0x7f8b94157060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:23.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.385+0000 7f8b93e00640 1 -- 172.21.15.63:0/829667589 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b940c96a0 con 0x7f8b94156150 2024-05-21T01:20:23.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.385+0000 7f8b8aa00640 1 --2- 172.21.15.63:0/829667589 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8b94073480 0x7f8b941577d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T01:20:23.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.385+0000 7f8b93e00640 1 --2- 172.21.15.63:0/829667589 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b94156150 0x7f8b94146b60 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c007e40 tx=0x7f8b8c00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:23.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.385+0000 7f8b8be00640 1 -- 172.21.15.63:0/829667589 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b8c01a070 con 0x7f8b94156150 2024-05-21T01:20:23.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.385+0000 7f8b8be00640 1 -- 172.21.15.63:0/829667589 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b8c003ba0 con 0x7f8b94156150 2024-05-21T01:20:23.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.385+0000 7f8b8be00640 1 -- 172.21.15.63:0/829667589 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b8c00de80 con 0x7f8b94156150 2024-05-21T01:20:23.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.385+0000 7f8b9a200640 1 -- 172.21.15.63:0/829667589 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b940c8410 con 0x7f8b94156150 2024-05-21T01:20:23.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.385+0000 7f8b9a200640 1 -- 172.21.15.63:0/829667589 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b940c89d0 con 0x7f8b94156150 2024-05-21T01:20:23.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.385+0000 7f8b9a200640 1 -- 172.21.15.63:0/829667589 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b940507f0 con 0x7f8b94156150 2024-05-21T01:20:23.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.385+0000 7f8b8be00640 1 -- 172.21.15.63:0/829667589 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7f8b8c01d070 con 0x7f8b94156150 2024-05-21T01:20:23.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.389+0000 7f8b8be00640 1 --2- 172.21.15.63:0/829667589 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f8b7006f430 0x7f8b700718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:23.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.389+0000 7f8b8be00640 1 -- 172.21.15.63:0/829667589 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f8b8c08f830 con 0x7f8b94156150 2024-05-21T01:20:23.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.389+0000 7f8b93400640 1 --2- 172.21.15.63:0/829667589 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f8b7006f430 0x7f8b700718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:23.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.389+0000 7f8b93400640 1 --2- 172.21.15.63:0/829667589 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f8b7006f430 0x7f8b700718f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8b840ad000 tx=0x7f8b84008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:23.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.393+0000 7f8b8be00640 1 -- 172.21.15.63:0/829667589 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f8b8c010070 con 0x7f8b94156150 2024-05-21T01:20:23.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.597+0000 7f8b9a200640 1 -- 172.21.15.63:0/829667589 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f8b940ca260 con 0x7f8b94156150 2024-05-21T01:20:23.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.601+0000 7f8b8be00640 1 -- 172.21.15.63:0/829667589 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v6) ==== 74+0+179546 (secure 0 0 0) 0x7f8b8c05c460 con 0x7f8b94156150 2024-05-21T01:20:23.608 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-05-21T01:20:23.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.605+0000 7f8b9a200640 1 -- 172.21.15.63:0/829667589 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f8b7006f430 msgr2=0x7f8b700718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:23.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.605+0000 7f8b9a200640 1 --2- 172.21.15.63:0/829667589 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f8b7006f430 0x7f8b700718f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8b840ad000 tx=0x7f8b84008040 comp rx=0 tx=0).stop 2024-05-21T01:20:23.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.605+0000 7f8b9a200640 1 -- 172.21.15.63:0/829667589 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b94156150 msgr2=0x7f8b94146b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:23.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.605+0000 7f8b9a200640 1 --2- 172.21.15.63:0/829667589 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b94156150 0x7f8b94146b60 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c007e40 tx=0x7f8b8c00d4a0 comp rx=0 tx=0).stop 2024-05-21T01:20:23.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.605+0000 7f8b9a200640 1 -- 172.21.15.63:0/829667589 shutdown_connections 2024-05-21T01:20:23.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.605+0000 7f8b9a200640 1 --2- 172.21.15.63:0/829667589 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f8b7006f430 0x7f8b700718f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:23.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.605+0000 7f8b9a200640 1 --2- 172.21.15.63:0/829667589 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8b94156150 0x7f8b94146b60 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:23.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.605+0000 7f8b9a200640 1 --2- 172.21.15.63:0/829667589 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8b94073480 0x7f8b941577d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:23.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.605+0000 7f8b9a200640 1 --2- 172.21.15.63:0/829667589 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8b940716d0 0x7f8b94157060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:23.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.605+0000 7f8b9a200640 1 -- 172.21.15.63:0/829667589 >> 172.21.15.63:0/829667589 conn(0x7f8b940cbf10 msgr2=0x7f8b94154f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:23.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.605+0000 7f8b9a200640 1 -- 172.21.15.63:0/829667589 shutdown_connections 2024-05-21T01:20:23.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.605+0000 7f8b9a200640 1 -- 172.21.15.63:0/829667589 wait complete. 2024-05-21T01:20:23.629 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":6,"flags":0,"active_gid":4103,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":921953667},{"type":"v1","addr":"172.21.15.131:6833","nonce":921953667}]},"active_addr":"172.21.15.131:6833/921953667","active_change":"2024-05-21T01:19:42.414303+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4113,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.131:0","nonce":821697031}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.131:0","nonce":86919654}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.131:0","nonce":3173467429}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.131:0","nonce":3526861627}]}]} 2024-05-21T01:20:23.632 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-05-21T01:20:23.633 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-05-21T01:20:23.633 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-21T01:20:23.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.769+0000 7f6cb4400640 1 Processor -- start 2024-05-21T01:20:23.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.769+0000 7f6cb4400640 1 -- start start 2024-05-21T01:20:23.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.769+0000 7f6cb4400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f6cac06f9b0 0x7f6cac0c94f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:23.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.769+0000 7f6cb4400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6cac0c69c0 0x7f6cac0c6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:23.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.769+0000 7f6cb4400640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cac0c7310 con 0x7f6cac06f5d0 2024-05-21T01:20:23.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.769+0000 7f6cb4400640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f6cac0c52a0 con 0x7f6cac06f9b0 2024-05-21T01:20:23.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.769+0000 7f6cb4400640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f6cac0c4fc0 con 0x7f6cac0c69c0 2024-05-21T01:20:23.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.769+0000 7f6cb1000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f6cac06f9b0 0x7f6cac0c94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:23.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.769+0000 7f6cb2400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6cac0c69c0 0x7f6cac0c6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:23.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.769+0000 7f6cb1000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f6cac06f9b0 0x7f6cac0c94f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.63:41850/0 (socket says 172.21.15.63:41850) 2024-05-21T01:20:23.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.769+0000 7f6cb1000640 1 -- 172.21.15.63:0/3248599424 learned_addr learned my addr 172.21.15.63:0/3248599424 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:23.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.773+0000 7f6cb2400640 1 -- 172.21.15.63:0/3248599424 >> v2:172.21.15.131:3300/0 conn(0x7f6cac06f9b0 msgr2=0x7f6cac0c94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:23.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.773+0000 7f6cb2400640 1 --2- 172.21.15.63:0/3248599424 >> v2:172.21.15.131:3300/0 conn(0x7f6cac06f9b0 0x7f6cac0c94f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:23.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.773+0000 7f6cb2400640 1 -- 172.21.15.63:0/3248599424 >> v1:172.21.15.131:6789/0 conn(0x7f6cac06f5d0 legacy=0x7f6cac0c47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:23.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.773+0000 7f6cb2400640 1 -- 172.21.15.63:0/3248599424 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cac0ca240 con 0x7f6cac0c69c0 2024-05-21T01:20:23.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.773+0000 7f6cb2400640 1 --2- 172.21.15.63:0/3248599424 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6cac0c69c0 0x7f6cac0c6dd0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6ca4009d90 tx=0x7f6ca401c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1018df3fe16e9aaa server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:23.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.773+0000 7f6cabe00640 1 -- 172.21.15.63:0/3248599424 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ca40b2070 con 0x7f6cac0c69c0 2024-05-21T01:20:23.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.773+0000 7f6cabe00640 1 -- 172.21.15.63:0/3248599424 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ca40a5a00 con 0x7f6cac0c69c0 2024-05-21T01:20:23.780 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.773+0000 7f6cabe00640 1 -- 172.21.15.63:0/3248599424 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ca40a5dd0 con 0x7f6cac0c69c0 2024-05-21T01:20:23.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.777+0000 7f6cb4400640 1 -- 172.21.15.63:0/3248599424 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6cac0c69c0 msgr2=0x7f6cac0c6dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:23.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.777+0000 7f6cb4400640 1 --2- 172.21.15.63:0/3248599424 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6cac0c69c0 0x7f6cac0c6dd0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6ca4009d90 tx=0x7f6ca401c940 comp rx=0 tx=0).stop 2024-05-21T01:20:23.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.777+0000 7f6cb4400640 1 -- 172.21.15.63:0/3248599424 shutdown_connections 2024-05-21T01:20:23.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.777+0000 7f6cb4400640 1 --2- 172.21.15.63:0/3248599424 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6cac0c69c0 0x7f6cac0c6dd0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:23.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.777+0000 7f6cb4400640 1 --2- 172.21.15.63:0/3248599424 >> v2:172.21.15.131:3300/0 conn(0x7f6cac06f9b0 0x7f6cac0c94f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:23.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.777+0000 7f6cb4400640 1 -- 172.21.15.63:0/3248599424 >> 172.21.15.63:0/3248599424 conn(0x7f6cac068460 msgr2=0x7f6cac068870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:23.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.777+0000 7f6cb4400640 1 -- 172.21.15.63:0/3248599424 shutdown_connections 2024-05-21T01:20:23.781 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.777+0000 7f6cb4400640 1 -- 172.21.15.63:0/3248599424 wait complete. 2024-05-21T01:20:23.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.777+0000 7f6cb4400640 1 Processor -- start 2024-05-21T01:20:23.782 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.777+0000 7f6cb4400640 1 -- start start 2024-05-21T01:20:23.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.777+0000 7f6cb4400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6cac06f5d0 0x7f6cac14f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:23.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.777+0000 7f6cb4400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6cac06f9b0 0x7f6cac141de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:23.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.777+0000 7f6cb4400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6cac0c69c0 0x7f6cac142320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:23.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.777+0000 7f6cb4400640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f6cac0c9bb0 con 0x7f6cac06f9b0 2024-05-21T01:20:23.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.777+0000 7f6cb4400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f6cac0c9a30 con 0x7f6cac0c69c0 2024-05-21T01:20:23.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.777+0000 7f6cb4400640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f6cac1541d0 con 0x7f6cac06f5d0 2024-05-21T01:20:23.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.777+0000 7f6cb1000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6cac06f9b0 0x7f6cac141de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:23.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.777+0000 7f6cb1000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6cac06f9b0 0x7f6cac141de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:49190/0 (socket says 172.21.15.63:49190) 2024-05-21T01:20:23.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.777+0000 7f6cb1000640 1 -- 172.21.15.63:0/3544013993 learned_addr learned my addr 172.21.15.63:0/3544013993 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:23.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.777+0000 7f6cb2400640 1 --2- 172.21.15.63:0/3544013993 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6cac0c69c0 0x7f6cac142320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:23.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.777+0000 7f6cb1a00640 1 --2- 172.21.15.63:0/3544013993 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6cac06f5d0 0x7f6cac14f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:23.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.777+0000 7f6cb1000640 1 -- 172.21.15.63:0/3544013993 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6cac06f5d0 msgr2=0x7f6cac14f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:23.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.777+0000 7f6cb1000640 1 --2- 172.21.15.63:0/3544013993 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6cac06f5d0 0x7f6cac14f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:23.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.777+0000 7f6cb1000640 1 -- 172.21.15.63:0/3544013993 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6cac0c69c0 msgr2=0x7f6cac142320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:23.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.777+0000 7f6cb1000640 1 --2- 172.21.15.63:0/3544013993 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6cac0c69c0 0x7f6cac142320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:23.785 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.777+0000 7f6cb1000640 1 -- 172.21.15.63:0/3544013993 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cac0718f0 con 0x7f6cac06f9b0 2024-05-21T01:20:23.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.781+0000 7f6cb1000640 1 --2- 172.21.15.63:0/3544013993 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6cac06f9b0 0x7f6cac141de0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6c9800e8c0 tx=0x7f6c9800ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:23.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.781+0000 7f6ca9600640 1 -- 172.21.15.63:0/3544013993 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c98017070 con 0x7f6cac06f9b0 2024-05-21T01:20:23.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.781+0000 7f6ca9600640 1 -- 172.21.15.63:0/3544013993 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c9800c940 con 0x7f6cac06f9b0 2024-05-21T01:20:23.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.781+0000 7f6cb4400640 1 -- 172.21.15.63:0/3544013993 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cac0727f0 con 0x7f6cac06f9b0 2024-05-21T01:20:23.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.781+0000 7f6ca9600640 1 -- 172.21.15.63:0/3544013993 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c9800cd30 con 0x7f6cac06f9b0 2024-05-21T01:20:23.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.781+0000 7f6cb4400640 1 -- 172.21.15.63:0/3544013993 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cac1f5360 con 0x7f6cac06f9b0 2024-05-21T01:20:23.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.781+0000 7f6cb4400640 1 -- 172.21.15.63:0/3544013993 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cac0507f0 con 0x7f6cac06f9b0 2024-05-21T01:20:23.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.781+0000 7f6ca9600640 1 -- 172.21.15.63:0/3544013993 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7f6c9801a070 con 0x7f6cac06f9b0 2024-05-21T01:20:23.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.781+0000 7f6ca9600640 1 --2- 172.21.15.63:0/3544013993 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f6c8c06f400 0x7f6c8c0718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:23.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.781+0000 7f6ca9600640 1 -- 172.21.15.63:0/3544013993 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f6c9808f4a0 con 0x7f6cac06f9b0 2024-05-21T01:20:23.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.781+0000 7f6cb1a00640 1 --2- 172.21.15.63:0/3544013993 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f6c8c06f400 0x7f6c8c0718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:23.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.785+0000 7f6cb1a00640 1 --2- 172.21.15.63:0/3544013993 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f6c8c06f400 0x7f6c8c0718c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6ca0007fd0 tx=0x7f6ca0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:23.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.785+0000 7f6ca9600640 1 -- 172.21.15.63:0/3544013993 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f6c9805ba40 con 0x7f6cac06f9b0 2024-05-21T01:20:23.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.953+0000 7f6cb4400640 1 -- 172.21.15.63:0/3544013993 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6cac073ee0 con 0x7f6cac06f9b0 2024-05-21T01:20:23.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.953+0000 7f6ca9600640 1 -- 172.21.15.63:0/3544013993 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18482 (secure 0 0 0) 0x7f6c9805fd40 con 0x7f6cac06f9b0 2024-05-21T01:20:23.959 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-05-21T01:20:23.959 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":25,"fsid":"9a7cbd84-ceb2-41c8-8b6e-ab931f86c51a","created":"2024-05-21T01:19:37.688082+0000","modified":"2024-05-21T01:19:58.978125+0000","last_up_change":"2024-05-21T01:19:48.472107+0000","last_in_change":"2024-05-21T01:19:39.973975+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-21T01:19:46.485266+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-21T01:19:52.032741+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-21T01:19:52.867322+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-21T01:19:56.562363+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cda28135-00bb-4194-adcb-e0abf3ae43f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":3740454920},{"type":"v1","addr":"172.21.15.63:6801","nonce":3740454920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":3740454920},{"type":"v1","addr":"172.21.15.63:6804","nonce":3740454920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":3740454920},{"type":"v1","addr":"172.21.15.63:6812","nonce":3740454920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":3740454920},{"type":"v1","addr":"172.21.15.63:6808","nonce":3740454920}]},"public_addr":"172.21.15.63:6801/3740454920","cluster_addr":"172.21.15.63:6804/3740454920","heartbeat_back_addr":"172.21.15.63:6812/3740454920","heartbeat_front_addr":"172.21.15.63:6808/3740454920","state":["exists","up"]},{"osd":1,"uuid":"4aeb370d-ec2f-4a91-b17b-035fd72bdaea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6803","nonce":896993303},{"type":"v1","addr":"172.21.15.63:6805","nonce":896993303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6807","nonce":896993303},{"type":"v1","addr":"172.21.15.63:6809","nonce":896993303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":896993303},{"type":"v1","addr":"172.21.15.63:6816","nonce":896993303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6811","nonce":896993303},{"type":"v1","addr":"172.21.15.63:6813","nonce":896993303}]},"public_addr":"172.21.15.63:6805/896993303","cluster_addr":"172.21.15.63:6809/896993303","heartbeat_back_addr":"172.21.15.63:6816/896993303","heartbeat_front_addr":"172.21.15.63:6813/896993303","state":["exists","up"]},{"osd":2,"uuid":"8368b112-35a3-43cf-ad1c-803f05708091","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":845807419},{"type":"v1","addr":"172.21.15.63:6817","nonce":845807419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":845807419},{"type":"v1","addr":"172.21.15.63:6819","nonce":845807419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":845807419},{"type":"v1","addr":"172.21.15.63:6823","nonce":845807419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":845807419},{"type":"v1","addr":"172.21.15.63:6821","nonce":845807419}]},"public_addr":"172.21.15.63:6817/845807419","cluster_addr":"172.21.15.63:6819/845807419","heartbeat_back_addr":"172.21.15.63:6823/845807419","heartbeat_front_addr":"172.21.15.63:6821/845807419","state":["exists","up"]},{"osd":3,"uuid":"26208950-e3ca-4b9a-94cd-c159453a5dfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":521563809},{"type":"v1","addr":"172.21.15.63:6825","nonce":521563809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":521563809},{"type":"v1","addr":"172.21.15.63:6827","nonce":521563809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":521563809},{"type":"v1","addr":"172.21.15.63:6831","nonce":521563809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":521563809},{"type":"v1","addr":"172.21.15.63:6829","nonce":521563809}]},"public_addr":"172.21.15.63:6825/521563809","cluster_addr":"172.21.15.63:6827/521563809","heartbeat_back_addr":"172.21.15.63:6831/521563809","heartbeat_front_addr":"172.21.15.63:6829/521563809","state":["exists","up"]},{"osd":4,"uuid":"d8c93283-1e10-4419-9934-d5048c5d0ad1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":2660673588},{"type":"v1","addr":"172.21.15.131:6801","nonce":2660673588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":2660673588},{"type":"v1","addr":"172.21.15.131:6803","nonce":2660673588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":2660673588},{"type":"v1","addr":"172.21.15.131:6807","nonce":2660673588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":2660673588},{"type":"v1","addr":"172.21.15.131:6805","nonce":2660673588}]},"public_addr":"172.21.15.131:6801/2660673588","cluster_addr":"172.21.15.131:6803/2660673588","heartbeat_back_addr":"172.21.15.131:6807/2660673588","heartbeat_front_addr":"172.21.15.131:6805/2660673588","state":["exists","up"]},{"osd":5,"uuid":"93a6fe9b-eaa6-4474-bf9b-ae0571feacf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6809","nonce":2508702891},{"type":"v1","addr":"172.21.15.131:6811","nonce":2508702891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6813","nonce":2508702891},{"type":"v1","addr":"172.21.15.131:6815","nonce":2508702891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6821","nonce":2508702891},{"type":"v1","addr":"172.21.15.131:6823","nonce":2508702891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6817","nonce":2508702891},{"type":"v1","addr":"172.21.15.131:6819","nonce":2508702891}]},"public_addr":"172.21.15.131:6811/2508702891","cluster_addr":"172.21.15.131:6815/2508702891","heartbeat_back_addr":"172.21.15.131:6823/2508702891","heartbeat_front_addr":"172.21.15.131:6819/2508702891","state":["exists","up"]},{"osd":6,"uuid":"e05e6c8c-2dda-49ab-8116-5ea9038d0f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":614380392},{"type":"v1","addr":"172.21.15.131:6810","nonce":614380392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":614380392},{"type":"v1","addr":"172.21.15.131:6814","nonce":614380392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":614380392},{"type":"v1","addr":"172.21.15.131:6822","nonce":614380392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":614380392},{"type":"v1","addr":"172.21.15.131:6818","nonce":614380392}]},"public_addr":"172.21.15.131:6810/614380392","cluster_addr":"172.21.15.131:6814/614380392","heartbeat_back_addr":"172.21.15.131:6822/614380392","heartbeat_front_addr":"172.21.15.131:6818/614380392","state":["exists","up"]},{"osd":7,"uuid":"0b393e5e-eeef-4e32-b23a-d405a8b0e7b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":4219797450},{"type":"v1","addr":"172.21.15.131:6825","nonce":4219797450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":4219797450},{"type":"v1","addr":"172.21.15.131:6827","nonce":4219797450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":4219797450},{"type":"v1","addr":"172.21.15.131:6831","nonce":4219797450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":4219797450},{"type":"v1","addr":"172.21.15.131:6829","nonce":4219797450}]},"public_addr":"172.21.15.131:6825/4219797450","cluster_addr":"172.21.15.131:6827/4219797450","heartbeat_back_addr":"172.21.15.131:6831/4219797450","heartbeat_front_addr":"172.21.15.131:6829/4219797450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.647841+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.912560+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.684614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.936286+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.380500+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.553497+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.517866+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.310320+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-21T01:20:23.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.957+0000 7f6cb4400640 1 -- 172.21.15.63:0/3544013993 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f6c8c06f400 msgr2=0x7f6c8c0718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:23.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.957+0000 7f6cb4400640 1 --2- 172.21.15.63:0/3544013993 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f6c8c06f400 0x7f6c8c0718c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6ca0007fd0 tx=0x7f6ca0009040 comp rx=0 tx=0).stop 2024-05-21T01:20:23.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.957+0000 7f6cb4400640 1 -- 172.21.15.63:0/3544013993 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6cac06f9b0 msgr2=0x7f6cac141de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:23.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.957+0000 7f6cb4400640 1 --2- 172.21.15.63:0/3544013993 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6cac06f9b0 0x7f6cac141de0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6c9800e8c0 tx=0x7f6c9800ed80 comp rx=0 tx=0).stop 2024-05-21T01:20:23.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.957+0000 7f6cb4400640 1 -- 172.21.15.63:0/3544013993 shutdown_connections 2024-05-21T01:20:23.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.957+0000 7f6cb4400640 1 --2- 172.21.15.63:0/3544013993 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f6c8c06f400 0x7f6c8c0718c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:23.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.957+0000 7f6cb4400640 1 --2- 172.21.15.63:0/3544013993 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6cac0c69c0 0x7f6cac142320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:23.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.957+0000 7f6cb4400640 1 --2- 172.21.15.63:0/3544013993 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6cac06f9b0 0x7f6cac141de0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:23.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.957+0000 7f6cb4400640 1 --2- 172.21.15.63:0/3544013993 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6cac06f5d0 0x7f6cac14f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:23.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.957+0000 7f6cb4400640 1 -- 172.21.15.63:0/3544013993 >> 172.21.15.63:0/3544013993 conn(0x7f6cac068460 msgr2=0x7f6cac148a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:23.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.957+0000 7f6cb4400640 1 -- 172.21.15.63:0/3544013993 shutdown_connections 2024-05-21T01:20:23.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:23.957+0000 7f6cb4400640 1 -- 172.21.15.63:0/3544013993 wait complete. 2024-05-21T01:20:23.980 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-05-21T01:20:23.980 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-21T01:20:24.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.117+0000 7f30d2600640 1 Processor -- start 2024-05-21T01:20:24.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.117+0000 7f30d2600640 1 -- start start 2024-05-21T01:20:24.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.117+0000 7f30d2600640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f30cc153e80 0x7f30cc0c93f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:24.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.117+0000 7f30d2600640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f30cc06dca0 0x7f30cc0c7040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:24.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.117+0000 7f30d2600640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30cc06e1e0 con 0x7f30cc153aa0 2024-05-21T01:20:24.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.117+0000 7f30d2600640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f30cc071b40 con 0x7f30cc06dca0 2024-05-21T01:20:24.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.117+0000 7f30d2600640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f30cc071e20 con 0x7f30cc153e80 2024-05-21T01:20:24.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.117+0000 7f30d1200640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f30cc153aa0 0x7f30cc06d300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:40090/0 (socket says 172.21.15.63:40090) 2024-05-21T01:20:24.122 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.117+0000 7f30d1200640 1 -- 172.21.15.63:0/2808207234 learned_addr learned my addr 172.21.15.63:0/2808207234 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-05-21T01:20:24.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.117+0000 7f30d1c00640 1 --2- 172.21.15.63:0/2808207234 >> v2:172.21.15.63:3300/0 conn(0x7f30cc06dca0 0x7f30cc0c7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:24.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.117+0000 7f30cbe00640 1 --2- 172.21.15.63:0/2808207234 >> v2:172.21.15.131:3300/0 conn(0x7f30cc153e80 0x7f30cc0c93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:24.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.117+0000 7f30d1c00640 1 -- 172.21.15.63:0/2808207234 >> v2:172.21.15.131:3300/0 conn(0x7f30cc153e80 msgr2=0x7f30cc0c93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:24.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.117+0000 7f30d1c00640 1 --2- 172.21.15.63:0/2808207234 >> v2:172.21.15.131:3300/0 conn(0x7f30cc153e80 0x7f30cc0c93f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:24.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.117+0000 7f30d1c00640 1 -- 172.21.15.63:0/2808207234 >> v1:172.21.15.63:6789/0 conn(0x7f30cc153aa0 legacy=0x7f30cc06d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:24.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.117+0000 7f30d1c00640 1 -- 172.21.15.63:0/2808207234 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30cc0c9930 con 0x7f30cc06dca0 2024-05-21T01:20:24.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.117+0000 7f30cb400640 1 -- 172.21.15.63:0/2808207234 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1481269804 0 0) 0x7f30cc06e1e0 con 0x7f30cc153aa0 2024-05-21T01:20:24.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.121+0000 7f30d1c00640 1 --2- 172.21.15.63:0/2808207234 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f30cc06dca0 0x7f30cc0c7040 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f30cc0cb210 tx=0x7f30c401f110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3270b0f2bf203648 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:24.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.121+0000 7f30cb400640 1 -- 172.21.15.63:0/2808207234 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30c40b4070 con 0x7f30cc06dca0 2024-05-21T01:20:24.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.121+0000 7f30cb400640 1 -- 172.21.15.63:0/2808207234 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30c40af600 con 0x7f30cc06dca0 2024-05-21T01:20:24.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.121+0000 7f30cb400640 1 -- 172.21.15.63:0/2808207234 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30c40af9d0 con 0x7f30cc06dca0 2024-05-21T01:20:24.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.121+0000 7f30d2600640 1 -- 172.21.15.63:0/2808207234 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f30cc06dca0 msgr2=0x7f30cc0c7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:24.126 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.121+0000 7f30d2600640 1 --2- 172.21.15.63:0/2808207234 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f30cc06dca0 0x7f30cc0c7040 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f30cc0cb210 tx=0x7f30c401f110 comp rx=0 tx=0).stop 2024-05-21T01:20:24.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.121+0000 7f30d2600640 1 -- 172.21.15.63:0/2808207234 shutdown_connections 2024-05-21T01:20:24.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.121+0000 7f30d2600640 1 --2- 172.21.15.63:0/2808207234 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f30cc06dca0 0x7f30cc0c7040 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:24.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.121+0000 7f30d2600640 1 --2- 172.21.15.63:0/2808207234 >> v2:172.21.15.131:3300/0 conn(0x7f30cc153e80 0x7f30cc0c93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:24.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.121+0000 7f30d2600640 1 -- 172.21.15.63:0/2808207234 >> 172.21.15.63:0/2808207234 conn(0x7f30cc0ca430 msgr2=0x7f30cc0ca840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:24.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.121+0000 7f30d2600640 1 -- 172.21.15.63:0/2808207234 shutdown_connections 2024-05-21T01:20:24.127 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.121+0000 7f30d2600640 1 -- 172.21.15.63:0/2808207234 wait complete. 2024-05-21T01:20:24.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.121+0000 7f30d2600640 1 Processor -- start 2024-05-21T01:20:24.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.121+0000 7f30d2600640 1 -- start start 2024-05-21T01:20:24.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.125+0000 7f30d2600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f30cc06dca0 0x7f30cc14c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:24.129 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.125+0000 7f30d2600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f30cc153aa0 0x7f30cc0c64d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:24.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.125+0000 7f30d2600640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f30cc153e80 0x7f30cc0c6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:24.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.125+0000 7f30d2600640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f30cc072280 con 0x7f30cc153aa0 2024-05-21T01:20:24.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.125+0000 7f30d2600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f30cc072100 con 0x7f30cc06dca0 2024-05-21T01:20:24.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.125+0000 7f30d2600640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f30cc159980 con 0x7f30cc153e80 2024-05-21T01:20:24.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.125+0000 7f30cbe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f30cc153aa0 0x7f30cc0c64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:24.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.125+0000 7f30cbe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f30cc153aa0 0x7f30cc0c64d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:49206/0 (socket says 172.21.15.63:49206) 2024-05-21T01:20:24.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.125+0000 7f30cbe00640 1 -- 172.21.15.63:0/2798946725 learned_addr learned my addr 172.21.15.63:0/2798946725 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:24.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.125+0000 7f30d1200640 1 --2- 172.21.15.63:0/2798946725 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f30cc06dca0 0x7f30cc14c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:24.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.125+0000 7f30d1c00640 1 --2- 172.21.15.63:0/2798946725 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f30cc153e80 0x7f30cc0c6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:24.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.125+0000 7f30cbe00640 1 -- 172.21.15.63:0/2798946725 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f30cc153e80 msgr2=0x7f30cc0c6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:24.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.125+0000 7f30cbe00640 1 --2- 172.21.15.63:0/2798946725 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f30cc153e80 0x7f30cc0c6a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:24.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.125+0000 7f30cbe00640 1 -- 172.21.15.63:0/2798946725 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f30cc06dca0 msgr2=0x7f30cc14c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:24.130 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.125+0000 7f30cbe00640 1 --2- 172.21.15.63:0/2798946725 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f30cc06dca0 0x7f30cc14c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:24.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.125+0000 7f30cbe00640 1 -- 172.21.15.63:0/2798946725 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30cc152d60 con 0x7f30cc153aa0 2024-05-21T01:20:24.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.125+0000 7f30cbe00640 1 --2- 172.21.15.63:0/2798946725 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f30cc153aa0 0x7f30cc0c64d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f30b800d5f0 tx=0x7f30b800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:24.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.125+0000 7f30c8c00640 1 -- 172.21.15.63:0/2798946725 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30b80125f0 con 0x7f30cc153aa0 2024-05-21T01:20:24.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.125+0000 7f30c8c00640 1 -- 172.21.15.63:0/2798946725 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30b8019070 con 0x7f30cc153aa0 2024-05-21T01:20:24.131 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.125+0000 7f30c8c00640 1 -- 172.21.15.63:0/2798946725 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30b80129b0 con 0x7f30cc153aa0 2024-05-21T01:20:24.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.125+0000 7f30d2600640 1 -- 172.21.15.63:0/2798946725 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30cc1579a0 con 0x7f30cc153aa0 2024-05-21T01:20:24.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.125+0000 7f30d2600640 1 -- 172.21.15.63:0/2798946725 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30cc1532b0 con 0x7f30cc153aa0 2024-05-21T01:20:24.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.125+0000 7f30d2600640 1 -- 172.21.15.63:0/2798946725 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30cc06c0c0 con 0x7f30cc153aa0 2024-05-21T01:20:24.132 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.129+0000 7f30c8c00640 1 -- 172.21.15.63:0/2798946725 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7f30b8012b50 con 0x7f30cc153aa0 2024-05-21T01:20:24.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.129+0000 7f30c8c00640 1 --2- 172.21.15.63:0/2798946725 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f30ac06f400 0x7f30ac0718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:24.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.129+0000 7f30c8c00640 1 -- 172.21.15.63:0/2798946725 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f30b808fa00 con 0x7f30cc153aa0 2024-05-21T01:20:24.133 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.129+0000 7f30d1200640 1 --2- 172.21.15.63:0/2798946725 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f30ac06f400 0x7f30ac0718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:24.134 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.129+0000 7f30d1200640 1 --2- 172.21.15.63:0/2798946725 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f30ac06f400 0x7f30ac0718c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f30c0007fd0 tx=0x7f30c0007b20 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:24.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.133+0000 7f30c8c00640 1 -- 172.21.15.63:0/2798946725 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f30b805c640 con 0x7f30cc153aa0 2024-05-21T01:20:24.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.297+0000 7f30d2600640 1 -- 172.21.15.63:0/2798946725 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f30cc0c60f0 con 0x7f30cc153aa0 2024-05-21T01:20:24.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.301+0000 7f30c8c00640 1 -- 172.21.15.63:0/2798946725 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18482 (secure 0 0 0) 0x7f30b805bf40 con 0x7f30cc153aa0 2024-05-21T01:20:24.305 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-05-21T01:20:24.306 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":25,"fsid":"9a7cbd84-ceb2-41c8-8b6e-ab931f86c51a","created":"2024-05-21T01:19:37.688082+0000","modified":"2024-05-21T01:19:58.978125+0000","last_up_change":"2024-05-21T01:19:48.472107+0000","last_in_change":"2024-05-21T01:19:39.973975+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-21T01:19:46.485266+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-21T01:19:52.032741+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-21T01:19:52.867322+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-21T01:19:56.562363+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cda28135-00bb-4194-adcb-e0abf3ae43f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":3740454920},{"type":"v1","addr":"172.21.15.63:6801","nonce":3740454920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":3740454920},{"type":"v1","addr":"172.21.15.63:6804","nonce":3740454920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":3740454920},{"type":"v1","addr":"172.21.15.63:6812","nonce":3740454920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":3740454920},{"type":"v1","addr":"172.21.15.63:6808","nonce":3740454920}]},"public_addr":"172.21.15.63:6801/3740454920","cluster_addr":"172.21.15.63:6804/3740454920","heartbeat_back_addr":"172.21.15.63:6812/3740454920","heartbeat_front_addr":"172.21.15.63:6808/3740454920","state":["exists","up"]},{"osd":1,"uuid":"4aeb370d-ec2f-4a91-b17b-035fd72bdaea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6803","nonce":896993303},{"type":"v1","addr":"172.21.15.63:6805","nonce":896993303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6807","nonce":896993303},{"type":"v1","addr":"172.21.15.63:6809","nonce":896993303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":896993303},{"type":"v1","addr":"172.21.15.63:6816","nonce":896993303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6811","nonce":896993303},{"type":"v1","addr":"172.21.15.63:6813","nonce":896993303}]},"public_addr":"172.21.15.63:6805/896993303","cluster_addr":"172.21.15.63:6809/896993303","heartbeat_back_addr":"172.21.15.63:6816/896993303","heartbeat_front_addr":"172.21.15.63:6813/896993303","state":["exists","up"]},{"osd":2,"uuid":"8368b112-35a3-43cf-ad1c-803f05708091","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":845807419},{"type":"v1","addr":"172.21.15.63:6817","nonce":845807419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":845807419},{"type":"v1","addr":"172.21.15.63:6819","nonce":845807419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":845807419},{"type":"v1","addr":"172.21.15.63:6823","nonce":845807419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":845807419},{"type":"v1","addr":"172.21.15.63:6821","nonce":845807419}]},"public_addr":"172.21.15.63:6817/845807419","cluster_addr":"172.21.15.63:6819/845807419","heartbeat_back_addr":"172.21.15.63:6823/845807419","heartbeat_front_addr":"172.21.15.63:6821/845807419","state":["exists","up"]},{"osd":3,"uuid":"26208950-e3ca-4b9a-94cd-c159453a5dfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":521563809},{"type":"v1","addr":"172.21.15.63:6825","nonce":521563809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":521563809},{"type":"v1","addr":"172.21.15.63:6827","nonce":521563809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":521563809},{"type":"v1","addr":"172.21.15.63:6831","nonce":521563809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":521563809},{"type":"v1","addr":"172.21.15.63:6829","nonce":521563809}]},"public_addr":"172.21.15.63:6825/521563809","cluster_addr":"172.21.15.63:6827/521563809","heartbeat_back_addr":"172.21.15.63:6831/521563809","heartbeat_front_addr":"172.21.15.63:6829/521563809","state":["exists","up"]},{"osd":4,"uuid":"d8c93283-1e10-4419-9934-d5048c5d0ad1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":2660673588},{"type":"v1","addr":"172.21.15.131:6801","nonce":2660673588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":2660673588},{"type":"v1","addr":"172.21.15.131:6803","nonce":2660673588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":2660673588},{"type":"v1","addr":"172.21.15.131:6807","nonce":2660673588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":2660673588},{"type":"v1","addr":"172.21.15.131:6805","nonce":2660673588}]},"public_addr":"172.21.15.131:6801/2660673588","cluster_addr":"172.21.15.131:6803/2660673588","heartbeat_back_addr":"172.21.15.131:6807/2660673588","heartbeat_front_addr":"172.21.15.131:6805/2660673588","state":["exists","up"]},{"osd":5,"uuid":"93a6fe9b-eaa6-4474-bf9b-ae0571feacf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6809","nonce":2508702891},{"type":"v1","addr":"172.21.15.131:6811","nonce":2508702891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6813","nonce":2508702891},{"type":"v1","addr":"172.21.15.131:6815","nonce":2508702891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6821","nonce":2508702891},{"type":"v1","addr":"172.21.15.131:6823","nonce":2508702891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6817","nonce":2508702891},{"type":"v1","addr":"172.21.15.131:6819","nonce":2508702891}]},"public_addr":"172.21.15.131:6811/2508702891","cluster_addr":"172.21.15.131:6815/2508702891","heartbeat_back_addr":"172.21.15.131:6823/2508702891","heartbeat_front_addr":"172.21.15.131:6819/2508702891","state":["exists","up"]},{"osd":6,"uuid":"e05e6c8c-2dda-49ab-8116-5ea9038d0f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":614380392},{"type":"v1","addr":"172.21.15.131:6810","nonce":614380392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":614380392},{"type":"v1","addr":"172.21.15.131:6814","nonce":614380392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":614380392},{"type":"v1","addr":"172.21.15.131:6822","nonce":614380392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":614380392},{"type":"v1","addr":"172.21.15.131:6818","nonce":614380392}]},"public_addr":"172.21.15.131:6810/614380392","cluster_addr":"172.21.15.131:6814/614380392","heartbeat_back_addr":"172.21.15.131:6822/614380392","heartbeat_front_addr":"172.21.15.131:6818/614380392","state":["exists","up"]},{"osd":7,"uuid":"0b393e5e-eeef-4e32-b23a-d405a8b0e7b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":4219797450},{"type":"v1","addr":"172.21.15.131:6825","nonce":4219797450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":4219797450},{"type":"v1","addr":"172.21.15.131:6827","nonce":4219797450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":4219797450},{"type":"v1","addr":"172.21.15.131:6831","nonce":4219797450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":4219797450},{"type":"v1","addr":"172.21.15.131:6829","nonce":4219797450}]},"public_addr":"172.21.15.131:6825/4219797450","cluster_addr":"172.21.15.131:6827/4219797450","heartbeat_back_addr":"172.21.15.131:6831/4219797450","heartbeat_front_addr":"172.21.15.131:6829/4219797450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.647841+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.912560+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.684614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.936286+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.380500+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.553497+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.517866+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.310320+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-21T01:20:24.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.301+0000 7f30d2600640 1 -- 172.21.15.63:0/2798946725 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f30ac06f400 msgr2=0x7f30ac0718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:24.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.301+0000 7f30d2600640 1 --2- 172.21.15.63:0/2798946725 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f30ac06f400 0x7f30ac0718c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f30c0007fd0 tx=0x7f30c0007b20 comp rx=0 tx=0).stop 2024-05-21T01:20:24.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.301+0000 7f30d2600640 1 -- 172.21.15.63:0/2798946725 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f30cc153aa0 msgr2=0x7f30cc0c64d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:24.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.301+0000 7f30d2600640 1 --2- 172.21.15.63:0/2798946725 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f30cc153aa0 0x7f30cc0c64d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f30b800d5f0 tx=0x7f30b800dab0 comp rx=0 tx=0).stop 2024-05-21T01:20:24.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.301+0000 7f30d2600640 1 -- 172.21.15.63:0/2798946725 shutdown_connections 2024-05-21T01:20:24.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.301+0000 7f30d2600640 1 --2- 172.21.15.63:0/2798946725 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f30ac06f400 0x7f30ac0718c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:24.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.301+0000 7f30d2600640 1 --2- 172.21.15.63:0/2798946725 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f30cc153e80 0x7f30cc0c6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:24.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.301+0000 7f30d2600640 1 --2- 172.21.15.63:0/2798946725 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f30cc153aa0 0x7f30cc0c64d0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:24.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.301+0000 7f30d2600640 1 --2- 172.21.15.63:0/2798946725 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f30cc06dca0 0x7f30cc14c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:24.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.301+0000 7f30d2600640 1 -- 172.21.15.63:0/2798946725 >> 172.21.15.63:0/2798946725 conn(0x7f30cc0ca430 msgr2=0x7f30cc0c40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:24.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.301+0000 7f30d2600640 1 -- 172.21.15.63:0/2798946725 shutdown_connections 2024-05-21T01:20:24.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.301+0000 7f30d2600640 1 -- 172.21.15.63:0/2798946725 wait complete. 2024-05-21T01:20:24.327 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-05-21T01:20:24.328 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-05-21T01:20:24.328 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-05-21T01:20:24.328 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-05-21T01:20:24.329 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-05-21T01:20:24.329 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-05-21T01:20:24.330 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-05-21T01:20:24.330 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-05-21T01:20:24.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.569+0000 7f1352800640 1 Processor -- start 2024-05-21T01:20:24.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.569+0000 7f1352800640 1 -- start start 2024-05-21T01:20:24.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.569+0000 7ff5c0400640 1 Processor -- start 2024-05-21T01:20:24.575 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.569+0000 7ff5c0400640 1 -- start start 2024-05-21T01:20:24.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.569+0000 7fa067c00640 1 Processor -- start 2024-05-21T01:20:24.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.569+0000 7fa067c00640 1 -- start start 2024-05-21T01:20:24.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.573+0000 7f1352800640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f134c06c4a0 0x7f134c15a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:24.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.573+0000 7f1352800640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f134c0c9a00 con 0x7f134c06db20 2024-05-21T01:20:24.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.573+0000 7f1352800640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f134c06cfd0 con 0x7f134c0b0d20 2024-05-21T01:20:24.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.573+0000 7f1352800640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f134c06cd80 con 0x7f134c06c4a0 2024-05-21T01:20:24.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.573+0000 7f1350a00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f134c06c4a0 0x7f134c15a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:24.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.573+0000 7ff5c0400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff5b00dd4d0 0x7ff5b00e6730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:24.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.573+0000 7f1350a00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f134c06c4a0 0x7f134c15a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.63:41876/0 (socket says 172.21.15.63:41876) 2024-05-21T01:20:24.578 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.573+0000 7f1350a00640 1 -- 172.21.15.63:0/1849600938 learned_addr learned my addr 172.21.15.63:0/1849600938 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:24.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.573+0000 7f1350a00640 1 -- 172.21.15.63:0/1849600938 >> v1:172.21.15.131:6789/0 conn(0x7f134c0b0d20 legacy=0x7f134c156d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:24.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.573+0000 7f1350a00640 1 -- 172.21.15.63:0/1849600938 >> v1:172.21.15.63:6789/0 conn(0x7f134c06db20 legacy=0x7f134c06df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:24.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.573+0000 7f1350a00640 1 -- 172.21.15.63:0/1849600938 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f134c06d2b0 con 0x7f134c06c4a0 2024-05-21T01:20:24.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.573+0000 7ff5c0400640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5b0047cb0 con 0x7ff5b0048150 2024-05-21T01:20:24.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.573+0000 7ff5c0400640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5b00e33b0 con 0x7ff5b00e6c70 2024-05-21T01:20:24.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.573+0000 7ff5c0400640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7ff5b00e3ce0 con 0x7ff5b00dd4d0 2024-05-21T01:20:24.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.573+0000 7ff5bda00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff5b00dd4d0 0x7ff5b00e6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:24.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.573+0000 7ff5bda00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff5b00dd4d0 0x7ff5b00e6730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.63:51444/0 (socket says 172.21.15.63:51444) 2024-05-21T01:20:24.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.573+0000 7ff5bda00640 1 -- 172.21.15.63:0/2684936593 learned_addr learned my addr 172.21.15.63:0/2684936593 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:24.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.573+0000 7fa067c00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa058050cb0 0x7fa0580d5000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:24.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.573+0000 7fa067c00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa0580dad30 0x7fa0580db140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:24.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.573+0000 7fa05fe00640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fa05804c2e0 0x7fa0580347a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.63:42340/0 (socket says 172.21.15.63:42340) 2024-05-21T01:20:24.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.573+0000 7fa05fe00640 1 -- 172.21.15.63:0/615870924 learned_addr learned my addr 172.21.15.63:0/615870924 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-05-21T01:20:24.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.573+0000 7fa065c00640 1 --2- 172.21.15.63:0/615870924 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa0580dad30 0x7fa0580db140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:24.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.573+0000 7fa067c00640 1 -- 172.21.15.63:0/615870924 --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa05804b990 con 0x7fa05804c2e0 2024-05-21T01:20:24.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.573+0000 7fa067c00640 1 -- 172.21.15.63:0/615870924 --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7fa05804bc70 con 0x7fa058050cb0 2024-05-21T01:20:24.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.573+0000 7fa067c00640 1 -- 172.21.15.63:0/615870924 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fa058006a50 con 0x7fa0580dad30 2024-05-21T01:20:24.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.573+0000 7fa065200640 1 --2- 172.21.15.63:0/615870924 >> v2:172.21.15.63:3300/0 conn(0x7fa058050cb0 0x7fa0580d5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:24.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.573+0000 7ff5b7e00640 1 -- 172.21.15.63:0/2684936593 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1501557145 0 0) 0x7ff5b0047cb0 con 0x7ff5b0048150 2024-05-21T01:20:24.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.573+0000 7ff5b7e00640 1 -- 172.21.15.63:0/2684936593 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff5a0003530 con 0x7ff5b0048150 2024-05-21T01:20:24.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.577+0000 7ff5b7e00640 1 -- 172.21.15.63:0/2684936593 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 283468174 0 0) 0x7ff5a0003530 con 0x7ff5b0048150 2024-05-21T01:20:24.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.577+0000 7ff5b7e00640 1 -- 172.21.15.63:0/2684936593 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff5b00dd4d0 msgr2=0x7ff5b00e6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:24.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.577+0000 7ff5b7e00640 1 --2- 172.21.15.63:0/2684936593 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff5b00dd4d0 0x7ff5b00e6730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:24.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.577+0000 7ff5b7e00640 1 -- 172.21.15.63:0/2684936593 >> v1:172.21.15.131:6789/0 conn(0x7ff5b00e6c70 legacy=0x7ff5b00edac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:24.581 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.577+0000 7ff5b7e00640 1 -- 172.21.15.63:0/2684936593 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5b00e3690 con 0x7ff5b0048150 2024-05-21T01:20:24.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.577+0000 7ff5b7e00640 1 -- 172.21.15.63:0/2684936593 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 466403955 0 0) 0x7ff5a4001700 con 0x7ff5b0048150 2024-05-21T01:20:24.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.577+0000 7ff5b7e00640 1 -- 172.21.15.63:0/2684936593 >> v1:172.21.15.63:6789/0 conn(0x7ff5b0048150 legacy=0x7ff5b000c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:24.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.577+0000 7ff5b7e00640 1 --2- 172.21.15.63:0/2684936593 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff5a0003a10 0x7ff5a0003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:24.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.577+0000 7ff5b7e00640 1 --2- 172.21.15.63:0/2684936593 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff5a0004810 0x7ff5a0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:24.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.577+0000 7ff5b7e00640 1 --2- 172.21.15.63:0/2684936593 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5a0005220 0x7ff5a000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:24.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.577+0000 7ff5b7e00640 1 -- 172.21.15.63:0/2684936593 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff5b00e3ce0 con 0x7ff5a0003a10 2024-05-21T01:20:24.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.577+0000 7ff5b7e00640 1 -- 172.21.15.63:0/2684936593 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7ff5a000c100 con 0x7ff5a0005220 2024-05-21T01:20:24.582 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.577+0000 7ff5b7e00640 1 -- 172.21.15.63:0/2684936593 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7ff5a000c300 con 0x7ff5a0004810 2024-05-21T01:20:24.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.577+0000 7ff5bd000640 1 --2- 172.21.15.63:0/2684936593 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff5a0004810 0x7ff5a0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:24.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.573+0000 7fa065c00640 1 -- 172.21.15.63:0/615870924 >> v2:172.21.15.63:3300/0 conn(0x7fa058050cb0 msgr2=0x7fa0580d5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:24.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.573+0000 7fa065c00640 1 --2- 172.21.15.63:0/615870924 >> v2:172.21.15.63:3300/0 conn(0x7fa058050cb0 0x7fa0580d5000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:24.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.573+0000 7fa065c00640 1 -- 172.21.15.63:0/615870924 >> v1:172.21.15.131:6789/0 conn(0x7fa05804c2e0 legacy=0x7fa0580347a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:24.583 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.573+0000 7fa065c00640 1 -- 172.21.15.63:0/615870924 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa058006d30 con 0x7fa0580dad30 2024-05-21T01:20:24.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.577+0000 7f1350a00640 1 --2- 172.21.15.63:0/1849600938 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f134c06c4a0 0x7f134c15a770 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f134c0b0120 tx=0x7f133801ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad64012d4b855eb3 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:24.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.577+0000 7ff5bda00640 1 --2- 172.21.15.63:0/2684936593 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff5a0003a10 0x7ff5a0003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:24.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.577+0000 7ff5bda00640 1 -- 172.21.15.63:0/2684936593 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff5a0004810 msgr2=0x7ff5a0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:24.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.577+0000 7ff5bda00640 1 --2- 172.21.15.63:0/2684936593 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff5a0004810 0x7ff5a0004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:24.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.577+0000 7ff5be400640 1 --2- 172.21.15.63:0/2684936593 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5a0005220 0x7ff5a000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:24.584 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.577+0000 7ff5bda00640 1 -- 172.21.15.63:0/2684936593 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5a0005220 msgr2=0x7ff5a000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:24.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.577+0000 7ff5bda00640 1 --2- 172.21.15.63:0/2684936593 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5a0005220 0x7ff5a000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:24.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.577+0000 7ff5bda00640 1 -- 172.21.15.63:0/2684936593 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5b0047cb0 con 0x7ff5a0003a10 2024-05-21T01:20:24.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.577+0000 7ff5be400640 1 --2- 172.21.15.63:0/2684936593 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5a0005220 0x7ff5a000b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T01:20:24.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.577+0000 7f134be00640 1 -- 172.21.15.63:0/1849600938 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13380b5070 con 0x7f134c06c4a0 2024-05-21T01:20:24.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.577+0000 7f134be00640 1 -- 172.21.15.63:0/1849600938 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13380a8a10 con 0x7f134c06c4a0 2024-05-21T01:20:24.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.577+0000 7f134be00640 1 -- 172.21.15.63:0/1849600938 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13380a8de0 con 0x7f134c06c4a0 2024-05-21T01:20:24.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.581+0000 7f1352800640 1 -- 172.21.15.63:0/1849600938 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f134c06c4a0 msgr2=0x7f134c15a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:24.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.581+0000 7f1352800640 1 --2- 172.21.15.63:0/1849600938 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f134c06c4a0 0x7f134c15a770 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f134c0b0120 tx=0x7f133801ed30 comp rx=0 tx=0).stop 2024-05-21T01:20:24.585 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.581+0000 7f1352800640 1 -- 172.21.15.63:0/1849600938 shutdown_connections 2024-05-21T01:20:24.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.581+0000 7f1352800640 1 --2- 172.21.15.63:0/1849600938 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f134c06c4a0 0x7f134c15a770 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:24.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.581+0000 7f1352800640 1 -- 172.21.15.63:0/1849600938 >> 172.21.15.63:0/1849600938 conn(0x7f134c0c9c60 msgr2=0x7f134c0ca070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:24.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.581+0000 7f85e9800640 1 Processor -- start 2024-05-21T01:20:24.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.581+0000 7f85e9800640 1 -- start start 2024-05-21T01:20:24.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.581+0000 7f1352800640 1 -- 172.21.15.63:0/1849600938 shutdown_connections 2024-05-21T01:20:24.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.581+0000 7fa065c00640 1 --2- 172.21.15.63:0/615870924 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa0580dad30 0x7fa0580db140 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa0540097c0 tx=0x7fa05401c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bbb81574f633e090 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:24.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.581+0000 7f1352800640 1 -- 172.21.15.63:0/1849600938 wait complete. 2024-05-21T01:20:24.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.581+0000 7f85e9800640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f85dc0e22f0 0x7f85dc045130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:24.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.581+0000 7f85e9800640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f85dc046d30 0x7f85dc005ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:24.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.581+0000 7f85e9800640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85dc0e30c0 con 0x7f85dc0457d0 2024-05-21T01:20:24.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.581+0000 7f85e9800640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f85dc045d20 con 0x7f85dc0e22f0 2024-05-21T01:20:24.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.581+0000 7f85e9800640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f85dc050dd0 con 0x7f85dc046d30 2024-05-21T01:20:24.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.581+0000 7f85e3e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f85dc0e22f0 0x7f85dc045130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:24.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.585+0000 7ff5bda00640 1 --2- 172.21.15.63:0/2684936593 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff5a0003a10 0x7ff5a0003e50 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff5b0052da0 tx=0x7ff5ac01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9427ffedcb892850 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:24.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.585+0000 7f85e3e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f85dc0e22f0 0x7f85dc045130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:49230/0 (socket says 172.21.15.63:49230) 2024-05-21T01:20:24.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.585+0000 7f85e3e00640 1 -- 172.21.15.63:0/3495304204 learned_addr learned my addr 172.21.15.63:0/3495304204 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:24.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.585+0000 7f85e3e00640 1 -- 172.21.15.63:0/3495304204 >> v2:172.21.15.131:3300/0 conn(0x7f85dc046d30 msgr2=0x7f85dc005ea0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-21T01:20:24.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.585+0000 7f85e3e00640 1 --2- 172.21.15.63:0/3495304204 >> v2:172.21.15.131:3300/0 conn(0x7f85dc046d30 0x7f85dc005ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:24.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.585+0000 7f85e3e00640 1 -- 172.21.15.63:0/3495304204 >> v1:172.21.15.63:6789/0 conn(0x7f85dc0457d0 legacy=0x7f85dc0e26d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:24.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.585+0000 7ff5b7e00640 1 -- 172.21.15.63:0/2684936593 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5ac0b0070 con 0x7ff5a0003a10 2024-05-21T01:20:24.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.585+0000 7ff5b7e00640 1 -- 172.21.15.63:0/2684936593 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5ac0ab600 con 0x7ff5a0003a10 2024-05-21T01:20:24.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.585+0000 7ff5b7e00640 1 -- 172.21.15.63:0/2684936593 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5ac00f040 con 0x7ff5a0003a10 2024-05-21T01:20:24.590 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.585+0000 7f1352800640 1 Processor -- start 2024-05-21T01:20:24.590 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.585+0000 7f85e3e00640 1 -- 172.21.15.63:0/3495304204 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85dc045f70 con 0x7f85dc0e22f0 2024-05-21T01:20:24.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.585+0000 7fa05f400640 1 -- 172.21.15.63:0/615870924 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0540b0070 con 0x7fa0580dad30 2024-05-21T01:20:24.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.585+0000 7fa05f400640 1 -- 172.21.15.63:0/615870924 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0540ab600 con 0x7fa0580dad30 2024-05-21T01:20:24.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.585+0000 7fa05f400640 1 -- 172.21.15.63:0/615870924 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0540ab9d0 con 0x7fa0580dad30 2024-05-21T01:20:24.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.585+0000 7fdc8a600640 1 Processor -- start 2024-05-21T01:20:24.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.585+0000 7fdc8a600640 1 -- start start 2024-05-21T01:20:24.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.585+0000 7f1352800640 1 -- start start 2024-05-21T01:20:24.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.585+0000 7fa067c00640 1 -- 172.21.15.63:0/615870924 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa0580dad30 msgr2=0x7fa0580db140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:24.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.585+0000 7fa067c00640 1 --2- 172.21.15.63:0/615870924 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa0580dad30 0x7fa0580db140 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa0540097c0 tx=0x7fa05401c3c0 comp rx=0 tx=0).stop 2024-05-21T01:20:24.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.585+0000 7f5340a00640 1 Processor -- start 2024-05-21T01:20:24.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.585+0000 7fa067c00640 1 -- 172.21.15.63:0/615870924 shutdown_connections 2024-05-21T01:20:24.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.585+0000 7fa067c00640 1 --2- 172.21.15.63:0/615870924 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa0580dad30 0x7fa0580db140 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:24.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.585+0000 7fa067c00640 1 --2- 172.21.15.63:0/615870924 >> v2:172.21.15.63:3300/0 conn(0x7fa058050cb0 0x7fa0580d5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:24.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.585+0000 7fa067c00640 1 -- 172.21.15.63:0/615870924 >> 172.21.15.63:0/615870924 conn(0x7fa058050190 msgr2=0x7fa0580505a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:24.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.585+0000 7f5340a00640 1 -- start start 2024-05-21T01:20:24.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.585+0000 7fa067c00640 1 -- 172.21.15.63:0/615870924 shutdown_connections 2024-05-21T01:20:24.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.585+0000 7fa067c00640 1 -- 172.21.15.63:0/615870924 wait complete. 2024-05-21T01:20:24.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.585+0000 7f1352800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f134c06c4a0 0x7f134c1f2230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:24.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.585+0000 7f1352800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f134c06db20 0x7f134c072090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:24.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.585+0000 7f1352800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f134c0b0d20 0x7f134c0c3430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:24.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.585+0000 7f1352800640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f134c0c7b60 con 0x7f134c06db20 2024-05-21T01:20:24.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.585+0000 7f1352800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f134c0b0800 con 0x7f134c06c4a0 2024-05-21T01:20:24.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.585+0000 7f1352800640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f134c0c7ce0 con 0x7f134c0b0d20 2024-05-21T01:20:24.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.585+0000 7f1350a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f134c06db20 0x7f134c072090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:24.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.585+0000 7f1351e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f134c0b0d20 0x7f134c0c3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:24.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.585+0000 7f1350a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f134c06db20 0x7f134c072090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:49238/0 (socket says 172.21.15.63:49238) 2024-05-21T01:20:24.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.585+0000 7f1350a00640 1 -- 172.21.15.63:0/2386393716 learned_addr learned my addr 172.21.15.63:0/2386393716 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:24.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.589+0000 7f1351e00640 1 -- 172.21.15.63:0/2386393716 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f134c06c4a0 msgr2=0x7f134c1f2230 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-21T01:20:24.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.589+0000 7fdc8a600640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fdc84152070 0x7fdc840723d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:24.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.589+0000 7f1351e00640 1 --2- 172.21.15.63:0/2386393716 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f134c06c4a0 0x7f134c1f2230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:24.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.589+0000 7fdc8a600640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdc840c8850 0x7fdc84072910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:24.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.589+0000 7f1351e00640 1 -- 172.21.15.63:0/2386393716 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f134c06db20 msgr2=0x7f134c072090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:24.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.589+0000 7f1351e00640 1 --2- 172.21.15.63:0/2386393716 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f134c06db20 0x7f134c072090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:24.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.589+0000 7f1351e00640 1 -- 172.21.15.63:0/2386393716 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f134c154e80 con 0x7f134c0b0d20 2024-05-21T01:20:24.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.589+0000 7fdc83400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fdc84152070 0x7fdc840723d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:24.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.589+0000 7f1350a00640 1 --2- 172.21.15.63:0/2386393716 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f134c06db20 0x7f134c072090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T01:20:24.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.589+0000 7fdc83400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fdc84152070 0x7fdc840723d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.63:41918/0 (socket says 172.21.15.63:41918) 2024-05-21T01:20:24.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.589+0000 7fdc83400640 1 -- 172.21.15.63:0/1190816849 learned_addr learned my addr 172.21.15.63:0/1190816849 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:24.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.589+0000 7fdc8a600640 1 --2- 172.21.15.63:0/1190816849 >> v2:172.21.15.63:3300/0 conn(0x7fdc8406c4a0 0x7fdc8406c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:24.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.589+0000 7f5340a00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f533c072bd0 0x7f533c15c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:24.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.589+0000 7f5340a00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f533c15c6d0 0x7f533c15cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:24.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.589+0000 7f5340a00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f533c158a80 con 0x7f533c152cb0 2024-05-21T01:20:24.598 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.589+0000 7f5340a00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f533c158d40 con 0x7f533c15c6d0 2024-05-21T01:20:24.598 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.589+0000 7f5340a00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f533c159020 con 0x7f533c072bd0 2024-05-21T01:20:24.598 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.585+0000 7ff5c0400640 1 -- 172.21.15.63:0/2684936593 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff5a0003a10 msgr2=0x7ff5a0003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:24.598 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.585+0000 7ff5c0400640 1 --2- 172.21.15.63:0/2684936593 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff5a0003a10 0x7ff5a0003e50 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff5b0052da0 tx=0x7ff5ac01c4d0 comp rx=0 tx=0).stop 2024-05-21T01:20:24.598 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.585+0000 7ff5be400640 1 -- 172.21.15.63:0/2684936593 reap_dead start 2024-05-21T01:20:24.598 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.585+0000 7ff5c0400640 1 -- 172.21.15.63:0/2684936593 shutdown_connections 2024-05-21T01:20:24.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.585+0000 7ff5c0400640 1 -- 172.21.15.63:0/2684936593 >> 172.21.15.63:0/2684936593 conn(0x7ff5b000e8a0 msgr2=0x7ff5b00523e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:24.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.585+0000 7ff5c0400640 1 -- 172.21.15.63:0/2684936593 shutdown_connections 2024-05-21T01:20:24.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.585+0000 7ff5c0400640 1 -- 172.21.15.63:0/2684936593 wait complete. 2024-05-21T01:20:24.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.589+0000 7ff5c0400640 1 Processor -- start 2024-05-21T01:20:24.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.589+0000 7f1351e00640 1 --2- 172.21.15.63:0/2386393716 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f134c0b0d20 0x7f134c0c3430 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f134400c760 tx=0x7f134400cc20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:24.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.589+0000 7fdc8a600640 1 -- 172.21.15.63:0/1190816849 --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7fdc84158e00 con 0x7fdc8406c4a0 2024-05-21T01:20:24.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.589+0000 7fdc8a600640 1 -- 172.21.15.63:0/1190816849 --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fdc84071b00 con 0x7fdc84152070 2024-05-21T01:20:24.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.589+0000 7fdc8a600640 1 -- 172.21.15.63:0/1190816849 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fdc841581f0 con 0x7fdc840c8850 2024-05-21T01:20:24.600 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.589+0000 7f533a800640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f533c15c6d0 0x7f533c15cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:24.600 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.589+0000 7f5339400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f533c072bd0 0x7f533c15c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:24.600 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.589+0000 7f533a800640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f533c15c6d0 0x7f533c15cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:49248/0 (socket says 172.21.15.63:49248) 2024-05-21T01:20:24.600 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.589+0000 7f533a800640 1 -- 172.21.15.63:0/2284791951 learned_addr learned my addr 172.21.15.63:0/2284791951 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:24.600 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.589+0000 7ff5c0400640 1 -- start start 2024-05-21T01:20:24.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.589+0000 7f1349600640 1 -- 172.21.15.63:0/2386393716 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1344003b80 con 0x7f134c0b0d20 2024-05-21T01:20:24.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.589+0000 7f1349600640 1 -- 172.21.15.63:0/2386393716 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1344003d20 con 0x7f134c0b0d20 2024-05-21T01:20:24.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.589+0000 7ff3a4000640 1 Processor -- start 2024-05-21T01:20:24.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.589+0000 7fa067c00640 1 Processor -- start 2024-05-21T01:20:24.602 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.589+0000 7fdc83e00640 1 --2- 172.21.15.63:0/1190816849 >> v2:172.21.15.63:3300/0 conn(0x7fdc8406c4a0 0x7fdc8406c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:24.602 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.589+0000 7ff3a4000640 1 -- start start 2024-05-21T01:20:24.602 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.589+0000 7f1349600640 1 -- 172.21.15.63:0/2386393716 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13440052f0 con 0x7f134c0b0d20 2024-05-21T01:20:24.602 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.589+0000 7f1352800640 1 -- 172.21.15.63:0/2386393716 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f134c155160 con 0x7f134c0b0d20 2024-05-21T01:20:24.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.589+0000 7fa067c00640 1 -- start start 2024-05-21T01:20:24.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.589+0000 7fdc82a00640 1 --2- 172.21.15.63:0/1190816849 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdc840c8850 0x7fdc84072910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:24.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.589+0000 7fdc83400640 1 -- 172.21.15.63:0/1190816849 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdc840c8850 msgr2=0x7fdc84072910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:24.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.589+0000 7fdc83400640 1 --2- 172.21.15.63:0/1190816849 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdc840c8850 0x7fdc84072910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:24.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.589+0000 7fdc83400640 1 -- 172.21.15.63:0/1190816849 >> v2:172.21.15.63:3300/0 conn(0x7fdc8406c4a0 msgr2=0x7fdc8406c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:24.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.589+0000 7fdc83400640 1 --2- 172.21.15.63:0/1190816849 >> v2:172.21.15.63:3300/0 conn(0x7fdc8406c4a0 0x7fdc8406c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:24.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.589+0000 7fdc83400640 1 -- 172.21.15.63:0/1190816849 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc841584d0 con 0x7fdc84152070 2024-05-21T01:20:24.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.589+0000 7f1352800640 1 -- 172.21.15.63:0/2386393716 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f134c071890 con 0x7f134c0b0d20 2024-05-21T01:20:24.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.589+0000 7fdc82a00640 1 --2- 172.21.15.63:0/1190816849 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdc840c8850 0x7fdc84072910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T01:20:24.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.593+0000 7ff3a4000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff39c0c94d0 0x7ff39c158980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:24.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.593+0000 7ff3a4000640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff39c152620 con 0x7ff39c0c8340 2024-05-21T01:20:24.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.593+0000 7ff3a4000640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff39c0c8d50 con 0x7ff39c06efa0 2024-05-21T01:20:24.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.593+0000 7ff3a4000640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7ff39c0c8b00 con 0x7ff39c0c94d0 2024-05-21T01:20:24.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.593+0000 7ff5c0400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff5a0003a10 0x7ff5b0007dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:24.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.593+0000 7ff3a2000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff39c0c94d0 0x7ff39c158980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:24.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.593+0000 7ff3a2000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff39c0c94d0 0x7ff39c158980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.63:41938/0 (socket says 172.21.15.63:41938) 2024-05-21T01:20:24.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.593+0000 7ff5c0400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff5b00e5cd0 0x7ff5b00e07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:24.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.593+0000 7ff5c0400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5b00e0d20 0x7ff5b00d3280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:24.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.593+0000 7ff5c0400640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff5b00350b0 con 0x7ff5b00e5cd0 2024-05-21T01:20:24.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.593+0000 7ff5c0400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7ff5b0034f30 con 0x7ff5b00e0d20 2024-05-21T01:20:24.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.593+0000 7ff5c0400640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7ff5b000cd50 con 0x7ff5a0003a10 2024-05-21T01:20:24.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.593+0000 7ff3a2000640 1 -- 172.21.15.63:0/2880231400 learned_addr learned my addr 172.21.15.63:0/2880231400 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:24.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.593+0000 7ff5bda00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff5a0003a10 0x7ff5b0007dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:24.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.593+0000 7f5339400640 1 -- 172.21.15.63:0/2284791951 >> v2:172.21.15.63:3300/0 conn(0x7f533c15c6d0 msgr2=0x7f533c15cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:24.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.593+0000 7ff5bda00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff5a0003a10 0x7ff5b0007dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.63:51500/0 (socket says 172.21.15.63:51500) 2024-05-21T01:20:24.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.593+0000 7ff5bda00640 1 -- 172.21.15.63:0/2443326449 learned_addr learned my addr 172.21.15.63:0/2443326449 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:24.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.593+0000 7f5339400640 1 --2- 172.21.15.63:0/2284791951 >> v2:172.21.15.63:3300/0 conn(0x7f533c15c6d0 0x7f533c15cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:24.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.593+0000 7f5339400640 1 -- 172.21.15.63:0/2284791951 >> v1:172.21.15.63:6789/0 conn(0x7f533c152cb0 legacy=0x7f533c0724c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:24.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.593+0000 7f5339400640 1 -- 172.21.15.63:0/2284791951 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f533c159300 con 0x7f533c072bd0 2024-05-21T01:20:24.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.593+0000 7ff5be400640 1 --2- 172.21.15.63:0/2443326449 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5b00e0d20 0x7ff5b00d3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:24.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.593+0000 7f85e3e00640 1 --2- 172.21.15.63:0/3495304204 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85dc0e22f0 0x7f85dc045130 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f85dc04bc40 tx=0x7f85d801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e24b6f9003fb624 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:24.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.593+0000 7f85e2a00640 1 -- 172.21.15.63:0/3495304204 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85d80ab660 con 0x7f85dc0e22f0 2024-05-21T01:20:24.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.593+0000 7f85e2a00640 1 -- 172.21.15.63:0/3495304204 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85d80b0070 con 0x7f85dc0e22f0 2024-05-21T01:20:24.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.593+0000 7f85e2a00640 1 -- 172.21.15.63:0/3495304204 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85d80aba20 con 0x7f85dc0e22f0 2024-05-21T01:20:24.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.593+0000 7ff5bd000640 1 --2- 172.21.15.63:0/2443326449 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff5b00e5cd0 0x7ff5b00e07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:24.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.593+0000 7ff3a2000640 1 -- 172.21.15.63:0/2880231400 >> v1:172.21.15.131:6789/0 conn(0x7ff39c06efa0 legacy=0x7ff39c151f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:24.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.593+0000 7ff3a2000640 1 -- 172.21.15.63:0/2880231400 >> v1:172.21.15.63:6789/0 conn(0x7ff39c0c8340 legacy=0x7ff39c0cd2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:24.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.593+0000 7ff3a2000640 1 -- 172.21.15.63:0/2880231400 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff39c15b830 con 0x7ff39c0c94d0 2024-05-21T01:20:24.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.593+0000 7ff5bda00640 1 -- 172.21.15.63:0/2443326449 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5b00e0d20 msgr2=0x7ff5b00d3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:24.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.593+0000 7ff5bda00640 1 --2- 172.21.15.63:0/2443326449 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5b00e0d20 0x7ff5b00d3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:24.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.593+0000 7ff5bda00640 1 -- 172.21.15.63:0/2443326449 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff5b00e5cd0 msgr2=0x7ff5b00e07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:24.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.593+0000 7ff5bda00640 1 --2- 172.21.15.63:0/2443326449 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff5b00e5cd0 0x7ff5b00e07e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:24.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.593+0000 7ff5bda00640 1 -- 172.21.15.63:0/2443326449 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5b0184a80 con 0x7ff5a0003a10 2024-05-21T01:20:24.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.593+0000 7ff5be400640 1 --2- 172.21.15.63:0/2443326449 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5b00e0d20 0x7ff5b00d3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-21T01:20:24.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.593+0000 7f85e9800640 1 -- 172.21.15.63:0/3495304204 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85dc0e22f0 msgr2=0x7f85dc045130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:24.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.593+0000 7f85e9800640 1 --2- 172.21.15.63:0/3495304204 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85dc0e22f0 0x7f85dc045130 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f85dc04bc40 tx=0x7f85d801c480 comp rx=0 tx=0).stop 2024-05-21T01:20:24.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.593+0000 7f85e9800640 1 -- 172.21.15.63:0/3495304204 shutdown_connections 2024-05-21T01:20:24.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.593+0000 7f85e9800640 1 --2- 172.21.15.63:0/3495304204 >> v2:172.21.15.131:3300/0 conn(0x7f85dc046d30 0x7f85dc005ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:24.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.593+0000 7f85e9800640 1 --2- 172.21.15.63:0/3495304204 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85dc0e22f0 0x7f85dc045130 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:24.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.593+0000 7f85e9800640 1 -- 172.21.15.63:0/3495304204 >> 172.21.15.63:0/3495304204 conn(0x7f85dc050190 msgr2=0x7f85dc0505a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:24.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.593+0000 7f85e9800640 1 -- 172.21.15.63:0/3495304204 shutdown_connections 2024-05-21T01:20:24.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.593+0000 7ff5bda00640 1 --2- 172.21.15.63:0/2443326449 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff5a0003a10 0x7ff5b0007dd0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac01c510 tx=0x7ff5a0005840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:24.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.593+0000 7fa067c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa05804c2e0 0x7fa0580d42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:24.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.593+0000 7fa067c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa058050cb0 0x7fa0580d5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:24.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.593+0000 7fa067c00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa0580dad30 0x7fa058179290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:24.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.593+0000 7fa067c00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fa05804c750 con 0x7fa058050cb0 2024-05-21T01:20:24.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.593+0000 7fa067c00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa058045130 con 0x7fa05804c2e0 2024-05-21T01:20:24.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.593+0000 7fa067c00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fa058007530 con 0x7fa0580dad30 2024-05-21T01:20:24.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.593+0000 7fa065200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa05804c2e0 0x7fa0580d42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:24.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.593+0000 7fa065200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa05804c2e0 0x7fa0580d42a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.63:41958/0 (socket says 172.21.15.63:41958) 2024-05-21T01:20:24.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.593+0000 7fa065200640 1 -- 172.21.15.63:0/341718179 learned_addr learned my addr 172.21.15.63:0/341718179 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:24.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.593+0000 7fa065200640 1 -- 172.21.15.63:0/341718179 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa0580dad30 msgr2=0x7fa058179290 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-21T01:20:24.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.593+0000 7fa065200640 1 --2- 172.21.15.63:0/341718179 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa0580dad30 0x7fa058179290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:24.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.593+0000 7fa065200640 1 -- 172.21.15.63:0/341718179 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa058050cb0 msgr2=0x7fa0580d5ec0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-21T01:20:24.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.593+0000 7fa065200640 1 --2- 172.21.15.63:0/341718179 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa058050cb0 0x7fa0580d5ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:24.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.593+0000 7fa065200640 1 -- 172.21.15.63:0/341718179 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0580cb680 con 0x7fa05804c2e0 2024-05-21T01:20:24.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.597+0000 7fa065200640 1 --2- 172.21.15.63:0/341718179 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa05804c2e0 0x7fa0580d42a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa06006b240 tx=0x7fa060069bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:24.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.593+0000 7f85e9800640 1 -- 172.21.15.63:0/3495304204 wait complete. 2024-05-21T01:20:24.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.597+0000 7ff5b5600640 1 -- 172.21.15.63:0/2443326449 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5ac0b0030 con 0x7ff5a0003a10 2024-05-21T01:20:24.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.597+0000 7ff5b5600640 1 -- 172.21.15.63:0/2443326449 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5ac0bc070 con 0x7ff5a0003a10 2024-05-21T01:20:24.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.597+0000 7f1349600640 1 -- 172.21.15.63:0/2386393716 <== mon.2 v2:172.21.15.131:3301/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7f1344005490 con 0x7f134c0b0d20 2024-05-21T01:20:24.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.597+0000 7fa05cc00640 1 -- 172.21.15.63:0/341718179 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa06006ac70 con 0x7fa05804c2e0 2024-05-21T01:20:24.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.597+0000 7fa05cc00640 1 -- 172.21.15.63:0/341718179 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa060074d90 con 0x7fa05804c2e0 2024-05-21T01:20:24.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.597+0000 7fa05cc00640 1 -- 172.21.15.63:0/341718179 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa060075140 con 0x7fa05804c2e0 2024-05-21T01:20:24.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.597+0000 7f1352800640 1 -- 172.21.15.63:0/2386393716 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f134c06c0c0 con 0x7f134c0b0d20 2024-05-21T01:20:24.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.597+0000 7fa067c00640 1 -- 172.21.15.63:0/341718179 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0580cb960 con 0x7fa05804c2e0 2024-05-21T01:20:24.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.597+0000 7ff5b5600640 1 -- 172.21.15.63:0/2443326449 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5ac0b6620 con 0x7ff5a0003a10 2024-05-21T01:20:24.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.597+0000 7ff5c0400640 1 -- 172.21.15.63:0/2443326449 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5b00ddf50 con 0x7ff5a0003a10 2024-05-21T01:20:24.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.597+0000 7ff5c0400640 1 -- 172.21.15.63:0/2443326449 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5b0184d00 con 0x7ff5a0003a10 2024-05-21T01:20:24.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.597+0000 7ff5c0400640 1 -- 172.21.15.63:0/2443326449 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff5b0005820 con 0x7ff5a0003a10 2024-05-21T01:20:24.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.597+0000 7fa067c00640 1 -- 172.21.15.63:0/341718179 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa05817cd30 con 0x7fa05804c2e0 2024-05-21T01:20:24.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.597+0000 7ff3a2000640 1 --2- 172.21.15.63:0/2880231400 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff39c0c94d0 0x7ff39c158980 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff39c068f80 tx=0x7ff39401c540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5775cb5d0f1ec031 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:24.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.597+0000 7fdc83400640 1 --2- 172.21.15.63:0/1190816849 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc84152070 0x7fdc840723d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fdc840c8820 tx=0x7fdc7c01fa80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de9ca9fc04488bad server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:24.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.597+0000 7f85e9800640 1 Processor -- start 2024-05-21T01:20:24.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.597+0000 7f1349600640 1 --2- 172.21.15.63:0/2386393716 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f132c06f450 0x7f132c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:24.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.597+0000 7f5339400640 1 --2- 172.21.15.63:0/2284791951 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f533c072bd0 0x7f533c15c190 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f533c0cbd70 tx=0x7f532c01ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=64bb82d9122a8d4c server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:24.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.597+0000 7f85e9800640 1 -- start start 2024-05-21T01:20:24.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.597+0000 7f1349600640 1 -- 172.21.15.63:0/2386393716 <== mon.2 v2:172.21.15.131:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f134408f4e0 con 0x7f134c0b0d20 2024-05-21T01:20:24.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.597+0000 7fa067c00640 1 -- 172.21.15.63:0/341718179 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa0580053a0 con 0x7fa05804c2e0 2024-05-21T01:20:24.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.597+0000 7f1351400640 1 --2- 172.21.15.63:0/2386393716 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f132c06f450 0x7f132c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:24.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.597+0000 7f1349600640 1 --2- 172.21.15.63:0/2386393716 >> [v2:172.21.15.63:6800/3740454920,v1:172.21.15.63:6801/3740454920] conn(0x7f132c078bc0 0x7f132c07b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:24.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.597+0000 7f1349600640 1 -- 172.21.15.63:0/2386393716 --> [v2:172.21.15.63:6800/3740454920,v1:172.21.15.63:6801/3740454920] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1344009eb0 con 0x7f132c078bc0 2024-05-21T01:20:24.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.597+0000 7f1349600640 1 -- 172.21.15.63:0/2386393716 <== mon.2 v2:172.21.15.131:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1344096050 con 0x7f134c0b0d20 2024-05-21T01:20:24.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.597+0000 7fdc82000640 1 -- 172.21.15.63:0/1190816849 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc7c0a9630 con 0x7fdc84152070 2024-05-21T01:20:24.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.597+0000 7f5338a00640 1 -- 172.21.15.63:0/2284791951 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f532c0b5070 con 0x7f533c072bd0 2024-05-21T01:20:24.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.597+0000 7f85e9800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85dc0457d0 0x7f85dc047eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:24.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.597+0000 7f85e9800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f85dc046d30 0x7f85dc17b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:24.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.597+0000 7fdc82000640 1 -- 172.21.15.63:0/1190816849 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc7c0a97d0 con 0x7fdc84152070 2024-05-21T01:20:24.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.597+0000 7fdc82000640 1 -- 172.21.15.63:0/1190816849 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc7c0a9ba0 con 0x7fdc84152070 2024-05-21T01:20:24.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.597+0000 7f85e9800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f85dc0e22f0 0x7f85dc0d6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:24.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.597+0000 7f85e9800640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f85dc0e2de0 con 0x7f85dc0457d0 2024-05-21T01:20:24.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.597+0000 7f85e9800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f85dc0063e0 con 0x7f85dc0e22f0 2024-05-21T01:20:24.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.597+0000 7f85e9800640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f85dc0d9260 con 0x7f85dc046d30 2024-05-21T01:20:24.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.597+0000 7f1350a00640 1 --2- 172.21.15.63:0/2386393716 >> [v2:172.21.15.63:6800/3740454920,v1:172.21.15.63:6801/3740454920] conn(0x7f132c078bc0 0x7f132c07b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:24.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.601+0000 7f85e3400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f85dc046d30 0x7f85dc17b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:24.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.601+0000 7f85e3400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f85dc046d30 0x7f85dc17b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.63:51514/0 (socket says 172.21.15.63:51514) 2024-05-21T01:20:24.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.601+0000 7f85e3400640 1 -- 172.21.15.63:0/4222507295 learned_addr learned my addr 172.21.15.63:0/4222507295 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:24.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.601+0000 7f1351400640 1 --2- 172.21.15.63:0/2386393716 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f132c06f450 0x7f132c071910 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1340003c80 tx=0x7f13400079c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:24.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.601+0000 7f5338a00640 1 -- 172.21.15.63:0/2284791951 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f532c0a8970 con 0x7f533c072bd0 2024-05-21T01:20:24.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.601+0000 7f5338a00640 1 -- 172.21.15.63:0/2284791951 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f532c0b5070 con 0x7f533c072bd0 2024-05-21T01:20:24.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.601+0000 7f85e8e00640 1 --2- 172.21.15.63:0/4222507295 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f85dc0e22f0 0x7f85dc0d6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:24.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.601+0000 7f85e3400640 1 -- 172.21.15.63:0/4222507295 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f85dc0e22f0 msgr2=0x7f85dc0d6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:24.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.601+0000 7f85e3400640 1 --2- 172.21.15.63:0/4222507295 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f85dc0e22f0 0x7f85dc0d6010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:24.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.601+0000 7f1350a00640 1 --2- 172.21.15.63:0/2386393716 >> [v2:172.21.15.63:6800/3740454920,v1:172.21.15.63:6801/3740454920] conn(0x7f132c078bc0 0x7f132c07b000 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:24.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.601+0000 7f85e3e00640 1 --2- 172.21.15.63:0/4222507295 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85dc0457d0 0x7f85dc047eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:24.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.601+0000 7f85e3400640 1 -- 172.21.15.63:0/4222507295 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85dc0457d0 msgr2=0x7f85dc047eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:24.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.601+0000 7f85e3400640 1 --2- 172.21.15.63:0/4222507295 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85dc0457d0 0x7f85dc047eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:24.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.601+0000 7ff39be00640 1 -- 172.21.15.63:0/2880231400 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3940b0070 con 0x7ff39c0c94d0 2024-05-21T01:20:24.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.601+0000 7ff39be00640 1 -- 172.21.15.63:0/2880231400 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3940ab600 con 0x7ff39c0c94d0 2024-05-21T01:20:24.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.601+0000 7f85e3400640 1 -- 172.21.15.63:0/4222507295 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85dc17b740 con 0x7f85dc046d30 2024-05-21T01:20:24.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.601+0000 7f85e3e00640 1 --2- 172.21.15.63:0/4222507295 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85dc0457d0 0x7f85dc047eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T01:20:24.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.601+0000 7ff39be00640 1 -- 172.21.15.63:0/2880231400 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3940ab9d0 con 0x7ff39c0c94d0 2024-05-21T01:20:24.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.601+0000 7f85e3400640 1 --2- 172.21.15.63:0/4222507295 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f85dc046d30 0x7f85dc17b200 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f85d000b4a0 tx=0x7f85d000b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:24.627 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.601+0000 7ff5b5600640 1 -- 172.21.15.63:0/2443326449 <== mon.2 v2:172.21.15.131:3301/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7ff5ac0b67c0 con 0x7ff5a0003a10 2024-05-21T01:20:24.627 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.601+0000 7fdc8a600640 1 -- 172.21.15.63:0/1190816849 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc84152070 msgr2=0x7fdc840723d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:24.627 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.601+0000 7fdc8a600640 1 --2- 172.21.15.63:0/1190816849 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc84152070 0x7fdc840723d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fdc840c8820 tx=0x7fdc7c01fa80 comp rx=0 tx=0).stop 2024-05-21T01:20:24.627 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.601+0000 7f85d7e00640 1 -- 172.21.15.63:0/4222507295 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85d0014070 con 0x7f85dc046d30 2024-05-21T01:20:24.627 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.601+0000 7f85d7e00640 1 -- 172.21.15.63:0/4222507295 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85d0010610 con 0x7f85dc046d30 2024-05-21T01:20:24.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.601+0000 7f85d7e00640 1 -- 172.21.15.63:0/4222507295 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85d00109e0 con 0x7f85dc046d30 2024-05-21T01:20:24.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.601+0000 7f85e9800640 1 -- 172.21.15.63:0/4222507295 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85dc0d9d70 con 0x7f85dc046d30 2024-05-21T01:20:24.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.601+0000 7f5340a00640 1 -- 172.21.15.63:0/2284791951 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f533c072bd0 msgr2=0x7f533c15c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:24.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.601+0000 7f5340a00640 1 --2- 172.21.15.63:0/2284791951 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f533c072bd0 0x7f533c15c190 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f533c0cbd70 tx=0x7f532c01ecb0 comp rx=0 tx=0).stop 2024-05-21T01:20:24.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.601+0000 7f85e9800640 1 -- 172.21.15.63:0/4222507295 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f85dc0da330 con 0x7f85dc046d30 2024-05-21T01:20:24.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.601+0000 7f5340a00640 1 -- 172.21.15.63:0/2284791951 shutdown_connections 2024-05-21T01:20:24.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.601+0000 7f5340a00640 1 --2- 172.21.15.63:0/2284791951 >> v2:172.21.15.63:3300/0 conn(0x7f533c15c6d0 0x7f533c15cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:24.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.601+0000 7f5340a00640 1 --2- 172.21.15.63:0/2284791951 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f533c072bd0 0x7f533c15c190 secure :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f533c0cbd70 tx=0x7f532c01ecb0 comp rx=0 tx=0).stop 2024-05-21T01:20:24.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.601+0000 7f5340a00640 1 -- 172.21.15.63:0/2284791951 >> 172.21.15.63:0/2284791951 conn(0x7f533c0cb390 msgr2=0x7f533c0ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:24.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.601+0000 7ff5b5600640 1 --2- 172.21.15.63:0/2443326449 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7ff59806f450 0x7ff598071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:24.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.601+0000 7ff5b5600640 1 -- 172.21.15.63:0/2443326449 <== mon.2 v2:172.21.15.131:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7ff5ac129f30 con 0x7ff5a0003a10 2024-05-21T01:20:24.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.601+0000 7f1349600640 1 -- 172.21.15.63:0/2386393716 <== osd.0 v2:172.21.15.63:6800/3740454920 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1344009eb0 con 0x7f132c078bc0 2024-05-21T01:20:24.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.601+0000 7ff5b5600640 1 --2- 172.21.15.63:0/2443326449 >> [v2:172.21.15.63:6815/845807419,v1:172.21.15.63:6817/845807419] conn(0x7ff598078bc0 0x7ff59807b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:24.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.601+0000 7ff3a4000640 1 -- 172.21.15.63:0/2880231400 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff39c0c94d0 msgr2=0x7ff39c158980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:24.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.601+0000 7ff3a4000640 1 --2- 172.21.15.63:0/2880231400 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff39c0c94d0 0x7ff39c158980 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff39c068f80 tx=0x7ff39401c540 comp rx=0 tx=0).stop 2024-05-21T01:20:24.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.601+0000 7f5340a00640 1 -- 172.21.15.63:0/2284791951 shutdown_connections 2024-05-21T01:20:24.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.601+0000 7f85e9800640 1 -- 172.21.15.63:0/4222507295 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f85dc04b8d0 con 0x7f85dc046d30 2024-05-21T01:20:24.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.601+0000 7ff3a4000640 1 -- 172.21.15.63:0/2880231400 shutdown_connections 2024-05-21T01:20:24.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.601+0000 7ff3a4000640 1 --2- 172.21.15.63:0/2880231400 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff39c0c94d0 0x7ff39c158980 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:24.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.601+0000 7ff3a4000640 1 -- 172.21.15.63:0/2880231400 >> 172.21.15.63:0/2880231400 conn(0x7ff39c068460 msgr2=0x7ff39c068870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:24.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.601+0000 7f5340a00640 1 -- 172.21.15.63:0/2284791951 wait complete. 2024-05-21T01:20:24.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.601+0000 7ff3a4000640 1 -- 172.21.15.63:0/2880231400 shutdown_connections 2024-05-21T01:20:24.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.601+0000 7fa05cc00640 1 -- 172.21.15.63:0/341718179 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7fa06006d620 con 0x7fa05804c2e0 2024-05-21T01:20:24.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.601+0000 7ff5bd000640 1 --2- 172.21.15.63:0/2443326449 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7ff59806f450 0x7ff598071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:24.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.605+0000 7ff5b5600640 1 -- 172.21.15.63:0/2443326449 --> [v2:172.21.15.63:6815/845807419,v1:172.21.15.63:6817/845807419] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff5ac0caec0 con 0x7ff598078bc0 2024-05-21T01:20:24.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.605+0000 7ff5b5600640 1 -- 172.21.15.63:0/2443326449 <== mon.2 v2:172.21.15.131:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff5ac12a410 con 0x7ff5a0003a10 2024-05-21T01:20:24.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.605+0000 7ff5be400640 1 --2- 172.21.15.63:0/2443326449 >> [v2:172.21.15.63:6815/845807419,v1:172.21.15.63:6817/845807419] conn(0x7ff598078bc0 0x7ff59807b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:24.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.605+0000 7ff3a4000640 1 -- 172.21.15.63:0/2880231400 wait complete. 2024-05-21T01:20:24.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.601+0000 7fdc8a600640 1 -- 172.21.15.63:0/1190816849 shutdown_connections 2024-05-21T01:20:24.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.601+0000 7fdc8a600640 1 --2- 172.21.15.63:0/1190816849 >> v2:172.21.15.63:3300/0 conn(0x7fdc8406c4a0 0x7fdc8406c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:24.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.605+0000 7fdc8a600640 1 --2- 172.21.15.63:0/1190816849 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdc840c8850 0x7fdc84072910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:24.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.605+0000 7fdc8a600640 1 --2- 172.21.15.63:0/1190816849 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc84152070 0x7fdc840723d0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:24.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.605+0000 7fdc8a600640 1 -- 172.21.15.63:0/1190816849 >> 172.21.15.63:0/1190816849 conn(0x7fdc84068890 msgr2=0x7fdc8406f3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:24.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.605+0000 7f888a200640 1 Processor -- start 2024-05-21T01:20:24.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.605+0000 7f888a200640 1 -- start start 2024-05-21T01:20:24.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.605+0000 7ff5bd000640 1 --2- 172.21.15.63:0/2443326449 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7ff59806f450 0x7ff598071910 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4000c10 tx=0x7ff5a4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:24.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.605+0000 7ff5be400640 1 --2- 172.21.15.63:0/2443326449 >> [v2:172.21.15.63:6815/845807419,v1:172.21.15.63:6817/845807419] conn(0x7ff598078bc0 0x7ff59807b000 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:24.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.605+0000 7ff3a4000640 1 Processor -- start 2024-05-21T01:20:24.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.605+0000 7ff3a4000640 1 -- start start 2024-05-21T01:20:24.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.605+0000 7fdc8a600640 1 -- 172.21.15.63:0/1190816849 shutdown_connections 2024-05-21T01:20:24.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.605+0000 7f888a200640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f888406f5d0 0x7f88840c47f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:24.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.605+0000 7f888a200640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88840c4d30 con 0x7f888406f9b0 2024-05-21T01:20:24.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.605+0000 7f888a200640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88840c4fc0 con 0x7f88840c69c0 2024-05-21T01:20:24.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.605+0000 7f888a200640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f88840c52a0 con 0x7f888406f5d0 2024-05-21T01:20:24.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.605+0000 7f8883400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f888406f5d0 0x7f88840c47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:24.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.605+0000 7f8883400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f888406f5d0 0x7f88840c47f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.63:41970/0 (socket says 172.21.15.63:41970) 2024-05-21T01:20:24.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.605+0000 7f8883400640 1 -- 172.21.15.63:0/1154833739 learned_addr learned my addr 172.21.15.63:0/1154833739 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:24.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.605+0000 7f5340a00640 1 Processor -- start 2024-05-21T01:20:24.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.605+0000 7ff3a4000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff39c06efa0 0x7ff39c148590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:24.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.605+0000 7ff3a4000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff39c0c8340 0x7ff39c0c5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:24.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.605+0000 7ff3a4000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff39c0c94d0 0x7ff39c1f6900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:24.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.605+0000 7f5340a00640 1 -- start start 2024-05-21T01:20:24.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.605+0000 7ff3a4000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff39c0cde00 con 0x7ff39c0c8340 2024-05-21T01:20:24.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.605+0000 7ff3a4000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7ff39c15bba0 con 0x7ff39c0c94d0 2024-05-21T01:20:24.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.605+0000 7ff3a4000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7ff39c16a7f0 con 0x7ff39c06efa0 2024-05-21T01:20:24.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.609+0000 7f8882000640 1 -- 172.21.15.63:0/1154833739 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 450192921 0 0) 0x7f88840c4fc0 con 0x7f88840c69c0 2024-05-21T01:20:24.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.609+0000 7fa05cc00640 1 --2- 172.21.15.63:0/341718179 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fa04006f450 0x7fa040071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:24.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.609+0000 7f8882000640 1 -- 172.21.15.63:0/1154833739 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8868003530 con 0x7f88840c69c0 2024-05-21T01:20:24.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.605+0000 7ff3a1600640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff39c06efa0 0x7ff39c148590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:24.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.605+0000 7ff3a1600640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff39c06efa0 0x7ff39c148590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.63:51528/0 (socket says 172.21.15.63:51528) 2024-05-21T01:20:24.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.605+0000 7ff3a1600640 1 -- 172.21.15.63:0/987025783 learned_addr learned my addr 172.21.15.63:0/987025783 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:24.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.609+0000 7ff3a0c00640 1 --2- 172.21.15.63:0/987025783 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff39c0c8340 0x7ff39c0c5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:24.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.609+0000 7ff3a2000640 1 --2- 172.21.15.63:0/987025783 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff39c0c94d0 0x7ff39c1f6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:24.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.609+0000 7f5340a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f533c152cb0 0x7f533c13d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:24.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.609+0000 7ff3a2000640 1 -- 172.21.15.63:0/987025783 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff39c06efa0 msgr2=0x7ff39c148590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:24.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.609+0000 7ff3a2000640 1 --2- 172.21.15.63:0/987025783 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff39c06efa0 0x7ff39c148590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:24.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.609+0000 7ff3a2000640 1 -- 172.21.15.63:0/987025783 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff39c0c8340 msgr2=0x7ff39c0c5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:24.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.609+0000 7ff3a2000640 1 --2- 172.21.15.63:0/987025783 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff39c0c8340 0x7ff39c0c5eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:24.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.609+0000 7ff3a2000640 1 -- 172.21.15.63:0/987025783 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff39c148ad0 con 0x7ff39c0c94d0 2024-05-21T01:20:24.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.605+0000 7fdc8a600640 1 -- 172.21.15.63:0/1190816849 wait complete. 2024-05-21T01:20:24.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.609+0000 7f5340a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f533c15c6d0 0x7f533c13ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:24.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.609+0000 7fdc8a600640 1 Processor -- start 2024-05-21T01:20:24.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.605+0000 7f85d7e00640 1 -- 172.21.15.63:0/4222507295 <== mon.2 v2:172.21.15.131:3301/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7f85d0017070 con 0x7f85dc046d30 2024-05-21T01:20:24.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.609+0000 7ff5b5600640 1 -- 172.21.15.63:0/2443326449 <== osd.2 v2:172.21.15.63:6815/845807419 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff5ac0caec0 con 0x7ff598078bc0 2024-05-21T01:20:24.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.609+0000 7f5340a00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f533c139000 0x7f533c13f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:24.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.609+0000 7fdc8a600640 1 -- start start 2024-05-21T01:20:24.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.609+0000 7f85d7e00640 1 --2- 172.21.15.63:0/4222507295 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f85c406f430 0x7f85c40718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:24.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.609+0000 7f5340a00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f533c153210 con 0x7f533c152cb0 2024-05-21T01:20:24.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.609+0000 7f5339400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f533c15c6d0 0x7f533c13ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:24.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.609+0000 7f5339400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f533c15c6d0 0x7f533c13ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.63:41984/0 (socket says 172.21.15.63:41984) 2024-05-21T01:20:24.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.609+0000 7f5339400640 1 -- 172.21.15.63:0/3806979399 learned_addr learned my addr 172.21.15.63:0/3806979399 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:24.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.609+0000 7f533a800640 1 --2- 172.21.15.63:0/3806979399 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f533c139000 0x7f533c13f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:24.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.609+0000 7f5340a00640 1 -- 172.21.15.63:0/3806979399 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f533c153090 con 0x7f533c15c6d0 2024-05-21T01:20:24.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.609+0000 7f5340a00640 1 -- 172.21.15.63:0/3806979399 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f533c06c4a0 con 0x7f533c139000 2024-05-21T01:20:24.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.609+0000 7f85d7e00640 1 -- 172.21.15.63:0/4222507295 <== mon.2 v2:172.21.15.131:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f85d008f4b0 con 0x7f85dc046d30 2024-05-21T01:20:24.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.609+0000 7f85e3e00640 1 --2- 172.21.15.63:0/4222507295 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f85c406f430 0x7f85c40718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:24.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.609+0000 7ff3a2000640 1 --2- 172.21.15.63:0/987025783 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff39c0c94d0 0x7ff39c1f6900 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff3940ab000 tx=0x7ff39401ad80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:24.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.609+0000 7f85d7e00640 1 --2- 172.21.15.63:0/4222507295 >> [v2:172.21.15.63:6824/521563809,v1:172.21.15.63:6825/521563809] conn(0x7f85c4078ba0 0x7f85c407afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:24.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.609+0000 7f85d7e00640 1 -- 172.21.15.63:0/4222507295 --> [v2:172.21.15.63:6824/521563809,v1:172.21.15.63:6825/521563809] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f85c407b6b0 con 0x7f85c4078ba0 2024-05-21T01:20:24.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.609+0000 7f85d7e00640 1 -- 172.21.15.63:0/4222507295 <== mon.2 v2:172.21.15.131:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f85d008f8a0 con 0x7f85dc046d30 2024-05-21T01:20:24.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.609+0000 7f8883400640 1 -- 172.21.15.63:0/1154833739 >> v1:172.21.15.131:6789/0 conn(0x7f88840c69c0 legacy=0x7f88840c6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:24.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.609+0000 7f8883400640 1 -- 172.21.15.63:0/1154833739 >> v1:172.21.15.63:6789/0 conn(0x7f888406f9b0 legacy=0x7f88840c94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:24.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.609+0000 7f8883400640 1 -- 172.21.15.63:0/1154833739 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88840734d0 con 0x7f888406f5d0 2024-05-21T01:20:24.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.609+0000 7f5339e00640 1 --2- 172.21.15.63:0/3806979399 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f533c152cb0 0x7f533c13d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:24.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.609+0000 7f85e8e00640 1 --2- 172.21.15.63:0/4222507295 >> [v2:172.21.15.63:6824/521563809,v1:172.21.15.63:6825/521563809] conn(0x7f85c4078ba0 0x7f85c407afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:24.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.609+0000 7f533a800640 1 -- 172.21.15.63:0/3806979399 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f533c15c6d0 msgr2=0x7f533c13ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:24.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.609+0000 7f533a800640 1 --2- 172.21.15.63:0/3806979399 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f533c15c6d0 0x7f533c13ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:24.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.609+0000 7f533a800640 1 -- 172.21.15.63:0/3806979399 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f533c152cb0 msgr2=0x7f533c13d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:24.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.609+0000 7f533a800640 1 --2- 172.21.15.63:0/3806979399 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f533c152cb0 0x7f533c13d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:24.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.609+0000 7f533a800640 1 -- 172.21.15.63:0/3806979399 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f533c159ce0 con 0x7f533c139000 2024-05-21T01:20:24.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.609+0000 7f5339400640 1 --2- 172.21.15.63:0/3806979399 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f533c15c6d0 0x7f533c13ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-21T01:20:24.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.609+0000 7ff399600640 1 -- 172.21.15.63:0/987025783 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3940b0040 con 0x7ff39c0c94d0 2024-05-21T01:20:24.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.609+0000 7ff399600640 1 -- 172.21.15.63:0/987025783 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3940bc070 con 0x7ff39c0c94d0 2024-05-21T01:20:24.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.609+0000 7ff399600640 1 -- 172.21.15.63:0/987025783 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3940b6880 con 0x7ff39c0c94d0 2024-05-21T01:20:24.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.609+0000 7f5339e00640 1 --2- 172.21.15.63:0/3806979399 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f533c152cb0 0x7f533c13d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T01:20:24.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.609+0000 7ff3a4000640 1 -- 172.21.15.63:0/987025783 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff39c0cc5f0 con 0x7ff39c0c94d0 2024-05-21T01:20:24.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.613+0000 7f533a800640 1 --2- 172.21.15.63:0/3806979399 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f533c139000 0x7f533c13f4a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f533400ebd0 tx=0x7f533400c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:24.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.613+0000 7f85e3e00640 1 --2- 172.21.15.63:0/4222507295 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f85c406f430 0x7f85c40718f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f85d80af000 tx=0x7f85d8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:24.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.613+0000 7ff3a4000640 1 -- 172.21.15.63:0/987025783 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff39c147070 con 0x7ff39c0c94d0 2024-05-21T01:20:24.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.613+0000 7fdc8a600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdc8406c4a0 0x7fdc840cdc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:24.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.609+0000 7fa05cc00640 1 -- 172.21.15.63:0/341718179 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fa06010c4c0 con 0x7fa05804c2e0 2024-05-21T01:20:24.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.613+0000 7fa05cc00640 1 --2- 172.21.15.63:0/341718179 >> [v2:172.21.15.63:6803/896993303,v1:172.21.15.63:6805/896993303] conn(0x7fa040078bd0 0x7fa04007b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:24.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.609+0000 7fa05fe00640 1 --2- 172.21.15.63:0/341718179 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fa04006f450 0x7fa040071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:24.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.613+0000 7fdc8a600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc840c8850 0x7fdc841f1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:24.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.613+0000 7fdc8a600640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdc84152070 0x7fdc840cb720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:24.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.613+0000 7fa05cc00640 1 -- 172.21.15.63:0/341718179 --> [v2:172.21.15.63:6803/896993303,v1:172.21.15.63:6805/896993303] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa060071e50 con 0x7fa040078bd0 2024-05-21T01:20:24.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.613+0000 7fa05cc00640 1 -- 172.21.15.63:0/341718179 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa06010c870 con 0x7fa05804c2e0 2024-05-21T01:20:24.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.613+0000 7fdc8a600640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fdc840717f0 con 0x7fdc8406c4a0 2024-05-21T01:20:24.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.613+0000 7fdc8a600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fdc84158a90 con 0x7fdc840c8850 2024-05-21T01:20:24.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.613+0000 7fdc8a600640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fdc84157ea0 con 0x7fdc84152070 2024-05-21T01:20:24.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.613+0000 7fdc82a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc840c8850 0x7fdc841f1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:24.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.613+0000 7fdc82a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc840c8850 0x7fdc841f1fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.63:41996/0 (socket says 172.21.15.63:41996) 2024-05-21T01:20:24.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.613+0000 7fdc82a00640 1 -- 172.21.15.63:0/2904919576 learned_addr learned my addr 172.21.15.63:0/2904919576 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:24.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.613+0000 7f5332000640 1 -- 172.21.15.63:0/3806979399 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f533400cb20 con 0x7f533c139000 2024-05-21T01:20:24.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.613+0000 7f5332000640 1 -- 172.21.15.63:0/3806979399 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f533400ccc0 con 0x7f533c139000 2024-05-21T01:20:24.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.613+0000 7f5332000640 1 -- 172.21.15.63:0/3806979399 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5334003bc0 con 0x7f533c139000 2024-05-21T01:20:24.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.613+0000 7f5340a00640 1 -- 172.21.15.63:0/3806979399 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f533c159f50 con 0x7f533c139000 2024-05-21T01:20:24.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.613+0000 7f5340a00640 1 -- 172.21.15.63:0/3806979399 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f533c0c76f0 con 0x7f533c139000 2024-05-21T01:20:24.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.613+0000 7fa065c00640 1 --2- 172.21.15.63:0/341718179 >> [v2:172.21.15.63:6803/896993303,v1:172.21.15.63:6805/896993303] conn(0x7fa040078bd0 0x7fa04007b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:24.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.613+0000 7fdc83e00640 1 --2- 172.21.15.63:0/2904919576 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdc84152070 0x7fdc840cb720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:24.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.613+0000 7fdc83400640 1 --2- 172.21.15.63:0/2904919576 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdc8406c4a0 0x7fdc840cdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:24.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.613+0000 7fa05fe00640 1 --2- 172.21.15.63:0/341718179 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fa04006f450 0x7fa040071910 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa04c008c90 tx=0x7fa04c0089c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:24.654 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.613+0000 7fdc82a00640 1 -- 172.21.15.63:0/2904919576 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdc84152070 msgr2=0x7fdc840cb720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:24.654 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.613+0000 7fdc82a00640 1 --2- 172.21.15.63:0/2904919576 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdc84152070 0x7fdc840cb720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:24.654 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.613+0000 7fdc82a00640 1 -- 172.21.15.63:0/2904919576 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdc8406c4a0 msgr2=0x7fdc840cdc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:24.654 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.613+0000 7fdc82a00640 1 --2- 172.21.15.63:0/2904919576 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdc8406c4a0 0x7fdc840cdc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:24.654 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.613+0000 7fdc82a00640 1 -- 172.21.15.63:0/2904919576 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc842017b0 con 0x7fdc840c8850 2024-05-21T01:20:24.654 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.613+0000 7fdc82a00640 1 --2- 172.21.15.63:0/2904919576 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc840c8850 0x7fdc841f1fe0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fdc7000c7c0 tx=0x7fdc7000cc80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:24.654 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.613+0000 7f5340a00640 1 -- 172.21.15.63:0/3806979399 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f533c0c6640 con 0x7f533c139000 2024-05-21T01:20:24.655 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.613+0000 7f85e8e00640 1 --2- 172.21.15.63:0/4222507295 >> [v2:172.21.15.63:6824/521563809,v1:172.21.15.63:6825/521563809] conn(0x7f85c4078ba0 0x7f85c407afe0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:24.655 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.613+0000 7fdc7b400640 1 -- 172.21.15.63:0/2904919576 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc70007a30 con 0x7fdc840c8850 2024-05-21T01:20:24.655 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.613+0000 7fdc7b400640 1 -- 172.21.15.63:0/2904919576 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc70007bd0 con 0x7fdc840c8850 2024-05-21T01:20:24.655 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.613+0000 7fdc7b400640 1 -- 172.21.15.63:0/2904919576 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc700113f0 con 0x7fdc840c8850 2024-05-21T01:20:24.655 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.613+0000 7fdc8a600640 1 -- 172.21.15.63:0/2904919576 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc84201a90 con 0x7fdc840c8850 2024-05-21T01:20:24.656 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.613+0000 7f8883400640 1 --2- 172.21.15.63:0/1154833739 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f888406f5d0 0x7f88840c47f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f88740098a0 tx=0x7f887401c540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eacbe54135444ac4 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:24.656 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.613+0000 7fa065c00640 1 --2- 172.21.15.63:0/341718179 >> [v2:172.21.15.63:6803/896993303,v1:172.21.15.63:6805/896993303] conn(0x7fa040078bd0 0x7fa04007b010 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:24.656 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.613+0000 7fdc8a600640 1 -- 172.21.15.63:0/2904919576 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc84202050 con 0x7fdc840c8850 2024-05-21T01:20:24.656 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.613+0000 7f8882000640 1 -- 172.21.15.63:0/1154833739 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88740ab430 con 0x7f888406f5d0 2024-05-21T01:20:24.657 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.613+0000 7f8882000640 1 -- 172.21.15.63:0/1154833739 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88740b0070 con 0x7f888406f5d0 2024-05-21T01:20:24.657 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.613+0000 7f8882000640 1 -- 172.21.15.63:0/1154833739 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88740ab7f0 con 0x7f888406f5d0 2024-05-21T01:20:24.657 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.617+0000 7ff399600640 1 -- 172.21.15.63:0/987025783 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7ff3940b6a20 con 0x7ff39c0c94d0 2024-05-21T01:20:24.657 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.617+0000 7f888a200640 1 -- 172.21.15.63:0/1154833739 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f888406f5d0 msgr2=0x7f88840c47f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:24.657 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.617+0000 7f888a200640 1 --2- 172.21.15.63:0/1154833739 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f888406f5d0 0x7f88840c47f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f88740098a0 tx=0x7f887401c540 comp rx=0 tx=0).stop 2024-05-21T01:20:24.657 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.617+0000 7f888a200640 1 -- 172.21.15.63:0/1154833739 shutdown_connections 2024-05-21T01:20:24.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.617+0000 7f888a200640 1 --2- 172.21.15.63:0/1154833739 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f888406f5d0 0x7f88840c47f0 secure :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f88740098a0 tx=0x7f887401c540 comp rx=0 tx=0).stop 2024-05-21T01:20:24.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.617+0000 7f888a200640 1 -- 172.21.15.63:0/1154833739 >> 172.21.15.63:0/1154833739 conn(0x7f8884068460 msgr2=0x7f8884068870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:24.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.617+0000 7f5332000640 1 -- 172.21.15.63:0/3806979399 <== mon.2 v2:172.21.15.131:3301/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7f5334012050 con 0x7f533c139000 2024-05-21T01:20:24.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.617+0000 7f85d7e00640 1 -- 172.21.15.63:0/4222507295 <== osd.3 v2:172.21.15.63:6824/521563809 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f85c407b6b0 con 0x7f85c4078ba0 2024-05-21T01:20:24.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.617+0000 7f888a200640 1 -- 172.21.15.63:0/1154833739 shutdown_connections 2024-05-21T01:20:24.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.617+0000 7fa05cc00640 1 -- 172.21.15.63:0/341718179 <== osd.1 v2:172.21.15.63:6803/896993303 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa060071e50 con 0x7fa040078bd0 2024-05-21T01:20:24.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.617+0000 7fdc8a600640 1 -- 172.21.15.63:0/2904919576 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdc84201560 con 0x7fdc840c8850 2024-05-21T01:20:24.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.617+0000 7f5332000640 1 --2- 172.21.15.63:0/3806979399 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f531c06f450 0x7f531c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:24.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.617+0000 7f5332000640 1 -- 172.21.15.63:0/3806979399 <== mon.2 v2:172.21.15.131:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f533408f9d0 con 0x7f533c139000 2024-05-21T01:20:24.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.617+0000 7ff38aa00640 1 -- 172.21.15.63:0/987025783 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff39c0507f0 con 0x7ff39c0c94d0 2024-05-21T01:20:24.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.617+0000 7ff399600640 1 --2- 172.21.15.63:0/987025783 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7ff38006f430 0x7ff3800718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:24.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.617+0000 7ff399600640 1 -- 172.21.15.63:0/987025783 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7ff3941298f0 con 0x7ff39c0c94d0 2024-05-21T01:20:24.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.617+0000 7ff399600640 1 --2- 172.21.15.63:0/987025783 >> [v2:172.21.15.131:6824/4219797450,v1:172.21.15.131:6825/4219797450] conn(0x7ff380078b30 0x7ff38007af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:24.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.617+0000 7ff399600640 1 -- 172.21.15.63:0/987025783 --> [v2:172.21.15.131:6824/4219797450,v1:172.21.15.131:6825/4219797450] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff3940c3e70 con 0x7ff380078b30 2024-05-21T01:20:24.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.617+0000 7f888a200640 1 -- 172.21.15.63:0/1154833739 wait complete. 2024-05-21T01:20:24.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.617+0000 7f5339e00640 1 --2- 172.21.15.63:0/3806979399 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f531c06f450 0x7f531c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:24.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.617+0000 7f5332000640 1 --2- 172.21.15.63:0/3806979399 >> [v2:172.21.15.131:6809/2508702891,v1:172.21.15.131:6811/2508702891] conn(0x7f531c078bc0 0x7f531c07b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:24.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.617+0000 7f5332000640 1 -- 172.21.15.63:0/3806979399 --> [v2:172.21.15.131:6809/2508702891,v1:172.21.15.131:6811/2508702891] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f533401ae70 con 0x7f531c078bc0 2024-05-21T01:20:24.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.617+0000 7f5332000640 1 -- 172.21.15.63:0/3806979399 <== mon.2 v2:172.21.15.131:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f53340942a0 con 0x7f533c139000 2024-05-21T01:20:24.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.617+0000 7ff3a1600640 1 --2- 172.21.15.63:0/987025783 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7ff38006f430 0x7ff3800718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:24.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.617+0000 7f5339400640 1 --2- 172.21.15.63:0/3806979399 >> [v2:172.21.15.131:6809/2508702891,v1:172.21.15.131:6811/2508702891] conn(0x7f531c078bc0 0x7f531c07b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:24.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.617+0000 7ff399600640 1 -- 172.21.15.63:0/987025783 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff394127e60 con 0x7ff39c0c94d0 2024-05-21T01:20:24.662 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.617+0000 7f888a200640 1 Processor -- start 2024-05-21T01:20:24.662 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.617+0000 7ff3a0c00640 1 --2- 172.21.15.63:0/987025783 >> [v2:172.21.15.131:6824/4219797450,v1:172.21.15.131:6825/4219797450] conn(0x7ff380078b30 0x7ff38007af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:24.662 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.621+0000 7f5339e00640 1 --2- 172.21.15.63:0/3806979399 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f531c06f450 0x7f531c071910 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5328000f70 tx=0x7f5328009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:24.663 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.621+0000 7fdc7b400640 1 -- 172.21.15.63:0/2904919576 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7fdc70011590 con 0x7fdc840c8850 2024-05-21T01:20:24.663 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.621+0000 7f888a200640 1 -- start start 2024-05-21T01:20:24.663 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.621+0000 7f5339400640 1 --2- 172.21.15.63:0/3806979399 >> [v2:172.21.15.131:6809/2508702891,v1:172.21.15.131:6811/2508702891] conn(0x7f531c078bc0 0x7f531c07b000 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:24.663 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.621+0000 7ff3a0c00640 1 --2- 172.21.15.63:0/987025783 >> [v2:172.21.15.131:6824/4219797450,v1:172.21.15.131:6825/4219797450] conn(0x7ff380078b30 0x7ff38007af70 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:24.664 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.621+0000 7fdc7b400640 1 --2- 172.21.15.63:0/2904919576 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fdc6406f500 0x7fdc640719c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:24.664 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.621+0000 7fdc7b400640 1 -- 172.21.15.63:0/2904919576 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fdc7008f740 con 0x7fdc840c8850 2024-05-21T01:20:24.664 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.621+0000 7fdc7b400640 1 --2- 172.21.15.63:0/2904919576 >> [v2:172.21.15.131:6800/2660673588,v1:172.21.15.131:6801/2660673588] conn(0x7fdc64078bf0 0x7fdc6407b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:24.664 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.621+0000 7fdc83400640 1 --2- 172.21.15.63:0/2904919576 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fdc6406f500 0x7fdc640719c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:24.664 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.621+0000 7fdc7b400640 1 -- 172.21.15.63:0/2904919576 --> [v2:172.21.15.131:6800/2660673588,v1:172.21.15.131:6801/2660673588] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdc6407b700 con 0x7fdc64078bf0 2024-05-21T01:20:24.664 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.621+0000 7fdc7b400640 1 -- 172.21.15.63:0/2904919576 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fdc70096050 con 0x7fdc840c8850 2024-05-21T01:20:24.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.621+0000 7f888a200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f888406f9b0 0x7f888415a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:24.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.621+0000 7fdc83e00640 1 --2- 172.21.15.63:0/2904919576 >> [v2:172.21.15.131:6800/2660673588,v1:172.21.15.131:6801/2660673588] conn(0x7fdc64078bf0 0x7fdc6407b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:24.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.621+0000 7f888a200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f88840c69c0 0x7f8884148720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:24.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.621+0000 7f888a200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f88841f6290 0x7f88841f6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:24.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.621+0000 7f8883400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f888406f9b0 0x7f888415a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:24.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.621+0000 7f888a200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f88841541d0 con 0x7f888406f9b0 2024-05-21T01:20:24.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.621+0000 7f888a200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f88840caae0 con 0x7f88840c69c0 2024-05-21T01:20:24.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.621+0000 7f8883400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f888406f9b0 0x7f888415a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:49302/0 (socket says 172.21.15.63:49302) 2024-05-21T01:20:24.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.621+0000 7f8883400640 1 -- 172.21.15.63:0/3994996906 learned_addr learned my addr 172.21.15.63:0/3994996906 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:24.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.621+0000 7f888a200640 1 -- 172.21.15.63:0/3994996906 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f8884154350 con 0x7f88841f6290 2024-05-21T01:20:24.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.621+0000 7fdc83400640 1 --2- 172.21.15.63:0/2904919576 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fdc6406f500 0x7fdc640719c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c0b2000 tx=0x7fdc7c00b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:24.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.621+0000 7f5332000640 1 -- 172.21.15.63:0/3806979399 <== osd.5 v2:172.21.15.131:6809/2508702891 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f533401ae70 con 0x7f531c078bc0 2024-05-21T01:20:24.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.621+0000 7f8882a00640 1 --2- 172.21.15.63:0/3994996906 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f88840c69c0 0x7f8884148720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:24.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.621+0000 7f8883e00640 1 --2- 172.21.15.63:0/3994996906 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f88841f6290 0x7f88841f6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:24.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.621+0000 7ff399600640 1 -- 172.21.15.63:0/987025783 <== osd.7 v2:172.21.15.131:6824/4219797450 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff3940c3e70 con 0x7ff380078b30 2024-05-21T01:20:24.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.621+0000 7fdc83e00640 1 --2- 172.21.15.63:0/2904919576 >> [v2:172.21.15.131:6800/2660673588,v1:172.21.15.131:6801/2660673588] conn(0x7fdc64078bf0 0x7fdc6407b030 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:24.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.625+0000 7ff3a1600640 1 --2- 172.21.15.63:0/987025783 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7ff38006f430 0x7ff3800718f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff3900050b0 tx=0x7ff390003700 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:24.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.625+0000 7f8883e00640 1 -- 172.21.15.63:0/3994996906 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f88840c69c0 msgr2=0x7f8884148720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:24.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.625+0000 7f8883e00640 1 --2- 172.21.15.63:0/3994996906 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f88840c69c0 0x7f8884148720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:24.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.625+0000 7f8883e00640 1 -- 172.21.15.63:0/3994996906 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f888406f9b0 msgr2=0x7f888415a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:24.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.625+0000 7f8883e00640 1 --2- 172.21.15.63:0/3994996906 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f888406f9b0 0x7f888415a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:24.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.625+0000 7f8883e00640 1 -- 172.21.15.63:0/3994996906 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88841f6c50 con 0x7f88841f6290 2024-05-21T01:20:24.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.625+0000 7f8883e00640 1 --2- 172.21.15.63:0/3994996906 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f88841f6290 0x7f88841f6710 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f887c00c7e0 tx=0x7f887c00cca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:24.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.625+0000 7fdc7b400640 1 -- 172.21.15.63:0/2904919576 <== osd.4 v2:172.21.15.131:6800/2660673588 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdc6407b700 con 0x7fdc64078bf0 2024-05-21T01:20:24.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.625+0000 7f887b400640 1 -- 172.21.15.63:0/3994996906 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f887c016020 con 0x7f88841f6290 2024-05-21T01:20:24.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.625+0000 7f887b400640 1 -- 172.21.15.63:0/3994996906 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f887c00aa70 con 0x7f88841f6290 2024-05-21T01:20:24.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.625+0000 7f887b400640 1 -- 172.21.15.63:0/3994996906 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f887c00ae60 con 0x7f88841f6290 2024-05-21T01:20:24.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.629+0000 7f888a200640 1 -- 172.21.15.63:0/3994996906 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8884158440 con 0x7f88841f6290 2024-05-21T01:20:24.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.629+0000 7f888a200640 1 -- 172.21.15.63:0/3994996906 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f88841586e0 con 0x7f88841f6290 2024-05-21T01:20:24.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.633+0000 7f887b400640 1 -- 172.21.15.63:0/3994996906 <== mon.2 v2:172.21.15.131:3301/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7f887c019020 con 0x7f88841f6290 2024-05-21T01:20:24.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.633+0000 7f888a200640 1 -- 172.21.15.63:0/3994996906 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f88841f5e70 con 0x7f88841f6290 2024-05-21T01:20:24.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.633+0000 7f887b400640 1 --2- 172.21.15.63:0/3994996906 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f886406f400 0x7f88640718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:24.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.633+0000 7f887b400640 1 -- 172.21.15.63:0/3994996906 <== mon.2 v2:172.21.15.131:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f887c08f680 con 0x7f88841f6290 2024-05-21T01:20:24.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.633+0000 7f8883400640 1 --2- 172.21.15.63:0/3994996906 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f886406f400 0x7f88640718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:24.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.637+0000 7f887b400640 1 --2- 172.21.15.63:0/3994996906 >> [v2:172.21.15.131:6808/614380392,v1:172.21.15.131:6810/614380392] conn(0x7f8864078a70 0x7f886407aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:24.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.637+0000 7f8883400640 1 --2- 172.21.15.63:0/3994996906 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f886406f400 0x7f88640718c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8874000c10 tx=0x7f8874008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:24.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.637+0000 7f887b400640 1 -- 172.21.15.63:0/3994996906 --> [v2:172.21.15.131:6808/614380392,v1:172.21.15.131:6810/614380392] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f886407b580 con 0x7f8864078a70 2024-05-21T01:20:24.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.637+0000 7f887b400640 1 -- 172.21.15.63:0/3994996906 <== mon.2 v2:172.21.15.131:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f887c096050 con 0x7f88841f6290 2024-05-21T01:20:24.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.637+0000 7f8882a00640 1 --2- 172.21.15.63:0/3994996906 >> [v2:172.21.15.131:6808/614380392,v1:172.21.15.131:6810/614380392] conn(0x7f8864078a70 0x7f886407aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:24.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.637+0000 7f1352800640 1 -- 172.21.15.63:0/2386393716 --> [v2:172.21.15.63:6800/3740454920,v1:172.21.15.63:6801/3740454920] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f134c0b1f20 con 0x7f132c078bc0 2024-05-21T01:20:24.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.637+0000 7f8882a00640 1 --2- 172.21.15.63:0/3994996906 >> [v2:172.21.15.131:6808/614380392,v1:172.21.15.131:6810/614380392] conn(0x7f8864078a70 0x7f886407aeb0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:24.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.637+0000 7fa067c00640 1 -- 172.21.15.63:0/341718179 --> [v2:172.21.15.63:6803/896993303,v1:172.21.15.63:6805/896993303] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa058032e70 con 0x7fa040078bd0 2024-05-21T01:20:24.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.637+0000 7f1349600640 1 -- 172.21.15.63:0/2386393716 <== osd.0 v2:172.21.15.63:6800/3740454920 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f134c0b1f20 con 0x7f132c078bc0 2024-05-21T01:20:24.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.637+0000 7f887b400640 1 -- 172.21.15.63:0/3994996906 <== osd.6 v2:172.21.15.131:6808/614380392 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f886407b580 con 0x7f8864078a70 2024-05-21T01:20:24.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.637+0000 7fa05cc00640 1 -- 172.21.15.63:0/341718179 <== osd.1 v2:172.21.15.63:6803/896993303 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fa058032e70 con 0x7fa040078bd0 2024-05-21T01:20:24.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.641+0000 7f1352800640 1 -- 172.21.15.63:0/2386393716 >> [v2:172.21.15.63:6800/3740454920,v1:172.21.15.63:6801/3740454920] conn(0x7f132c078bc0 msgr2=0x7f132c07b000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:24.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.641+0000 7f1352800640 1 --2- 172.21.15.63:0/2386393716 >> [v2:172.21.15.63:6800/3740454920,v1:172.21.15.63:6801/3740454920] conn(0x7f132c078bc0 0x7f132c07b000 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:24.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.641+0000 7f1352800640 1 -- 172.21.15.63:0/2386393716 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f132c06f450 msgr2=0x7f132c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:24.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.641+0000 7f1352800640 1 --2- 172.21.15.63:0/2386393716 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f132c06f450 0x7f132c071910 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1340003c80 tx=0x7f13400079c0 comp rx=0 tx=0).stop 2024-05-21T01:20:24.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.641+0000 7f1352800640 1 -- 172.21.15.63:0/2386393716 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f134c0b0d20 msgr2=0x7f134c0c3430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:24.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.641+0000 7f1352800640 1 --2- 172.21.15.63:0/2386393716 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f134c0b0d20 0x7f134c0c3430 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f134400c760 tx=0x7f134400cc20 comp rx=0 tx=0).stop 2024-05-21T01:20:24.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.641+0000 7f1351e00640 1 -- 172.21.15.63:0/2386393716 reap_dead start 2024-05-21T01:20:24.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.641+0000 7f1352800640 1 -- 172.21.15.63:0/2386393716 shutdown_connections 2024-05-21T01:20:24.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.641+0000 7f1352800640 1 -- 172.21.15.63:0/2386393716 >> 172.21.15.63:0/2386393716 conn(0x7f134c0c9c60 msgr2=0x7f134c0c7e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:24.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.641+0000 7f1352800640 1 -- 172.21.15.63:0/2386393716 shutdown_connections 2024-05-21T01:20:24.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.641+0000 7f1352800640 1 -- 172.21.15.63:0/2386393716 wait complete. 2024-05-21T01:20:24.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.641+0000 7fa067c00640 1 -- 172.21.15.63:0/341718179 >> [v2:172.21.15.63:6803/896993303,v1:172.21.15.63:6805/896993303] conn(0x7fa040078bd0 msgr2=0x7fa04007b010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:24.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.641+0000 7fa067c00640 1 --2- 172.21.15.63:0/341718179 >> [v2:172.21.15.63:6803/896993303,v1:172.21.15.63:6805/896993303] conn(0x7fa040078bd0 0x7fa04007b010 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:24.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.645+0000 7ff5c0400640 1 -- 172.21.15.63:0/2443326449 --> [v2:172.21.15.63:6815/845807419,v1:172.21.15.63:6817/845807419] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff5b004c810 con 0x7ff598078bc0 2024-05-21T01:20:24.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.645+0000 7ff5b5600640 1 -- 172.21.15.63:0/2443326449 <== osd.2 v2:172.21.15.63:6815/845807419 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff5b004c810 con 0x7ff598078bc0 2024-05-21T01:20:24.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.645+0000 7fa067c00640 1 -- 172.21.15.63:0/341718179 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fa04006f450 msgr2=0x7fa040071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:24.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.645+0000 7fa067c00640 1 --2- 172.21.15.63:0/341718179 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fa04006f450 0x7fa040071910 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa04c008c90 tx=0x7fa04c0089c0 comp rx=0 tx=0).stop 2024-05-21T01:20:24.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.645+0000 7fa067c00640 1 -- 172.21.15.63:0/341718179 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa05804c2e0 msgr2=0x7fa0580d42a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:24.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.645+0000 7fa067c00640 1 --2- 172.21.15.63:0/341718179 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa05804c2e0 0x7fa0580d42a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa06006b240 tx=0x7fa060069bd0 comp rx=0 tx=0).stop 2024-05-21T01:20:24.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.645+0000 7fa065c00640 1 -- 172.21.15.63:0/341718179 reap_dead start 2024-05-21T01:20:24.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.649+0000 7fa067c00640 1 -- 172.21.15.63:0/341718179 shutdown_connections 2024-05-21T01:20:24.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.649+0000 7fa067c00640 1 -- 172.21.15.63:0/341718179 >> 172.21.15.63:0/341718179 conn(0x7fa058050190 msgr2=0x7fa058045520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:24.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.649+0000 7fa067c00640 1 -- 172.21.15.63:0/341718179 shutdown_connections 2024-05-21T01:20:24.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.649+0000 7fa067c00640 1 -- 172.21.15.63:0/341718179 wait complete. 2024-05-21T01:20:24.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.649+0000 7ff5c0400640 1 -- 172.21.15.63:0/2443326449 >> [v2:172.21.15.63:6815/845807419,v1:172.21.15.63:6817/845807419] conn(0x7ff598078bc0 msgr2=0x7ff59807b000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:24.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.649+0000 7ff5c0400640 1 --2- 172.21.15.63:0/2443326449 >> [v2:172.21.15.63:6815/845807419,v1:172.21.15.63:6817/845807419] conn(0x7ff598078bc0 0x7ff59807b000 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:24.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.653+0000 7ff5c0400640 1 -- 172.21.15.63:0/2443326449 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7ff59806f450 msgr2=0x7ff598071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:24.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.653+0000 7ff5c0400640 1 --2- 172.21.15.63:0/2443326449 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7ff59806f450 0x7ff598071910 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4000c10 tx=0x7ff5a4009040 comp rx=0 tx=0).stop 2024-05-21T01:20:24.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.653+0000 7ff5c0400640 1 -- 172.21.15.63:0/2443326449 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff5a0003a10 msgr2=0x7ff5b0007dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:24.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.653+0000 7ff5c0400640 1 --2- 172.21.15.63:0/2443326449 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff5a0003a10 0x7ff5b0007dd0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac01c510 tx=0x7ff5a0005840 comp rx=0 tx=0).stop 2024-05-21T01:20:24.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.653+0000 7ff5be400640 1 -- 172.21.15.63:0/2443326449 reap_dead start 2024-05-21T01:20:24.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.653+0000 7ff5c0400640 1 -- 172.21.15.63:0/2443326449 shutdown_connections 2024-05-21T01:20:24.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.653+0000 7ff5c0400640 1 -- 172.21.15.63:0/2443326449 >> 172.21.15.63:0/2443326449 conn(0x7ff5b000e8a0 msgr2=0x7ff5b004f680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:24.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.657+0000 7ff5c0400640 1 -- 172.21.15.63:0/2443326449 shutdown_connections 2024-05-21T01:20:24.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.657+0000 7ff5c0400640 1 -- 172.21.15.63:0/2443326449 wait complete. 2024-05-21T01:20:24.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.657+0000 7f85e9800640 1 -- 172.21.15.63:0/4222507295 --> [v2:172.21.15.63:6824/521563809,v1:172.21.15.63:6825/521563809] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f85dc0e2b10 con 0x7f85c4078ba0 2024-05-21T01:20:24.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.661+0000 7f85d7e00640 1 -- 172.21.15.63:0/4222507295 <== osd.3 v2:172.21.15.63:6824/521563809 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f85dc0e2b10 con 0x7f85c4078ba0 2024-05-21T01:20:24.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.661+0000 7ff38aa00640 1 -- 172.21.15.63:0/987025783 --> [v2:172.21.15.131:6824/4219797450,v1:172.21.15.131:6825/4219797450] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff39c14fbb0 con 0x7ff380078b30 2024-05-21T01:20:24.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.661+0000 7f85e9800640 1 -- 172.21.15.63:0/4222507295 >> [v2:172.21.15.63:6824/521563809,v1:172.21.15.63:6825/521563809] conn(0x7f85c4078ba0 msgr2=0x7f85c407afe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:24.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.661+0000 7f85e9800640 1 --2- 172.21.15.63:0/4222507295 >> [v2:172.21.15.63:6824/521563809,v1:172.21.15.63:6825/521563809] conn(0x7f85c4078ba0 0x7f85c407afe0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:24.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.661+0000 7fdc8a600640 1 -- 172.21.15.63:0/2904919576 --> [v2:172.21.15.131:6800/2660673588,v1:172.21.15.131:6801/2660673588] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdc840507f0 con 0x7fdc64078bf0 2024-05-21T01:20:24.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.661+0000 7f85e9800640 1 -- 172.21.15.63:0/4222507295 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f85c406f430 msgr2=0x7f85c40718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:24.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.661+0000 7f85e9800640 1 --2- 172.21.15.63:0/4222507295 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f85c406f430 0x7f85c40718f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f85d80af000 tx=0x7f85d8008040 comp rx=0 tx=0).stop 2024-05-21T01:20:24.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.661+0000 7f85e9800640 1 -- 172.21.15.63:0/4222507295 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f85dc046d30 msgr2=0x7f85dc17b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:24.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.661+0000 7f85e9800640 1 --2- 172.21.15.63:0/4222507295 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f85dc046d30 0x7f85dc17b200 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f85d000b4a0 tx=0x7f85d000b960 comp rx=0 tx=0).stop 2024-05-21T01:20:24.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.661+0000 7f85e8e00640 1 -- 172.21.15.63:0/4222507295 reap_dead start 2024-05-21T01:20:24.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.661+0000 7fdc7b400640 1 -- 172.21.15.63:0/2904919576 <== osd.4 v2:172.21.15.131:6800/2660673588 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fdc840507f0 con 0x7fdc64078bf0 2024-05-21T01:20:24.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.661+0000 7f85e9800640 1 -- 172.21.15.63:0/4222507295 shutdown_connections 2024-05-21T01:20:24.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.661+0000 7f85e9800640 1 -- 172.21.15.63:0/4222507295 >> 172.21.15.63:0/4222507295 conn(0x7f85dc050190 msgr2=0x7f85dc006de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:24.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.661+0000 7f85e9800640 1 -- 172.21.15.63:0/4222507295 shutdown_connections 2024-05-21T01:20:24.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.661+0000 7ff399600640 1 -- 172.21.15.63:0/987025783 <== osd.7 v2:172.21.15.131:6824/4219797450 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff39c14fbb0 con 0x7ff380078b30 2024-05-21T01:20:24.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.661+0000 7f85e9800640 1 -- 172.21.15.63:0/4222507295 wait complete. 2024-05-21T01:20:24.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.661+0000 7f5340a00640 1 -- 172.21.15.63:0/3806979399 --> [v2:172.21.15.131:6809/2508702891,v1:172.21.15.131:6811/2508702891] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f533c06c0c0 con 0x7f531c078bc0 2024-05-21T01:20:24.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.661+0000 7ff38aa00640 1 -- 172.21.15.63:0/987025783 >> [v2:172.21.15.131:6824/4219797450,v1:172.21.15.131:6825/4219797450] conn(0x7ff380078b30 msgr2=0x7ff38007af70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:24.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.661+0000 7ff38aa00640 1 --2- 172.21.15.63:0/987025783 >> [v2:172.21.15.131:6824/4219797450,v1:172.21.15.131:6825/4219797450] conn(0x7ff380078b30 0x7ff38007af70 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:24.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.665+0000 7f5332000640 1 -- 172.21.15.63:0/3806979399 <== osd.5 v2:172.21.15.131:6809/2508702891 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f533c06c0c0 con 0x7f531c078bc0 2024-05-21T01:20:24.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.665+0000 7ff38aa00640 1 -- 172.21.15.63:0/987025783 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7ff38006f430 msgr2=0x7ff3800718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:24.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.665+0000 7ff38aa00640 1 --2- 172.21.15.63:0/987025783 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7ff38006f430 0x7ff3800718f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff3900050b0 tx=0x7ff390003700 comp rx=0 tx=0).stop 2024-05-21T01:20:24.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.665+0000 7ff38aa00640 1 -- 172.21.15.63:0/987025783 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff39c0c94d0 msgr2=0x7ff39c1f6900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:24.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.665+0000 7ff38aa00640 1 --2- 172.21.15.63:0/987025783 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff39c0c94d0 0x7ff39c1f6900 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff3940ab000 tx=0x7ff39401ad80 comp rx=0 tx=0).stop 2024-05-21T01:20:24.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.665+0000 7ff3a2000640 1 -- 172.21.15.63:0/987025783 reap_dead start 2024-05-21T01:20:24.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.665+0000 7fdc8a600640 1 -- 172.21.15.63:0/2904919576 >> [v2:172.21.15.131:6800/2660673588,v1:172.21.15.131:6801/2660673588] conn(0x7fdc64078bf0 msgr2=0x7fdc6407b030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:24.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.665+0000 7fdc8a600640 1 --2- 172.21.15.63:0/2904919576 >> [v2:172.21.15.131:6800/2660673588,v1:172.21.15.131:6801/2660673588] conn(0x7fdc64078bf0 0x7fdc6407b030 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:24.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.665+0000 7ff38aa00640 1 -- 172.21.15.63:0/987025783 shutdown_connections 2024-05-21T01:20:24.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.665+0000 7fdc8a600640 1 -- 172.21.15.63:0/2904919576 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fdc6406f500 msgr2=0x7fdc640719c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:24.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.665+0000 7fdc8a600640 1 --2- 172.21.15.63:0/2904919576 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fdc6406f500 0x7fdc640719c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c0b2000 tx=0x7fdc7c00b040 comp rx=0 tx=0).stop 2024-05-21T01:20:24.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.665+0000 7fdc8a600640 1 -- 172.21.15.63:0/2904919576 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc840c8850 msgr2=0x7fdc841f1fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:24.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.665+0000 7fdc8a600640 1 --2- 172.21.15.63:0/2904919576 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc840c8850 0x7fdc841f1fe0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fdc7000c7c0 tx=0x7fdc7000cc80 comp rx=0 tx=0).stop 2024-05-21T01:20:24.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.665+0000 7ff38aa00640 1 -- 172.21.15.63:0/987025783 >> 172.21.15.63:0/987025783 conn(0x7ff39c068460 msgr2=0x7ff39c0c6d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:24.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.665+0000 7fdc83e00640 1 -- 172.21.15.63:0/2904919576 reap_dead start 2024-05-21T01:20:24.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.665+0000 7f5340a00640 1 -- 172.21.15.63:0/3806979399 >> [v2:172.21.15.131:6809/2508702891,v1:172.21.15.131:6811/2508702891] conn(0x7f531c078bc0 msgr2=0x7f531c07b000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:24.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.665+0000 7fdc8a600640 1 -- 172.21.15.63:0/2904919576 shutdown_connections 2024-05-21T01:20:24.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.665+0000 7fdc8a600640 1 -- 172.21.15.63:0/2904919576 >> 172.21.15.63:0/2904919576 conn(0x7fdc84068890 msgr2=0x7fdc840ca1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:24.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.665+0000 7f5340a00640 1 --2- 172.21.15.63:0/3806979399 >> [v2:172.21.15.131:6809/2508702891,v1:172.21.15.131:6811/2508702891] conn(0x7f531c078bc0 0x7f531c07b000 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:24.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.665+0000 7f5340a00640 1 -- 172.21.15.63:0/3806979399 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f531c06f450 msgr2=0x7f531c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:24.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.665+0000 7f5340a00640 1 --2- 172.21.15.63:0/3806979399 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f531c06f450 0x7f531c071910 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5328000f70 tx=0x7f5328009040 comp rx=0 tx=0).stop 2024-05-21T01:20:24.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.665+0000 7f5340a00640 1 -- 172.21.15.63:0/3806979399 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f533c139000 msgr2=0x7f533c13f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:24.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.665+0000 7f5340a00640 1 --2- 172.21.15.63:0/3806979399 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f533c139000 0x7f533c13f4a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f533400ebd0 tx=0x7f533400c490 comp rx=0 tx=0).stop 2024-05-21T01:20:24.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.665+0000 7ff38aa00640 1 -- 172.21.15.63:0/987025783 shutdown_connections 2024-05-21T01:20:24.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.665+0000 7ff38aa00640 1 -- 172.21.15.63:0/987025783 wait complete. 2024-05-21T01:20:24.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.669+0000 7f533a800640 1 -- 172.21.15.63:0/3806979399 reap_dead start 2024-05-21T01:20:24.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.669+0000 7f5340a00640 1 -- 172.21.15.63:0/3806979399 shutdown_connections 2024-05-21T01:20:24.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.669+0000 7f5340a00640 1 -- 172.21.15.63:0/3806979399 >> 172.21.15.63:0/3806979399 conn(0x7f533c0cb390 msgr2=0x7f533c156c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:24.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.669+0000 7f5340a00640 1 -- 172.21.15.63:0/3806979399 shutdown_connections 2024-05-21T01:20:24.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.669+0000 7f5340a00640 1 -- 172.21.15.63:0/3806979399 wait complete. 2024-05-21T01:20:24.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.669+0000 7fdc8a600640 1 -- 172.21.15.63:0/2904919576 shutdown_connections 2024-05-21T01:20:24.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.669+0000 7fdc8a600640 1 -- 172.21.15.63:0/2904919576 wait complete. 2024-05-21T01:20:24.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.677+0000 7f888a200640 1 -- 172.21.15.63:0/3994996906 --> [v2:172.21.15.131:6808/614380392,v1:172.21.15.131:6810/614380392] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f88840507f0 con 0x7f8864078a70 2024-05-21T01:20:24.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.681+0000 7f887b400640 1 -- 172.21.15.63:0/3994996906 <== osd.6 v2:172.21.15.131:6808/614380392 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f88840507f0 con 0x7f8864078a70 2024-05-21T01:20:24.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.681+0000 7f888a200640 1 -- 172.21.15.63:0/3994996906 >> [v2:172.21.15.131:6808/614380392,v1:172.21.15.131:6810/614380392] conn(0x7f8864078a70 msgr2=0x7f886407aeb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:24.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.681+0000 7f888a200640 1 --2- 172.21.15.63:0/3994996906 >> [v2:172.21.15.131:6808/614380392,v1:172.21.15.131:6810/614380392] conn(0x7f8864078a70 0x7f886407aeb0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:24.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.681+0000 7f888a200640 1 -- 172.21.15.63:0/3994996906 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f886406f400 msgr2=0x7f88640718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:24.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.681+0000 7f888a200640 1 --2- 172.21.15.63:0/3994996906 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f886406f400 0x7f88640718c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8874000c10 tx=0x7f8874008040 comp rx=0 tx=0).stop 2024-05-21T01:20:24.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.681+0000 7f888a200640 1 -- 172.21.15.63:0/3994996906 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f88841f6290 msgr2=0x7f88841f6710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:24.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.681+0000 7f888a200640 1 --2- 172.21.15.63:0/3994996906 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f88841f6290 0x7f88841f6710 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f887c00c7e0 tx=0x7f887c00cca0 comp rx=0 tx=0).stop 2024-05-21T01:20:24.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.681+0000 7f8883e00640 1 -- 172.21.15.63:0/3994996906 reap_dead start 2024-05-21T01:20:24.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.681+0000 7f888a200640 1 -- 172.21.15.63:0/3994996906 shutdown_connections 2024-05-21T01:20:24.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.681+0000 7f888a200640 1 -- 172.21.15.63:0/3994996906 >> 172.21.15.63:0/3994996906 conn(0x7f8884068460 msgr2=0x7f8884150f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:24.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.681+0000 7f888a200640 1 -- 172.21.15.63:0/3994996906 shutdown_connections 2024-05-21T01:20:24.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.681+0000 7f888a200640 1 -- 172.21.15.63:0/3994996906 wait complete. 2024-05-21T01:20:24.697 INFO:teuthology.orchestra.run.smithi063.stdout:64424509450 2024-05-21T01:20:24.698 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-21T01:20:24.703 INFO:teuthology.orchestra.run.smithi063.stdout:64424509450 2024-05-21T01:20:24.703 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-21T01:20:24.706 INFO:teuthology.orchestra.run.smithi063.stdout:64424509452 2024-05-21T01:20:24.707 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-21T01:20:24.713 INFO:teuthology.orchestra.run.smithi063.stdout:64424509451 2024-05-21T01:20:24.713 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-21T01:20:24.716 INFO:teuthology.orchestra.run.smithi063.stdout:55834574858 2024-05-21T01:20:24.717 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-21T01:20:24.723 INFO:teuthology.orchestra.run.smithi063.stdout:55834574858 2024-05-21T01:20:24.724 INFO:teuthology.orchestra.run.smithi063.stdout:60129542154 2024-05-21T01:20:24.724 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-21T01:20:24.725 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-21T01:20:24.725 INFO:teuthology.orchestra.run.smithi063.stdout:60129542155 2024-05-21T01:20:24.726 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-21T01:20:24.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.941+0000 7f3071400640 1 Processor -- start 2024-05-21T01:20:24.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.941+0000 7f3071400640 1 -- start start 2024-05-21T01:20:24.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.945+0000 7f3071400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f306c06c4a0 0x7f306c158490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:24.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.945+0000 7f3071400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f306c1589d0 0x7f306c0c36d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:24.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.945+0000 7f3071400640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f306c15b6d0 con 0x7f306c0c93c0 2024-05-21T01:20:24.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.945+0000 7f3071400640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f306c15c250 con 0x7f306c1589d0 2024-05-21T01:20:24.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.945+0000 7f3071400640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f306c15b9b0 con 0x7f306c06c4a0 2024-05-21T01:20:24.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.945+0000 7f306be00640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f306c0c93c0 0x7f306c0c22a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.63:42354/0 (socket says 172.21.15.63:42354) 2024-05-21T01:20:24.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.945+0000 7f306be00640 1 -- 172.21.15.63:0/4148165659 learned_addr learned my addr 172.21.15.63:0/4148165659 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-05-21T01:20:24.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.945+0000 7f3070a00640 1 --2- 172.21.15.63:0/4148165659 >> v2:172.21.15.63:3300/0 conn(0x7f306c1589d0 0x7f306c0c36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:24.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.945+0000 7f306b400640 1 --2- 172.21.15.63:0/4148165659 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f306c06c4a0 0x7f306c158490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:24.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.945+0000 7f3070a00640 1 -- 172.21.15.63:0/4148165659 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f306c06c4a0 msgr2=0x7f306c158490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:24.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.945+0000 7f3070a00640 1 --2- 172.21.15.63:0/4148165659 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f306c06c4a0 0x7f306c158490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:24.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.945+0000 7f3070a00640 1 -- 172.21.15.63:0/4148165659 >> v1:172.21.15.131:6789/0 conn(0x7f306c0c93c0 legacy=0x7f306c0c22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:24.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.945+0000 7f3070a00640 1 -- 172.21.15.63:0/4148165659 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f306c15bc90 con 0x7f306c1589d0 2024-05-21T01:20:24.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.953+0000 7f3070a00640 1 --2- 172.21.15.63:0/4148165659 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f306c1589d0 0x7f306c0c36d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f30580097c0 tx=0x7f305801d5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6988366c353ab3b6 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:24.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.953+0000 7f306aa00640 1 -- 172.21.15.63:0/4148165659 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30580b2070 con 0x7f306c1589d0 2024-05-21T01:20:24.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.953+0000 7f306aa00640 1 -- 172.21.15.63:0/4148165659 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30580ad620 con 0x7f306c1589d0 2024-05-21T01:20:24.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.953+0000 7f306aa00640 1 -- 172.21.15.63:0/4148165659 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30580b2070 con 0x7f306c1589d0 2024-05-21T01:20:24.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.953+0000 7f3071400640 1 -- 172.21.15.63:0/4148165659 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f306c1589d0 msgr2=0x7f306c0c36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:24.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.953+0000 7f3071400640 1 --2- 172.21.15.63:0/4148165659 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f306c1589d0 0x7f306c0c36d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f30580097c0 tx=0x7f305801d5f0 comp rx=0 tx=0).stop 2024-05-21T01:20:24.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.953+0000 7f3071400640 1 -- 172.21.15.63:0/4148165659 shutdown_connections 2024-05-21T01:20:24.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.953+0000 7f3071400640 1 --2- 172.21.15.63:0/4148165659 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f306c1589d0 0x7f306c0c36d0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:24.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.953+0000 7f3071400640 1 --2- 172.21.15.63:0/4148165659 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f306c06c4a0 0x7f306c158490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:24.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.953+0000 7f3071400640 1 -- 172.21.15.63:0/4148165659 >> 172.21.15.63:0/4148165659 conn(0x7f306c0c9c60 msgr2=0x7f306c0ca070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:24.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.953+0000 7fac4ca00640 1 Processor -- start 2024-05-21T01:20:24.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.953+0000 7fe746800640 1 Processor -- start 2024-05-21T01:20:24.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.953+0000 7f3071400640 1 -- 172.21.15.63:0/4148165659 shutdown_connections 2024-05-21T01:20:24.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.953+0000 7fe746800640 1 -- start start 2024-05-21T01:20:24.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.953+0000 7fac4ca00640 1 -- start start 2024-05-21T01:20:24.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.953+0000 7f3071400640 1 -- 172.21.15.63:0/4148165659 wait complete. 2024-05-21T01:20:24.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.957+0000 7fe746800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe740153e80 0x7fe74015a510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:24.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.957+0000 7fe746800640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fe7400723a0 0x7fe740072830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:24.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.957+0000 7fe746800640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe740154260 con 0x7fe74006c4a0 2024-05-21T01:20:24.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.957+0000 7fe746800640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fe74006de80 con 0x7fe7400723a0 2024-05-21T01:20:24.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.957+0000 7fe746800640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fe74006e160 con 0x7fe740153e80 2024-05-21T01:20:24.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.957+0000 7f3071400640 1 Processor -- start 2024-05-21T01:20:24.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.957+0000 7fac4ca00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fac4815a3f0 0x7fac480c5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:24.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.957+0000 7fac4ca00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fac480c84b0 0x7fac481635d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:24.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.957+0000 7fac45400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fac480c84b0 0x7fac481635d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:24.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.957+0000 7fe744a00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fe74006c4a0 0x7fe7400c7900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:40154/0 (socket says 172.21.15.63:40154) 2024-05-21T01:20:24.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.957+0000 7fe745e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fe7400723a0 0x7fe740072830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:24.963 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.957+0000 7fe744a00640 1 -- 172.21.15.63:0/3231575345 learned_addr learned my addr 172.21.15.63:0/3231575345 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-05-21T01:20:24.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.957+0000 7fac45400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fac480c84b0 0x7fac481635d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.63:42028/0 (socket says 172.21.15.63:42028) 2024-05-21T01:20:24.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.957+0000 7fac45400640 1 -- 172.21.15.63:0/1160052476 learned_addr learned my addr 172.21.15.63:0/1160052476 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:24.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.957+0000 7fac45e00640 1 --2- 172.21.15.63:0/1160052476 >> v2:172.21.15.63:3300/0 conn(0x7fac4815a3f0 0x7fac480c5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:24.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.957+0000 7fe745400640 1 --2- 172.21.15.63:0/3231575345 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe740153e80 0x7fe74015a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:24.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.957+0000 7f3071400640 1 -- start start 2024-05-21T01:20:24.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.957+0000 7fac4ca00640 1 -- 172.21.15.63:0/1160052476 --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac4815a7d0 con 0x7fac480c7fe0 2024-05-21T01:20:24.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.957+0000 7fe73fe00640 1 -- 172.21.15.63:0/3231575345 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1731058213 0 0) 0x7fe740154260 con 0x7fe74006c4a0 2024-05-21T01:20:24.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.957+0000 7fe745e00640 1 -- 172.21.15.63:0/3231575345 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe740153e80 msgr2=0x7fe74015a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:24.966 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.957+0000 7fe745e00640 1 --2- 172.21.15.63:0/3231575345 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe740153e80 0x7fe74015a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:24.966 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.957+0000 7fe745e00640 1 -- 172.21.15.63:0/3231575345 >> v1:172.21.15.63:6789/0 conn(0x7fe74006c4a0 legacy=0x7fe7400c7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:24.966 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.961+0000 7fe745e00640 1 -- 172.21.15.63:0/3231575345 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe740072d70 con 0x7fe7400723a0 2024-05-21T01:20:24.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.961+0000 7f3071400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f306c06c4a0 0x7f306c0aef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:24.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.961+0000 7f3071400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f306c0c93c0 0x7f306c151300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:24.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.961+0000 7f3071400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f306c1589d0 0x7f306c151840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:24.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.961+0000 7f306be00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f306c06c4a0 0x7f306c0aef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:24.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.961+0000 7f306be00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f306c06c4a0 0x7f306c0aef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.63:51578/0 (socket says 172.21.15.63:51578) 2024-05-21T01:20:24.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.961+0000 7f306be00640 1 -- 172.21.15.63:0/4194008732 learned_addr learned my addr 172.21.15.63:0/4194008732 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:24.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.961+0000 7f3071400640 1 -- 172.21.15.63:0/4194008732 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f306c165010 con 0x7f306c0c93c0 2024-05-21T01:20:24.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.961+0000 7f3071400640 1 -- 172.21.15.63:0/4194008732 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f306c164e90 con 0x7f306c1589d0 2024-05-21T01:20:24.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.961+0000 7f3071400640 1 -- 172.21.15.63:0/4194008732 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f306c165190 con 0x7f306c06c4a0 2024-05-21T01:20:24.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.961+0000 7f306b400640 1 --2- 172.21.15.63:0/4194008732 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f306c0c93c0 0x7f306c151300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:24.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.961+0000 7f3070a00640 1 --2- 172.21.15.63:0/4194008732 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f306c1589d0 0x7f306c151840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:24.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.961+0000 7f306be00640 1 -- 172.21.15.63:0/4194008732 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f306c1589d0 msgr2=0x7f306c151840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:24.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.961+0000 7f306be00640 1 --2- 172.21.15.63:0/4194008732 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f306c1589d0 0x7f306c151840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:24.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.961+0000 7f306be00640 1 -- 172.21.15.63:0/4194008732 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f306c0c93c0 msgr2=0x7f306c151300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:24.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.961+0000 7f306be00640 1 --2- 172.21.15.63:0/4194008732 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f306c0c93c0 0x7f306c151300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:24.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.961+0000 7f306be00640 1 -- 172.21.15.63:0/4194008732 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f306c0adfd0 con 0x7f306c06c4a0 2024-05-21T01:20:24.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.961+0000 7f306be00640 1 --2- 172.21.15.63:0/4194008732 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f306c06c4a0 0x7f306c0aef80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3064001a60 tx=0x7f3064001f20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:24.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.961+0000 7fac4ca00640 1 -- 172.21.15.63:0/1160052476 --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7fac480c9660 con 0x7fac4815a3f0 2024-05-21T01:20:24.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.961+0000 7fac4ca00640 1 -- 172.21.15.63:0/1160052476 --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fac480c8b20 con 0x7fac480c84b0 2024-05-21T01:20:24.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.961+0000 7f3063e00640 1 -- 172.21.15.63:0/4194008732 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3064018070 con 0x7f306c06c4a0 2024-05-21T01:20:24.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.961+0000 7f3071400640 1 -- 172.21.15.63:0/4194008732 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f306c0ae2b0 con 0x7f306c06c4a0 2024-05-21T01:20:24.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.961+0000 7f3063e00640 1 -- 172.21.15.63:0/4194008732 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f306400d6c0 con 0x7f306c06c4a0 2024-05-21T01:20:24.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.961+0000 7f3063e00640 1 -- 172.21.15.63:0/4194008732 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f306400dab0 con 0x7f306c06c4a0 2024-05-21T01:20:24.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.961+0000 7f3071400640 1 -- 172.21.15.63:0/4194008732 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f306c0ae870 con 0x7f306c06c4a0 2024-05-21T01:20:24.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.965+0000 7f3071400640 1 -- 172.21.15.63:0/4194008732 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f306c06c0c0 con 0x7f306c06c4a0 2024-05-21T01:20:24.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.961+0000 7fac45e00640 1 -- 172.21.15.63:0/1160052476 >> v2:172.21.15.131:3300/0 conn(0x7fac480c84b0 msgr2=0x7fac481635d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:24.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.961+0000 7fac45e00640 1 --2- 172.21.15.63:0/1160052476 >> v2:172.21.15.131:3300/0 conn(0x7fac480c84b0 0x7fac481635d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:24.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.961+0000 7fac45e00640 1 -- 172.21.15.63:0/1160052476 >> v1:172.21.15.63:6789/0 conn(0x7fac480c7fe0 legacy=0x7fac48160060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:24.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.961+0000 7fac45e00640 1 -- 172.21.15.63:0/1160052476 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac48164100 con 0x7fac4815a3f0 2024-05-21T01:20:24.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.965+0000 7fac45400640 1 --2- 172.21.15.63:0/1160052476 >> v2:172.21.15.131:3300/0 conn(0x7fac480c84b0 0x7fac481635d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T01:20:24.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.961+0000 7f6d24600640 1 Processor -- start 2024-05-21T01:20:24.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.965+0000 7f6d24600640 1 -- start start 2024-05-21T01:20:24.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.965+0000 7f6d24600640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6d1c157ee0 0x7f6d1c158300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:24.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.965+0000 7f6d24600640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d1c15b220 con 0x7f6d1c0c8540 2024-05-21T01:20:24.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.965+0000 7f6d24600640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d1c15b4e0 con 0x7f6d1c151e00 2024-05-21T01:20:24.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.965+0000 7f6d24600640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f6d1c15b7c0 con 0x7f6d1c157ee0 2024-05-21T01:20:24.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.965+0000 7f6d21200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6d1c157ee0 0x7f6d1c158300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:24.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.965+0000 7f6d21200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6d1c157ee0 0x7f6d1c158300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.63:51586/0 (socket says 172.21.15.63:51586) 2024-05-21T01:20:24.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.965+0000 7f6d21200640 1 -- 172.21.15.63:0/2981523404 learned_addr learned my addr 172.21.15.63:0/2981523404 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:24.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.965+0000 7f6d21200640 1 -- 172.21.15.63:0/2981523404 >> v1:172.21.15.131:6789/0 conn(0x7f6d1c151e00 legacy=0x7f6d1c0ca3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:24.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.965+0000 7f6d21200640 1 -- 172.21.15.63:0/2981523404 >> v1:172.21.15.63:6789/0 conn(0x7f6d1c0c8540 legacy=0x7f6d1c0c89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:24.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.965+0000 7f3063e00640 1 -- 172.21.15.63:0/4194008732 <== mon.2 v2:172.21.15.131:3301/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7f306401b070 con 0x7f306c06c4a0 2024-05-21T01:20:24.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.969+0000 7f6d21200640 1 -- 172.21.15.63:0/2981523404 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d1c15baa0 con 0x7f6d1c157ee0 2024-05-21T01:20:24.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.969+0000 7fe745e00640 1 --2- 172.21.15.63:0/3231575345 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe7400723a0 0x7fe740072830 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe738009d90 tx=0x7fe73801c9b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da5f1d73cb945004 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:24.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.969+0000 7fe73fe00640 1 -- 172.21.15.63:0/3231575345 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7380b2070 con 0x7fe7400723a0 2024-05-21T01:20:24.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.969+0000 7fe73fe00640 1 -- 172.21.15.63:0/3231575345 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7380a5720 con 0x7fe7400723a0 2024-05-21T01:20:24.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.969+0000 7fe73fe00640 1 -- 172.21.15.63:0/3231575345 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7380a5af0 con 0x7fe7400723a0 2024-05-21T01:20:24.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.969+0000 7fac45e00640 1 --2- 172.21.15.63:0/1160052476 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fac4815a3f0 0x7fac480c5990 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fac4815dc90 tx=0x7fac3801ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a238d099772d8c76 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:24.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.969+0000 7fac44a00640 1 -- 172.21.15.63:0/1160052476 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac380b5070 con 0x7fac4815a3f0 2024-05-21T01:20:24.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.969+0000 7f500d400640 1 Processor -- start 2024-05-21T01:20:24.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.969+0000 7fac44a00640 1 -- 172.21.15.63:0/1160052476 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac380a8970 con 0x7fac4815a3f0 2024-05-21T01:20:24.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.969+0000 7f3063e00640 1 --2- 172.21.15.63:0/4194008732 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f304c06f430 0x7f304c0718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:24.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.969+0000 7f3063e00640 1 -- 172.21.15.63:0/4194008732 <== mon.2 v2:172.21.15.131:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f306408ee70 con 0x7f306c06c4a0 2024-05-21T01:20:24.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.969+0000 7fe746800640 1 -- 172.21.15.63:0/3231575345 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe7400723a0 msgr2=0x7fe740072830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:24.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.969+0000 7fe746800640 1 --2- 172.21.15.63:0/3231575345 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe7400723a0 0x7fe740072830 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe738009d90 tx=0x7fe73801c9b0 comp rx=0 tx=0).stop 2024-05-21T01:20:24.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.969+0000 7f306b400640 1 --2- 172.21.15.63:0/4194008732 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f304c06f430 0x7f304c0718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:24.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.969+0000 7f500d400640 1 -- start start 2024-05-21T01:20:24.976 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.969+0000 7fe746800640 1 -- 172.21.15.63:0/3231575345 shutdown_connections 2024-05-21T01:20:24.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.969+0000 7fe746800640 1 --2- 172.21.15.63:0/3231575345 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe7400723a0 0x7fe740072830 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:24.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.969+0000 7fac44a00640 1 -- 172.21.15.63:0/1160052476 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac380b5070 con 0x7fac4815a3f0 2024-05-21T01:20:24.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.969+0000 7fe746800640 1 --2- 172.21.15.63:0/3231575345 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe740153e80 0x7fe74015a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:24.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.969+0000 7fac4ca00640 1 -- 172.21.15.63:0/1160052476 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fac4815a3f0 msgr2=0x7fac480c5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:24.977 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.969+0000 7fac4ca00640 1 --2- 172.21.15.63:0/1160052476 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fac4815a3f0 0x7fac480c5990 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fac4815dc90 tx=0x7fac3801ec90 comp rx=0 tx=0).stop 2024-05-21T01:20:24.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.969+0000 7fe746800640 1 -- 172.21.15.63:0/3231575345 >> 172.21.15.63:0/3231575345 conn(0x7fe7400cacf0 msgr2=0x7fe7400cb100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:24.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.969+0000 7fe746800640 1 -- 172.21.15.63:0/3231575345 shutdown_connections 2024-05-21T01:20:24.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.969+0000 7fe746800640 1 -- 172.21.15.63:0/3231575345 wait complete. 2024-05-21T01:20:24.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.969+0000 7fac4ca00640 1 -- 172.21.15.63:0/1160052476 shutdown_connections 2024-05-21T01:20:24.978 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.969+0000 7fac4ca00640 1 --2- 172.21.15.63:0/1160052476 >> v2:172.21.15.131:3300/0 conn(0x7fac480c84b0 0x7fac481635d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:24.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.969+0000 7fac4ca00640 1 --2- 172.21.15.63:0/1160052476 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fac4815a3f0 0x7fac480c5990 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:24.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.969+0000 7fac4ca00640 1 -- 172.21.15.63:0/1160052476 >> 172.21.15.63:0/1160052476 conn(0x7fac480cd170 msgr2=0x7fac480cd580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:24.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.969+0000 7f306b400640 1 --2- 172.21.15.63:0/4194008732 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f304c06f430 0x7f304c0718f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f306c1607b0 tx=0x7f305c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:24.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.969+0000 7fac4ca00640 1 -- 172.21.15.63:0/1160052476 shutdown_connections 2024-05-21T01:20:24.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.969+0000 7fac4ca00640 1 -- 172.21.15.63:0/1160052476 wait complete. 2024-05-21T01:20:24.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.973+0000 7f500d400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f500806c4a0 0x7f50080c93c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:24.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.973+0000 7f500d400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f50080c36d0 0x7f50080c3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:24.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.973+0000 7f500d400640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5008158d20 con 0x7f50080ca780 2024-05-21T01:20:24.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.973+0000 7f500d400640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f50080c9900 con 0x7f500806c4a0 2024-05-21T01:20:24.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.973+0000 7f500d400640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f500815c250 con 0x7f50080c36d0 2024-05-21T01:20:24.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.973+0000 7f4fff400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f500806c4a0 0x7f50080c93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:24.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.973+0000 7f5007e00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f50080ca780 0x7f50080c22a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:40194/0 (socket says 172.21.15.63:40194) 2024-05-21T01:20:24.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.973+0000 7f5007e00640 1 -- 172.21.15.63:0/1521951943 learned_addr learned my addr 172.21.15.63:0/1521951943 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-05-21T01:20:24.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.973+0000 7fe746800640 1 Processor -- start 2024-05-21T01:20:24.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.973+0000 7f500ca00640 1 --2- 172.21.15.63:0/1521951943 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f50080c36d0 0x7f50080c3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:24.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.973+0000 7f5007400640 1 -- 172.21.15.63:0/1521951943 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2040665793 0 0) 0x7f5008158d20 con 0x7f50080ca780 2024-05-21T01:20:24.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.973+0000 7f5007400640 1 -- 172.21.15.63:0/1521951943 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4fec003530 con 0x7f50080ca780 2024-05-21T01:20:24.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.973+0000 7fe746800640 1 -- start start 2024-05-21T01:20:24.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.973+0000 7fac4ca00640 1 Processor -- start 2024-05-21T01:20:24.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.973+0000 7f500ca00640 1 -- 172.21.15.63:0/1521951943 >> v2:172.21.15.63:3300/0 conn(0x7f500806c4a0 msgr2=0x7f50080c93c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:24.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.973+0000 7f500ca00640 1 --2- 172.21.15.63:0/1521951943 >> v2:172.21.15.63:3300/0 conn(0x7f500806c4a0 0x7f50080c93c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:24.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.973+0000 7f500ca00640 1 -- 172.21.15.63:0/1521951943 >> v1:172.21.15.63:6789/0 conn(0x7f50080ca780 legacy=0x7f50080c22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:24.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.973+0000 7f500ca00640 1 -- 172.21.15.63:0/1521951943 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f500815b6d0 con 0x7f50080c36d0 2024-05-21T01:20:24.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.973+0000 7fac4ca00640 1 -- start start 2024-05-21T01:20:24.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.973+0000 7f966aa00640 1 Processor -- start 2024-05-21T01:20:24.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.973+0000 7f6ac3800640 1 Processor -- start 2024-05-21T01:20:24.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.973+0000 7f6d21200640 1 --2- 172.21.15.63:0/2981523404 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6d1c157ee0 0x7f6d1c158300 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6d080088a0 tx=0x7f6d0801ea90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=577fcde5314f5531 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:24.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.973+0000 7f6ac3800640 1 -- start start 2024-05-21T01:20:24.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.973+0000 7fe746800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe74006c4a0 0x7fe7401f9780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:24.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.973+0000 7fe746800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe7400723a0 0x7fe7401660b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:24.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.973+0000 7fac4ca00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fac480c7fe0 0x7fac4815eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:24.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.973+0000 7fac4ca00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fac480c84b0 0x7fac4815f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:24.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.973+0000 7fac4ca00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fac4815a3f0 0x7fac481f9080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:24.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.973+0000 7fac4ca00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fac480c8d70 con 0x7fac480c84b0 2024-05-21T01:20:24.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.973+0000 7fac4ca00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fac480c93d0 con 0x7fac480c7fe0 2024-05-21T01:20:24.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.973+0000 7fac4ca00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fac480c98b0 con 0x7fac4815a3f0 2024-05-21T01:20:24.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.973+0000 7f966aa00640 1 -- start start 2024-05-21T01:20:24.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.977+0000 7fac46800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fac4815a3f0 0x7fac481f9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:24.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.977+0000 7fac46800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fac4815a3f0 0x7fac481f9080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.63:51614/0 (socket says 172.21.15.63:51614) 2024-05-21T01:20:24.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.977+0000 7fac46800640 1 -- 172.21.15.63:0/2918214457 learned_addr learned my addr 172.21.15.63:0/2918214457 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:24.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.977+0000 7fac45e00640 1 --2- 172.21.15.63:0/2918214457 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fac480c7fe0 0x7fac4815eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:24.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.977+0000 7fac45400640 1 --2- 172.21.15.63:0/2918214457 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fac480c84b0 0x7fac4815f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:24.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.977+0000 7fe746800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe740153e80 0x7fe740164e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:24.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.977+0000 7fe745400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe74006c4a0 0x7fe7401f9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:24.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.977+0000 7fe745400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe74006c4a0 0x7fe7401f9780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.63:42046/0 (socket says 172.21.15.63:42046) 2024-05-21T01:20:24.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.977+0000 7fe744a00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe7400723a0 0x7fe7401660b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:24.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.977+0000 7fe744a00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe7400723a0 0x7fe7401660b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.63:51606/0 (socket says 172.21.15.63:51606) 2024-05-21T01:20:24.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.977+0000 7fe746800640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe7400c8010 con 0x7fe740153e80 2024-05-21T01:20:24.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.977+0000 7fe746800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fe74006ece0 con 0x7fe74006c4a0 2024-05-21T01:20:24.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.977+0000 7fe746800640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fe7400c8190 con 0x7fe7400723a0 2024-05-21T01:20:24.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.977+0000 7fac46800640 1 -- 172.21.15.63:0/2918214457 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fac480c7fe0 msgr2=0x7fac4815eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:24.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.977+0000 7fac46800640 1 --2- 172.21.15.63:0/2918214457 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fac480c7fe0 0x7fac4815eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:24.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.977+0000 7fac46800640 1 -- 172.21.15.63:0/2918214457 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fac480c84b0 msgr2=0x7fac4815f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:24.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.977+0000 7fac46800640 1 --2- 172.21.15.63:0/2918214457 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fac480c84b0 0x7fac4815f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:24.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.977+0000 7fac46800640 1 -- 172.21.15.63:0/2918214457 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac481e9700 con 0x7fac4815a3f0 2024-05-21T01:20:24.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.977+0000 7fe745400640 1 -- 172.21.15.63:0/2508371191 learned_addr learned my addr 172.21.15.63:0/2508371191 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:24.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.977+0000 7f6ac3800640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f6abc156e20 0x7f6abc06d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:24.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.977+0000 7fe745e00640 1 --2- 172.21.15.63:0/2508371191 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe740153e80 0x7fe740164e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:24.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.977+0000 7f966aa00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f966406f9b0 0x7f9664072660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:24.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.977+0000 7f966aa00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96640cdcc0 con 0x7f9664163950 2024-05-21T01:20:24.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.977+0000 7f966aa00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96640cdfa0 con 0x7f966406f5d0 2024-05-21T01:20:24.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.977+0000 7f966aa00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f96640cad70 con 0x7f966406f9b0 2024-05-21T01:20:24.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.977+0000 7f6ac3800640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6abc160330 con 0x7f6abc163810 2024-05-21T01:20:24.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.977+0000 7f6ac3800640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6abc0ca1b0 con 0x7f6abc0c6380 2024-05-21T01:20:24.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.977+0000 7f6ac3800640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f6abc1605a0 con 0x7f6abc156e20 2024-05-21T01:20:24.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.977+0000 7fe744a00640 1 -- 172.21.15.63:0/2508371191 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe74006c4a0 msgr2=0x7fe7401f9780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:24.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.977+0000 7fe744a00640 1 --2- 172.21.15.63:0/2508371191 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe74006c4a0 0x7fe7401f9780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:24.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.977+0000 7fe744a00640 1 -- 172.21.15.63:0/2508371191 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe740153e80 msgr2=0x7fe740164e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:24.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.977+0000 7fe744a00640 1 --2- 172.21.15.63:0/2508371191 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe740153e80 0x7fe740164e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:24.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.977+0000 7fe744a00640 1 -- 172.21.15.63:0/2508371191 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7400ca660 con 0x7fe7400723a0 2024-05-21T01:20:24.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.977+0000 7f6ac0e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f6abc156e20 0x7f6abc06d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:24.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.977+0000 7f6ac0e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f6abc156e20 0x7f6abc06d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.63:42070/0 (socket says 172.21.15.63:42070) 2024-05-21T01:20:24.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.977+0000 7f6ac0e00640 1 -- 172.21.15.63:0/1148544732 learned_addr learned my addr 172.21.15.63:0/1148544732 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:24.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.977+0000 7fac46800640 1 --2- 172.21.15.63:0/2918214457 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fac4815a3f0 0x7fac481f9080 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fac4000c7a0 tx=0x7fac4000cc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:24.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.977+0000 7f9663e00640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f966406f5d0 0x7f96640cd280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.63:42384/0 (socket says 172.21.15.63:42384) 2024-05-21T01:20:24.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.977+0000 7f9663e00640 1 -- 172.21.15.63:0/2802590051 learned_addr learned my addr 172.21.15.63:0/2802590051 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-05-21T01:20:24.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.977+0000 7fe744a00640 1 --2- 172.21.15.63:0/2508371191 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe7400723a0 0x7fe7401660b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe72c00c410 tx=0x7fe72c00c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:24.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.977+0000 7f9663400640 1 --2- 172.21.15.63:0/2802590051 >> v2:172.21.15.63:3300/0 conn(0x7f966406f9b0 0x7f9664072660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:24.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.977+0000 7f6ac0e00640 1 -- 172.21.15.63:0/1148544732 >> v1:172.21.15.131:6789/0 conn(0x7f6abc0c6380 legacy=0x7f6abc0cc300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:24.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.977+0000 7f6ac0e00640 1 -- 172.21.15.63:0/1148544732 >> v1:172.21.15.63:6789/0 conn(0x7f6abc163810 legacy=0x7f6abc163c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:24.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.977+0000 7f6ac0e00640 1 -- 172.21.15.63:0/1148544732 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6abc160880 con 0x7f6abc156e20 2024-05-21T01:20:24.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.977+0000 7f9662a00640 1 -- 172.21.15.63:0/2802590051 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 998033704 0 0) 0x7f96640cdfa0 con 0x7f966406f5d0 2024-05-21T01:20:24.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.977+0000 7f9662a00640 1 -- 172.21.15.63:0/2802590051 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9648003530 con 0x7f966406f5d0 2024-05-21T01:20:24.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.977+0000 7f9663400640 1 -- 172.21.15.63:0/2802590051 >> v1:172.21.15.131:6789/0 conn(0x7f966406f5d0 legacy=0x7f96640cd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:24.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.977+0000 7f9663400640 1 -- 172.21.15.63:0/2802590051 >> v1:172.21.15.63:6789/0 conn(0x7f9664163950 legacy=0x7f9664159ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:24.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.977+0000 7f9663400640 1 -- 172.21.15.63:0/2802590051 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9664071b80 con 0x7f966406f9b0 2024-05-21T01:20:24.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.977+0000 7f500ca00640 1 --2- 172.21.15.63:0/1521951943 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f50080c36d0 0x7f50080c3b20 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f50000097c0 tx=0x7f500001c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e41400b22a4d3b3 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:24.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.977+0000 7fb917e00640 1 Processor -- start 2024-05-21T01:20:24.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.981+0000 7fb917e00640 1 -- start start 2024-05-21T01:20:24.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.981+0000 7f5007400640 1 -- 172.21.15.63:0/1521951943 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50000b0070 con 0x7f50080c36d0 2024-05-21T01:20:24.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.981+0000 7fac3e000640 1 -- 172.21.15.63:0/2918214457 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac40003ba0 con 0x7fac4815a3f0 2024-05-21T01:20:24.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.981+0000 7fac4ca00640 1 -- 172.21.15.63:0/2918214457 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac48160910 con 0x7fac4815a3f0 2024-05-21T01:20:24.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.981+0000 7f6d1be00640 1 -- 172.21.15.63:0/2981523404 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d080ad070 con 0x7f6d1c157ee0 2024-05-21T01:20:24.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.981+0000 7fe73d600640 1 -- 172.21.15.63:0/2508371191 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe72c0074e0 con 0x7fe7400723a0 2024-05-21T01:20:24.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.981+0000 7fe73d600640 1 -- 172.21.15.63:0/2508371191 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe72c0047f0 con 0x7fe7400723a0 2024-05-21T01:20:24.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.981+0000 7fe73d600640 1 -- 172.21.15.63:0/2508371191 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe72c007680 con 0x7fe7400723a0 2024-05-21T01:20:24.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.981+0000 7fac3e000640 1 -- 172.21.15.63:0/2918214457 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac40003d40 con 0x7fac4815a3f0 2024-05-21T01:20:24.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.981+0000 7fb917e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb910155e30 0x7fb91015c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:24.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.981+0000 7fb917e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fb910156210 0x7fb91006d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:24.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.981+0000 7fb917e00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9100c66c0 con 0x7fb9100d19b0 2024-05-21T01:20:24.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.981+0000 7fb917e00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7fb9100cc300 con 0x7fb910155e30 2024-05-21T01:20:24.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.981+0000 7fb917e00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fb9100c75b0 con 0x7fb910156210 2024-05-21T01:20:24.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.981+0000 7fac4ca00640 1 -- 172.21.15.63:0/2918214457 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fac4815e090 con 0x7fac4815a3f0 2024-05-21T01:20:24.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.981+0000 7f5007400640 1 -- 172.21.15.63:0/1521951943 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50000ab600 con 0x7f50080c36d0 2024-05-21T01:20:24.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.981+0000 7f6d1be00640 1 -- 172.21.15.63:0/2981523404 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d080a7a10 con 0x7f6d1c157ee0 2024-05-21T01:20:24.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.981+0000 7fac3e000640 1 -- 172.21.15.63:0/2918214457 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac4000aa30 con 0x7fac4815a3f0 2024-05-21T01:20:24.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.981+0000 7f6d1be00640 1 -- 172.21.15.63:0/2981523404 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d080a7de0 con 0x7f6d1c157ee0 2024-05-21T01:20:24.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.981+0000 7fb915e00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fb9100d19b0 0x7fb91015d390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:40226/0 (socket says 172.21.15.63:40226) 2024-05-21T01:20:24.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.981+0000 7f500d400640 1 -- 172.21.15.63:0/1521951943 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f50080c36d0 msgr2=0x7f50080c3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:24.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.981+0000 7f500d400640 1 --2- 172.21.15.63:0/1521951943 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f50080c36d0 0x7f50080c3b20 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f50000097c0 tx=0x7f500001c4a0 comp rx=0 tx=0).stop 2024-05-21T01:20:24.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.981+0000 7fb915e00640 1 -- 172.21.15.63:0/2665135878 learned_addr learned my addr 172.21.15.63:0/2665135878 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-05-21T01:20:24.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.981+0000 7f3063e00640 1 -- 172.21.15.63:0/4194008732 <== mon.2 v2:172.21.15.131:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f306405b440 con 0x7f306c06c4a0 2024-05-21T01:20:24.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.981+0000 7f500d400640 1 -- 172.21.15.63:0/1521951943 shutdown_connections 2024-05-21T01:20:24.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.981+0000 7f500d400640 1 --2- 172.21.15.63:0/1521951943 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f50080c36d0 0x7f50080c3b20 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:24.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.981+0000 7f500d400640 1 --2- 172.21.15.63:0/1521951943 >> v2:172.21.15.63:3300/0 conn(0x7f500806c4a0 0x7f50080c93c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:24.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.981+0000 7f500d400640 1 -- 172.21.15.63:0/1521951943 >> 172.21.15.63:0/1521951943 conn(0x7f50080c9c60 msgr2=0x7f50080ca070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:24.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.981+0000 7fb915400640 1 --2- 172.21.15.63:0/2665135878 >> v2:172.21.15.63:3300/0 conn(0x7fb910155e30 0x7fb91015c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:24.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.981+0000 7fb914a00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fb910156210 0x7fb91006d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:24.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.981+0000 7fe746800640 1 -- 172.21.15.63:0/2508371191 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7400ca940 con 0x7fe7400723a0 2024-05-21T01:20:24.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.981+0000 7fe746800640 1 -- 172.21.15.63:0/2508371191 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe740141790 con 0x7fe7400723a0 2024-05-21T01:20:24.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.981+0000 7f9663400640 1 --2- 172.21.15.63:0/2802590051 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f966406f9b0 0x7f9664072660 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f96540097c0 tx=0x7f965401ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7d842e2aec0fcec server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:24.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.981+0000 7f500d400640 1 -- 172.21.15.63:0/1521951943 shutdown_connections 2024-05-21T01:20:25.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.981+0000 7f500d400640 1 -- 172.21.15.63:0/1521951943 wait complete. 2024-05-21T01:20:25.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.981+0000 7f6d24600640 1 -- 172.21.15.63:0/2981523404 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6d1c157ee0 msgr2=0x7f6d1c158300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:25.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.981+0000 7f6d24600640 1 --2- 172.21.15.63:0/2981523404 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6d1c157ee0 0x7f6d1c158300 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6d080088a0 tx=0x7f6d0801ea90 comp rx=0 tx=0).stop 2024-05-21T01:20:25.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.981+0000 7fb914a00640 1 -- 172.21.15.63:0/2665135878 >> v2:172.21.15.63:3300/0 conn(0x7fb910155e30 msgr2=0x7fb91015c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:25.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.981+0000 7fb914a00640 1 --2- 172.21.15.63:0/2665135878 >> v2:172.21.15.63:3300/0 conn(0x7fb910155e30 0x7fb91015c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:25.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.981+0000 7fb914a00640 1 -- 172.21.15.63:0/2665135878 >> v1:172.21.15.63:6789/0 conn(0x7fb9100d19b0 legacy=0x7fb91015d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:25.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.981+0000 7fb914a00640 1 -- 172.21.15.63:0/2665135878 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9100c69a0 con 0x7fb910156210 2024-05-21T01:20:25.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.981+0000 7fe746800640 1 -- 172.21.15.63:0/2508371191 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe74006c0c0 con 0x7fe7400723a0 2024-05-21T01:20:25.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.985+0000 7f6d24600640 1 -- 172.21.15.63:0/2981523404 shutdown_connections 2024-05-21T01:20:25.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.985+0000 7f6d24600640 1 --2- 172.21.15.63:0/2981523404 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6d1c157ee0 0x7f6d1c158300 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:25.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.985+0000 7f6d24600640 1 -- 172.21.15.63:0/2981523404 >> 172.21.15.63:0/2981523404 conn(0x7f6d1c06c8a0 msgr2=0x7f6d1c06ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:25.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.985+0000 7f6ac0e00640 1 --2- 172.21.15.63:0/1148544732 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6abc156e20 0x7f6abc06d5b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6abc0ca380 tx=0x7f6ab001c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3943edb0507a5d2 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:25.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.985+0000 7f6d24600640 1 -- 172.21.15.63:0/2981523404 shutdown_connections 2024-05-21T01:20:25.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.985+0000 7f6d24600640 1 -- 172.21.15.63:0/2981523404 wait complete. 2024-05-21T01:20:25.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.985+0000 7f6abb400640 1 -- 172.21.15.63:0/1148544732 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab00aa670 con 0x7f6abc156e20 2024-05-21T01:20:25.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.985+0000 7f6abb400640 1 -- 172.21.15.63:0/1148544732 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ab00af070 con 0x7f6abc156e20 2024-05-21T01:20:25.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.985+0000 7f6abb400640 1 -- 172.21.15.63:0/1148544732 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab00aaa30 con 0x7f6abc156e20 2024-05-21T01:20:25.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.981+0000 7fac4ca00640 1 -- 172.21.15.63:0/2918214457 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac200052a0 con 0x7fac4815a3f0 2024-05-21T01:20:25.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.985+0000 7f6ac3800640 1 -- 172.21.15.63:0/1148544732 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6abc156e20 msgr2=0x7f6abc06d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:25.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.985+0000 7f6ac3800640 1 --2- 172.21.15.63:0/1148544732 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6abc156e20 0x7f6abc06d5b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6abc0ca380 tx=0x7f6ab001c510 comp rx=0 tx=0).stop 2024-05-21T01:20:25.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.985+0000 7f9662a00640 1 -- 172.21.15.63:0/2802590051 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96540b5070 con 0x7f966406f9b0 2024-05-21T01:20:25.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.985+0000 7f9662a00640 1 -- 172.21.15.63:0/2802590051 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96540a8990 con 0x7f966406f9b0 2024-05-21T01:20:25.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.985+0000 7f9662a00640 1 -- 172.21.15.63:0/2802590051 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96540a8d60 con 0x7f966406f9b0 2024-05-21T01:20:25.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.985+0000 7f6ac3800640 1 -- 172.21.15.63:0/1148544732 shutdown_connections 2024-05-21T01:20:25.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.985+0000 7f6ac3800640 1 --2- 172.21.15.63:0/1148544732 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6abc156e20 0x7f6abc06d5b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:25.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.985+0000 7f6ac3800640 1 -- 172.21.15.63:0/1148544732 >> 172.21.15.63:0/1148544732 conn(0x7f6abc068460 msgr2=0x7f6abc068870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:25.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.985+0000 7f6ac3800640 1 -- 172.21.15.63:0/1148544732 shutdown_connections 2024-05-21T01:20:25.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.985+0000 7f6ac3800640 1 -- 172.21.15.63:0/1148544732 wait complete. 2024-05-21T01:20:25.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.985+0000 7f500d400640 1 Processor -- start 2024-05-21T01:20:25.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.985+0000 7f6d24600640 1 Processor -- start 2024-05-21T01:20:25.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.985+0000 7f966aa00640 1 -- 172.21.15.63:0/2802590051 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f966406f9b0 msgr2=0x7f9664072660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:25.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.985+0000 7f966aa00640 1 --2- 172.21.15.63:0/2802590051 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f966406f9b0 0x7f9664072660 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f96540097c0 tx=0x7f965401ec90 comp rx=0 tx=0).stop 2024-05-21T01:20:25.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.985+0000 7fe73d600640 1 -- 172.21.15.63:0/2508371191 <== mon.2 v2:172.21.15.131:3301/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7fe72c011070 con 0x7fe7400723a0 2024-05-21T01:20:25.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.985+0000 7f6d24600640 1 -- start start 2024-05-21T01:20:25.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.989+0000 7f966aa00640 1 -- 172.21.15.63:0/2802590051 shutdown_connections 2024-05-21T01:20:25.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.989+0000 7f966aa00640 1 --2- 172.21.15.63:0/2802590051 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f966406f9b0 0x7f9664072660 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:25.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.989+0000 7f966aa00640 1 -- 172.21.15.63:0/2802590051 >> 172.21.15.63:0/2802590051 conn(0x7f9664068460 msgr2=0x7f9664068870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:25.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.989+0000 7fe73d600640 1 --2- 172.21.15.63:0/2508371191 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fe72006f4d0 0x7fe720071990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:25.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.985+0000 7f500d400640 1 -- start start 2024-05-21T01:20:25.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.989+0000 7f966aa00640 1 -- 172.21.15.63:0/2802590051 shutdown_connections 2024-05-21T01:20:25.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.989+0000 7f966aa00640 1 -- 172.21.15.63:0/2802590051 wait complete. 2024-05-21T01:20:25.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.989+0000 7fe73d600640 1 -- 172.21.15.63:0/2508371191 <== mon.2 v2:172.21.15.131:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fe72c08f5f0 con 0x7fe7400723a0 2024-05-21T01:20:25.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.989+0000 7fb914a00640 1 --2- 172.21.15.63:0/2665135878 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb910156210 0x7fb91006d250 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb9100b43f0 tx=0x7fb8fc01ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e0698738debcdfc server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:25.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.989+0000 7f500d400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f500806c4a0 0x7f50080aea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:25.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.989+0000 7f500d400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f50080c36d0 0x7f50081fa3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:25.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.989+0000 7fb90fe00640 1 -- 172.21.15.63:0/2665135878 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8fc0b5070 con 0x7fb910156210 2024-05-21T01:20:25.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.989+0000 7fe745400640 1 --2- 172.21.15.63:0/2508371191 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fe72006f4d0 0x7fe720071990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:25.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.989+0000 7fb90fe00640 1 -- 172.21.15.63:0/2665135878 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8fc0a8970 con 0x7fb910156210 2024-05-21T01:20:25.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.989+0000 7fb90fe00640 1 -- 172.21.15.63:0/2665135878 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8fc0b5070 con 0x7fb910156210 2024-05-21T01:20:25.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.989+0000 7fac3e000640 1 -- 172.21.15.63:0/2918214457 <== mon.2 v2:172.21.15.131:3301/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7fac4000abd0 con 0x7fac4815a3f0 2024-05-21T01:20:25.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.989+0000 7f500d400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50080ca780 0x7f50081fa910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:25.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.989+0000 7f5007e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f500806c4a0 0x7f50080aea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:25.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.989+0000 7f5007e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f500806c4a0 0x7f50080aea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.63:51624/0 (socket says 172.21.15.63:51624) 2024-05-21T01:20:25.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.989+0000 7f4fff400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f50080c36d0 0x7f50081fa3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:25.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.989+0000 7f4fff400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f50080c36d0 0x7f50081fa3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.63:42090/0 (socket says 172.21.15.63:42090) 2024-05-21T01:20:25.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.989+0000 7f500d400640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f5008164680 con 0x7f50080ca780 2024-05-21T01:20:25.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.989+0000 7f500d400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f500815b340 con 0x7f50080c36d0 2024-05-21T01:20:25.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.989+0000 7f500d400640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f5008164800 con 0x7f500806c4a0 2024-05-21T01:20:25.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.989+0000 7f500ca00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50080ca780 0x7f50081fa910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:25.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.989+0000 7f500ca00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50080ca780 0x7f50081fa910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:49378/0 (socket says 172.21.15.63:49378) 2024-05-21T01:20:25.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.989+0000 7f500ca00640 1 -- 172.21.15.63:0/1550998402 learned_addr learned my addr 172.21.15.63:0/1550998402 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:25.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.989+0000 7f6d24600640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6d1c0c8540 0x7f6d1c150570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:25.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.989+0000 7f6d24600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6d1c151e00 0x7f6d1c151110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:25.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.989+0000 7f6d24600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d1c157ee0 0x7f6d1c146ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:25.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.989+0000 7f6d21200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6d1c151e00 0x7f6d1c151110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:25.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.989+0000 7f6d22600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d1c157ee0 0x7f6d1c146ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:25.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.989+0000 7f6d21c00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6d1c0c8540 0x7f6d1c150570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:25.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.989+0000 7f6d22600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d1c157ee0 0x7f6d1c146ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:49392/0 (socket says 172.21.15.63:49392) 2024-05-21T01:20:25.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.989+0000 7f6d22600640 1 -- 172.21.15.63:0/47706281 learned_addr learned my addr 172.21.15.63:0/47706281 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:25.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.989+0000 7f6d24600640 1 -- 172.21.15.63:0/47706281 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f6d1c0c9b70 con 0x7f6d1c157ee0 2024-05-21T01:20:25.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.989+0000 7f6d24600640 1 -- 172.21.15.63:0/47706281 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f6d1c1521e0 con 0x7f6d1c151e00 2024-05-21T01:20:25.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.989+0000 7f6d24600640 1 -- 172.21.15.63:0/47706281 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f6d1c0c9cf0 con 0x7f6d1c0c8540 2024-05-21T01:20:25.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.989+0000 7fb917e00640 1 -- 172.21.15.63:0/2665135878 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb910156210 msgr2=0x7fb91006d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:25.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.989+0000 7fb917e00640 1 --2- 172.21.15.63:0/2665135878 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb910156210 0x7fb91006d250 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb9100b43f0 tx=0x7fb8fc01ec70 comp rx=0 tx=0).stop 2024-05-21T01:20:25.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.989+0000 7f6ac3800640 1 Processor -- start 2024-05-21T01:20:25.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.989+0000 7f6ac3800640 1 -- start start 2024-05-21T01:20:25.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.989+0000 7fe745400640 1 --2- 172.21.15.63:0/2508371191 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fe72006f4d0 0x7fe720071990 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe73400aaf0 tx=0x7fe734008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:25.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.989+0000 7fac3e000640 1 --2- 172.21.15.63:0/2918214457 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fac2806f400 0x7fac280718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:25.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.989+0000 7fac3e000640 1 -- 172.21.15.63:0/2918214457 <== mon.2 v2:172.21.15.131:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fac4008f460 con 0x7fac4815a3f0 2024-05-21T01:20:25.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.989+0000 7f6d22600640 1 -- 172.21.15.63:0/47706281 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6d1c0c8540 msgr2=0x7f6d1c150570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:25.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.989+0000 7f6d22600640 1 --2- 172.21.15.63:0/47706281 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6d1c0c8540 0x7f6d1c150570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:25.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.989+0000 7f6d22600640 1 -- 172.21.15.63:0/47706281 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6d1c151e00 msgr2=0x7f6d1c151110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:25.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.989+0000 7f6d22600640 1 --2- 172.21.15.63:0/47706281 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6d1c151e00 0x7f6d1c151110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:25.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.989+0000 7f6d22600640 1 -- 172.21.15.63:0/47706281 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d1c150ab0 con 0x7f6d1c157ee0 2024-05-21T01:20:25.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.989+0000 7f6d21200640 1 --2- 172.21.15.63:0/47706281 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6d1c151e00 0x7f6d1c151110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T01:20:25.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.989+0000 7f500ca00640 1 -- 172.21.15.63:0/1550998402 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f500806c4a0 msgr2=0x7f50080aea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:25.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.989+0000 7f500ca00640 1 --2- 172.21.15.63:0/1550998402 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f500806c4a0 0x7f50080aea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:25.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.989+0000 7f500ca00640 1 -- 172.21.15.63:0/1550998402 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f50080c36d0 msgr2=0x7f50081fa3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:25.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.989+0000 7f500ca00640 1 --2- 172.21.15.63:0/1550998402 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f50080c36d0 0x7f50081fa3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:25.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.989+0000 7f500ca00640 1 -- 172.21.15.63:0/1550998402 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50080c46c0 con 0x7f50080ca780 2024-05-21T01:20:25.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.989+0000 7fac45e00640 1 --2- 172.21.15.63:0/2918214457 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fac2806f400 0x7fac280718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:25.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.989+0000 7fb917e00640 1 -- 172.21.15.63:0/2665135878 shutdown_connections 2024-05-21T01:20:25.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.989+0000 7fb917e00640 1 --2- 172.21.15.63:0/2665135878 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb910156210 0x7fb91006d250 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:25.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.989+0000 7fb917e00640 1 --2- 172.21.15.63:0/2665135878 >> v2:172.21.15.63:3300/0 conn(0x7fb910155e30 0x7fb91015c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:25.015 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.989+0000 7fb917e00640 1 -- 172.21.15.63:0/2665135878 >> 172.21.15.63:0/2665135878 conn(0x7fb9100684c0 msgr2=0x7fb9100688d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:25.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.989+0000 7f966aa00640 1 Processor -- start 2024-05-21T01:20:25.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.989+0000 7f6d22600640 1 --2- 172.21.15.63:0/47706281 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d1c157ee0 0x7f6d1c146ad0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6d1000c3f0 tx=0x7f6d1000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:25.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.989+0000 7f6ac3800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6abc0c6380 0x7f6abc158720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:25.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.993+0000 7f966aa00640 1 -- start start 2024-05-21T01:20:25.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.993+0000 7f6ac3800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6abc156e20 0x7f6abc157a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:25.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.993+0000 7fb917e00640 1 -- 172.21.15.63:0/2665135878 shutdown_connections 2024-05-21T01:20:25.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.993+0000 7fb917e00640 1 -- 172.21.15.63:0/2665135878 wait complete. 2024-05-21T01:20:25.017 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.993+0000 7f6ac3800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6abc163810 0x7f6abc157fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:25.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.993+0000 7f500ca00640 1 --2- 172.21.15.63:0/1550998402 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50080ca780 0x7f50081fa910 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f500001a0d0 tx=0x7f5000019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:25.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.993+0000 7f6ac0e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6abc0c6380 0x7f6abc158720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:25.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.993+0000 7f6ac0e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6abc0c6380 0x7f6abc158720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.63:42122/0 (socket says 172.21.15.63:42122) 2024-05-21T01:20:25.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.993+0000 7f6abbe00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6abc156e20 0x7f6abc157a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:25.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.993+0000 7f6ac0e00640 1 -- 172.21.15.63:0/3746577623 learned_addr learned my addr 172.21.15.63:0/3746577623 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:25.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.993+0000 7f6ac3800640 1 -- 172.21.15.63:0/3746577623 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f6abc06e050 con 0x7f6abc163810 2024-05-21T01:20:25.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.993+0000 7f6ac3800640 1 -- 172.21.15.63:0/3746577623 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f6abc06ded0 con 0x7f6abc0c6380 2024-05-21T01:20:25.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.993+0000 7f6ac3800640 1 -- 172.21.15.63:0/3746577623 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f6abc0cca10 con 0x7f6abc156e20 2024-05-21T01:20:25.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.993+0000 7f6d19600640 1 -- 172.21.15.63:0/47706281 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d10011790 con 0x7f6d1c157ee0 2024-05-21T01:20:25.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.993+0000 7f6ac1800640 1 --2- 172.21.15.63:0/3746577623 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6abc163810 0x7f6abc157fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:25.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.993+0000 7f6d19600640 1 -- 172.21.15.63:0/47706281 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d10017070 con 0x7f6d1c157ee0 2024-05-21T01:20:25.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.993+0000 7f6d19600640 1 -- 172.21.15.63:0/47706281 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d10011b70 con 0x7f6d1c157ee0 2024-05-21T01:20:25.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.993+0000 7fac45e00640 1 --2- 172.21.15.63:0/2918214457 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fac2806f400 0x7fac280718c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fac380b2000 tx=0x7fac380aa070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:25.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.993+0000 7f5004c00640 1 -- 172.21.15.63:0/1550998402 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50000b0040 con 0x7f50080ca780 2024-05-21T01:20:25.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.993+0000 7f6d24600640 1 -- 172.21.15.63:0/47706281 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d1c151650 con 0x7f6d1c157ee0 2024-05-21T01:20:25.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.993+0000 7f6d24600640 1 -- 172.21.15.63:0/47706281 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d1c1475c0 con 0x7f6d1c157ee0 2024-05-21T01:20:25.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.993+0000 7f5004c00640 1 -- 172.21.15.63:0/1550998402 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50000ba070 con 0x7f50080ca780 2024-05-21T01:20:25.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.993+0000 7f5004c00640 1 -- 172.21.15.63:0/1550998402 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50000044f0 con 0x7f50080ca780 2024-05-21T01:20:25.020 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.993+0000 7f500d400640 1 -- 172.21.15.63:0/1550998402 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5008165430 con 0x7f50080ca780 2024-05-21T01:20:25.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.993+0000 7fb917e00640 1 Processor -- start 2024-05-21T01:20:25.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.993+0000 7f966aa00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f966406f5d0 0x7f96641e97e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:25.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.993+0000 7f966aa00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f966406f9b0 0x7f96641e9d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:25.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.993+0000 7f966aa00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9664163950 0x7f96641569f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:25.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.993+0000 7f966aa00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f966415a700 con 0x7f966406f5d0 2024-05-21T01:20:25.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.993+0000 7f966aa00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f96640cd990 con 0x7f966406f9b0 2024-05-21T01:20:25.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.993+0000 7f966aa00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f966415a880 con 0x7f9664163950 2024-05-21T01:20:25.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.993+0000 7f9663400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f966406f9b0 0x7f96641e9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:25.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.993+0000 7f9663400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f966406f9b0 0x7f96641e9d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.63:42126/0 (socket says 172.21.15.63:42126) 2024-05-21T01:20:25.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.993+0000 7f9663400640 1 -- 172.21.15.63:0/1906912002 learned_addr learned my addr 172.21.15.63:0/1906912002 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:25.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.993+0000 7f6ac0e00640 1 -- 172.21.15.63:0/3746577623 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6abc156e20 msgr2=0x7f6abc157a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:25.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.993+0000 7f6ac0e00640 1 --2- 172.21.15.63:0/3746577623 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6abc156e20 0x7f6abc157a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:25.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.993+0000 7f6ac0e00640 1 -- 172.21.15.63:0/3746577623 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6abc163810 msgr2=0x7f6abc157fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:25.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.993+0000 7f6ac0e00640 1 --2- 172.21.15.63:0/3746577623 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6abc163810 0x7f6abc157fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:25.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.993+0000 7f6ac0e00640 1 -- 172.21.15.63:0/3746577623 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6abc1fd560 con 0x7f6abc0c6380 2024-05-21T01:20:25.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.993+0000 7fb917e00640 1 -- start start 2024-05-21T01:20:25.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.993+0000 7f500d400640 1 -- 172.21.15.63:0/1550998402 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50081656d0 con 0x7f50080ca780 2024-05-21T01:20:25.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.993+0000 7f6d0ea00640 1 -- 172.21.15.63:0/47706281 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cf00052a0 con 0x7f6d1c157ee0 2024-05-21T01:20:25.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.993+0000 7f9668a00640 1 --2- 172.21.15.63:0/1906912002 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9664163950 0x7f96641569f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:25.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.993+0000 7f9663e00640 1 --2- 172.21.15.63:0/1906912002 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f966406f5d0 0x7f96641e97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:25.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.993+0000 7f6ac0e00640 1 --2- 172.21.15.63:0/3746577623 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6abc0c6380 0x7f6abc158720 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6ab001a140 tx=0x7f6ab001ad50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:25.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.997+0000 7f6ab8c00640 1 -- 172.21.15.63:0/3746577623 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab00aae60 con 0x7f6abc0c6380 2024-05-21T01:20:25.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.997+0000 7f6ac3800640 1 -- 172.21.15.63:0/3746577623 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6abc0cb8d0 con 0x7f6abc0c6380 2024-05-21T01:20:25.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.997+0000 7f6ac3800640 1 -- 172.21.15.63:0/3746577623 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6abc14e780 con 0x7f6abc0c6380 2024-05-21T01:20:25.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.997+0000 7fb917e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb9100d19b0 0x7fb9101fed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:25.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.997+0000 7fb917e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb910155e30 0x7fb910150b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:25.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.997+0000 7f6ab8c00640 1 -- 172.21.15.63:0/3746577623 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ab00b3800 con 0x7f6abc0c6380 2024-05-21T01:20:25.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.997+0000 7f6ab8c00640 1 -- 172.21.15.63:0/3746577623 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab00b3bd0 con 0x7f6abc0c6380 2024-05-21T01:20:25.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.997+0000 7f9663400640 1 -- 172.21.15.63:0/1906912002 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9664163950 msgr2=0x7f96641569f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:25.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.997+0000 7f9663400640 1 --2- 172.21.15.63:0/1906912002 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9664163950 0x7f96641569f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:25.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.997+0000 7f9663400640 1 -- 172.21.15.63:0/1906912002 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f966406f5d0 msgr2=0x7f96641e97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:25.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.997+0000 7f9663400640 1 --2- 172.21.15.63:0/1906912002 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f966406f5d0 0x7f96641e97e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:25.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.997+0000 7f9663400640 1 -- 172.21.15.63:0/1906912002 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96641eb4c0 con 0x7f966406f9b0 2024-05-21T01:20:25.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.997+0000 7fb917e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb910151b30 0x7fb91015f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:25.025 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.997+0000 7fb917e00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fb9100c7240 con 0x7fb910151b30 2024-05-21T01:20:25.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.997+0000 7fb917e00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fb9100c6f60 con 0x7fb910155e30 2024-05-21T01:20:25.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.997+0000 7fb917e00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fb91006d790 con 0x7fb9100d19b0 2024-05-21T01:20:25.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.997+0000 7fb915e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb910151b30 0x7fb91015f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:25.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.997+0000 7fb915400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb9100d19b0 0x7fb9101fed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:25.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.997+0000 7f500d400640 1 -- 172.21.15.63:0/1550998402 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f500806c0c0 con 0x7f50080ca780 2024-05-21T01:20:25.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.997+0000 7fb915e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb910151b30 0x7fb91015f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:49430/0 (socket says 172.21.15.63:49430) 2024-05-21T01:20:25.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.997+0000 7fb915e00640 1 -- 172.21.15.63:0/1122955279 learned_addr learned my addr 172.21.15.63:0/1122955279 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:25.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.997+0000 7fb914a00640 1 --2- 172.21.15.63:0/1122955279 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb910155e30 0x7fb910150b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:25.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.997+0000 7fb915e00640 1 -- 172.21.15.63:0/1122955279 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb9100d19b0 msgr2=0x7fb9101fed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:25.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.997+0000 7fb915e00640 1 --2- 172.21.15.63:0/1122955279 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb9100d19b0 0x7fb9101fed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:25.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.997+0000 7fb915e00640 1 -- 172.21.15.63:0/1122955279 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb910155e30 msgr2=0x7fb910150b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:25.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.997+0000 7fb915e00640 1 --2- 172.21.15.63:0/1122955279 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb910155e30 0x7fb910150b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:25.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.997+0000 7fb915e00640 1 -- 172.21.15.63:0/1122955279 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9100ce010 con 0x7fb910151b30 2024-05-21T01:20:25.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.997+0000 7f6ac3800640 1 -- 172.21.15.63:0/3746577623 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a980052a0 con 0x7f6abc0c6380 2024-05-21T01:20:25.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.997+0000 7f6d19600640 1 -- 172.21.15.63:0/47706281 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7f6d10011d10 con 0x7f6d1c157ee0 2024-05-21T01:20:25.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.997+0000 7f6d19600640 1 --2- 172.21.15.63:0/47706281 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f6cfc06f450 0x7f6cfc071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:25.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.997+0000 7f6d19600640 1 -- 172.21.15.63:0/47706281 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f6d10057270 con 0x7f6d1c157ee0 2024-05-21T01:20:25.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.997+0000 7f6d21c00640 1 --2- 172.21.15.63:0/47706281 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f6cfc06f450 0x7f6cfc071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:25.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.997+0000 7f9663400640 1 --2- 172.21.15.63:0/1906912002 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f966406f9b0 0x7f96641e9d20 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f965401d340 tx=0x7f965401ba30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:25.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.997+0000 7fb915e00640 1 --2- 172.21.15.63:0/1122955279 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb910151b30 0x7fb91015f270 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb90800cbf0 tx=0x7fb90800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:25.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.997+0000 7f965be00640 1 -- 172.21.15.63:0/1906912002 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96540b5040 con 0x7f966406f9b0 2024-05-21T01:20:25.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.997+0000 7f966aa00640 1 -- 172.21.15.63:0/1906912002 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96641eb7a0 con 0x7f966406f9b0 2024-05-21T01:20:25.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:24.997+0000 7f966aa00640 1 -- 172.21.15.63:0/1906912002 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96641f6880 con 0x7f966406f9b0 2024-05-21T01:20:25.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.001+0000 7fe73d600640 1 -- 172.21.15.63:0/2508371191 <== mon.2 v2:172.21.15.131:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fe72c05bc50 con 0x7fe7400723a0 2024-05-21T01:20:25.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.001+0000 7f965be00640 1 -- 172.21.15.63:0/1906912002 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96540c0070 con 0x7f966406f9b0 2024-05-21T01:20:25.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.001+0000 7f965be00640 1 -- 172.21.15.63:0/1906912002 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96540b09c0 con 0x7f966406f9b0 2024-05-21T01:20:25.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.001+0000 7f5004c00640 1 -- 172.21.15.63:0/1550998402 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7f50000b3070 con 0x7f50080ca780 2024-05-21T01:20:25.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.001+0000 7f6d21c00640 1 --2- 172.21.15.63:0/47706281 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f6cfc06f450 0x7f6cfc071910 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6d14001ee0 tx=0x7f6d14009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:25.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.001+0000 7f6ab8c00640 1 -- 172.21.15.63:0/3746577623 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7f6ab00bc390 con 0x7f6abc0c6380 2024-05-21T01:20:25.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.001+0000 7f6ab8c00640 1 --2- 172.21.15.63:0/3746577623 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f6a9c06f430 0x7f6a9c0718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:25.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.001+0000 7f5004c00640 1 --2- 172.21.15.63:0/1550998402 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f4fe406f4d0 0x7f4fe4071990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:25.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.001+0000 7f5004c00640 1 -- 172.21.15.63:0/1550998402 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f5000129270 con 0x7f50080ca780 2024-05-21T01:20:25.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.001+0000 7f6ab8c00640 1 -- 172.21.15.63:0/3746577623 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f6ab0129920 con 0x7f6abc0c6380 2024-05-21T01:20:25.031 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.001+0000 7f966aa00640 1 -- 172.21.15.63:0/1906912002 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f963c0052a0 con 0x7f966406f9b0 2024-05-21T01:20:25.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.001+0000 7f5007e00640 1 --2- 172.21.15.63:0/1550998402 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f4fe406f4d0 0x7f4fe4071990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:25.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.001+0000 7f6abbe00640 1 --2- 172.21.15.63:0/3746577623 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f6a9c06f430 0x7f6a9c0718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:25.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.005+0000 7f6abbe00640 1 --2- 172.21.15.63:0/3746577623 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f6a9c06f430 0x7f6a9c0718f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6abc146350 tx=0x7f6aa8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:25.032 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.005+0000 7f5007e00640 1 --2- 172.21.15.63:0/1550998402 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f4fe406f4d0 0x7f4fe4071990 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4ff8001810 tx=0x7f4ff8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:25.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.005+0000 7f965be00640 1 -- 172.21.15.63:0/1906912002 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7f96540b8070 con 0x7f966406f9b0 2024-05-21T01:20:25.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.005+0000 7f965be00640 1 --2- 172.21.15.63:0/1906912002 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f964406f430 0x7f96440718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:25.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.005+0000 7f965be00640 1 -- 172.21.15.63:0/1906912002 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f965412cd80 con 0x7f966406f9b0 2024-05-21T01:20:25.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.005+0000 7f9663e00640 1 --2- 172.21.15.63:0/1906912002 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f964406f430 0x7f96440718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:25.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.005+0000 7fb90d600640 1 -- 172.21.15.63:0/1122955279 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb908017070 con 0x7fb910151b30 2024-05-21T01:20:25.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.009+0000 7f6d19600640 1 -- 172.21.15.63:0/47706281 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f6d1005b6e0 con 0x7f6d1c157ee0 2024-05-21T01:20:25.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.009+0000 7fb917e00640 1 -- 172.21.15.63:0/1122955279 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb910151070 con 0x7fb910151b30 2024-05-21T01:20:25.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.009+0000 7f9663e00640 1 --2- 172.21.15.63:0/1906912002 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f964406f430 0x7f96440718f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f965c005c10 tx=0x7f965c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:25.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.009+0000 7fb917e00640 1 -- 172.21.15.63:0/1122955279 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9100ce590 con 0x7fb910151b30 2024-05-21T01:20:25.034 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.009+0000 7fb917e00640 1 -- 172.21.15.63:0/1122955279 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9100507f0 con 0x7fb910151b30 2024-05-21T01:20:25.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.013+0000 7f5004c00640 1 -- 172.21.15.63:0/1550998402 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f5000016090 con 0x7f50080ca780 2024-05-21T01:20:25.035 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.013+0000 7fb90d600640 1 -- 172.21.15.63:0/1122955279 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb90800aca0 con 0x7fb910151b30 2024-05-21T01:20:25.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.013+0000 7fb90d600640 1 -- 172.21.15.63:0/1122955279 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb908021060 con 0x7fb910151b30 2024-05-21T01:20:25.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.013+0000 7fb90d600640 1 -- 172.21.15.63:0/1122955279 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7fb90801a070 con 0x7fb910151b30 2024-05-21T01:20:25.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.013+0000 7fb90d600640 1 --2- 172.21.15.63:0/1122955279 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fb8f006f430 0x7fb8f00718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:25.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.013+0000 7fb90d600640 1 -- 172.21.15.63:0/1122955279 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb90808f820 con 0x7fb910151b30 2024-05-21T01:20:25.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.021+0000 7fb915400640 1 --2- 172.21.15.63:0/1122955279 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fb8f006f430 0x7fb8f00718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:25.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.021+0000 7fb915400640 1 --2- 172.21.15.63:0/1122955279 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fb8f006f430 0x7fb8f00718f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb904009b60 tx=0x7fb904009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:25.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.021+0000 7fb90d600640 1 -- 172.21.15.63:0/1122955279 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fb90805bdf0 con 0x7fb910151b30 2024-05-21T01:20:25.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.021+0000 7fac3e000640 1 -- 172.21.15.63:0/2918214457 <== mon.2 v2:172.21.15.131:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fac4005b930 con 0x7fac4815a3f0 2024-05-21T01:20:25.036 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.029+0000 7f6ab8c00640 1 -- 172.21.15.63:0/3746577623 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f6ab0016130 con 0x7f6abc0c6380 2024-05-21T01:20:25.045 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.041+0000 7f965be00640 1 -- 172.21.15.63:0/1906912002 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f96540c9060 con 0x7f966406f9b0 2024-05-21T01:20:25.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.329+0000 7f3071400640 1 -- 172.21.15.63:0/4194008732 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f306c06d040 con 0x7f306c06c4a0 2024-05-21T01:20:25.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.333+0000 7f3063e00640 1 -- 172.21.15.63:0/4194008732 <== mon.2 v2:172.21.15.131:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f306405f740 con 0x7f306c06c4a0 2024-05-21T01:20:25.338 INFO:teuthology.orchestra.run.smithi063.stdout:64424509448 2024-05-21T01:20:25.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.333+0000 7f6d0ea00640 1 -- 172.21.15.63:0/47706281 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f6cf0005860 con 0x7f6d1c157ee0 2024-05-21T01:20:25.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.333+0000 7f6d19600640 1 -- 172.21.15.63:0/47706281 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6d1005afe0 con 0x7f6d1c157ee0 2024-05-21T01:20:25.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.337+0000 7f3071400640 1 -- 172.21.15.63:0/4194008732 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f304c06f430 msgr2=0x7f304c0718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:25.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.337+0000 7f3071400640 1 --2- 172.21.15.63:0/4194008732 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f304c06f430 0x7f304c0718f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f306c1607b0 tx=0x7f305c008040 comp rx=0 tx=0).stop 2024-05-21T01:20:25.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.337+0000 7f3071400640 1 -- 172.21.15.63:0/4194008732 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f306c06c4a0 msgr2=0x7f306c0aef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:25.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.337+0000 7f3071400640 1 --2- 172.21.15.63:0/4194008732 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f306c06c4a0 0x7f306c0aef80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3064001a60 tx=0x7f3064001f20 comp rx=0 tx=0).stop 2024-05-21T01:20:25.343 INFO:teuthology.orchestra.run.smithi063.stdout:64424509449 2024-05-21T01:20:25.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.337+0000 7f6d0ea00640 1 -- 172.21.15.63:0/47706281 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f6cfc06f450 msgr2=0x7f6cfc071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:25.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.337+0000 7f6d0ea00640 1 --2- 172.21.15.63:0/47706281 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f6cfc06f450 0x7f6cfc071910 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6d14001ee0 tx=0x7f6d14009040 comp rx=0 tx=0).stop 2024-05-21T01:20:25.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.337+0000 7f6d0ea00640 1 -- 172.21.15.63:0/47706281 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d1c157ee0 msgr2=0x7f6d1c146ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:25.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.337+0000 7f6d0ea00640 1 --2- 172.21.15.63:0/47706281 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d1c157ee0 0x7f6d1c146ad0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6d1000c3f0 tx=0x7f6d1000c8b0 comp rx=0 tx=0).stop 2024-05-21T01:20:25.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.337+0000 7f6d0ea00640 1 -- 172.21.15.63:0/47706281 shutdown_connections 2024-05-21T01:20:25.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.337+0000 7f6d0ea00640 1 --2- 172.21.15.63:0/47706281 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f6cfc06f450 0x7f6cfc071910 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:25.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.337+0000 7f6d0ea00640 1 --2- 172.21.15.63:0/47706281 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d1c157ee0 0x7f6d1c146ad0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:25.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.337+0000 7f6d0ea00640 1 --2- 172.21.15.63:0/47706281 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6d1c151e00 0x7f6d1c151110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:25.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.337+0000 7f6d0ea00640 1 --2- 172.21.15.63:0/47706281 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6d1c0c8540 0x7f6d1c150570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:25.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.337+0000 7f6d0ea00640 1 -- 172.21.15.63:0/47706281 >> 172.21.15.63:0/47706281 conn(0x7f6d1c06c8a0 msgr2=0x7f6d1c06eec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:25.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.337+0000 7f6d0ea00640 1 -- 172.21.15.63:0/47706281 shutdown_connections 2024-05-21T01:20:25.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.337+0000 7f6d0ea00640 1 -- 172.21.15.63:0/47706281 wait complete. 2024-05-21T01:20:25.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.341+0000 7f3071400640 1 -- 172.21.15.63:0/4194008732 shutdown_connections 2024-05-21T01:20:25.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.341+0000 7f3071400640 1 --2- 172.21.15.63:0/4194008732 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f304c06f430 0x7f304c0718f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:25.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.341+0000 7f3071400640 1 --2- 172.21.15.63:0/4194008732 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f306c1589d0 0x7f306c151840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:25.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.341+0000 7f3071400640 1 --2- 172.21.15.63:0/4194008732 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f306c0c93c0 0x7f306c151300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:25.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.341+0000 7f3071400640 1 --2- 172.21.15.63:0/4194008732 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f306c06c4a0 0x7f306c0aef80 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:25.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.341+0000 7f3071400640 1 -- 172.21.15.63:0/4194008732 >> 172.21.15.63:0/4194008732 conn(0x7f306c0c9c60 msgr2=0x7f306c161c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:25.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.341+0000 7f3071400640 1 -- 172.21.15.63:0/4194008732 shutdown_connections 2024-05-21T01:20:25.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.341+0000 7f3071400640 1 -- 172.21.15.63:0/4194008732 wait complete. 2024-05-21T01:20:25.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.341+0000 7fe746800640 1 -- 172.21.15.63:0/2508371191 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fe7401412a0 con 0x7fe7400723a0 2024-05-21T01:20:25.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.341+0000 7fe73d600640 1 -- 172.21.15.63:0/2508371191 <== mon.2 v2:172.21.15.131:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe72c064290 con 0x7fe7400723a0 2024-05-21T01:20:25.349 INFO:teuthology.orchestra.run.smithi063.stdout:64424509448 2024-05-21T01:20:25.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.345+0000 7fe746800640 1 -- 172.21.15.63:0/2508371191 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fe72006f4d0 msgr2=0x7fe720071990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:25.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.345+0000 7fe746800640 1 --2- 172.21.15.63:0/2508371191 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fe72006f4d0 0x7fe720071990 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe73400aaf0 tx=0x7fe734008040 comp rx=0 tx=0).stop 2024-05-21T01:20:25.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.345+0000 7fe746800640 1 -- 172.21.15.63:0/2508371191 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe7400723a0 msgr2=0x7fe7401660b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:25.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.345+0000 7fe746800640 1 --2- 172.21.15.63:0/2508371191 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe7400723a0 0x7fe7401660b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe72c00c410 tx=0x7fe72c00c8d0 comp rx=0 tx=0).stop 2024-05-21T01:20:25.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.345+0000 7fe746800640 1 -- 172.21.15.63:0/2508371191 shutdown_connections 2024-05-21T01:20:25.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.345+0000 7fe746800640 1 --2- 172.21.15.63:0/2508371191 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fe72006f4d0 0x7fe720071990 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:25.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.345+0000 7fe746800640 1 --2- 172.21.15.63:0/2508371191 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe740153e80 0x7fe740164e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:25.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.345+0000 7fe746800640 1 --2- 172.21.15.63:0/2508371191 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe7400723a0 0x7fe7401660b0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:25.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.345+0000 7fe746800640 1 --2- 172.21.15.63:0/2508371191 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe74006c4a0 0x7fe7401f9780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:25.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.345+0000 7fe746800640 1 -- 172.21.15.63:0/2508371191 >> 172.21.15.63:0/2508371191 conn(0x7fe7400cacf0 msgr2=0x7fe7400cc0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:25.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.353+0000 7fe746800640 1 -- 172.21.15.63:0/2508371191 shutdown_connections 2024-05-21T01:20:25.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.353+0000 7fe746800640 1 -- 172.21.15.63:0/2508371191 wait complete. 2024-05-21T01:20:25.366 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.361+0000 7f500d400640 1 -- 172.21.15.63:0/1550998402 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f50080c2dc0 con 0x7f50080ca780 2024-05-21T01:20:25.368 INFO:teuthology.orchestra.run.smithi063.stdout:55834574857 2024-05-21T01:20:25.368 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.361+0000 7f5004c00640 1 -- 172.21.15.63:0/1550998402 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f50000f5f20 con 0x7f50080ca780 2024-05-21T01:20:25.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.365+0000 7f500d400640 1 -- 172.21.15.63:0/1550998402 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f4fe406f4d0 msgr2=0x7f4fe4071990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:25.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.365+0000 7f500d400640 1 --2- 172.21.15.63:0/1550998402 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f4fe406f4d0 0x7f4fe4071990 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4ff8001810 tx=0x7f4ff8009040 comp rx=0 tx=0).stop 2024-05-21T01:20:25.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.365+0000 7f500d400640 1 -- 172.21.15.63:0/1550998402 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50080ca780 msgr2=0x7f50081fa910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:25.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.365+0000 7f500d400640 1 --2- 172.21.15.63:0/1550998402 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50080ca780 0x7f50081fa910 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f500001a0d0 tx=0x7f5000019240 comp rx=0 tx=0).stop 2024-05-21T01:20:25.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.365+0000 7f500d400640 1 -- 172.21.15.63:0/1550998402 shutdown_connections 2024-05-21T01:20:25.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.365+0000 7f500d400640 1 --2- 172.21.15.63:0/1550998402 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f4fe406f4d0 0x7f4fe4071990 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:25.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.365+0000 7f500d400640 1 --2- 172.21.15.63:0/1550998402 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50080ca780 0x7f50081fa910 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:25.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.365+0000 7f500d400640 1 --2- 172.21.15.63:0/1550998402 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f50080c36d0 0x7f50081fa3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:25.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.365+0000 7f500d400640 1 --2- 172.21.15.63:0/1550998402 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f500806c4a0 0x7f50080aea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:25.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.365+0000 7f500d400640 1 -- 172.21.15.63:0/1550998402 >> 172.21.15.63:0/1550998402 conn(0x7f50080c9c60 msgr2=0x7f50080c8640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:25.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.365+0000 7f500d400640 1 -- 172.21.15.63:0/1550998402 shutdown_connections 2024-05-21T01:20:25.372 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.365+0000 7f500d400640 1 -- 172.21.15.63:0/1550998402 wait complete. 2024-05-21T01:20:25.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.369+0000 7fb917e00640 1 -- 172.21.15.63:0/1122955279 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fb9100cbe20 con 0x7fb910151b30 2024-05-21T01:20:25.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.369+0000 7fb90d600640 1 -- 172.21.15.63:0/1122955279 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb9080600f0 con 0x7fb910151b30 2024-05-21T01:20:25.376 INFO:teuthology.orchestra.run.smithi063.stdout:60129542154 2024-05-21T01:20:25.378 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509448 for osd.0 2024-05-21T01:20:25.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.373+0000 7fac4ca00640 1 -- 172.21.15.63:0/2918214457 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fac20005590 con 0x7fac4815a3f0 2024-05-21T01:20:25.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.373+0000 7fac3e000640 1 -- 172.21.15.63:0/2918214457 <== mon.2 v2:172.21.15.131:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fac4005fc30 con 0x7fac4815a3f0 2024-05-21T01:20:25.378 INFO:teuthology.orchestra.run.smithi063.stdout:64424509450 2024-05-21T01:20:25.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.377+0000 7fb917e00640 1 -- 172.21.15.63:0/1122955279 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fb8f006f430 msgr2=0x7fb8f00718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:25.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.377+0000 7fb917e00640 1 --2- 172.21.15.63:0/1122955279 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fb8f006f430 0x7fb8f00718f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb904009b60 tx=0x7fb904009190 comp rx=0 tx=0).stop 2024-05-21T01:20:25.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.377+0000 7fac4ca00640 1 -- 172.21.15.63:0/2918214457 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fac2806f400 msgr2=0x7fac280718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:25.382 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509449 for osd.2 2024-05-21T01:20:25.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.377+0000 7fac4ca00640 1 --2- 172.21.15.63:0/2918214457 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fac2806f400 0x7fac280718c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fac380b2000 tx=0x7fac380aa070 comp rx=0 tx=0).stop 2024-05-21T01:20:25.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.377+0000 7fac4ca00640 1 -- 172.21.15.63:0/2918214457 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fac4815a3f0 msgr2=0x7fac481f9080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:25.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.377+0000 7fac4ca00640 1 --2- 172.21.15.63:0/2918214457 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fac4815a3f0 0x7fac481f9080 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fac4000c7a0 tx=0x7fac4000cc60 comp rx=0 tx=0).stop 2024-05-21T01:20:25.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.377+0000 7fac4ca00640 1 -- 172.21.15.63:0/2918214457 shutdown_connections 2024-05-21T01:20:25.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.377+0000 7fac4ca00640 1 --2- 172.21.15.63:0/2918214457 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fac2806f400 0x7fac280718c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:25.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.377+0000 7fac4ca00640 1 --2- 172.21.15.63:0/2918214457 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fac4815a3f0 0x7fac481f9080 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:25.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.377+0000 7fac4ca00640 1 --2- 172.21.15.63:0/2918214457 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fac480c84b0 0x7fac4815f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:25.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.377+0000 7fac4ca00640 1 --2- 172.21.15.63:0/2918214457 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fac480c7fe0 0x7fac4815eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:25.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.377+0000 7fb917e00640 1 -- 172.21.15.63:0/1122955279 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb910151b30 msgr2=0x7fb91015f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:25.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.377+0000 7fb917e00640 1 --2- 172.21.15.63:0/1122955279 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb910151b30 0x7fb91015f270 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb90800cbf0 tx=0x7fb90800a060 comp rx=0 tx=0).stop 2024-05-21T01:20:25.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.377+0000 7fb917e00640 1 -- 172.21.15.63:0/1122955279 shutdown_connections 2024-05-21T01:20:25.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.377+0000 7fb917e00640 1 --2- 172.21.15.63:0/1122955279 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fb8f006f430 0x7fb8f00718f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:25.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.377+0000 7fb917e00640 1 --2- 172.21.15.63:0/1122955279 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb910151b30 0x7fb91015f270 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:25.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.377+0000 7fb917e00640 1 --2- 172.21.15.63:0/1122955279 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb910155e30 0x7fb910150b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:25.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.377+0000 7fb917e00640 1 --2- 172.21.15.63:0/1122955279 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb9100d19b0 0x7fb9101fed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:25.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.377+0000 7fb917e00640 1 -- 172.21.15.63:0/1122955279 >> 172.21.15.63:0/1122955279 conn(0x7fb9100684c0 msgr2=0x7fb9100688a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:25.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.377+0000 7fac4ca00640 1 -- 172.21.15.63:0/2918214457 >> 172.21.15.63:0/2918214457 conn(0x7fac480cd170 msgr2=0x7fac48073110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:25.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.377+0000 7fac4ca00640 1 -- 172.21.15.63:0/2918214457 shutdown_connections 2024-05-21T01:20:25.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.377+0000 7fb917e00640 1 -- 172.21.15.63:0/1122955279 shutdown_connections 2024-05-21T01:20:25.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.377+0000 7fac4ca00640 1 -- 172.21.15.63:0/2918214457 wait complete. 2024-05-21T01:20:25.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.377+0000 7fb917e00640 1 -- 172.21.15.63:0/1122955279 wait complete. 2024-05-21T01:20:25.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.381+0000 7f6ac3800640 1 -- 172.21.15.63:0/3746577623 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f6a98005860 con 0x7f6abc0c6380 2024-05-21T01:20:25.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.381+0000 7f6ab8c00640 1 -- 172.21.15.63:0/3746577623 <== mon.1 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6ab00f5fa0 con 0x7f6abc0c6380 2024-05-21T01:20:25.386 INFO:teuthology.orchestra.run.smithi063.stdout:60129542153 2024-05-21T01:20:25.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.381+0000 7f6ac3800640 1 -- 172.21.15.63:0/3746577623 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f6a9c06f430 msgr2=0x7f6a9c0718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:25.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.381+0000 7f6ac3800640 1 --2- 172.21.15.63:0/3746577623 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f6a9c06f430 0x7f6a9c0718f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6abc146350 tx=0x7f6aa8009040 comp rx=0 tx=0).stop 2024-05-21T01:20:25.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.381+0000 7f6ac3800640 1 -- 172.21.15.63:0/3746577623 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6abc0c6380 msgr2=0x7f6abc158720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:25.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.381+0000 7f6ac3800640 1 --2- 172.21.15.63:0/3746577623 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6abc0c6380 0x7f6abc158720 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6ab001a140 tx=0x7f6ab001ad50 comp rx=0 tx=0).stop 2024-05-21T01:20:25.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.385+0000 7f6ac3800640 1 -- 172.21.15.63:0/3746577623 shutdown_connections 2024-05-21T01:20:25.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.385+0000 7f6ac3800640 1 --2- 172.21.15.63:0/3746577623 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f6a9c06f430 0x7f6a9c0718f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:25.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.385+0000 7f6ac3800640 1 --2- 172.21.15.63:0/3746577623 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6abc163810 0x7f6abc157fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:25.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.385+0000 7f6ac3800640 1 --2- 172.21.15.63:0/3746577623 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6abc156e20 0x7f6abc157a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:25.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.385+0000 7f6ac3800640 1 --2- 172.21.15.63:0/3746577623 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6abc0c6380 0x7f6abc158720 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:25.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.385+0000 7f6ac3800640 1 -- 172.21.15.63:0/3746577623 >> 172.21.15.63:0/3746577623 conn(0x7f6abc068460 msgr2=0x7f6abc068840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:25.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.385+0000 7f6ac3800640 1 -- 172.21.15.63:0/3746577623 shutdown_connections 2024-05-21T01:20:25.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.385+0000 7f6ac3800640 1 -- 172.21.15.63:0/3746577623 wait complete. 2024-05-21T01:20:25.396 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509448 for osd.1 2024-05-21T01:20:25.396 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.393+0000 7f966aa00640 1 -- 172.21.15.63:0/1906912002 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f963c005860 con 0x7f966406f9b0 2024-05-21T01:20:25.397 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.393+0000 7f965be00640 1 -- 172.21.15.63:0/1906912002 <== mon.1 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f96540187f0 con 0x7f966406f9b0 2024-05-21T01:20:25.397 INFO:teuthology.orchestra.run.smithi063.stdout:55834574857 2024-05-21T01:20:25.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.393+0000 7f966aa00640 1 -- 172.21.15.63:0/1906912002 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f964406f430 msgr2=0x7f96440718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:25.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.393+0000 7f966aa00640 1 --2- 172.21.15.63:0/1906912002 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f964406f430 0x7f96440718f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f965c005c10 tx=0x7f965c009040 comp rx=0 tx=0).stop 2024-05-21T01:20:25.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.393+0000 7f966aa00640 1 -- 172.21.15.63:0/1906912002 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f966406f9b0 msgr2=0x7f96641e9d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:25.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.393+0000 7f966aa00640 1 --2- 172.21.15.63:0/1906912002 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f966406f9b0 0x7f96641e9d20 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f965401d340 tx=0x7f965401ba30 comp rx=0 tx=0).stop 2024-05-21T01:20:25.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.393+0000 7f966aa00640 1 -- 172.21.15.63:0/1906912002 shutdown_connections 2024-05-21T01:20:25.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.393+0000 7f966aa00640 1 --2- 172.21.15.63:0/1906912002 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f964406f430 0x7f96440718f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:25.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.393+0000 7f966aa00640 1 --2- 172.21.15.63:0/1906912002 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9664163950 0x7f96641569f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:25.400 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.393+0000 7f966aa00640 1 --2- 172.21.15.63:0/1906912002 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f966406f9b0 0x7f96641e9d20 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:25.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.393+0000 7f966aa00640 1 --2- 172.21.15.63:0/1906912002 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f966406f5d0 0x7f96641e97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:25.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.393+0000 7f966aa00640 1 -- 172.21.15.63:0/1906912002 >> 172.21.15.63:0/1906912002 conn(0x7f9664068460 msgr2=0x7f96640cd160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:25.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.393+0000 7f966aa00640 1 -- 172.21.15.63:0/1906912002 shutdown_connections 2024-05-21T01:20:25.401 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:25.393+0000 7f966aa00640 1 -- 172.21.15.63:0/1906912002 wait complete. 2024-05-21T01:20:25.409 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.7 2024-05-21T01:20:25.416 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542154 for osd.6 2024-05-21T01:20:25.418 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509452 got 64424509450 for osd.3 2024-05-21T01:20:25.423 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542153 for osd.5 2024-05-21T01:20:25.426 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.4 2024-05-21T01:20:25.679 INFO:tasks.ceph.mds.c.smithi063.stderr:2024-05-21T01:20:25.673+0000 7f1e92c00640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-05-21T01:20:26.114 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-21T01:20:26.118 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-21T01:20:26.379 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-21T01:20:26.382 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-21T01:20:26.397 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-21T01:20:26.410 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-21T01:20:26.417 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-21T01:20:26.419 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-21T01:20:26.424 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-21T01:20:26.426 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-21T01:20:26.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.597+0000 7fe0d7000640 1 Processor -- start 2024-05-21T01:20:26.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.597+0000 7fe0d7000640 1 -- start start 2024-05-21T01:20:26.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.601+0000 7fe0d7000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe0c80d5000 0x7fe0c804c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:26.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.601+0000 7fe0d5c00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe0c80d5000 0x7fe0c804c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:26.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.601+0000 7fe0d5c00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe0c80d5000 0x7fe0c804c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.63:51668/0 (socket says 172.21.15.63:51668) 2024-05-21T01:20:26.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.601+0000 7fe0d5200640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fe0c80347a0 0x7fe0c80dad30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.63:42390/0 (socket says 172.21.15.63:42390) 2024-05-21T01:20:26.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.601+0000 7fe0d5c00640 1 -- 172.21.15.63:0/721412916 learned_addr learned my addr 172.21.15.63:0/721412916 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:26.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.601+0000 7fe0d7000640 1 -- 172.21.15.63:0/721412916 --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0c804c820 con 0x7fe0c80db440 2024-05-21T01:20:26.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.601+0000 7fe0d7000640 1 -- 172.21.15.63:0/721412916 --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0c804b990 con 0x7fe0c80347a0 2024-05-21T01:20:26.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.601+0000 7fe0d7000640 1 -- 172.21.15.63:0/721412916 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fe0c804bc70 con 0x7fe0c80d5000 2024-05-21T01:20:26.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.605+0000 7fe0cfe00640 1 -- 172.21.15.63:0/721412916 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1803712 0 0) 0x7fe0c804b990 con 0x7fe0c80347a0 2024-05-21T01:20:26.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.605+0000 7fe0cfe00640 1 -- 172.21.15.63:0/721412916 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe0b8003530 con 0x7fe0c80347a0 2024-05-21T01:20:26.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.605+0000 7fe0d5c00640 1 -- 172.21.15.63:0/721412916 >> v1:172.21.15.131:6789/0 conn(0x7fe0c80347a0 legacy=0x7fe0c80dad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:26.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.605+0000 7fe0d5c00640 1 -- 172.21.15.63:0/721412916 >> v1:172.21.15.63:6789/0 conn(0x7fe0c80db440 legacy=0x7fe0c80e5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:26.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.605+0000 7fe0d5c00640 1 -- 172.21.15.63:0/721412916 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0c8006a50 con 0x7fe0c80d5000 2024-05-21T01:20:26.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.609+0000 7fe0d5c00640 1 --2- 172.21.15.63:0/721412916 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe0c80d5000 0x7fe0c804c2e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe0c40098a0 tx=0x7fe0c4020dc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=30f46b84b9ac9750 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:26.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.609+0000 7fe0cfe00640 1 -- 172.21.15.63:0/721412916 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c40b7070 con 0x7fe0c80d5000 2024-05-21T01:20:26.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.609+0000 7fe0cfe00640 1 -- 172.21.15.63:0/721412916 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0c40aaa60 con 0x7fe0c80d5000 2024-05-21T01:20:26.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.609+0000 7fe0d7000640 1 -- 172.21.15.63:0/721412916 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe0c80d5000 msgr2=0x7fe0c804c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:26.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.609+0000 7fe0cfe00640 1 -- 172.21.15.63:0/721412916 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c40b7070 con 0x7fe0c80d5000 2024-05-21T01:20:26.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.609+0000 7fe0d7000640 1 --2- 172.21.15.63:0/721412916 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe0c80d5000 0x7fe0c804c2e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe0c40098a0 tx=0x7fe0c4020dc0 comp rx=0 tx=0).stop 2024-05-21T01:20:26.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.613+0000 7fe0d7000640 1 -- 172.21.15.63:0/721412916 shutdown_connections 2024-05-21T01:20:26.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.613+0000 7fe0d7000640 1 --2- 172.21.15.63:0/721412916 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe0c80d5000 0x7fe0c804c2e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:26.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.613+0000 7fe0d7000640 1 -- 172.21.15.63:0/721412916 >> 172.21.15.63:0/721412916 conn(0x7fe0c8050190 msgr2=0x7fe0c80505a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:26.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.617+0000 7fe0d7000640 1 -- 172.21.15.63:0/721412916 shutdown_connections 2024-05-21T01:20:26.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.617+0000 7fe0d7000640 1 -- 172.21.15.63:0/721412916 wait complete. 2024-05-21T01:20:26.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.617+0000 7fe0d7000640 1 Processor -- start 2024-05-21T01:20:26.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.621+0000 7fe0d7000640 1 -- start start 2024-05-21T01:20:26.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.621+0000 7fe0d7000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe0c80347a0 0x7fe0c80dc0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:26.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.621+0000 7fe0d7000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe0c80d5000 0x7fe0c80dcd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:26.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.621+0000 7fe0d7000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0c80db440 0x7fe0c80dd2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:26.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.621+0000 7fe0d7000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe0c8045130 con 0x7fe0c80db440 2024-05-21T01:20:26.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.621+0000 7fe0d7000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fe0c8007010 con 0x7fe0c80347a0 2024-05-21T01:20:26.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.621+0000 7fe0d7000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fe0c80d53e0 con 0x7fe0c80d5000 2024-05-21T01:20:26.627 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.621+0000 7fe0d5200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe0c80d5000 0x7fe0c80dcd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:26.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.621+0000 7fe0d5200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe0c80d5000 0x7fe0c80dcd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.63:51684/0 (socket says 172.21.15.63:51684) 2024-05-21T01:20:26.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.621+0000 7fe0d5200640 1 -- 172.21.15.63:0/633394198 learned_addr learned my addr 172.21.15.63:0/633394198 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:26.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.621+0000 7fe0d6600640 1 --2- 172.21.15.63:0/633394198 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0c80db440 0x7fe0c80dd2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:26.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.621+0000 7fe0d5c00640 1 --2- 172.21.15.63:0/633394198 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe0c80347a0 0x7fe0c80dc0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:26.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.621+0000 7fe0d5200640 1 -- 172.21.15.63:0/633394198 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe0c80347a0 msgr2=0x7fe0c80dc0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:26.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.621+0000 7fe0d5200640 1 --2- 172.21.15.63:0/633394198 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe0c80347a0 0x7fe0c80dc0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:26.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.621+0000 7fe0d5200640 1 -- 172.21.15.63:0/633394198 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0c80db440 msgr2=0x7fe0c80dd2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:26.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.621+0000 7fe0d5200640 1 --2- 172.21.15.63:0/633394198 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0c80db440 0x7fe0c80dd2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:26.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.621+0000 7fe0d5200640 1 -- 172.21.15.63:0/633394198 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0c80ddd70 con 0x7fe0c80d5000 2024-05-21T01:20:26.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.621+0000 7fe0d5200640 1 --2- 172.21.15.63:0/633394198 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe0c80d5000 0x7fe0c80dcd80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe0d0000b70 tx=0x7fe0d0069bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:26.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.625+0000 7fe0cd600640 1 -- 172.21.15.63:0/633394198 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d006aa70 con 0x7fe0c80d5000 2024-05-21T01:20:26.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.625+0000 7fe0cd600640 1 -- 172.21.15.63:0/633394198 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0d0092020 con 0x7fe0c80d5000 2024-05-21T01:20:26.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.625+0000 7fe0cd600640 1 -- 172.21.15.63:0/633394198 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d0074d90 con 0x7fe0c80d5000 2024-05-21T01:20:26.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.625+0000 7fe0d7000640 1 -- 172.21.15.63:0/633394198 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0c80de050 con 0x7fe0c80d5000 2024-05-21T01:20:26.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.625+0000 7fe0d7000640 1 -- 172.21.15.63:0/633394198 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0c80de610 con 0x7fe0c80d5000 2024-05-21T01:20:26.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.625+0000 7fe0d7000640 1 -- 172.21.15.63:0/633394198 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0c80053a0 con 0x7fe0c80d5000 2024-05-21T01:20:26.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.629+0000 7fe0cd600640 1 -- 172.21.15.63:0/633394198 <== mon.2 v2:172.21.15.131:3301/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7fe0d0074f30 con 0x7fe0c80d5000 2024-05-21T01:20:26.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.629+0000 7fe0cd600640 1 --2- 172.21.15.63:0/633394198 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fe0b006f400 0x7fe0b00718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:26.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.633+0000 7fe0cd600640 1 -- 172.21.15.63:0/633394198 <== mon.2 v2:172.21.15.131:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fe0d00d46e0 con 0x7fe0c80d5000 2024-05-21T01:20:26.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.633+0000 7fe0d5c00640 1 --2- 172.21.15.63:0/633394198 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fe0b006f400 0x7fe0b00718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:26.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.633+0000 7fe0d5c00640 1 --2- 172.21.15.63:0/633394198 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fe0b006f400 0x7fe0b00718c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe0c40b4000 tx=0x7fe0c4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:26.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.649+0000 7fe0cd600640 1 -- 172.21.15.63:0/633394198 <== mon.2 v2:172.21.15.131:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fe0d009c030 con 0x7fe0c80d5000 2024-05-21T01:20:26.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.661+0000 7f7ca2c00640 1 Processor -- start 2024-05-21T01:20:26.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.661+0000 7f7ca2c00640 1 -- start start 2024-05-21T01:20:26.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.665+0000 7f7ca2c00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7c9c152b40 0x7f7c9c072160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:26.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.665+0000 7f7ca2c00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f7c9c15bf20 0x7f7c9c15c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:26.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.665+0000 7f7ca2c00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c9c0ca4b0 con 0x7f7c9c152f20 2024-05-21T01:20:26.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.665+0000 7f7ca2c00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f7c9c073c70 con 0x7f7c9c152b40 2024-05-21T01:20:26.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.665+0000 7f7ca2c00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f7c9c0736f0 con 0x7f7c9c15bf20 2024-05-21T01:20:26.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.665+0000 7f7ca1800640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7c9c152b40 0x7f7c9c072160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:26.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.665+0000 7f7ca1800640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7c9c152b40 0x7f7c9c072160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:49442/0 (socket says 172.21.15.63:49442) 2024-05-21T01:20:26.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.665+0000 7f7ca1800640 1 -- 172.21.15.63:0/817688809 learned_addr learned my addr 172.21.15.63:0/817688809 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:26.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.665+0000 7f6dcf000640 1 Processor -- start 2024-05-21T01:20:26.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.665+0000 7f7ca1800640 1 -- 172.21.15.63:0/817688809 >> v2:172.21.15.131:3300/0 conn(0x7f7c9c15bf20 msgr2=0x7f7c9c15c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:26.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.665+0000 7f7ca1800640 1 --2- 172.21.15.63:0/817688809 >> v2:172.21.15.131:3300/0 conn(0x7f7c9c15bf20 0x7f7c9c15c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:26.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.665+0000 7f7ca1800640 1 -- 172.21.15.63:0/817688809 >> v1:172.21.15.63:6789/0 conn(0x7f7c9c152f20 legacy=0x7f7c9c0c9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:26.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.665+0000 7f7ca1800640 1 -- 172.21.15.63:0/817688809 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c9c073990 con 0x7f7c9c152b40 2024-05-21T01:20:26.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.665+0000 7f6dcf000640 1 -- start start 2024-05-21T01:20:26.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.669+0000 7fa074a00640 1 Processor -- start 2024-05-21T01:20:26.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.669+0000 7fa074a00640 1 -- start start 2024-05-21T01:20:26.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.669+0000 7f6dcf000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f6dc80cc700 0x7f6dc8155e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:26.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.669+0000 7f6dcf000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6dc80b61b0 0x7f6dc8156350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:26.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.669+0000 7f6dcf000640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6dc80b4a00 con 0x7f6dc80ccae0 2024-05-21T01:20:26.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.669+0000 7f6dcf000640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f6dc80b47b0 con 0x7f6dc80cc700 2024-05-21T01:20:26.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.669+0000 7fa074a00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa07015a440 0x7fa070160130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:26.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.669+0000 7f6dcf000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f6dc80b4ce0 con 0x7f6dc80b61b0 2024-05-21T01:20:26.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.669+0000 7f6dcd000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6dc80b61b0 0x7f6dc8156350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:26.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.669+0000 7f6dcd000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6dc80b61b0 0x7f6dc8156350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.63:51694/0 (socket says 172.21.15.63:51694) 2024-05-21T01:20:26.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.669+0000 7f6dcd000640 1 -- 172.21.15.63:0/1411887137 learned_addr learned my addr 172.21.15.63:0/1411887137 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:26.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.669+0000 7fa074a00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa0700725e0 0x7fa07006cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:26.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.669+0000 7fa06de00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa07015a440 0x7fa070160130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:26.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.669+0000 7fa074a00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa07006ef30 con 0x7fa07006d520 2024-05-21T01:20:26.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.669+0000 7fa074a00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7fa0700cc120 con 0x7fa07015a440 2024-05-21T01:20:26.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.669+0000 7fa06de00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa07015a440 0x7fa070160130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:49456/0 (socket says 172.21.15.63:49456) 2024-05-21T01:20:26.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.669+0000 7fa06de00640 1 -- 172.21.15.63:0/914146225 learned_addr learned my addr 172.21.15.63:0/914146225 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:26.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.669+0000 7fa074a00640 1 -- 172.21.15.63:0/914146225 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fa0701607c0 con 0x7fa0700725e0 2024-05-21T01:20:26.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.669+0000 7f6dc7e00640 1 --2- 172.21.15.63:0/1411887137 >> v2:172.21.15.131:3300/0 conn(0x7f6dc80cc700 0x7f6dc8155e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:26.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.673+0000 7f7ca1800640 1 --2- 172.21.15.63:0/817688809 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7c9c152b40 0x7f7c9c072160 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7c90009870 tx=0x7f7c9001ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9a284f6530864f4 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:26.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.673+0000 7f7c9be00640 1 -- 172.21.15.63:0/817688809 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c900b5070 con 0x7f7c9c152b40 2024-05-21T01:20:26.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.673+0000 7f7c9be00640 1 -- 172.21.15.63:0/817688809 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c900a8a10 con 0x7f7c9c152b40 2024-05-21T01:20:26.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.673+0000 7f7c9be00640 1 -- 172.21.15.63:0/817688809 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c900b5070 con 0x7f7c9c152b40 2024-05-21T01:20:26.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.673+0000 7fa06d400640 1 --2- 172.21.15.63:0/914146225 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa0700725e0 0x7fa07006cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:26.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.673+0000 7fa06ca00640 1 -- 172.21.15.63:0/914146225 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1697772903 0 0) 0x7fa07006ef30 con 0x7fa07006d520 2024-05-21T01:20:26.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.673+0000 7fa06de00640 1 -- 172.21.15.63:0/914146225 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa0700725e0 msgr2=0x7fa07006cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:26.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.673+0000 7fa06de00640 1 --2- 172.21.15.63:0/914146225 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa0700725e0 0x7fa07006cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:26.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.673+0000 7fa06de00640 1 -- 172.21.15.63:0/914146225 >> v1:172.21.15.63:6789/0 conn(0x7fa07006d520 legacy=0x7fa070073cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:26.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.673+0000 7fa06de00640 1 -- 172.21.15.63:0/914146225 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa07015a820 con 0x7fa07015a440 2024-05-21T01:20:26.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.673+0000 7fa06d400640 1 --2- 172.21.15.63:0/914146225 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa0700725e0 0x7fa07006cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T01:20:26.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.673+0000 7f7ca2c00640 1 -- 172.21.15.63:0/817688809 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7c9c152b40 msgr2=0x7f7c9c072160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:26.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.673+0000 7f7ca2c00640 1 --2- 172.21.15.63:0/817688809 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7c9c152b40 0x7f7c9c072160 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7c90009870 tx=0x7f7c9001ed30 comp rx=0 tx=0).stop 2024-05-21T01:20:26.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.673+0000 7f6dcd000640 1 -- 172.21.15.63:0/1411887137 >> v2:172.21.15.131:3300/0 conn(0x7f6dc80cc700 msgr2=0x7f6dc8155e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:26.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.673+0000 7f6dcd000640 1 --2- 172.21.15.63:0/1411887137 >> v2:172.21.15.131:3300/0 conn(0x7f6dc80cc700 0x7f6dc8155e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:26.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.673+0000 7f6dcd000640 1 -- 172.21.15.63:0/1411887137 >> v1:172.21.15.131:6789/0 conn(0x7f6dc80ccae0 legacy=0x7f6dc80b5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:26.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.673+0000 7f6dcd000640 1 -- 172.21.15.63:0/1411887137 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dc80b4fc0 con 0x7f6dc80b61b0 2024-05-21T01:20:26.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.677+0000 7f7ca2c00640 1 -- 172.21.15.63:0/817688809 shutdown_connections 2024-05-21T01:20:26.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.677+0000 7f7ca2c00640 1 --2- 172.21.15.63:0/817688809 >> v2:172.21.15.131:3300/0 conn(0x7f7c9c15bf20 0x7f7c9c15c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:26.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.677+0000 7f7ca2c00640 1 --2- 172.21.15.63:0/817688809 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7c9c152b40 0x7f7c9c072160 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:26.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.677+0000 7f7ca2c00640 1 -- 172.21.15.63:0/817688809 >> 172.21.15.63:0/817688809 conn(0x7f7c9c0cacf0 msgr2=0x7f7c9c0cb100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:26.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.677+0000 7fa06de00640 1 --2- 172.21.15.63:0/914146225 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa07015a440 0x7fa070160130 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa060009870 tx=0x7fa06001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92f6452b009761b8 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:26.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.677+0000 7f39b1c00640 1 Processor -- start 2024-05-21T01:20:26.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.677+0000 7f39b1c00640 1 -- start start 2024-05-21T01:20:26.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.677+0000 7fa06ca00640 1 -- 172.21.15.63:0/914146225 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0600b2070 con 0x7fa07015a440 2024-05-21T01:20:26.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.677+0000 7fa06ca00640 1 -- 172.21.15.63:0/914146225 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0600a9070 con 0x7fa07015a440 2024-05-21T01:20:26.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.677+0000 7fa06ca00640 1 -- 172.21.15.63:0/914146225 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0600ad880 con 0x7fa07015a440 2024-05-21T01:20:26.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.677+0000 7f7ca2c00640 1 -- 172.21.15.63:0/817688809 shutdown_connections 2024-05-21T01:20:26.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.677+0000 7f7ca2c00640 1 -- 172.21.15.63:0/817688809 wait complete. 2024-05-21T01:20:26.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.681+0000 7fa074a00640 1 -- 172.21.15.63:0/914146225 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa07015a440 msgr2=0x7fa070160130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:26.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.681+0000 7fa074a00640 1 --2- 172.21.15.63:0/914146225 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa07015a440 0x7fa070160130 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa060009870 tx=0x7fa06001c560 comp rx=0 tx=0).stop 2024-05-21T01:20:26.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.677+0000 7f8a8f800640 1 Processor -- start 2024-05-21T01:20:26.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.681+0000 7f39b1c00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f39ac156120 0x7f39ac15bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:26.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.681+0000 7f39b1c00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f39ac0c9da0 0x7f39ac0cfac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:26.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.681+0000 7f39b1c00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39ac073cc0 con 0x7f39ac074750 2024-05-21T01:20:26.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.681+0000 7f39b1c00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f39ac0d0000 con 0x7f39ac0c9da0 2024-05-21T01:20:26.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.681+0000 7f39b1c00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f39ac073a20 con 0x7f39ac156120 2024-05-21T01:20:26.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.681+0000 7f39aaa00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f39ac156120 0x7f39ac15bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:26.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.681+0000 7f39aaa00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f39ac156120 0x7f39ac15bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.63:51724/0 (socket says 172.21.15.63:51724) 2024-05-21T01:20:26.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.681+0000 7f39ab400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f39ac0c9da0 0x7f39ac0cfac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:26.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.681+0000 7f39aaa00640 1 -- 172.21.15.63:0/2042169163 learned_addr learned my addr 172.21.15.63:0/2042169163 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:26.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.681+0000 7f7ca2c00640 1 Processor -- start 2024-05-21T01:20:26.687 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.681+0000 7f7ca2c00640 1 -- start start 2024-05-21T01:20:26.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.677+0000 7f8a8f800640 1 -- start start 2024-05-21T01:20:26.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.681+0000 7f8a8f800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8a880cd7f0 0x7f8a8806ce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:26.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.681+0000 7f8a8f800640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f8a880cdcd0 0x7f8a8806d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:26.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.681+0000 7f8a8f800640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a8815a9b0 con 0x7f8a8815a5d0 2024-05-21T01:20:26.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.681+0000 7f8a8f800640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f8a880cc910 con 0x7f8a880cdcd0 2024-05-21T01:20:26.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.681+0000 7f8a8f800640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f8a88076880 con 0x7f8a880cd7f0 2024-05-21T01:20:26.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.681+0000 7f8a8ce00640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f8a8815a5d0 0x7f8a880cccb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.63:42426/0 (socket says 172.21.15.63:42426) 2024-05-21T01:20:26.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.681+0000 7f8a8ce00640 1 -- 172.21.15.63:0/2027649572 learned_addr learned my addr 172.21.15.63:0/2027649572 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-05-21T01:20:26.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.681+0000 7f8a8d800640 1 --2- 172.21.15.63:0/2027649572 >> v2:172.21.15.131:3300/0 conn(0x7f8a880cdcd0 0x7f8a8806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:26.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.681+0000 7f6dcd000640 1 --2- 172.21.15.63:0/1411887137 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6dc80b61b0 0x7f6dc8156350 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6dc0009870 tx=0x7f6dc001c5a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f44cd503ef3ec7f server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:26.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.681+0000 7f8a87e00640 1 --2- 172.21.15.63:0/2027649572 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8a880cd7f0 0x7f8a8806ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:26.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.681+0000 7f6dc6a00640 1 -- 172.21.15.63:0/1411887137 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc00ab650 con 0x7f6dc80b61b0 2024-05-21T01:20:26.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.681+0000 7f6dc6a00640 1 -- 172.21.15.63:0/1411887137 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dc00b0070 con 0x7f6dc80b61b0 2024-05-21T01:20:26.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.681+0000 7f6dc6a00640 1 -- 172.21.15.63:0/1411887137 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc00aba10 con 0x7f6dc80b61b0 2024-05-21T01:20:26.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.681+0000 7f39aaa00640 1 -- 172.21.15.63:0/2042169163 >> v2:172.21.15.131:3300/0 conn(0x7f39ac0c9da0 msgr2=0x7f39ac0cfac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:26.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.681+0000 7f39aaa00640 1 --2- 172.21.15.63:0/2042169163 >> v2:172.21.15.131:3300/0 conn(0x7f39ac0c9da0 0x7f39ac0cfac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:26.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.681+0000 7f39aaa00640 1 -- 172.21.15.63:0/2042169163 >> v1:172.21.15.131:6789/0 conn(0x7f39ac074750 legacy=0x7f39ac0cf3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:26.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.681+0000 7f39aaa00640 1 -- 172.21.15.63:0/2042169163 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39ac0ca650 con 0x7f39ac156120 2024-05-21T01:20:26.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.681+0000 7f8a87400640 1 -- 172.21.15.63:0/2027649572 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4047480992 0 0) 0x7f8a8815a9b0 con 0x7f8a8815a5d0 2024-05-21T01:20:26.690 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.681+0000 7f8a87400640 1 -- 172.21.15.63:0/2027649572 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a70003530 con 0x7f8a8815a5d0 2024-05-21T01:20:26.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.681+0000 7f7ca2c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7c9c152b40 0x7f7c9c153320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:26.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.681+0000 7f7ca2c00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7c9c152f20 0x7f7c9c157ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:26.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.681+0000 7f7ca2c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7c9c15bf20 0x7f7c9c1e98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:26.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.681+0000 7f7ca2c00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f7c9c0c9880 con 0x7f7c9c152b40 2024-05-21T01:20:26.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.681+0000 7f7ca2c00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f7c9c0c95a0 con 0x7f7c9c15bf20 2024-05-21T01:20:26.691 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.681+0000 7f7ca2c00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f7c9c0cbb30 con 0x7f7c9c152f20 2024-05-21T01:20:26.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.681+0000 7f8a87400640 1 -- 172.21.15.63:0/2027649572 <== mon.1 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 799474946 0 0) 0x7f8a70003530 con 0x7f8a8815a5d0 2024-05-21T01:20:26.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.681+0000 7f7ca0e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7c9c152f20 0x7f7c9c157ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:26.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.681+0000 7f7ca0e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7c9c152f20 0x7f7c9c157ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.63:51742/0 (socket says 172.21.15.63:51742) 2024-05-21T01:20:26.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.681+0000 7f7ca0e00640 1 -- 172.21.15.63:0/2532463236 learned_addr learned my addr 172.21.15.63:0/2532463236 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:26.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.681+0000 7f7ca2200640 1 --2- 172.21.15.63:0/2532463236 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7c9c15bf20 0x7f7c9c1e98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:26.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.685+0000 7fa074a00640 1 -- 172.21.15.63:0/914146225 shutdown_connections 2024-05-21T01:20:26.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.685+0000 7fa074a00640 1 --2- 172.21.15.63:0/914146225 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa0700725e0 0x7fa07006cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:26.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.685+0000 7fa074a00640 1 --2- 172.21.15.63:0/914146225 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa07015a440 0x7fa070160130 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:26.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.685+0000 7fa074a00640 1 -- 172.21.15.63:0/914146225 >> 172.21.15.63:0/914146225 conn(0x7fa0700cae00 msgr2=0x7fa0700cb210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:26.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.685+0000 7fa074a00640 1 -- 172.21.15.63:0/914146225 shutdown_connections 2024-05-21T01:20:26.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.685+0000 7fa074a00640 1 -- 172.21.15.63:0/914146225 wait complete. 2024-05-21T01:20:26.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.685+0000 7f6dcf000640 1 -- 172.21.15.63:0/1411887137 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6dc80b61b0 msgr2=0x7f6dc8156350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:26.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.685+0000 7f6dcf000640 1 --2- 172.21.15.63:0/1411887137 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6dc80b61b0 0x7f6dc8156350 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6dc0009870 tx=0x7f6dc001c5a0 comp rx=0 tx=0).stop 2024-05-21T01:20:26.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.685+0000 7f6dcf000640 1 -- 172.21.15.63:0/1411887137 shutdown_connections 2024-05-21T01:20:26.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.685+0000 7f6dcf000640 1 --2- 172.21.15.63:0/1411887137 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6dc80b61b0 0x7f6dc8156350 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:26.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.685+0000 7f6dcf000640 1 --2- 172.21.15.63:0/1411887137 >> v2:172.21.15.131:3300/0 conn(0x7f6dc80cc700 0x7f6dc8155e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:26.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.685+0000 7f6dcf000640 1 -- 172.21.15.63:0/1411887137 >> 172.21.15.63:0/1411887137 conn(0x7f6dc8068290 msgr2=0x7f6dc80686a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:26.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.685+0000 7f8a87400640 1 -- 172.21.15.63:0/2027649572 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8a880cd7f0 msgr2=0x7f8a8806ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:26.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.685+0000 7f8a87400640 1 --2- 172.21.15.63:0/2027649572 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8a880cd7f0 0x7f8a8806ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:26.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.685+0000 7f8a87400640 1 -- 172.21.15.63:0/2027649572 >> v2:172.21.15.131:3300/0 conn(0x7f8a880cdcd0 msgr2=0x7f8a8806d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:26.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.685+0000 7f8a87400640 1 --2- 172.21.15.63:0/2027649572 >> v2:172.21.15.131:3300/0 conn(0x7f8a880cdcd0 0x7f8a8806d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:26.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.685+0000 7f8a87400640 1 -- 172.21.15.63:0/2027649572 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a88164530 con 0x7f8a8815a5d0 2024-05-21T01:20:26.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.685+0000 7f8a87400640 1 -- 172.21.15.63:0/2027649572 <== mon.1 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 466403955 0 0) 0x7f8a7c001a80 con 0x7f8a8815a5d0 2024-05-21T01:20:26.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.685+0000 7f8a87400640 1 -- 172.21.15.63:0/2027649572 >> v1:172.21.15.131:6789/0 conn(0x7f8a8815a5d0 legacy=0x7f8a880cccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:26.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.685+0000 7f8a87400640 1 --2- 172.21.15.63:0/2027649572 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8a70003a10 0x7f8a70003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:26.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.685+0000 7f8a87400640 1 --2- 172.21.15.63:0/2027649572 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8a70004810 0x7f8a70004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:26.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.685+0000 7f8a87400640 1 --2- 172.21.15.63:0/2027649572 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8a700051d0 0x7f8a7000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:26.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.685+0000 7f8a87400640 1 -- 172.21.15.63:0/2027649572 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f8a880cc910 con 0x7f8a70003a10 2024-05-21T01:20:26.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.685+0000 7f8a87400640 1 -- 172.21.15.63:0/2027649572 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f8a88076880 con 0x7f8a70004810 2024-05-21T01:20:26.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.685+0000 7f8a87400640 1 -- 172.21.15.63:0/2027649572 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f8a7000bf10 con 0x7f8a700051d0 2024-05-21T01:20:26.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.685+0000 7f8a87e00640 1 --2- 172.21.15.63:0/2027649572 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8a70004810 0x7f8a70004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:26.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.685+0000 7f7ca0e00640 1 -- 172.21.15.63:0/2532463236 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7c9c15bf20 msgr2=0x7f7c9c1e98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:26.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.685+0000 7f7ca0e00640 1 --2- 172.21.15.63:0/2532463236 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7c9c15bf20 0x7f7c9c1e98b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:26.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.685+0000 7f7ca0e00640 1 -- 172.21.15.63:0/2532463236 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7c9c152b40 msgr2=0x7f7c9c153320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:26.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.685+0000 7f7ca0e00640 1 --2- 172.21.15.63:0/2532463236 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7c9c152b40 0x7f7c9c153320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:26.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.685+0000 7f7ca0e00640 1 -- 172.21.15.63:0/2532463236 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c9c0cd3d0 con 0x7f7c9c152f20 2024-05-21T01:20:26.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.685+0000 7f7ca0e00640 1 --2- 172.21.15.63:0/2532463236 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7c9c152f20 0x7f7c9c157ec0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7c8800c4b0 tx=0x7f7c8800c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:26.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.685+0000 7f8a8d800640 1 --2- 172.21.15.63:0/2027649572 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8a700051d0 0x7f8a7000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:26.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.685+0000 7f8a8ce00640 1 --2- 172.21.15.63:0/2027649572 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8a70003a10 0x7f8a70003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:26.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.685+0000 7f7c99600640 1 -- 172.21.15.63:0/2532463236 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c880052d0 con 0x7f7c9c152f20 2024-05-21T01:20:26.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.685+0000 7f7c99600640 1 -- 172.21.15.63:0/2532463236 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c88005470 con 0x7f7c9c152f20 2024-05-21T01:20:26.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.685+0000 7f7c99600640 1 -- 172.21.15.63:0/2532463236 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c88012870 con 0x7f7c9c152f20 2024-05-21T01:20:26.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.685+0000 7f8a8ce00640 1 -- 172.21.15.63:0/2027649572 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8a700051d0 msgr2=0x7f8a7000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:26.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.685+0000 7f8a8ce00640 1 --2- 172.21.15.63:0/2027649572 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8a700051d0 0x7f8a7000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:26.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.685+0000 7f8a8ce00640 1 -- 172.21.15.63:0/2027649572 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8a70004810 msgr2=0x7f8a70004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:26.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.685+0000 7f8a8ce00640 1 --2- 172.21.15.63:0/2027649572 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8a70004810 0x7f8a70004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:26.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.685+0000 7f8a8ce00640 1 -- 172.21.15.63:0/2027649572 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a88164530 con 0x7f8a70003a10 2024-05-21T01:20:26.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.685+0000 7f39aaa00640 1 --2- 172.21.15.63:0/2042169163 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f39ac156120 0x7f39ac15bc20 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f399c009870 tx=0x7f399c01ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce5a829ef704831e server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:26.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.685+0000 7f7ca2c00640 1 -- 172.21.15.63:0/2532463236 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c9c0cd6b0 con 0x7f7c9c152f20 2024-05-21T01:20:26.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.685+0000 7f7ca2c00640 1 -- 172.21.15.63:0/2532463236 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c9c1576c0 con 0x7f7c9c152f20 2024-05-21T01:20:26.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.685+0000 7f6dcf000640 1 -- 172.21.15.63:0/1411887137 shutdown_connections 2024-05-21T01:20:26.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.685+0000 7fa074a00640 1 Processor -- start 2024-05-21T01:20:26.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.685+0000 7fa074a00640 1 -- start start 2024-05-21T01:20:26.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.685+0000 7f39a9600640 1 -- 172.21.15.63:0/2042169163 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f399c0b5070 con 0x7f39ac156120 2024-05-21T01:20:26.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.685+0000 7f39a9600640 1 -- 172.21.15.63:0/2042169163 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f399c0a8a50 con 0x7f39ac156120 2024-05-21T01:20:26.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.685+0000 7f39a9600640 1 -- 172.21.15.63:0/2042169163 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f399c0a8e20 con 0x7f39ac156120 2024-05-21T01:20:26.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.689+0000 7fa074a00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa07006d520 0x7fa0701f9d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:26.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.689+0000 7fa074a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa0700725e0 0x7fa070155de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:26.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.689+0000 7fa074a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa07015a440 0x7fa070152f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:26.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.689+0000 7fa074a00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fa070074810 con 0x7fa07015a440 2024-05-21T01:20:26.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.689+0000 7fa074a00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa07006c7e0 con 0x7fa0700725e0 2024-05-21T01:20:26.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.689+0000 7fa074a00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fa070074990 con 0x7fa07006d520 2024-05-21T01:20:26.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.689+0000 7fa06de00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa07006d520 0x7fa0701f9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:26.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.689+0000 7f39b1c00640 1 -- 172.21.15.63:0/2042169163 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f39ac156120 msgr2=0x7f39ac15bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:26.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.689+0000 7f39b1c00640 1 --2- 172.21.15.63:0/2042169163 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f39ac156120 0x7f39ac15bc20 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f399c009870 tx=0x7f399c01ed50 comp rx=0 tx=0).stop 2024-05-21T01:20:26.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.689+0000 7fa06de00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa07006d520 0x7fa0701f9d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.63:51760/0 (socket says 172.21.15.63:51760) 2024-05-21T01:20:26.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.689+0000 7f7ca2c00640 1 -- 172.21.15.63:0/2532463236 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c9c06c0c0 con 0x7f7c9c152f20 2024-05-21T01:20:26.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.689+0000 7fa06d400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa0700725e0 0x7fa070155de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:26.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.689+0000 7fa06d400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa0700725e0 0x7fa070155de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.63:42216/0 (socket says 172.21.15.63:42216) 2024-05-21T01:20:26.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.689+0000 7fa06d400640 1 -- 172.21.15.63:0/2927638036 learned_addr learned my addr 172.21.15.63:0/2927638036 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:26.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.685+0000 7f6dcf000640 1 -- 172.21.15.63:0/1411887137 wait complete. 2024-05-21T01:20:26.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.689+0000 7fa06e800640 1 --2- 172.21.15.63:0/2927638036 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa07015a440 0x7fa070152f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:26.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.689+0000 7f6dcf000640 1 Processor -- start 2024-05-21T01:20:26.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.689+0000 7f39b1c00640 1 -- 172.21.15.63:0/2042169163 shutdown_connections 2024-05-21T01:20:26.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.689+0000 7f39b1c00640 1 --2- 172.21.15.63:0/2042169163 >> v2:172.21.15.131:3300/0 conn(0x7f39ac0c9da0 0x7f39ac0cfac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:26.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.689+0000 7f39b1c00640 1 --2- 172.21.15.63:0/2042169163 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f39ac156120 0x7f39ac15bc20 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:26.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.689+0000 7f39b1c00640 1 -- 172.21.15.63:0/2042169163 >> 172.21.15.63:0/2042169163 conn(0x7f39ac068290 msgr2=0x7f39ac0686a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:26.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.689+0000 7fa06de00640 1 -- 172.21.15.63:0/2927638036 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa0700725e0 msgr2=0x7fa070155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:26.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.689+0000 7fa06de00640 1 --2- 172.21.15.63:0/2927638036 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa0700725e0 0x7fa070155de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:26.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.689+0000 7fa06de00640 1 -- 172.21.15.63:0/2927638036 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa07015a440 msgr2=0x7fa070152f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:26.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.689+0000 7fa06de00640 1 --2- 172.21.15.63:0/2927638036 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa07015a440 0x7fa070152f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:26.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.689+0000 7fa06de00640 1 -- 172.21.15.63:0/2927638036 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa07006cfe0 con 0x7fa07006d520 2024-05-21T01:20:26.704 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.689+0000 7f39b1c00640 1 -- 172.21.15.63:0/2042169163 shutdown_connections 2024-05-21T01:20:26.704 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.689+0000 7f39b1c00640 1 -- 172.21.15.63:0/2042169163 wait complete. 2024-05-21T01:20:26.704 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.689+0000 7fa06de00640 1 --2- 172.21.15.63:0/2927638036 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa07006d520 0x7fa0701f9d50 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa07006a3c0 tx=0x7fa06001ada0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:26.704 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.689+0000 7f8a8ce00640 1 --2- 172.21.15.63:0/2027649572 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8a70003a10 0x7f8a70003e30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c00a8f0 tx=0x7f8a7c01d390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ab4581d613aead9 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:26.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.693+0000 7f6dcf000640 1 -- start start 2024-05-21T01:20:26.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.693+0000 7f8a87400640 1 -- 172.21.15.63:0/2027649572 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a7c00a4e0 con 0x7f8a70003a10 2024-05-21T01:20:26.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.693+0000 7f8a87400640 1 -- 172.21.15.63:0/2027649572 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a7c0ad630 con 0x7f8a70003a10 2024-05-21T01:20:26.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.693+0000 7f8a87400640 1 -- 172.21.15.63:0/2027649572 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a7c0adaa0 con 0x7f8a70003a10 2024-05-21T01:20:26.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.693+0000 7f8a8f800640 1 -- 172.21.15.63:0/2027649572 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8a70003a10 msgr2=0x7f8a70003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:26.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.693+0000 7f8a8f800640 1 --2- 172.21.15.63:0/2027649572 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8a70003a10 0x7f8a70003e30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c00a8f0 tx=0x7f8a7c01d390 comp rx=0 tx=0).stop 2024-05-21T01:20:26.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.693+0000 7f39b1c00640 1 Processor -- start 2024-05-21T01:20:26.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.693+0000 7f8a8d800640 1 -- 172.21.15.63:0/2027649572 reap_dead start 2024-05-21T01:20:26.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.693+0000 7f39b1c00640 1 -- start start 2024-05-21T01:20:26.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.693+0000 7f6dcf000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6dc80b61b0 0x7f6dc82013b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:26.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.693+0000 7f6dcf000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6dc80cc700 0x7f6dc80c7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:26.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.693+0000 7f6dcf000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6dc80ccae0 0x7f6dc8205150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:26.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.693+0000 7f6dcf000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc80d1f20 con 0x7f6dc80ccae0 2024-05-21T01:20:26.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.693+0000 7f6dcf000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc80d20a0 con 0x7f6dc80b61b0 2024-05-21T01:20:26.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.693+0000 7f6dcf000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f6dc8168920 con 0x7f6dc80cc700 2024-05-21T01:20:26.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.693+0000 7f8a8f800640 1 -- 172.21.15.63:0/2027649572 shutdown_connections 2024-05-21T01:20:26.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.693+0000 7f8a8f800640 1 -- 172.21.15.63:0/2027649572 >> 172.21.15.63:0/2027649572 conn(0x7f8a880cae90 msgr2=0x7f8a880cb2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:26.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.693+0000 7f8a8f800640 1 -- 172.21.15.63:0/2027649572 shutdown_connections 2024-05-21T01:20:26.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.693+0000 7f6dc7e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6dc80b61b0 0x7f6dc82013b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:26.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.693+0000 7f6dc7400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6dc80cc700 0x7f6dc80c7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:26.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.693+0000 7f6dc7400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6dc80cc700 0x7f6dc80c7420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.63:51774/0 (socket says 172.21.15.63:51774) 2024-05-21T01:20:26.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.693+0000 7f6dc7400640 1 -- 172.21.15.63:0/1550114235 learned_addr learned my addr 172.21.15.63:0/1550114235 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:26.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.693+0000 7f6dcd000640 1 --2- 172.21.15.63:0/1550114235 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6dc80ccae0 0x7f6dc8205150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:26.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.693+0000 7f8a8f800640 1 -- 172.21.15.63:0/2027649572 wait complete. 2024-05-21T01:20:26.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.693+0000 7f6dc7400640 1 -- 172.21.15.63:0/1550114235 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6dc80b61b0 msgr2=0x7f6dc82013b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:26.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.693+0000 7f6dc7400640 1 --2- 172.21.15.63:0/1550114235 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6dc80b61b0 0x7f6dc82013b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:26.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.693+0000 7f6dc7400640 1 -- 172.21.15.63:0/1550114235 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6dc80ccae0 msgr2=0x7f6dc8205150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:26.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.693+0000 7f6dc7400640 1 --2- 172.21.15.63:0/1550114235 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6dc80ccae0 0x7f6dc8205150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:26.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.693+0000 7f6dc7400640 1 -- 172.21.15.63:0/1550114235 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dc82049c0 con 0x7f6dc80cc700 2024-05-21T01:20:26.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.693+0000 7f39b1c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f39ac074750 0x7f39ac071340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:26.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.693+0000 7f39b1c00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f39ac0c9da0 0x7f39ac14e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:26.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.693+0000 7f39b1c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f39ac159b30 0x7f39ac1f5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:26.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.693+0000 7f39b1c00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f39ac0caef0 con 0x7f39ac159b30 2024-05-21T01:20:26.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.693+0000 7f39b1c00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f39ac0cac10 con 0x7f39ac074750 2024-05-21T01:20:26.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.693+0000 7f39b1c00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f39ac06f400 con 0x7f39ac0c9da0 2024-05-21T01:20:26.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.693+0000 7f6dc7400640 1 --2- 172.21.15.63:0/1550114235 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6dc80cc700 0x7f6dc80c7420 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6db400c3f0 tx=0x7f6db400c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:26.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.693+0000 7f7c99600640 1 -- 172.21.15.63:0/2532463236 <== mon.2 v2:172.21.15.131:3301/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7f7c88012a10 con 0x7f7c9c152f20 2024-05-21T01:20:26.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.693+0000 7f7c99600640 1 --2- 172.21.15.63:0/2532463236 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f7c7c06f400 0x7f7c7c0718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:26.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.693+0000 7f7c99600640 1 -- 172.21.15.63:0/2532463236 <== mon.2 v2:172.21.15.131:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f7c8808f1f0 con 0x7f7c9c152f20 2024-05-21T01:20:26.712 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.693+0000 7f39aa000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f39ac0c9da0 0x7f39ac14e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:26.712 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.697+0000 7f39aa000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f39ac0c9da0 0x7f39ac14e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.63:51776/0 (socket says 172.21.15.63:51776) 2024-05-21T01:20:26.712 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.697+0000 7f39aa000640 1 -- 172.21.15.63:0/2087696697 learned_addr learned my addr 172.21.15.63:0/2087696697 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:26.712 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.697+0000 7f39ab400640 1 --2- 172.21.15.63:0/2087696697 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f39ac159b30 0x7f39ac1f5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:26.712 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.697+0000 7f39aaa00640 1 --2- 172.21.15.63:0/2087696697 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f39ac074750 0x7f39ac071340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:26.712 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.697+0000 7f7ca1800640 1 --2- 172.21.15.63:0/2532463236 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f7c7c06f400 0x7f7c7c0718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:26.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.697+0000 7f39ab400640 1 -- 172.21.15.63:0/2087696697 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f39ac0c9da0 msgr2=0x7f39ac14e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:26.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.697+0000 7f39ab400640 1 --2- 172.21.15.63:0/2087696697 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f39ac0c9da0 0x7f39ac14e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:26.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.697+0000 7f39ab400640 1 -- 172.21.15.63:0/2087696697 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f39ac074750 msgr2=0x7f39ac071340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:26.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.697+0000 7f39ab400640 1 --2- 172.21.15.63:0/2087696697 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f39ac074750 0x7f39ac071340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:26.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.697+0000 7f39ab400640 1 -- 172.21.15.63:0/2087696697 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39ac1f1eb0 con 0x7f39ac159b30 2024-05-21T01:20:26.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.697+0000 7f6dbfe00640 1 -- 172.21.15.63:0/1550114235 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6db4017070 con 0x7f6dc80cc700 2024-05-21T01:20:26.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.697+0000 7fa066000640 1 -- 172.21.15.63:0/2927638036 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0600b2040 con 0x7fa07006d520 2024-05-21T01:20:26.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.697+0000 7fa074a00640 1 -- 172.21.15.63:0/2927638036 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa070156320 con 0x7fa07006d520 2024-05-21T01:20:26.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.697+0000 7f6dcf000640 1 -- 172.21.15.63:0/1550114235 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dc8158ff0 con 0x7f6dc80cc700 2024-05-21T01:20:26.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.697+0000 7f6dcf000640 1 -- 172.21.15.63:0/1550114235 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dc81595b0 con 0x7f6dc80cc700 2024-05-21T01:20:26.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.697+0000 7f39ab400640 1 --2- 172.21.15.63:0/2087696697 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f39ac159b30 0x7f39ac1f5070 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f39a400ef90 tx=0x7f39a400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:26.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.697+0000 7f8a8f800640 1 Processor -- start 2024-05-21T01:20:26.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.697+0000 7f8a8f800640 1 -- start start 2024-05-21T01:20:26.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.697+0000 7f39a2a00640 1 -- 172.21.15.63:0/2087696697 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39a4018020 con 0x7f39ac159b30 2024-05-21T01:20:26.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.697+0000 7f39a2a00640 1 -- 172.21.15.63:0/2087696697 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39a4014480 con 0x7f39ac159b30 2024-05-21T01:20:26.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.697+0000 7f39a2a00640 1 -- 172.21.15.63:0/2087696697 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39a4014870 con 0x7f39ac159b30 2024-05-21T01:20:26.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.697+0000 7f7ca1800640 1 --2- 172.21.15.63:0/2532463236 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f7c7c06f400 0x7f7c7c0718c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7c900b2000 tx=0x7f7c90004740 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:26.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.697+0000 7f6dcf000640 1 -- 172.21.15.63:0/1550114235 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6dc80507f0 con 0x7f6dc80cc700 2024-05-21T01:20:26.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.697+0000 7f39b1c00640 1 -- 172.21.15.63:0/2087696697 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39ac0c7a50 con 0x7f39ac159b30 2024-05-21T01:20:26.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.697+0000 7f39b1c00640 1 -- 172.21.15.63:0/2087696697 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39ac0c7fd0 con 0x7f39ac159b30 2024-05-21T01:20:26.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.697+0000 7fa074a00640 1 -- 172.21.15.63:0/2927638036 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa07015af10 con 0x7fa07006d520 2024-05-21T01:20:26.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.697+0000 7f8a8f800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8a70003a10 0x7f8a8815ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:26.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.697+0000 7f8a8f800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8a8814e7e0 0x7f8a8814ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:26.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.697+0000 7f8a8f800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8a88146f90 0x7f8a88147410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:26.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.697+0000 7f8a8f800640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f8a880cd3c0 con 0x7f8a88146f90 2024-05-21T01:20:26.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.697+0000 7f8a8f800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f8a881641d0 con 0x7f8a70003a10 2024-05-21T01:20:26.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.697+0000 7f8a8f800640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f8a880cd540 con 0x7f8a8814e7e0 2024-05-21T01:20:26.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.697+0000 7f8a8ce00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8a70003a10 0x7f8a8815ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:26.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.697+0000 7f8a8ce00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8a70003a10 0x7f8a8815ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.63:42244/0 (socket says 172.21.15.63:42244) 2024-05-21T01:20:26.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.697+0000 7f8a8ce00640 1 -- 172.21.15.63:0/3126018906 learned_addr learned my addr 172.21.15.63:0/3126018906 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:26.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.701+0000 7fa074a00640 1 -- 172.21.15.63:0/2927638036 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0700507f0 con 0x7fa07006d520 2024-05-21T01:20:26.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.697+0000 7f8a87e00640 1 --2- 172.21.15.63:0/3126018906 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8a8814e7e0 0x7f8a8814ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:26.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.701+0000 7f39b1c00640 1 -- 172.21.15.63:0/2087696697 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39ac0507f0 con 0x7f39ac159b30 2024-05-21T01:20:26.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.701+0000 7f2063000640 1 Processor -- start 2024-05-21T01:20:26.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.701+0000 7f8a8d800640 1 --2- 172.21.15.63:0/3126018906 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8a88146f90 0x7f8a88147410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:26.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.701+0000 7f2063000640 1 -- start start 2024-05-21T01:20:26.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.701+0000 7f8a8ce00640 1 -- 172.21.15.63:0/3126018906 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8a8814e7e0 msgr2=0x7f8a8814ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:26.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.701+0000 7f39a2a00640 1 -- 172.21.15.63:0/2087696697 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7f39a401b020 con 0x7f39ac159b30 2024-05-21T01:20:26.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.701+0000 7f8a8ce00640 1 --2- 172.21.15.63:0/3126018906 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8a8814e7e0 0x7f8a8814ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:26.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.701+0000 7f8a8ce00640 1 -- 172.21.15.63:0/3126018906 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8a88146f90 msgr2=0x7f8a88147410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:26.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.701+0000 7f8a8ce00640 1 --2- 172.21.15.63:0/3126018906 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8a88146f90 0x7f8a88147410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:26.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.701+0000 7f8a8ce00640 1 -- 172.21.15.63:0/3126018906 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a8814f180 con 0x7f8a70003a10 2024-05-21T01:20:26.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.701+0000 7f8a8d800640 1 --2- 172.21.15.63:0/3126018906 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8a88146f90 0x7f8a88147410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T01:20:26.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.701+0000 7f39a2a00640 1 --2- 172.21.15.63:0/2087696697 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f398c06f450 0x7f398c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:26.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.701+0000 7f8a8ce00640 1 --2- 172.21.15.63:0/3126018906 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8a70003a10 0x7f8a8815ab30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c00a810 tx=0x7f8a70005840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:26.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.701+0000 7f39a2a00640 1 -- 172.21.15.63:0/2087696697 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f39a4058de0 con 0x7f39ac159b30 2024-05-21T01:20:26.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.701+0000 7f39aaa00640 1 --2- 172.21.15.63:0/2087696697 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f398c06f450 0x7f398c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:26.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.701+0000 7f39aaa00640 1 --2- 172.21.15.63:0/2087696697 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f398c06f450 0x7f398c071910 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f399c0b2000 tx=0x7f399c0aa070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:26.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.701+0000 7f2063000640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f205c155b40 0x7f205c0c6370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:26.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.701+0000 7f2063000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f205c0cd310 0x7f205c15c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:26.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.705+0000 7f2063000640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f205c15f1d0 con 0x7f205c15fc70 2024-05-21T01:20:26.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.705+0000 7f2063000640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f205c0cc160 con 0x7f205c155b40 2024-05-21T01:20:26.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.705+0000 7f2063000640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f205c160080 con 0x7f205c0cd310 2024-05-21T01:20:26.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.705+0000 7f2061c00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f205c155b40 0x7f205c0c6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:26.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.705+0000 7f2061200640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f205c0cd310 0x7f205c15c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:26.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.705+0000 7f2061c00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f205c155b40 0x7f205c0c6370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:49530/0 (socket says 172.21.15.63:49530) 2024-05-21T01:20:26.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.705+0000 7f2061c00640 1 -- 172.21.15.63:0/2520702720 learned_addr learned my addr 172.21.15.63:0/2520702720 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:26.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.705+0000 7f2061200640 1 -- 172.21.15.63:0/2520702720 >> v2:172.21.15.63:3300/0 conn(0x7f205c155b40 msgr2=0x7f205c0c6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:26.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.705+0000 7f2061200640 1 --2- 172.21.15.63:0/2520702720 >> v2:172.21.15.63:3300/0 conn(0x7f205c155b40 0x7f205c0c6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:26.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.705+0000 7f2061200640 1 -- 172.21.15.63:0/2520702720 >> v1:172.21.15.63:6789/0 conn(0x7f205c15fc70 legacy=0x7f205c0d13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:26.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.705+0000 7f8a84c00640 1 -- 172.21.15.63:0/3126018906 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a7c0bb070 con 0x7f8a70003a10 2024-05-21T01:20:26.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.705+0000 7f8a84c00640 1 -- 172.21.15.63:0/3126018906 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a7c001840 con 0x7f8a70003a10 2024-05-21T01:20:26.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.705+0000 7f8a84c00640 1 -- 172.21.15.63:0/3126018906 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a7c0bb070 con 0x7f8a70003a10 2024-05-21T01:20:26.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.705+0000 7f8a8f800640 1 -- 172.21.15.63:0/3126018906 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a88147950 con 0x7f8a70003a10 2024-05-21T01:20:26.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.705+0000 7f8a8f800640 1 -- 172.21.15.63:0/3126018906 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a88203d70 con 0x7f8a70003a10 2024-05-21T01:20:26.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.705+0000 7f2061200640 1 -- 172.21.15.63:0/2520702720 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f205c0cc3b0 con 0x7f205c0cd310 2024-05-21T01:20:26.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.705+0000 7f8a8f800640 1 -- 172.21.15.63:0/3126018906 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a880507f0 con 0x7f8a70003a10 2024-05-21T01:20:26.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.709+0000 7f39a2a00640 1 -- 172.21.15.63:0/2087696697 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f39a4022030 con 0x7f39ac159b30 2024-05-21T01:20:26.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.709+0000 7f8a84c00640 1 -- 172.21.15.63:0/3126018906 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7f8a7c0ad4f0 con 0x7f8a70003a10 2024-05-21T01:20:26.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.709+0000 7f2061200640 1 --2- 172.21.15.63:0/2520702720 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f205c0cd310 0x7f205c15c5c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f205c0cc2e0 tx=0x7f205401f150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39c2e6f76e8c016 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:26.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.709+0000 7f8a84c00640 1 --2- 172.21.15.63:0/3126018906 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f8a6806f630 0x7f8a68071af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:26.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.709+0000 7f8a84c00640 1 -- 172.21.15.63:0/3126018906 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f8a7c129620 con 0x7f8a70003a10 2024-05-21T01:20:26.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.713+0000 7f7c99600640 1 -- 172.21.15.63:0/2532463236 <== mon.2 v2:172.21.15.131:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f7c8805bd90 con 0x7f7c9c152f20 2024-05-21T01:20:26.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.713+0000 7f8a87e00640 1 --2- 172.21.15.63:0/3126018906 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f8a6806f630 0x7f8a68071af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:26.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.713+0000 7f8a87e00640 1 --2- 172.21.15.63:0/3126018906 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f8a6806f630 0x7f8a68071af0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8a88163f40 tx=0x7f8a74009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:26.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.713+0000 7fa066000640 1 -- 172.21.15.63:0/2927638036 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0600be070 con 0x7fa07006d520 2024-05-21T01:20:26.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.713+0000 7fa066000640 1 -- 172.21.15.63:0/2927638036 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0600c3660 con 0x7fa07006d520 2024-05-21T01:20:26.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.713+0000 7f6dbfe00640 1 -- 172.21.15.63:0/1550114235 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6db40052d0 con 0x7f6dc80cc700 2024-05-21T01:20:26.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.717+0000 7f6dbfe00640 1 -- 172.21.15.63:0/1550114235 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6db4003800 con 0x7f6dc80cc700 2024-05-21T01:20:26.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.717+0000 7fa066000640 1 -- 172.21.15.63:0/2927638036 <== mon.2 v2:172.21.15.131:3301/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7fa0600ab070 con 0x7fa07006d520 2024-05-21T01:20:26.728 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.717+0000 7f6dbfe00640 1 -- 172.21.15.63:0/1550114235 <== mon.2 v2:172.21.15.131:3301/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7f6db401a070 con 0x7f6dc80cc700 2024-05-21T01:20:26.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.717+0000 7fa066000640 1 --2- 172.21.15.63:0/2927638036 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fa04c06f430 0x7fa04c0718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:26.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.717+0000 7fa066000640 1 -- 172.21.15.63:0/2927638036 <== mon.2 v2:172.21.15.131:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fa06012a100 con 0x7fa07006d520 2024-05-21T01:20:26.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.721+0000 7fa06d400640 1 --2- 172.21.15.63:0/2927638036 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fa04c06f430 0x7fa04c0718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:26.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.721+0000 7f6dbfe00640 1 --2- 172.21.15.63:0/1550114235 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f6da806f400 0x7f6da80718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:26.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.721+0000 7f6dbfe00640 1 -- 172.21.15.63:0/1550114235 <== mon.2 v2:172.21.15.131:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f6db408eab0 con 0x7f6dc80cc700 2024-05-21T01:20:26.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.721+0000 7f6dc7e00640 1 --2- 172.21.15.63:0/1550114235 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f6da806f400 0x7f6da80718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:26.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.721+0000 7fa06d400640 1 --2- 172.21.15.63:0/2927638036 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fa04c06f430 0x7fa04c0718f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa070156d80 tx=0x7fa058008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:26.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.721+0000 7f6dc7e00640 1 --2- 172.21.15.63:0/1550114235 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f6da806f400 0x7f6da80718c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6db8003b90 tx=0x7f6db80098d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:26.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.721+0000 7f8a84c00640 1 -- 172.21.15.63:0/3126018906 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f8a7c0c5020 con 0x7f8a70003a10 2024-05-21T01:20:26.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.721+0000 7f205be00640 1 -- 172.21.15.63:0/2520702720 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20540b4070 con 0x7f205c0cd310 2024-05-21T01:20:26.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.721+0000 7f205be00640 1 -- 172.21.15.63:0/2520702720 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20540af600 con 0x7f205c0cd310 2024-05-21T01:20:26.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.721+0000 7f205be00640 1 -- 172.21.15.63:0/2520702720 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20540af9d0 con 0x7f205c0cd310 2024-05-21T01:20:26.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.725+0000 7f2063000640 1 -- 172.21.15.63:0/2520702720 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f205c0cd310 msgr2=0x7f205c15c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:26.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.725+0000 7f2063000640 1 --2- 172.21.15.63:0/2520702720 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f205c0cd310 0x7f205c15c5c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f205c0cc2e0 tx=0x7f205401f150 comp rx=0 tx=0).stop 2024-05-21T01:20:26.732 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.729+0000 7f2063000640 1 -- 172.21.15.63:0/2520702720 shutdown_connections 2024-05-21T01:20:26.732 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.729+0000 7f2063000640 1 --2- 172.21.15.63:0/2520702720 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f205c0cd310 0x7f205c15c5c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:26.732 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.729+0000 7f2063000640 1 --2- 172.21.15.63:0/2520702720 >> v2:172.21.15.63:3300/0 conn(0x7f205c155b40 0x7f205c0c6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:26.732 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.729+0000 7f2063000640 1 -- 172.21.15.63:0/2520702720 >> 172.21.15.63:0/2520702720 conn(0x7f205c0741d0 msgr2=0x7f205c068290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:26.733 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.729+0000 7f2063000640 1 -- 172.21.15.63:0/2520702720 shutdown_connections 2024-05-21T01:20:26.733 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.729+0000 7f2063000640 1 -- 172.21.15.63:0/2520702720 wait complete. 2024-05-21T01:20:26.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.729+0000 7fa066000640 1 -- 172.21.15.63:0/2927638036 <== mon.2 v2:172.21.15.131:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fa060016150 con 0x7fa07006d520 2024-05-21T01:20:26.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.729+0000 7f2063000640 1 Processor -- start 2024-05-21T01:20:26.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.729+0000 7f2063000640 1 -- start start 2024-05-21T01:20:26.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.733+0000 7f2063000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f205c0cd310 0x7f205c1509b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:26.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.733+0000 7f2063000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f205c155b40 0x7f205c150010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:26.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.733+0000 7f2063000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f205c15fc70 0x7f205c159960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:26.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.733+0000 7f2063000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f205c0cc690 con 0x7f205c155b40 2024-05-21T01:20:26.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.733+0000 7f2063000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f205c15f750 con 0x7f205c15fc70 2024-05-21T01:20:26.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.733+0000 7f2063000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f205c155f20 con 0x7f205c0cd310 2024-05-21T01:20:26.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.733+0000 7f2061200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f205c155b40 0x7f205c150010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:26.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.733+0000 7f2061200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f205c155b40 0x7f205c150010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:49536/0 (socket says 172.21.15.63:49536) 2024-05-21T01:20:26.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.733+0000 7f2061200640 1 -- 172.21.15.63:0/3418446252 learned_addr learned my addr 172.21.15.63:0/3418446252 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:26.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.733+0000 7f2061c00640 1 --2- 172.21.15.63:0/3418446252 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f205c0cd310 0x7f205c1509b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:26.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.733+0000 7f2061200640 1 -- 172.21.15.63:0/3418446252 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f205c0cd310 msgr2=0x7f205c1509b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:26.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.733+0000 7f2061200640 1 --2- 172.21.15.63:0/3418446252 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f205c0cd310 0x7f205c1509b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:26.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.733+0000 7f2061200640 1 -- 172.21.15.63:0/3418446252 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f205c15fc70 msgr2=0x7f205c159960 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-21T01:20:26.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.733+0000 7f2061200640 1 --2- 172.21.15.63:0/3418446252 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f205c15fc70 0x7f205c159960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:26.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.733+0000 7f2061200640 1 -- 172.21.15.63:0/3418446252 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f205c1510f0 con 0x7f205c155b40 2024-05-21T01:20:26.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.733+0000 7f2061200640 1 --2- 172.21.15.63:0/3418446252 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f205c155b40 0x7f205c150010 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f205401cda0 tx=0x7f205401bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:26.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.733+0000 7f2059600640 1 -- 172.21.15.63:0/3418446252 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20540b4070 con 0x7f205c155b40 2024-05-21T01:20:26.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.733+0000 7f2059600640 1 -- 172.21.15.63:0/3418446252 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20540c1070 con 0x7f205c155b40 2024-05-21T01:20:26.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.733+0000 7f2059600640 1 -- 172.21.15.63:0/3418446252 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20540bb8b0 con 0x7f205c155b40 2024-05-21T01:20:26.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.733+0000 7f583f000640 1 Processor -- start 2024-05-21T01:20:26.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.733+0000 7f2063000640 1 -- 172.21.15.63:0/3418446252 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f205c1f9190 con 0x7f205c155b40 2024-05-21T01:20:26.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.733+0000 7f2063000640 1 -- 172.21.15.63:0/3418446252 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f205c1f9750 con 0x7f205c155b40 2024-05-21T01:20:26.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.737+0000 7f2063000640 1 -- 172.21.15.63:0/3418446252 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f205c06c0c0 con 0x7f205c155b40 2024-05-21T01:20:26.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.733+0000 7f583f000640 1 -- start start 2024-05-21T01:20:26.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.737+0000 7f583f000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f5838163740 0x7f583815a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:26.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.737+0000 7f583f000640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58380743a0 con 0x7f58380cc800 2024-05-21T01:20:26.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.737+0000 7f583f000640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f583806ffd0 con 0x7f583815a1d0 2024-05-21T01:20:26.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.737+0000 7f583f000640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f58380cc440 con 0x7f5838163740 2024-05-21T01:20:26.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.737+0000 7f583e600640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f58380cc800 0x7f58380cb330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:40252/0 (socket says 172.21.15.63:40252) 2024-05-21T01:20:26.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.737+0000 7f583e600640 1 -- 172.21.15.63:0/1624792592 learned_addr learned my addr 172.21.15.63:0/1624792592 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-05-21T01:20:26.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.737+0000 7f583d200640 1 --2- 172.21.15.63:0/1624792592 >> v2:172.21.15.131:3300/0 conn(0x7f5838163740 0x7f583815a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:26.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.737+0000 7f583d200640 1 -- 172.21.15.63:0/1624792592 >> v1:172.21.15.131:6789/0 conn(0x7f583815a1d0 legacy=0x7f583806f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:26.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.737+0000 7f2059600640 1 -- 172.21.15.63:0/3418446252 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7f20540bba50 con 0x7f205c155b40 2024-05-21T01:20:26.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.741+0000 7f2059600640 1 --2- 172.21.15.63:0/3418446252 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f203c06f450 0x7f203c071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:26.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.741+0000 7f2059600640 1 -- 172.21.15.63:0/3418446252 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f2054002020 con 0x7f205c155b40 2024-05-21T01:20:26.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.741+0000 7f583d200640 1 -- 172.21.15.63:0/1624792592 >> v1:172.21.15.63:6789/0 conn(0x7f58380cc800 legacy=0x7f58380cb330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:26.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.741+0000 7f583d200640 1 -- 172.21.15.63:0/1624792592 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58380cbea0 con 0x7f5838163740 2024-05-21T01:20:26.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.741+0000 7f6dbfe00640 1 -- 172.21.15.63:0/1550114235 <== mon.2 v2:172.21.15.131:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f6db4022080 con 0x7f6dc80cc700 2024-05-21T01:20:26.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.745+0000 7f2061c00640 1 --2- 172.21.15.63:0/3418446252 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f203c06f450 0x7f203c071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:26.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.745+0000 7f583d200640 1 --2- 172.21.15.63:0/1624792592 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5838163740 0x7f583815a5b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5824009740 tx=0x7f582401c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=770e6d72cc2f3e9c server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:26.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.745+0000 7f5837e00640 1 -- 172.21.15.63:0/1624792592 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58240b0070 con 0x7f5838163740 2024-05-21T01:20:26.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.745+0000 7f5837e00640 1 -- 172.21.15.63:0/1624792592 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58240ab600 con 0x7f5838163740 2024-05-21T01:20:26.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.745+0000 7f5837e00640 1 -- 172.21.15.63:0/1624792592 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58240ab9d0 con 0x7f5838163740 2024-05-21T01:20:26.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.745+0000 7f2061c00640 1 --2- 172.21.15.63:0/3418446252 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f203c06f450 0x7f203c071910 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2048009a20 tx=0x7f2048008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:26.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.745+0000 7f583f000640 1 -- 172.21.15.63:0/1624792592 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5838163740 msgr2=0x7f583815a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:26.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.745+0000 7f583f000640 1 --2- 172.21.15.63:0/1624792592 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5838163740 0x7f583815a5b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5824009740 tx=0x7f582401c2d0 comp rx=0 tx=0).stop 2024-05-21T01:20:26.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.745+0000 7f583f000640 1 -- 172.21.15.63:0/1624792592 shutdown_connections 2024-05-21T01:20:26.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.745+0000 7f583f000640 1 --2- 172.21.15.63:0/1624792592 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5838163740 0x7f583815a5b0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:26.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.745+0000 7f583f000640 1 -- 172.21.15.63:0/1624792592 >> 172.21.15.63:0/1624792592 conn(0x7f58380cd550 msgr2=0x7f58380cd960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:26.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.745+0000 7f583f000640 1 -- 172.21.15.63:0/1624792592 shutdown_connections 2024-05-21T01:20:26.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.749+0000 7f2059600640 1 -- 172.21.15.63:0/3418446252 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f2054018cd0 con 0x7f205c155b40 2024-05-21T01:20:26.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.745+0000 7f583f000640 1 -- 172.21.15.63:0/1624792592 wait complete. 2024-05-21T01:20:26.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.749+0000 7f583f000640 1 Processor -- start 2024-05-21T01:20:26.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.749+0000 7f583f000640 1 -- start start 2024-05-21T01:20:26.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.749+0000 7f583f000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f58380cc800 0x7f58380c9f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:26.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.749+0000 7f583f000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f583815a1d0 0x7f58381fabb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:26.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.749+0000 7f583f000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5838163740 0x7f58381fb0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:26.756 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.749+0000 7f583f000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f58380c49d0 con 0x7f583815a1d0 2024-05-21T01:20:26.756 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.749+0000 7f583f000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f583806f0c0 con 0x7f58380cc800 2024-05-21T01:20:26.756 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.749+0000 7f583f000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f58380cba40 con 0x7f5838163740 2024-05-21T01:20:26.756 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.749+0000 7f583dc00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f58380cc800 0x7f58380c9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:26.756 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.749+0000 7f583dc00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f58380cc800 0x7f58380c9f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.63:42266/0 (socket says 172.21.15.63:42266) 2024-05-21T01:20:26.756 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.749+0000 7f583dc00640 1 -- 172.21.15.63:0/3030087363 learned_addr learned my addr 172.21.15.63:0/3030087363 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:26.757 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.753+0000 7f583e600640 1 --2- 172.21.15.63:0/3030087363 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5838163740 0x7f58381fb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:26.757 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.753+0000 7f583dc00640 1 -- 172.21.15.63:0/3030087363 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5838163740 msgr2=0x7f58381fb0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:26.757 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.753+0000 7f583dc00640 1 --2- 172.21.15.63:0/3030087363 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5838163740 0x7f58381fb0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:26.758 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.753+0000 7f583dc00640 1 -- 172.21.15.63:0/3030087363 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f583815a1d0 msgr2=0x7f58381fabb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:26.758 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.753+0000 7f583dc00640 1 --2- 172.21.15.63:0/3030087363 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f583815a1d0 0x7f58381fabb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:26.758 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.753+0000 7f583dc00640 1 -- 172.21.15.63:0/3030087363 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58381fd880 con 0x7f58380cc800 2024-05-21T01:20:26.758 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.753+0000 7f583dc00640 1 --2- 172.21.15.63:0/3030087363 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f58380cc800 0x7f58380c9f80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f582c00c700 tx=0x7f582c00cb00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:26.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.753+0000 7f5835600640 1 -- 172.21.15.63:0/3030087363 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f582c017070 con 0x7f58380cc800 2024-05-21T01:20:26.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.753+0000 7f5835600640 1 -- 172.21.15.63:0/3030087363 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f582c005480 con 0x7f58380cc800 2024-05-21T01:20:26.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.753+0000 7f5835600640 1 -- 172.21.15.63:0/3030087363 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f582c003840 con 0x7f58380cc800 2024-05-21T01:20:26.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.757+0000 7f583f000640 1 -- 172.21.15.63:0/3030087363 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58381fca20 con 0x7f58380cc800 2024-05-21T01:20:26.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.757+0000 7f583f000640 1 -- 172.21.15.63:0/3030087363 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58381fcfe0 con 0x7f58380cc800 2024-05-21T01:20:26.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.757+0000 7f583f000640 1 -- 172.21.15.63:0/3030087363 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f583806c0c0 con 0x7f58380cc800 2024-05-21T01:20:26.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.761+0000 7f5835600640 1 -- 172.21.15.63:0/3030087363 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7f582c01a070 con 0x7f58380cc800 2024-05-21T01:20:26.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.761+0000 7f5835600640 1 --2- 172.21.15.63:0/3030087363 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f581806f4d0 0x7f5818071990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:26.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.761+0000 7f5835600640 1 -- 172.21.15.63:0/3030087363 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f582c08f0a0 con 0x7f58380cc800 2024-05-21T01:20:26.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.761+0000 7f583d200640 1 --2- 172.21.15.63:0/3030087363 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f581806f4d0 0x7f5818071990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:26.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.765+0000 7f583d200640 1 --2- 172.21.15.63:0/3030087363 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f581806f4d0 0x7f5818071990 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f58240ad000 tx=0x7f5824004740 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:26.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:26.773+0000 7f5835600640 1 -- 172.21.15.63:0/3030087363 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f582c021020 con 0x7f58380cc800 2024-05-21T01:20:27.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.001+0000 7fe0d7000640 1 -- 172.21.15.63:0/633394198 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fe0c8032e70 con 0x7fe0c80d5000 2024-05-21T01:20:27.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.001+0000 7fe0cd600640 1 -- 172.21.15.63:0/633394198 <== mon.2 v2:172.21.15.131:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe0d00d80f0 con 0x7fe0c80d5000 2024-05-21T01:20:27.006 INFO:teuthology.orchestra.run.smithi063.stdout:64424509450 2024-05-21T01:20:27.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.005+0000 7fe0d7000640 1 -- 172.21.15.63:0/633394198 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fe0b006f400 msgr2=0x7fe0b00718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:27.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.005+0000 7fe0d7000640 1 --2- 172.21.15.63:0/633394198 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fe0b006f400 0x7fe0b00718c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe0c40b4000 tx=0x7fe0c4008040 comp rx=0 tx=0).stop 2024-05-21T01:20:27.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.005+0000 7fe0d7000640 1 -- 172.21.15.63:0/633394198 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe0c80d5000 msgr2=0x7fe0c80dcd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:27.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.005+0000 7fe0d7000640 1 --2- 172.21.15.63:0/633394198 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe0c80d5000 0x7fe0c80dcd80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe0d0000b70 tx=0x7fe0d0069bd0 comp rx=0 tx=0).stop 2024-05-21T01:20:27.012 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.009+0000 7fe0d7000640 1 -- 172.21.15.63:0/633394198 shutdown_connections 2024-05-21T01:20:27.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.009+0000 7fe0d7000640 1 --2- 172.21.15.63:0/633394198 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fe0b006f400 0x7fe0b00718c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:27.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.009+0000 7fe0d7000640 1 --2- 172.21.15.63:0/633394198 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0c80db440 0x7fe0c80dd2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:27.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.009+0000 7fe0d7000640 1 --2- 172.21.15.63:0/633394198 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe0c80d5000 0x7fe0c80dcd80 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:27.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.009+0000 7fe0d7000640 1 --2- 172.21.15.63:0/633394198 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe0c80347a0 0x7fe0c80dc0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:27.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.009+0000 7fe0d7000640 1 -- 172.21.15.63:0/633394198 >> 172.21.15.63:0/633394198 conn(0x7fe0c8050190 msgr2=0x7fe0c8035940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:27.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.009+0000 7fe0d7000640 1 -- 172.21.15.63:0/633394198 shutdown_connections 2024-05-21T01:20:27.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.009+0000 7fe0d7000640 1 -- 172.21.15.63:0/633394198 wait complete. 2024-05-21T01:20:27.045 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.0 2024-05-21T01:20:27.046 DEBUG:teuthology.parallel:result is None 2024-05-21T01:20:27.051 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.045+0000 7f39b1c00640 1 -- 172.21.15.63:0/2087696697 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f39ac0ccc90 con 0x7f39ac159b30 2024-05-21T01:20:27.053 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.049+0000 7f39a2a00640 1 -- 172.21.15.63:0/2087696697 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f39a4010040 con 0x7f39ac159b30 2024-05-21T01:20:27.053 INFO:teuthology.orchestra.run.smithi063.stdout:64424509452 2024-05-21T01:20:27.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.053+0000 7f39b1c00640 1 -- 172.21.15.63:0/2087696697 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f398c06f450 msgr2=0x7f398c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:27.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.053+0000 7f39b1c00640 1 --2- 172.21.15.63:0/2087696697 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f398c06f450 0x7f398c071910 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f399c0b2000 tx=0x7f399c0aa070 comp rx=0 tx=0).stop 2024-05-21T01:20:27.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.053+0000 7f39b1c00640 1 -- 172.21.15.63:0/2087696697 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f39ac159b30 msgr2=0x7f39ac1f5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:27.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.053+0000 7f39b1c00640 1 --2- 172.21.15.63:0/2087696697 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f39ac159b30 0x7f39ac1f5070 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f39a400ef90 tx=0x7f39a400c490 comp rx=0 tx=0).stop 2024-05-21T01:20:27.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.053+0000 7f39b1c00640 1 -- 172.21.15.63:0/2087696697 shutdown_connections 2024-05-21T01:20:27.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.053+0000 7f39b1c00640 1 --2- 172.21.15.63:0/2087696697 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f398c06f450 0x7f398c071910 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:27.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.053+0000 7f39b1c00640 1 --2- 172.21.15.63:0/2087696697 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f39ac159b30 0x7f39ac1f5070 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:27.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.053+0000 7f39b1c00640 1 --2- 172.21.15.63:0/2087696697 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f39ac0c9da0 0x7f39ac14e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:27.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.053+0000 7f39b1c00640 1 --2- 172.21.15.63:0/2087696697 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f39ac074750 0x7f39ac071340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:27.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.053+0000 7f39b1c00640 1 -- 172.21.15.63:0/2087696697 >> 172.21.15.63:0/2087696697 conn(0x7f39ac068290 msgr2=0x7f39ac0cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:27.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.053+0000 7f39b1c00640 1 -- 172.21.15.63:0/2087696697 shutdown_connections 2024-05-21T01:20:27.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.053+0000 7f39b1c00640 1 -- 172.21.15.63:0/2087696697 wait complete. 2024-05-21T01:20:27.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.065+0000 7f7ca2c00640 1 -- 172.21.15.63:0/2532463236 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f7c9c0c8cf0 con 0x7f7c9c152f20 2024-05-21T01:20:27.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.065+0000 7f7c99600640 1 -- 172.21.15.63:0/2532463236 <== mon.2 v2:172.21.15.131:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7c8805b690 con 0x7f7c9c152f20 2024-05-21T01:20:27.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.065+0000 7f6dcf000640 1 -- 172.21.15.63:0/1550114235 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f6dc80c9250 con 0x7f6dc80cc700 2024-05-21T01:20:27.071 INFO:teuthology.orchestra.run.smithi063.stdout:60129542154 2024-05-21T01:20:27.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.065+0000 7f6dbfe00640 1 -- 172.21.15.63:0/1550114235 <== mon.2 v2:172.21.15.131:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6db4005480 con 0x7f6dc80cc700 2024-05-21T01:20:27.071 INFO:teuthology.orchestra.run.smithi063.stdout:64424509450 2024-05-21T01:20:27.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.069+0000 7f7ca2c00640 1 -- 172.21.15.63:0/2532463236 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f7c7c06f400 msgr2=0x7f7c7c0718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:27.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.069+0000 7f7ca2c00640 1 --2- 172.21.15.63:0/2532463236 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f7c7c06f400 0x7f7c7c0718c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7c900b2000 tx=0x7f7c90004740 comp rx=0 tx=0).stop 2024-05-21T01:20:27.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.069+0000 7f7ca2c00640 1 -- 172.21.15.63:0/2532463236 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7c9c152f20 msgr2=0x7f7c9c157ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:27.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.069+0000 7f7ca2c00640 1 --2- 172.21.15.63:0/2532463236 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7c9c152f20 0x7f7c9c157ec0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7c8800c4b0 tx=0x7f7c8800c970 comp rx=0 tx=0).stop 2024-05-21T01:20:27.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.069+0000 7f6dcf000640 1 -- 172.21.15.63:0/1550114235 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f6da806f400 msgr2=0x7f6da80718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:27.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.069+0000 7f6dcf000640 1 --2- 172.21.15.63:0/1550114235 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f6da806f400 0x7f6da80718c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6db8003b90 tx=0x7f6db80098d0 comp rx=0 tx=0).stop 2024-05-21T01:20:27.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.069+0000 7f6dcf000640 1 -- 172.21.15.63:0/1550114235 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6dc80cc700 msgr2=0x7f6dc80c7420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:27.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.069+0000 7f7ca2c00640 1 -- 172.21.15.63:0/2532463236 shutdown_connections 2024-05-21T01:20:27.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.069+0000 7f7ca2c00640 1 --2- 172.21.15.63:0/2532463236 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f7c7c06f400 0x7f7c7c0718c0 secure :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7c900b2000 tx=0x7f7c90004740 comp rx=0 tx=0).stop 2024-05-21T01:20:27.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.069+0000 7f7ca2c00640 1 --2- 172.21.15.63:0/2532463236 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7c9c15bf20 0x7f7c9c1e98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:27.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.069+0000 7f7ca2c00640 1 --2- 172.21.15.63:0/2532463236 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7c9c152f20 0x7f7c9c157ec0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:27.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.069+0000 7f7ca2c00640 1 --2- 172.21.15.63:0/2532463236 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7c9c152b40 0x7f7c9c153320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:27.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.069+0000 7f7ca2c00640 1 -- 172.21.15.63:0/2532463236 >> 172.21.15.63:0/2532463236 conn(0x7f7c9c0cacf0 msgr2=0x7f7c9c15a340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:27.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.069+0000 7f6dcf000640 1 --2- 172.21.15.63:0/1550114235 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6dc80cc700 0x7f6dc80c7420 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6db400c3f0 tx=0x7f6db400c8b0 comp rx=0 tx=0).stop 2024-05-21T01:20:27.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.069+0000 7f7ca2c00640 1 -- 172.21.15.63:0/2532463236 shutdown_connections 2024-05-21T01:20:27.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.069+0000 7f7ca2c00640 1 -- 172.21.15.63:0/2532463236 wait complete. 2024-05-21T01:20:27.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.069+0000 7f6dcf000640 1 -- 172.21.15.63:0/1550114235 shutdown_connections 2024-05-21T01:20:27.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.069+0000 7f6dcf000640 1 --2- 172.21.15.63:0/1550114235 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f6da806f400 0x7f6da80718c0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:27.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.069+0000 7f6dcf000640 1 --2- 172.21.15.63:0/1550114235 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6dc80ccae0 0x7f6dc8205150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:27.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.069+0000 7f6dcf000640 1 --2- 172.21.15.63:0/1550114235 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6dc80cc700 0x7f6dc80c7420 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:27.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.069+0000 7f6dcf000640 1 --2- 172.21.15.63:0/1550114235 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6dc80b61b0 0x7f6dc82013b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:27.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.069+0000 7f6dcf000640 1 -- 172.21.15.63:0/1550114235 >> 172.21.15.63:0/1550114235 conn(0x7f6dc8068290 msgr2=0x7f6dc80cd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:27.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.069+0000 7f6dcf000640 1 -- 172.21.15.63:0/1550114235 shutdown_connections 2024-05-21T01:20:27.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.069+0000 7f6dcf000640 1 -- 172.21.15.63:0/1550114235 wait complete. 2024-05-21T01:20:27.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.073+0000 7f8a8f800640 1 -- 172.21.15.63:0/3126018906 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f8a880cca90 con 0x7f8a70003a10 2024-05-21T01:20:27.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.077+0000 7f8a84c00640 1 -- 172.21.15.63:0/3126018906 <== mon.1 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8a7c0170f0 con 0x7f8a70003a10 2024-05-21T01:20:27.084 INFO:teuthology.orchestra.run.smithi063.stdout:60129542155 2024-05-21T01:20:27.084 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.077+0000 7f8a8f800640 1 -- 172.21.15.63:0/3126018906 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f8a6806f630 msgr2=0x7f8a68071af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:27.084 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.077+0000 7f8a8f800640 1 --2- 172.21.15.63:0/3126018906 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f8a6806f630 0x7f8a68071af0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8a88163f40 tx=0x7f8a74009190 comp rx=0 tx=0).stop 2024-05-21T01:20:27.084 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.077+0000 7f8a8f800640 1 -- 172.21.15.63:0/3126018906 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8a70003a10 msgr2=0x7f8a8815ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:27.084 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.077+0000 7f8a8f800640 1 --2- 172.21.15.63:0/3126018906 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8a70003a10 0x7f8a8815ab30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c00a810 tx=0x7f8a70005840 comp rx=0 tx=0).stop 2024-05-21T01:20:27.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.081+0000 7f8a8f800640 1 -- 172.21.15.63:0/3126018906 shutdown_connections 2024-05-21T01:20:27.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.081+0000 7f8a8f800640 1 --2- 172.21.15.63:0/3126018906 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f8a6806f630 0x7f8a68071af0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:27.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.081+0000 7f8a8f800640 1 --2- 172.21.15.63:0/3126018906 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8a88146f90 0x7f8a88147410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:27.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.081+0000 7f8a8f800640 1 --2- 172.21.15.63:0/3126018906 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8a8814e7e0 0x7f8a8814ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:27.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.081+0000 7f8a8f800640 1 --2- 172.21.15.63:0/3126018906 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8a70003a10 0x7f8a8815ab30 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:27.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.081+0000 7f8a8f800640 1 -- 172.21.15.63:0/3126018906 >> 172.21.15.63:0/3126018906 conn(0x7f8a880cae90 msgr2=0x7f8a8816a030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:27.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.081+0000 7f8a8f800640 1 -- 172.21.15.63:0/3126018906 shutdown_connections 2024-05-21T01:20:27.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.081+0000 7f8a8f800640 1 -- 172.21.15.63:0/3126018906 wait complete. 2024-05-21T01:20:27.088 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509452 got 64424509452 for osd.3 2024-05-21T01:20:27.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.081+0000 7fa074a00640 1 -- 172.21.15.63:0/2927638036 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fa07015e3d0 con 0x7fa07006d520 2024-05-21T01:20:27.089 DEBUG:teuthology.parallel:result is None 2024-05-21T01:20:27.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.085+0000 7fa066000640 1 -- 172.21.15.63:0/2927638036 <== mon.2 v2:172.21.15.131:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa0600f6d00 con 0x7fa07006d520 2024-05-21T01:20:27.089 INFO:teuthology.orchestra.run.smithi063.stdout:64424509451 2024-05-21T01:20:27.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.089+0000 7fa074a00640 1 -- 172.21.15.63:0/2927638036 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fa04c06f430 msgr2=0x7fa04c0718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:27.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.089+0000 7fa074a00640 1 --2- 172.21.15.63:0/2927638036 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fa04c06f430 0x7fa04c0718f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa070156d80 tx=0x7fa058008040 comp rx=0 tx=0).stop 2024-05-21T01:20:27.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.089+0000 7fa074a00640 1 -- 172.21.15.63:0/2927638036 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa07006d520 msgr2=0x7fa0701f9d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:27.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.089+0000 7fa074a00640 1 --2- 172.21.15.63:0/2927638036 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa07006d520 0x7fa0701f9d50 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa07006a3c0 tx=0x7fa06001ada0 comp rx=0 tx=0).stop 2024-05-21T01:20:27.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.089+0000 7fa074a00640 1 -- 172.21.15.63:0/2927638036 shutdown_connections 2024-05-21T01:20:27.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.089+0000 7fa074a00640 1 --2- 172.21.15.63:0/2927638036 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fa04c06f430 0x7fa04c0718f0 secure :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa070156d80 tx=0x7fa058008040 comp rx=0 tx=0).stop 2024-05-21T01:20:27.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.089+0000 7fa074a00640 1 --2- 172.21.15.63:0/2927638036 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa07015a440 0x7fa070152f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:27.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.089+0000 7fa074a00640 1 --2- 172.21.15.63:0/2927638036 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa0700725e0 0x7fa070155de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:27.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.089+0000 7fa074a00640 1 --2- 172.21.15.63:0/2927638036 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa07006d520 0x7fa0701f9d50 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:27.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.089+0000 7fa074a00640 1 -- 172.21.15.63:0/2927638036 >> 172.21.15.63:0/2927638036 conn(0x7fa0700cae00 msgr2=0x7fa0700ce9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:27.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.089+0000 7fa074a00640 1 -- 172.21.15.63:0/2927638036 shutdown_connections 2024-05-21T01:20:27.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.089+0000 7fa074a00640 1 -- 172.21.15.63:0/2927638036 wait complete. 2024-05-21T01:20:27.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.093+0000 7f2063000640 1 -- 172.21.15.63:0/3418446252 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f205c159690 con 0x7f205c155b40 2024-05-21T01:20:27.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.093+0000 7f2059600640 1 -- 172.21.15.63:0/3418446252 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2054018cd0 con 0x7f205c155b40 2024-05-21T01:20:27.098 INFO:teuthology.orchestra.run.smithi063.stdout:55834574858 2024-05-21T01:20:27.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.097+0000 7f2063000640 1 -- 172.21.15.63:0/3418446252 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f203c06f450 msgr2=0x7f203c071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:27.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.097+0000 7f2063000640 1 --2- 172.21.15.63:0/3418446252 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f203c06f450 0x7f203c071910 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2048009a20 tx=0x7f2048008040 comp rx=0 tx=0).stop 2024-05-21T01:20:27.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.097+0000 7f2063000640 1 -- 172.21.15.63:0/3418446252 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f205c155b40 msgr2=0x7f205c150010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:27.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.097+0000 7f2063000640 1 --2- 172.21.15.63:0/3418446252 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f205c155b40 0x7f205c150010 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f205401cda0 tx=0x7f205401bf10 comp rx=0 tx=0).stop 2024-05-21T01:20:27.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.097+0000 7f2063000640 1 -- 172.21.15.63:0/3418446252 shutdown_connections 2024-05-21T01:20:27.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.097+0000 7f2063000640 1 --2- 172.21.15.63:0/3418446252 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f203c06f450 0x7f203c071910 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:27.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.097+0000 7f2063000640 1 --2- 172.21.15.63:0/3418446252 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f205c15fc70 0x7f205c159960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:27.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.097+0000 7f2063000640 1 --2- 172.21.15.63:0/3418446252 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f205c155b40 0x7f205c150010 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:27.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.097+0000 7f2063000640 1 --2- 172.21.15.63:0/3418446252 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f205c0cd310 0x7f205c1509b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:27.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.097+0000 7f2063000640 1 -- 172.21.15.63:0/3418446252 >> 172.21.15.63:0/3418446252 conn(0x7f205c0741d0 msgr2=0x7f205c15c330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:27.104 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.1 2024-05-21T01:20:27.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.097+0000 7f2063000640 1 -- 172.21.15.63:0/3418446252 shutdown_connections 2024-05-21T01:20:27.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.097+0000 7f2063000640 1 -- 172.21.15.63:0/3418446252 wait complete. 2024-05-21T01:20:27.104 DEBUG:teuthology.parallel:result is None 2024-05-21T01:20:27.109 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.105+0000 7f583f000640 1 -- 172.21.15.63:0/3030087363 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f58381fa910 con 0x7f58380cc800 2024-05-21T01:20:27.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.105+0000 7f5835600640 1 -- 172.21.15.63:0/3030087363 <== mon.1 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f582c05bcc0 con 0x7f58380cc800 2024-05-21T01:20:27.110 INFO:teuthology.orchestra.run.smithi063.stdout:55834574858 2024-05-21T01:20:27.111 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542154 for osd.5 2024-05-21T01:20:27.111 DEBUG:teuthology.parallel:result is None 2024-05-21T01:20:27.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.105+0000 7f583f000640 1 -- 172.21.15.63:0/3030087363 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f581806f4d0 msgr2=0x7f5818071990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:27.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.105+0000 7f583f000640 1 --2- 172.21.15.63:0/3030087363 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f581806f4d0 0x7f5818071990 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f58240ad000 tx=0x7f5824004740 comp rx=0 tx=0).stop 2024-05-21T01:20:27.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.105+0000 7f583f000640 1 -- 172.21.15.63:0/3030087363 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f58380cc800 msgr2=0x7f58380c9f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:27.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.105+0000 7f583f000640 1 --2- 172.21.15.63:0/3030087363 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f58380cc800 0x7f58380c9f80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f582c00c700 tx=0x7f582c00cb00 comp rx=0 tx=0).stop 2024-05-21T01:20:27.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.105+0000 7f583f000640 1 -- 172.21.15.63:0/3030087363 shutdown_connections 2024-05-21T01:20:27.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.105+0000 7f583f000640 1 --2- 172.21.15.63:0/3030087363 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f581806f4d0 0x7f5818071990 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:27.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.105+0000 7f583f000640 1 --2- 172.21.15.63:0/3030087363 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5838163740 0x7f58381fb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:27.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.105+0000 7f583f000640 1 --2- 172.21.15.63:0/3030087363 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f583815a1d0 0x7f58381fabb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:27.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.105+0000 7f583f000640 1 --2- 172.21.15.63:0/3030087363 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f58380cc800 0x7f58380c9f80 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:27.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.105+0000 7f583f000640 1 -- 172.21.15.63:0/3030087363 >> 172.21.15.63:0/3030087363 conn(0x7f58380cd550 msgr2=0x7f5838163f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:27.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.109+0000 7f583f000640 1 -- 172.21.15.63:0/3030087363 shutdown_connections 2024-05-21T01:20:27.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.109+0000 7f583f000640 1 -- 172.21.15.63:0/3030087363 wait complete. 2024-05-21T01:20:27.121 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542155 for osd.6 2024-05-21T01:20:27.121 DEBUG:teuthology.parallel:result is None 2024-05-21T01:20:27.126 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509451 for osd.2 2024-05-21T01:20:27.127 DEBUG:teuthology.parallel:result is None 2024-05-21T01:20:27.129 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.7 2024-05-21T01:20:27.129 DEBUG:teuthology.parallel:result is None 2024-05-21T01:20:27.136 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.4 2024-05-21T01:20:27.136 DEBUG:teuthology.parallel:result is None 2024-05-21T01:20:27.136 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-21T01:20:27.136 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-21T01:20:27.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.321+0000 7f1963000640 1 Processor -- start 2024-05-21T01:20:27.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.321+0000 7f1963000640 1 -- start start 2024-05-21T01:20:27.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.321+0000 7f1963000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f195c156070 0x7f195c071640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:27.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.321+0000 7f1963000640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f195c071b80 0x7f195c0cf530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:27.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.321+0000 7f1963000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f195c06f080 0x7f195c0cfa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:27.328 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.321+0000 7f1963000640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f195c15bf20 con 0x7f195c071b80 2024-05-21T01:20:27.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.321+0000 7f1963000640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f195c15c1e0 con 0x7f195c06f080 2024-05-21T01:20:27.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.321+0000 7f1963000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f195c15c4c0 con 0x7f195c156070 2024-05-21T01:20:27.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.321+0000 7f1953400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f195c071b80 0x7f195c0cf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:27.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.321+0000 7f1953400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f195c071b80 0x7f195c0cf530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:49558/0 (socket says 172.21.15.63:49558) 2024-05-21T01:20:27.329 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.321+0000 7f1953400640 1 -- 172.21.15.63:0/477120048 learned_addr learned my addr 172.21.15.63:0/477120048 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:27.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.321+0000 7f195be00640 1 --2- 172.21.15.63:0/477120048 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f195c156070 0x7f195c071640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:27.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.321+0000 7f1961000640 1 --2- 172.21.15.63:0/477120048 >> v2:172.21.15.131:3300/0 conn(0x7f195c06f080 0x7f195c0cfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:27.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.321+0000 7f1953400640 1 -- 172.21.15.63:0/477120048 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f195c156070 msgr2=0x7f195c071640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:27.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.321+0000 7f1953400640 1 --2- 172.21.15.63:0/477120048 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f195c156070 0x7f195c071640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:27.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.321+0000 7f1953400640 1 -- 172.21.15.63:0/477120048 >> v2:172.21.15.131:3300/0 conn(0x7f195c06f080 msgr2=0x7f195c0cfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:27.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.321+0000 7f1953400640 1 --2- 172.21.15.63:0/477120048 >> v2:172.21.15.131:3300/0 conn(0x7f195c06f080 0x7f195c0cfa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:27.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.321+0000 7f1953400640 1 -- 172.21.15.63:0/477120048 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f195c15c7a0 con 0x7f195c071b80 2024-05-21T01:20:27.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.321+0000 7f195be00640 1 --2- 172.21.15.63:0/477120048 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f195c156070 0x7f195c071640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T01:20:27.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.325+0000 7f1953400640 1 --2- 172.21.15.63:0/477120048 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f195c071b80 0x7f195c0cf530 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f195c06f750 tx=0x7f194401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4180dd3a6075ea8d server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:27.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.325+0000 7f195b400640 1 -- 172.21.15.63:0/477120048 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19440a5670 con 0x7f195c071b80 2024-05-21T01:20:27.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.325+0000 7f195b400640 1 -- 172.21.15.63:0/477120048 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19440a5810 con 0x7f195c071b80 2024-05-21T01:20:27.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.325+0000 7f195b400640 1 -- 172.21.15.63:0/477120048 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19440a5be0 con 0x7f195c071b80 2024-05-21T01:20:27.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.325+0000 7f1963000640 1 -- 172.21.15.63:0/477120048 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f195c071b80 msgr2=0x7f195c0cf530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:27.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.325+0000 7f1963000640 1 --2- 172.21.15.63:0/477120048 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f195c071b80 0x7f195c0cf530 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f195c06f750 tx=0x7f194401c9f0 comp rx=0 tx=0).stop 2024-05-21T01:20:27.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.325+0000 7f1963000640 1 -- 172.21.15.63:0/477120048 shutdown_connections 2024-05-21T01:20:27.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.325+0000 7f1963000640 1 --2- 172.21.15.63:0/477120048 >> v2:172.21.15.131:3300/0 conn(0x7f195c06f080 0x7f195c0cfa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:27.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.325+0000 7f1963000640 1 --2- 172.21.15.63:0/477120048 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f195c071b80 0x7f195c0cf530 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:27.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.325+0000 7f1963000640 1 --2- 172.21.15.63:0/477120048 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f195c156070 0x7f195c071640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:27.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.325+0000 7f1963000640 1 -- 172.21.15.63:0/477120048 >> 172.21.15.63:0/477120048 conn(0x7f195c0735f0 msgr2=0x7f195c073a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:27.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.325+0000 7f1963000640 1 -- 172.21.15.63:0/477120048 shutdown_connections 2024-05-21T01:20:27.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.325+0000 7f1963000640 1 -- 172.21.15.63:0/477120048 wait complete. 2024-05-21T01:20:27.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.329+0000 7f1963000640 1 Processor -- start 2024-05-21T01:20:27.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.329+0000 7f1963000640 1 -- start start 2024-05-21T01:20:27.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.329+0000 7f1963000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f195c06f080 0x7f195c0cbd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:27.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.329+0000 7f1963000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f195c071b80 0x7f195c0cc290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:27.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.329+0000 7f1963000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f195c156070 0x7f195c1512c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:27.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.329+0000 7f1963000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f195c1565d0 con 0x7f195c071b80 2024-05-21T01:20:27.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.329+0000 7f1963000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f195c156450 con 0x7f195c06f080 2024-05-21T01:20:27.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.329+0000 7f1963000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f195c15f510 con 0x7f195c156070 2024-05-21T01:20:27.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.329+0000 7f1953400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f195c071b80 0x7f195c0cc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:27.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.329+0000 7f1953400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f195c071b80 0x7f195c0cc290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:49564/0 (socket says 172.21.15.63:49564) 2024-05-21T01:20:27.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.329+0000 7f1953400640 1 -- 172.21.15.63:0/2278733099 learned_addr learned my addr 172.21.15.63:0/2278733099 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:27.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.329+0000 7f195be00640 1 --2- 172.21.15.63:0/2278733099 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f195c06f080 0x7f195c0cbd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:27.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.329+0000 7f1961000640 1 --2- 172.21.15.63:0/2278733099 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f195c156070 0x7f195c1512c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:27.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.329+0000 7f1953400640 1 -- 172.21.15.63:0/2278733099 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f195c156070 msgr2=0x7f195c1512c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:27.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.329+0000 7f1953400640 1 --2- 172.21.15.63:0/2278733099 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f195c156070 0x7f195c1512c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:27.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.329+0000 7f1953400640 1 -- 172.21.15.63:0/2278733099 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f195c06f080 msgr2=0x7f195c0cbd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:27.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.329+0000 7f1953400640 1 --2- 172.21.15.63:0/2278733099 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f195c06f080 0x7f195c0cbd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:27.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.329+0000 7f1953400640 1 -- 172.21.15.63:0/2278733099 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f195c1f4e30 con 0x7f195c071b80 2024-05-21T01:20:27.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.329+0000 7f1953400640 1 --2- 172.21.15.63:0/2278733099 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f195c071b80 0x7f195c0cc290 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f194401b0a0 tx=0x7f1944019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:27.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.329+0000 7f1958c00640 1 -- 172.21.15.63:0/2278733099 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19440b8670 con 0x7f195c071b80 2024-05-21T01:20:27.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.329+0000 7f1958c00640 1 -- 172.21.15.63:0/2278733099 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19440be070 con 0x7f195c071b80 2024-05-21T01:20:27.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.329+0000 7f1958c00640 1 -- 172.21.15.63:0/2278733099 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19440b8a70 con 0x7f195c071b80 2024-05-21T01:20:27.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.329+0000 7f1963000640 1 -- 172.21.15.63:0/2278733099 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f195c1f5110 con 0x7f195c071b80 2024-05-21T01:20:27.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.329+0000 7f1963000640 1 -- 172.21.15.63:0/2278733099 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f195c1f56d0 con 0x7f195c071b80 2024-05-21T01:20:27.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.329+0000 7f1963000640 1 -- 172.21.15.63:0/2278733099 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f195c1f5a00 con 0x7f195c071b80 2024-05-21T01:20:27.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.333+0000 7f1958c00640 1 -- 172.21.15.63:0/2278733099 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7f19440b8c10 con 0x7f195c071b80 2024-05-21T01:20:27.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.333+0000 7f1958c00640 1 --2- 172.21.15.63:0/2278733099 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f193806f400 0x7f19380718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:27.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.333+0000 7f1958c00640 1 -- 172.21.15.63:0/2278733099 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f194412a680 con 0x7f195c071b80 2024-05-21T01:20:27.338 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.333+0000 7f195be00640 1 --2- 172.21.15.63:0/2278733099 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f193806f400 0x7f19380718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:27.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.333+0000 7f195be00640 1 --2- 172.21.15.63:0/2278733099 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f193806f400 0x7f19380718c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f194c0045f0 tx=0x7f194c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:27.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.337+0000 7f1958c00640 1 -- 172.21.15.63:0/2278733099 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f19440165e0 con 0x7f195c071b80 2024-05-21T01:20:27.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.501+0000 7f1963000640 1 -- 172.21.15.63:0/2278733099 --> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f195c0507f0 con 0x7f193806f400 2024-05-21T01:20:27.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.525+0000 7f1958c00640 1 -- 172.21.15.63:0/2278733099 <== mgr.4103 v2:172.21.15.131:6832/921953667 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332685 (secure 0 0 0) 0x7f195c0507f0 con 0x7f193806f400 2024-05-21T01:20:27.532 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-05-21T01:20:27.534 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-05-21T01:20:27.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.529+0000 7f1963000640 1 -- 172.21.15.63:0/2278733099 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f193806f400 msgr2=0x7f19380718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:27.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.529+0000 7f1963000640 1 --2- 172.21.15.63:0/2278733099 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f193806f400 0x7f19380718c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f194c0045f0 tx=0x7f194c008040 comp rx=0 tx=0).stop 2024-05-21T01:20:27.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.529+0000 7f1963000640 1 -- 172.21.15.63:0/2278733099 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f195c071b80 msgr2=0x7f195c0cc290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:27.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.529+0000 7f1963000640 1 --2- 172.21.15.63:0/2278733099 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f195c071b80 0x7f195c0cc290 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f194401b0a0 tx=0x7f1944019790 comp rx=0 tx=0).stop 2024-05-21T01:20:27.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.529+0000 7f1963000640 1 -- 172.21.15.63:0/2278733099 shutdown_connections 2024-05-21T01:20:27.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.529+0000 7f1963000640 1 --2- 172.21.15.63:0/2278733099 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f193806f400 0x7f19380718c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:27.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.529+0000 7f1963000640 1 --2- 172.21.15.63:0/2278733099 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f195c156070 0x7f195c1512c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:27.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.529+0000 7f1963000640 1 --2- 172.21.15.63:0/2278733099 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f195c071b80 0x7f195c0cc290 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:27.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.529+0000 7f1963000640 1 --2- 172.21.15.63:0/2278733099 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f195c06f080 0x7f195c0cbd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:27.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.529+0000 7f1963000640 1 -- 172.21.15.63:0/2278733099 >> 172.21.15.63:0/2278733099 conn(0x7f195c0735f0 msgr2=0x7f195c0cfdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:27.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.529+0000 7f1963000640 1 -- 172.21.15.63:0/2278733099 shutdown_connections 2024-05-21T01:20:27.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.529+0000 7f1963000640 1 -- 172.21.15.63:0/2278733099 wait complete. 2024-05-21T01:20:27.552 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2024-05-21T01:20:26.443517+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596324,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":169,"num_write_kb":1651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":135,"ondisk_log_size":135,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218372,"kb_used_data":2216,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756348,"statfs":{"total":773094113280,"available":772870500352,"internally_reserved":0,"allocated":2269184,"data_stored":2013126,"data_compressed":66932,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3097,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005272"},"pg_stats":[{"pgid":"2.1f","version":"24'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.573917+0000","last_change":"2024-05-21T01:19:53.545236+0000","last_active":"2024-05-21T01:19:59.573917+0000","last_peered":"2024-05-21T01:19:59.573917+0000","last_clean":"2024-05-21T01:19:59.573917+0000","last_became_active":"2024-05-21T01:19:53.544469+0000","last_became_peered":"2024-05-21T01:19:53.544469+0000","last_unstale":"2024-05-21T01:19:59.573917+0000","last_undegraded":"2024-05-21T01:19:59.573917+0000","last_fullsized":"2024-05-21T01:19:59.573917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:33:09.421287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.211552+0000","last_change":"2024-05-21T01:19:54.568235+0000","last_active":"2024-05-21T01:20:00.211552+0000","last_peered":"2024-05-21T01:20:00.211552+0000","last_clean":"2024-05-21T01:20:00.211552+0000","last_became_active":"2024-05-21T01:19:54.567245+0000","last_became_peered":"2024-05-21T01:19:54.567245+0000","last_unstale":"2024-05-21T01:20:00.211552+0000","last_undegraded":"2024-05-21T01:20:00.211552+0000","last_fullsized":"2024-05-21T01:20:00.211552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:39:51.222819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207912+0000","last_change":"2024-05-21T01:19:58.618772+0000","last_active":"2024-05-21T01:20:00.207912+0000","last_peered":"2024-05-21T01:20:00.207912+0000","last_clean":"2024-05-21T01:20:00.207912+0000","last_became_active":"2024-05-21T01:19:58.617757+0000","last_became_peered":"2024-05-21T01:19:58.617757+0000","last_unstale":"2024-05-21T01:20:00.207912+0000","last_undegraded":"2024-05-21T01:20:00.207912+0000","last_fullsized":"2024-05-21T01:20:00.207912+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T13:07:31.666521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.211893+0000","last_change":"2024-05-21T01:19:53.551775+0000","last_active":"2024-05-21T01:20:00.211893+0000","last_peered":"2024-05-21T01:20:00.211893+0000","last_clean":"2024-05-21T01:20:00.211893+0000","last_became_active":"2024-05-21T01:19:53.551049+0000","last_became_peered":"2024-05-21T01:19:53.551049+0000","last_unstale":"2024-05-21T01:20:00.211893+0000","last_undegraded":"2024-05-21T01:20:00.211893+0000","last_fullsized":"2024-05-21T01:20:00.211893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:49:02.289202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.211755+0000","last_change":"2024-05-21T01:19:54.573420+0000","last_active":"2024-05-21T01:20:00.211755+0000","last_peered":"2024-05-21T01:20:00.211755+0000","last_clean":"2024-05-21T01:20:00.211755+0000","last_became_active":"2024-05-21T01:19:54.569573+0000","last_became_peered":"2024-05-21T01:19:54.569573+0000","last_unstale":"2024-05-21T01:20:00.211755+0000","last_undegraded":"2024-05-21T01:20:00.211755+0000","last_fullsized":"2024-05-21T01:20:00.211755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:00:12.257816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.206470+0000","last_change":"2024-05-21T01:19:58.604490+0000","last_active":"2024-05-21T01:20:00.206470+0000","last_peered":"2024-05-21T01:20:00.206470+0000","last_clean":"2024-05-21T01:20:00.206470+0000","last_became_active":"2024-05-21T01:19:58.604108+0000","last_became_peered":"2024-05-21T01:19:58.604108+0000","last_unstale":"2024-05-21T01:20:00.206470+0000","last_undegraded":"2024-05-21T01:20:00.206470+0000","last_fullsized":"2024-05-21T01:20:00.206470+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:11:10.963073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207737+0000","last_change":"2024-05-21T01:19:53.525403+0000","last_active":"2024-05-21T01:20:00.207737+0000","last_peered":"2024-05-21T01:20:00.207737+0000","last_clean":"2024-05-21T01:20:00.207737+0000","last_became_active":"2024-05-21T01:19:53.521265+0000","last_became_peered":"2024-05-21T01:19:53.521265+0000","last_unstale":"2024-05-21T01:20:00.207737+0000","last_undegraded":"2024-05-21T01:20:00.207737+0000","last_fullsized":"2024-05-21T01:20:00.207737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:52:16.488269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.209201+0000","last_change":"2024-05-21T01:19:54.536436+0000","last_active":"2024-05-21T01:20:00.209201+0000","last_peered":"2024-05-21T01:20:00.209201+0000","last_clean":"2024-05-21T01:20:00.209201+0000","last_became_active":"2024-05-21T01:19:54.536061+0000","last_became_peered":"2024-05-21T01:19:54.536061+0000","last_unstale":"2024-05-21T01:20:00.209201+0000","last_undegraded":"2024-05-21T01:20:00.209201+0000","last_fullsized":"2024-05-21T01:20:00.209201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:48:23.811712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.206960+0000","last_change":"2024-05-21T01:19:58.623087+0000","last_active":"2024-05-21T01:20:00.206960+0000","last_peered":"2024-05-21T01:20:00.206960+0000","last_clean":"2024-05-21T01:20:00.206960+0000","last_became_active":"2024-05-21T01:19:58.622672+0000","last_became_peered":"2024-05-21T01:19:58.622672+0000","last_unstale":"2024-05-21T01:20:00.206960+0000","last_undegraded":"2024-05-21T01:20:00.206960+0000","last_fullsized":"2024-05-21T01:20:00.206960+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:45:49.241750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207109+0000","last_change":"2024-05-21T01:19:53.522497+0000","last_active":"2024-05-21T01:20:00.207109+0000","last_peered":"2024-05-21T01:20:00.207109+0000","last_clean":"2024-05-21T01:20:00.207109+0000","last_became_active":"2024-05-21T01:19:53.521684+0000","last_became_peered":"2024-05-21T01:19:53.521684+0000","last_unstale":"2024-05-21T01:20:00.207109+0000","last_undegraded":"2024-05-21T01:20:00.207109+0000","last_fullsized":"2024-05-21T01:20:00.207109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:18:17.808255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.567660+0000","last_change":"2024-05-21T01:19:54.549512+0000","last_active":"2024-05-21T01:19:59.567660+0000","last_peered":"2024-05-21T01:19:59.567660+0000","last_clean":"2024-05-21T01:19:59.567660+0000","last_became_active":"2024-05-21T01:19:54.549291+0000","last_became_peered":"2024-05-21T01:19:54.549291+0000","last_unstale":"2024-05-21T01:19:59.567660+0000","last_undegraded":"2024-05-21T01:19:59.567660+0000","last_fullsized":"2024-05-21T01:19:59.567660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:48:34.571236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.206754+0000","last_change":"2024-05-21T01:19:58.614748+0000","last_active":"2024-05-21T01:20:00.206754+0000","last_peered":"2024-05-21T01:20:00.206754+0000","last_clean":"2024-05-21T01:20:00.206754+0000","last_became_active":"2024-05-21T01:19:58.614313+0000","last_became_peered":"2024-05-21T01:19:58.614313+0000","last_unstale":"2024-05-21T01:20:00.206754+0000","last_undegraded":"2024-05-21T01:20:00.206754+0000","last_fullsized":"2024-05-21T01:20:00.206754+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:45:34.204591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.567029+0000","last_change":"2024-05-21T01:19:54.545467+0000","last_active":"2024-05-21T01:19:59.567029+0000","last_peered":"2024-05-21T01:19:59.567029+0000","last_clean":"2024-05-21T01:19:59.567029+0000","last_became_active":"2024-05-21T01:19:54.545181+0000","last_became_peered":"2024-05-21T01:19:54.545181+0000","last_unstale":"2024-05-21T01:19:59.567029+0000","last_undegraded":"2024-05-21T01:19:59.567029+0000","last_fullsized":"2024-05-21T01:19:59.567029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:43:15.387067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.567246+0000","last_change":"2024-05-21T01:19:53.536139+0000","last_active":"2024-05-21T01:19:59.567246+0000","last_peered":"2024-05-21T01:19:59.567246+0000","last_clean":"2024-05-21T01:19:59.567246+0000","last_became_active":"2024-05-21T01:19:53.535899+0000","last_became_peered":"2024-05-21T01:19:53.535899+0000","last_unstale":"2024-05-21T01:19:59.567246+0000","last_undegraded":"2024-05-21T01:19:59.567246+0000","last_fullsized":"2024-05-21T01:19:59.567246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:40:12.033744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.567390+0000","last_change":"2024-05-21T01:19:58.621487+0000","last_active":"2024-05-21T01:19:59.567390+0000","last_peered":"2024-05-21T01:19:59.567390+0000","last_clean":"2024-05-21T01:19:59.567390+0000","last_became_active":"2024-05-21T01:19:58.621083+0000","last_became_peered":"2024-05-21T01:19:58.621083+0000","last_unstale":"2024-05-21T01:19:59.567390+0000","last_undegraded":"2024-05-21T01:19:59.567390+0000","last_fullsized":"2024-05-21T01:19:59.567390+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:18:44.587274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.208662+0000","last_change":"2024-05-21T01:19:54.572420+0000","last_active":"2024-05-21T01:20:00.208662+0000","last_peered":"2024-05-21T01:20:00.208662+0000","last_clean":"2024-05-21T01:20:00.208662+0000","last_became_active":"2024-05-21T01:19:54.571863+0000","last_became_peered":"2024-05-21T01:19:54.571863+0000","last_unstale":"2024-05-21T01:20:00.208662+0000","last_undegraded":"2024-05-21T01:20:00.208662+0000","last_fullsized":"2024-05-21T01:20:00.208662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:13:52.491903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.575374+0000","last_change":"2024-05-21T01:19:53.553351+0000","last_active":"2024-05-21T01:19:59.575374+0000","last_peered":"2024-05-21T01:19:59.575374+0000","last_clean":"2024-05-21T01:19:59.575374+0000","last_became_active":"2024-05-21T01:19:53.552694+0000","last_became_peered":"2024-05-21T01:19:53.552694+0000","last_unstale":"2024-05-21T01:19:59.575374+0000","last_undegraded":"2024-05-21T01:19:59.575374+0000","last_fullsized":"2024-05-21T01:19:59.575374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:46:55.273278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.206544+0000","last_change":"2024-05-21T01:19:58.594904+0000","last_active":"2024-05-21T01:20:00.206544+0000","last_peered":"2024-05-21T01:20:00.206544+0000","last_clean":"2024-05-21T01:20:00.206544+0000","last_became_active":"2024-05-21T01:19:58.594450+0000","last_became_peered":"2024-05-21T01:19:58.594450+0000","last_unstale":"2024-05-21T01:20:00.206544+0000","last_undegraded":"2024-05-21T01:20:00.206544+0000","last_fullsized":"2024-05-21T01:20:00.206544+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:37:30.286986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.571649+0000","last_change":"2024-05-21T01:19:54.554750+0000","last_active":"2024-05-21T01:19:59.571649+0000","last_peered":"2024-05-21T01:19:59.571649+0000","last_clean":"2024-05-21T01:19:59.571649+0000","last_became_active":"2024-05-21T01:19:54.551583+0000","last_became_peered":"2024-05-21T01:19:54.551583+0000","last_unstale":"2024-05-21T01:19:59.571649+0000","last_undegraded":"2024-05-21T01:19:59.571649+0000","last_fullsized":"2024-05-21T01:19:59.571649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:37:19.564099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"25'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:24.662369+0000","last_change":"2024-05-21T01:19:53.523277+0000","last_active":"2024-05-21T01:20:24.662369+0000","last_peered":"2024-05-21T01:20:24.662369+0000","last_clean":"2024-05-21T01:20:24.662369+0000","last_became_active":"2024-05-21T01:19:53.522525+0000","last_became_peered":"2024-05-21T01:19:53.522525+0000","last_unstale":"2024-05-21T01:20:24.662369+0000","last_undegraded":"2024-05-21T01:20:24.662369+0000","last_fullsized":"2024-05-21T01:20:24.662369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:23:59.949781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.209007+0000","last_change":"2024-05-21T01:19:58.615575+0000","last_active":"2024-05-21T01:20:00.209007+0000","last_peered":"2024-05-21T01:20:00.209007+0000","last_clean":"2024-05-21T01:20:00.209007+0000","last_became_active":"2024-05-21T01:19:58.614401+0000","last_became_peered":"2024-05-21T01:19:58.614401+0000","last_unstale":"2024-05-21T01:20:00.209007+0000","last_undegraded":"2024-05-21T01:20:00.209007+0000","last_fullsized":"2024-05-21T01:20:00.209007+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:51:09.839503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.566770+0000","last_change":"2024-05-21T01:19:54.555489+0000","last_active":"2024-05-21T01:19:59.566770+0000","last_peered":"2024-05-21T01:19:59.566770+0000","last_clean":"2024-05-21T01:19:59.566770+0000","last_became_active":"2024-05-21T01:19:54.555227+0000","last_became_peered":"2024-05-21T01:19:54.555227+0000","last_unstale":"2024-05-21T01:19:59.566770+0000","last_undegraded":"2024-05-21T01:19:59.566770+0000","last_fullsized":"2024-05-21T01:19:59.566770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:00:22.873520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.205893+0000","last_change":"2024-05-21T01:19:53.520840+0000","last_active":"2024-05-21T01:20:00.205893+0000","last_peered":"2024-05-21T01:20:00.205893+0000","last_clean":"2024-05-21T01:20:00.205893+0000","last_became_active":"2024-05-21T01:19:53.520540+0000","last_became_peered":"2024-05-21T01:19:53.520540+0000","last_unstale":"2024-05-21T01:20:00.205893+0000","last_undegraded":"2024-05-21T01:20:00.205893+0000","last_fullsized":"2024-05-21T01:20:00.205893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:08:36.426465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207823+0000","last_change":"2024-05-21T01:19:58.604357+0000","last_active":"2024-05-21T01:20:00.207823+0000","last_peered":"2024-05-21T01:20:00.207823+0000","last_clean":"2024-05-21T01:20:00.207823+0000","last_became_active":"2024-05-21T01:19:58.603922+0000","last_became_peered":"2024-05-21T01:19:58.603922+0000","last_unstale":"2024-05-21T01:20:00.207823+0000","last_undegraded":"2024-05-21T01:20:00.207823+0000","last_fullsized":"2024-05-21T01:20:00.207823+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:55:18.226031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.572430+0000","last_change":"2024-05-21T01:19:54.569315+0000","last_active":"2024-05-21T01:19:59.572430+0000","last_peered":"2024-05-21T01:19:59.572430+0000","last_clean":"2024-05-21T01:19:59.572430+0000","last_became_active":"2024-05-21T01:19:54.568232+0000","last_became_peered":"2024-05-21T01:19:54.568232+0000","last_unstale":"2024-05-21T01:19:59.572430+0000","last_undegraded":"2024-05-21T01:19:59.572430+0000","last_fullsized":"2024-05-21T01:19:59.572430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:19:01.819418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"25'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:24.660940+0000","last_change":"2024-05-21T01:19:53.525301+0000","last_active":"2024-05-21T01:20:24.660940+0000","last_peered":"2024-05-21T01:20:24.660940+0000","last_clean":"2024-05-21T01:20:24.660940+0000","last_became_active":"2024-05-21T01:19:53.525010+0000","last_became_peered":"2024-05-21T01:19:53.525010+0000","last_unstale":"2024-05-21T01:20:24.660940+0000","last_undegraded":"2024-05-21T01:20:24.660940+0000","last_fullsized":"2024-05-21T01:20:24.660940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:53:11.316975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.206622+0000","last_change":"2024-05-21T01:19:58.590354+0000","last_active":"2024-05-21T01:20:00.206622+0000","last_peered":"2024-05-21T01:20:00.206622+0000","last_clean":"2024-05-21T01:20:00.206622+0000","last_became_active":"2024-05-21T01:19:58.589985+0000","last_became_peered":"2024-05-21T01:19:58.589985+0000","last_unstale":"2024-05-21T01:20:00.206622+0000","last_undegraded":"2024-05-21T01:20:00.206622+0000","last_fullsized":"2024-05-21T01:20:00.206622+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:08:09.222858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.573671+0000","last_change":"2024-05-21T01:19:54.555318+0000","last_active":"2024-05-21T01:19:59.573671+0000","last_peered":"2024-05-21T01:19:59.573671+0000","last_clean":"2024-05-21T01:19:59.573671+0000","last_became_active":"2024-05-21T01:19:54.552947+0000","last_became_peered":"2024-05-21T01:19:54.552947+0000","last_unstale":"2024-05-21T01:19:59.573671+0000","last_undegraded":"2024-05-21T01:19:59.573671+0000","last_fullsized":"2024-05-21T01:19:59.573671+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:29:24.153986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.572949+0000","last_change":"2024-05-21T01:19:53.525004+0000","last_active":"2024-05-21T01:19:59.572949+0000","last_peered":"2024-05-21T01:19:59.572949+0000","last_clean":"2024-05-21T01:19:59.572949+0000","last_became_active":"2024-05-21T01:19:53.521014+0000","last_became_peered":"2024-05-21T01:19:53.521014+0000","last_unstale":"2024-05-21T01:19:59.572949+0000","last_undegraded":"2024-05-21T01:19:59.572949+0000","last_fullsized":"2024-05-21T01:19:59.572949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:02:46.668320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.571502+0000","last_change":"2024-05-21T01:19:58.599880+0000","last_active":"2024-05-21T01:19:59.571502+0000","last_peered":"2024-05-21T01:19:59.571502+0000","last_clean":"2024-05-21T01:19:59.571502+0000","last_became_active":"2024-05-21T01:19:58.598712+0000","last_became_peered":"2024-05-21T01:19:58.598712+0000","last_unstale":"2024-05-21T01:19:59.571502+0000","last_undegraded":"2024-05-21T01:19:59.571502+0000","last_fullsized":"2024-05-21T01:19:59.571502+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:43:05.995986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.577134+0000","last_change":"2024-05-21T01:19:54.576044+0000","last_active":"2024-05-21T01:19:59.577134+0000","last_peered":"2024-05-21T01:19:59.577134+0000","last_clean":"2024-05-21T01:19:59.577134+0000","last_became_active":"2024-05-21T01:19:54.575543+0000","last_became_peered":"2024-05-21T01:19:54.575543+0000","last_unstale":"2024-05-21T01:19:59.577134+0000","last_undegraded":"2024-05-21T01:19:59.577134+0000","last_fullsized":"2024-05-21T01:19:59.577134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T09:33:07.188470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"25'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.568216+0000","last_change":"2024-05-21T01:19:53.543705+0000","last_active":"2024-05-21T01:19:59.568216+0000","last_peered":"2024-05-21T01:19:59.568216+0000","last_clean":"2024-05-21T01:19:59.568216+0000","last_became_active":"2024-05-21T01:19:53.543450+0000","last_became_peered":"2024-05-21T01:19:53.543450+0000","last_unstale":"2024-05-21T01:19:59.568216+0000","last_undegraded":"2024-05-21T01:19:59.568216+0000","last_fullsized":"2024-05-21T01:19:59.568216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:05:49.465156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.575415+0000","last_change":"2024-05-21T01:19:58.612049+0000","last_active":"2024-05-21T01:19:59.575415+0000","last_peered":"2024-05-21T01:19:59.575415+0000","last_clean":"2024-05-21T01:19:59.575415+0000","last_became_active":"2024-05-21T01:19:58.610837+0000","last_became_peered":"2024-05-21T01:19:58.610837+0000","last_unstale":"2024-05-21T01:19:59.575415+0000","last_undegraded":"2024-05-21T01:19:59.575415+0000","last_fullsized":"2024-05-21T01:19:59.575415+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:24:14.332056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207496+0000","last_change":"2024-05-21T01:19:54.553083+0000","last_active":"2024-05-21T01:20:00.207496+0000","last_peered":"2024-05-21T01:20:00.207496+0000","last_clean":"2024-05-21T01:20:00.207496+0000","last_became_active":"2024-05-21T01:19:54.552812+0000","last_became_peered":"2024-05-21T01:19:54.552812+0000","last_unstale":"2024-05-21T01:20:00.207496+0000","last_undegraded":"2024-05-21T01:20:00.207496+0000","last_fullsized":"2024-05-21T01:20:00.207496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:37:25.835345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.210838+0000","last_change":"2024-05-21T01:19:53.551697+0000","last_active":"2024-05-21T01:20:00.210838+0000","last_peered":"2024-05-21T01:20:00.210838+0000","last_clean":"2024-05-21T01:20:00.210838+0000","last_became_active":"2024-05-21T01:19:53.550921+0000","last_became_peered":"2024-05-21T01:19:53.550921+0000","last_unstale":"2024-05-21T01:20:00.210838+0000","last_undegraded":"2024-05-21T01:20:00.210838+0000","last_fullsized":"2024-05-21T01:20:00.210838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T09:31:31.996638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.571559+0000","last_change":"2024-05-21T01:19:58.626472+0000","last_active":"2024-05-21T01:19:59.571559+0000","last_peered":"2024-05-21T01:19:59.571559+0000","last_clean":"2024-05-21T01:19:59.571559+0000","last_became_active":"2024-05-21T01:19:58.625720+0000","last_became_peered":"2024-05-21T01:19:58.625720+0000","last_unstale":"2024-05-21T01:19:59.571559+0000","last_undegraded":"2024-05-21T01:19:59.571559+0000","last_fullsized":"2024-05-21T01:19:59.571559+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:16:03.911585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207190+0000","last_change":"2024-05-21T01:19:54.547947+0000","last_active":"2024-05-21T01:20:00.207190+0000","last_peered":"2024-05-21T01:20:00.207190+0000","last_clean":"2024-05-21T01:20:00.207190+0000","last_became_active":"2024-05-21T01:19:54.547689+0000","last_became_peered":"2024-05-21T01:19:54.547689+0000","last_unstale":"2024-05-21T01:20:00.207190+0000","last_undegraded":"2024-05-21T01:20:00.207190+0000","last_fullsized":"2024-05-21T01:20:00.207190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:40:55.985899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.567365+0000","last_change":"2024-05-21T01:19:53.540973+0000","last_active":"2024-05-21T01:19:59.567365+0000","last_peered":"2024-05-21T01:19:59.567365+0000","last_clean":"2024-05-21T01:19:59.567365+0000","last_became_active":"2024-05-21T01:19:53.540670+0000","last_became_peered":"2024-05-21T01:19:53.540670+0000","last_unstale":"2024-05-21T01:19:59.567365+0000","last_undegraded":"2024-05-21T01:19:59.567365+0000","last_fullsized":"2024-05-21T01:19:59.567365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:08:21.802284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.576864+0000","last_change":"2024-05-21T01:19:58.611280+0000","last_active":"2024-05-21T01:19:59.576864+0000","last_peered":"2024-05-21T01:19:59.576864+0000","last_clean":"2024-05-21T01:19:59.576864+0000","last_became_active":"2024-05-21T01:19:58.610511+0000","last_became_peered":"2024-05-21T01:19:58.610511+0000","last_unstale":"2024-05-21T01:19:59.576864+0000","last_undegraded":"2024-05-21T01:19:59.576864+0000","last_fullsized":"2024-05-21T01:19:59.576864+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:49:19.660422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.209521+0000","last_change":"2024-05-21T01:19:54.572546+0000","last_active":"2024-05-21T01:20:00.209521+0000","last_peered":"2024-05-21T01:20:00.209521+0000","last_clean":"2024-05-21T01:20:00.209521+0000","last_became_active":"2024-05-21T01:19:54.572022+0000","last_became_peered":"2024-05-21T01:19:54.572022+0000","last_unstale":"2024-05-21T01:20:00.209521+0000","last_undegraded":"2024-05-21T01:20:00.209521+0000","last_fullsized":"2024-05-21T01:20:00.209521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:50:08.351383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"25'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.208285+0000","last_change":"2024-05-21T01:19:53.556786+0000","last_active":"2024-05-21T01:20:00.208285+0000","last_peered":"2024-05-21T01:20:00.208285+0000","last_clean":"2024-05-21T01:20:00.208285+0000","last_became_active":"2024-05-21T01:19:53.556143+0000","last_became_peered":"2024-05-21T01:19:53.556143+0000","last_unstale":"2024-05-21T01:20:00.208285+0000","last_undegraded":"2024-05-21T01:20:00.208285+0000","last_fullsized":"2024-05-21T01:20:00.208285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:02:17.391701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.577698+0000","last_change":"2024-05-21T01:19:58.599203+0000","last_active":"2024-05-21T01:19:59.577698+0000","last_peered":"2024-05-21T01:19:59.577698+0000","last_clean":"2024-05-21T01:19:59.577698+0000","last_became_active":"2024-05-21T01:19:58.598175+0000","last_became_peered":"2024-05-21T01:19:58.598175+0000","last_unstale":"2024-05-21T01:19:59.577698+0000","last_undegraded":"2024-05-21T01:19:59.577698+0000","last_fullsized":"2024-05-21T01:19:59.577698+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:45:17.138090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.574222+0000","last_change":"2024-05-21T01:19:54.551092+0000","last_active":"2024-05-21T01:19:59.574222+0000","last_peered":"2024-05-21T01:19:59.574222+0000","last_clean":"2024-05-21T01:19:59.574222+0000","last_became_active":"2024-05-21T01:19:54.550338+0000","last_became_peered":"2024-05-21T01:19:54.550338+0000","last_unstale":"2024-05-21T01:19:59.574222+0000","last_undegraded":"2024-05-21T01:19:59.574222+0000","last_fullsized":"2024-05-21T01:19:59.574222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:29:13.540719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"25'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.566905+0000","last_change":"2024-05-21T01:19:53.554835+0000","last_active":"2024-05-21T01:19:59.566905+0000","last_peered":"2024-05-21T01:19:59.566905+0000","last_clean":"2024-05-21T01:19:59.566905+0000","last_became_active":"2024-05-21T01:19:53.554598+0000","last_became_peered":"2024-05-21T01:19:53.554598+0000","last_unstale":"2024-05-21T01:19:59.566905+0000","last_undegraded":"2024-05-21T01:19:59.566905+0000","last_fullsized":"2024-05-21T01:19:59.566905+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:28:43.940978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.211238+0000","last_change":"2024-05-21T01:19:58.629747+0000","last_active":"2024-05-21T01:20:00.211238+0000","last_peered":"2024-05-21T01:20:00.211238+0000","last_clean":"2024-05-21T01:20:00.211238+0000","last_became_active":"2024-05-21T01:19:58.622106+0000","last_became_peered":"2024-05-21T01:19:58.622106+0000","last_unstale":"2024-05-21T01:20:00.211238+0000","last_undegraded":"2024-05-21T01:20:00.211238+0000","last_fullsized":"2024-05-21T01:20:00.211238+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:22:07.047914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.571255+0000","last_change":"2024-05-21T01:19:54.554303+0000","last_active":"2024-05-21T01:19:59.571255+0000","last_peered":"2024-05-21T01:19:59.571255+0000","last_clean":"2024-05-21T01:19:59.571255+0000","last_became_active":"2024-05-21T01:19:54.552126+0000","last_became_peered":"2024-05-21T01:19:54.552126+0000","last_unstale":"2024-05-21T01:19:59.571255+0000","last_undegraded":"2024-05-21T01:19:59.571255+0000","last_fullsized":"2024-05-21T01:19:59.571255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:59:46.383359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.567302+0000","last_change":"2024-05-21T01:19:53.536580+0000","last_active":"2024-05-21T01:19:59.567302+0000","last_peered":"2024-05-21T01:19:59.567302+0000","last_clean":"2024-05-21T01:19:59.567302+0000","last_became_active":"2024-05-21T01:19:53.535105+0000","last_became_peered":"2024-05-21T01:19:53.535105+0000","last_unstale":"2024-05-21T01:19:59.567302+0000","last_undegraded":"2024-05-21T01:19:59.567302+0000","last_fullsized":"2024-05-21T01:19:59.567302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:58:05.019025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":118,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207611+0000","last_change":"2024-05-21T01:19:49.490062+0000","last_active":"2024-05-21T01:20:00.207611+0000","last_peered":"2024-05-21T01:20:00.207611+0000","last_clean":"2024-05-21T01:20:00.207611+0000","last_became_active":"2024-05-21T01:19:49.488796+0000","last_became_peered":"2024-05-21T01:19:49.488796+0000","last_unstale":"2024-05-21T01:20:00.207611+0000","last_undegraded":"2024-05-21T01:20:00.207611+0000","last_fullsized":"2024-05-21T01:20:00.207611+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:47.457865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:47.457865+0000","last_clean_scrub_stamp":"2024-05-21T01:19:47.457865+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T09:37:06.199150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.568012+0000","last_change":"2024-05-21T01:19:58.590851+0000","last_active":"2024-05-21T01:19:59.568012+0000","last_peered":"2024-05-21T01:19:59.568012+0000","last_clean":"2024-05-21T01:19:59.568012+0000","last_became_active":"2024-05-21T01:19:58.589288+0000","last_became_peered":"2024-05-21T01:19:58.589288+0000","last_unstale":"2024-05-21T01:19:59.568012+0000","last_undegraded":"2024-05-21T01:19:59.568012+0000","last_fullsized":"2024-05-21T01:19:59.568012+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:36:46.992834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.567741+0000","last_change":"2024-05-21T01:19:54.543894+0000","last_active":"2024-05-21T01:19:59.567741+0000","last_peered":"2024-05-21T01:19:59.567741+0000","last_clean":"2024-05-21T01:19:59.567741+0000","last_became_active":"2024-05-21T01:19:54.543586+0000","last_became_peered":"2024-05-21T01:19:54.543586+0000","last_unstale":"2024-05-21T01:19:59.567741+0000","last_undegraded":"2024-05-21T01:19:59.567741+0000","last_fullsized":"2024-05-21T01:19:59.567741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:33:02.756634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.577243+0000","last_change":"2024-05-21T01:19:53.532115+0000","last_active":"2024-05-21T01:19:59.577243+0000","last_peered":"2024-05-21T01:19:59.577243+0000","last_clean":"2024-05-21T01:19:59.577243+0000","last_became_active":"2024-05-21T01:19:53.529879+0000","last_became_peered":"2024-05-21T01:19:53.529879+0000","last_unstale":"2024-05-21T01:19:59.577243+0000","last_undegraded":"2024-05-21T01:19:59.577243+0000","last_fullsized":"2024-05-21T01:19:59.577243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:42:07.436243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.206924+0000","last_change":"2024-05-21T01:19:58.604417+0000","last_active":"2024-05-21T01:20:00.206924+0000","last_peered":"2024-05-21T01:20:00.206924+0000","last_clean":"2024-05-21T01:20:00.206924+0000","last_became_active":"2024-05-21T01:19:58.603929+0000","last_became_peered":"2024-05-21T01:19:58.603929+0000","last_unstale":"2024-05-21T01:20:00.206924+0000","last_undegraded":"2024-05-21T01:20:00.206924+0000","last_fullsized":"2024-05-21T01:20:00.206924+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:15:59.031738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207029+0000","last_change":"2024-05-21T01:19:54.542096+0000","last_active":"2024-05-21T01:20:00.207029+0000","last_peered":"2024-05-21T01:20:00.207029+0000","last_clean":"2024-05-21T01:20:00.207029+0000","last_became_active":"2024-05-21T01:19:54.541837+0000","last_became_peered":"2024-05-21T01:19:54.541837+0000","last_unstale":"2024-05-21T01:20:00.207029+0000","last_undegraded":"2024-05-21T01:20:00.207029+0000","last_fullsized":"2024-05-21T01:20:00.207029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:55:30.807311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.211049+0000","last_change":"2024-05-21T01:19:53.551697+0000","last_active":"2024-05-21T01:20:00.211049+0000","last_peered":"2024-05-21T01:20:00.211049+0000","last_clean":"2024-05-21T01:20:00.211049+0000","last_became_active":"2024-05-21T01:19:53.550893+0000","last_became_peered":"2024-05-21T01:19:53.550893+0000","last_unstale":"2024-05-21T01:20:00.211049+0000","last_undegraded":"2024-05-21T01:20:00.211049+0000","last_fullsized":"2024-05-21T01:20:00.211049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:42:20.295229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.210457+0000","last_change":"2024-05-21T01:19:58.628526+0000","last_active":"2024-05-21T01:20:00.210457+0000","last_peered":"2024-05-21T01:20:00.210457+0000","last_clean":"2024-05-21T01:20:00.210457+0000","last_became_active":"2024-05-21T01:19:58.620667+0000","last_became_peered":"2024-05-21T01:19:58.620667+0000","last_unstale":"2024-05-21T01:20:00.210457+0000","last_undegraded":"2024-05-21T01:20:00.210457+0000","last_fullsized":"2024-05-21T01:20:00.210457+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:46:22.396063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.208496+0000","last_change":"2024-05-21T01:19:54.532551+0000","last_active":"2024-05-21T01:20:00.208496+0000","last_peered":"2024-05-21T01:20:00.208496+0000","last_clean":"2024-05-21T01:20:00.208496+0000","last_became_active":"2024-05-21T01:19:54.532251+0000","last_became_peered":"2024-05-21T01:19:54.532251+0000","last_unstale":"2024-05-21T01:20:00.208496+0000","last_undegraded":"2024-05-21T01:20:00.208496+0000","last_fullsized":"2024-05-21T01:20:00.208496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:00:30.042781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.572555+0000","last_change":"2024-05-21T01:19:53.554659+0000","last_active":"2024-05-21T01:19:59.572555+0000","last_peered":"2024-05-21T01:19:59.572555+0000","last_clean":"2024-05-21T01:19:59.572555+0000","last_became_active":"2024-05-21T01:19:53.553953+0000","last_became_peered":"2024-05-21T01:19:53.553953+0000","last_unstale":"2024-05-21T01:19:59.572555+0000","last_undegraded":"2024-05-21T01:19:59.572555+0000","last_fullsized":"2024-05-21T01:19:59.572555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:31:13.091061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.566596+0000","last_change":"2024-05-21T01:19:58.593243+0000","last_active":"2024-05-21T01:19:59.566596+0000","last_peered":"2024-05-21T01:19:59.566596+0000","last_clean":"2024-05-21T01:19:59.566596+0000","last_became_active":"2024-05-21T01:19:58.592758+0000","last_became_peered":"2024-05-21T01:19:58.592758+0000","last_unstale":"2024-05-21T01:19:59.566596+0000","last_undegraded":"2024-05-21T01:19:59.566596+0000","last_fullsized":"2024-05-21T01:19:59.566596+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:46:17.877736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207962+0000","last_change":"2024-05-21T01:19:54.538391+0000","last_active":"2024-05-21T01:20:00.207962+0000","last_peered":"2024-05-21T01:20:00.207962+0000","last_clean":"2024-05-21T01:20:00.207962+0000","last_became_active":"2024-05-21T01:19:54.538106+0000","last_became_peered":"2024-05-21T01:19:54.538106+0000","last_unstale":"2024-05-21T01:20:00.207962+0000","last_undegraded":"2024-05-21T01:20:00.207962+0000","last_fullsized":"2024-05-21T01:20:00.207962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:36:07.297496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.208540+0000","last_change":"2024-05-21T01:19:53.551917+0000","last_active":"2024-05-21T01:20:00.208540+0000","last_peered":"2024-05-21T01:20:00.208540+0000","last_clean":"2024-05-21T01:20:00.208540+0000","last_became_active":"2024-05-21T01:19:53.551608+0000","last_became_peered":"2024-05-21T01:19:53.551608+0000","last_unstale":"2024-05-21T01:20:00.208540+0000","last_undegraded":"2024-05-21T01:20:00.208540+0000","last_fullsized":"2024-05-21T01:20:00.208540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:20:54.093966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.208119+0000","last_change":"2024-05-21T01:19:58.613367+0000","last_active":"2024-05-21T01:20:00.208119+0000","last_peered":"2024-05-21T01:20:00.208119+0000","last_clean":"2024-05-21T01:20:00.208119+0000","last_became_active":"2024-05-21T01:19:58.612950+0000","last_became_peered":"2024-05-21T01:19:58.612950+0000","last_unstale":"2024-05-21T01:20:00.208119+0000","last_undegraded":"2024-05-21T01:20:00.208119+0000","last_fullsized":"2024-05-21T01:20:00.208119+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:32:12.365734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.566761+0000","last_change":"2024-05-21T01:19:54.548979+0000","last_active":"2024-05-21T01:19:59.566761+0000","last_peered":"2024-05-21T01:19:59.566761+0000","last_clean":"2024-05-21T01:19:59.566761+0000","last_became_active":"2024-05-21T01:19:54.548704+0000","last_became_peered":"2024-05-21T01:19:54.548704+0000","last_unstale":"2024-05-21T01:19:59.566761+0000","last_undegraded":"2024-05-21T01:19:59.566761+0000","last_fullsized":"2024-05-21T01:19:59.566761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:57:09.076705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"25'10","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:24.653856+0000","last_change":"2024-05-21T01:19:53.542425+0000","last_active":"2024-05-21T01:20:24.653856+0000","last_peered":"2024-05-21T01:20:24.653856+0000","last_clean":"2024-05-21T01:20:24.653856+0000","last_became_active":"2024-05-21T01:19:53.541577+0000","last_became_peered":"2024-05-21T01:19:53.541577+0000","last_unstale":"2024-05-21T01:20:24.653856+0000","last_undegraded":"2024-05-21T01:20:24.653856+0000","last_fullsized":"2024-05-21T01:20:24.653856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:47:54.892789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.211663+0000","last_change":"2024-05-21T01:19:58.630293+0000","last_active":"2024-05-21T01:20:00.211663+0000","last_peered":"2024-05-21T01:20:00.211663+0000","last_clean":"2024-05-21T01:20:00.211663+0000","last_became_active":"2024-05-21T01:19:58.629119+0000","last_became_peered":"2024-05-21T01:19:58.629119+0000","last_unstale":"2024-05-21T01:20:00.211663+0000","last_undegraded":"2024-05-21T01:20:00.211663+0000","last_fullsized":"2024-05-21T01:20:00.211663+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:10:45.318517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207523+0000","last_change":"2024-05-21T01:19:54.575541+0000","last_active":"2024-05-21T01:20:00.207523+0000","last_peered":"2024-05-21T01:20:00.207523+0000","last_clean":"2024-05-21T01:20:00.207523+0000","last_became_active":"2024-05-21T01:19:54.575314+0000","last_became_peered":"2024-05-21T01:19:54.575314+0000","last_unstale":"2024-05-21T01:20:00.207523+0000","last_undegraded":"2024-05-21T01:20:00.207523+0000","last_fullsized":"2024-05-21T01:20:00.207523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:02:36.840590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.206224+0000","last_change":"2024-05-21T01:19:53.523758+0000","last_active":"2024-05-21T01:20:00.206224+0000","last_peered":"2024-05-21T01:20:00.206224+0000","last_clean":"2024-05-21T01:20:00.206224+0000","last_became_active":"2024-05-21T01:19:53.523273+0000","last_became_peered":"2024-05-21T01:19:53.523273+0000","last_unstale":"2024-05-21T01:20:00.206224+0000","last_undegraded":"2024-05-21T01:20:00.206224+0000","last_fullsized":"2024-05-21T01:20:00.206224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:05:47.275193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.211601+0000","last_change":"2024-05-21T01:19:58.621996+0000","last_active":"2024-05-21T01:20:00.211601+0000","last_peered":"2024-05-21T01:20:00.211601+0000","last_clean":"2024-05-21T01:20:00.211601+0000","last_became_active":"2024-05-21T01:19:58.620552+0000","last_became_peered":"2024-05-21T01:19:58.620552+0000","last_unstale":"2024-05-21T01:20:00.211601+0000","last_undegraded":"2024-05-21T01:20:00.211601+0000","last_fullsized":"2024-05-21T01:20:00.211601+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:58:32.635003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.567139+0000","last_change":"2024-05-21T01:19:54.557379+0000","last_active":"2024-05-21T01:19:59.567139+0000","last_peered":"2024-05-21T01:19:59.567139+0000","last_clean":"2024-05-21T01:19:59.567139+0000","last_became_active":"2024-05-21T01:19:54.550335+0000","last_became_peered":"2024-05-21T01:19:54.550335+0000","last_unstale":"2024-05-21T01:19:59.567139+0000","last_undegraded":"2024-05-21T01:19:59.567139+0000","last_fullsized":"2024-05-21T01:19:59.567139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:24:52.297888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"25'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:24.658932+0000","last_change":"2024-05-21T01:19:53.534431+0000","last_active":"2024-05-21T01:20:24.658932+0000","last_peered":"2024-05-21T01:20:24.658932+0000","last_clean":"2024-05-21T01:20:24.658932+0000","last_became_active":"2024-05-21T01:19:53.534174+0000","last_became_peered":"2024-05-21T01:19:53.534174+0000","last_unstale":"2024-05-21T01:20:24.658932+0000","last_undegraded":"2024-05-21T01:20:24.658932+0000","last_fullsized":"2024-05-21T01:20:24.658932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:42:04.743914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.576325+0000","last_change":"2024-05-21T01:19:58.609289+0000","last_active":"2024-05-21T01:19:59.576325+0000","last_peered":"2024-05-21T01:19:59.576325+0000","last_clean":"2024-05-21T01:19:59.576325+0000","last_became_active":"2024-05-21T01:19:58.608371+0000","last_became_peered":"2024-05-21T01:19:58.608371+0000","last_unstale":"2024-05-21T01:19:59.576325+0000","last_undegraded":"2024-05-21T01:19:59.576325+0000","last_fullsized":"2024-05-21T01:19:59.576325+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:27:36.997803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.575122+0000","last_change":"2024-05-21T01:19:54.551617+0000","last_active":"2024-05-21T01:19:59.575122+0000","last_peered":"2024-05-21T01:19:59.575122+0000","last_clean":"2024-05-21T01:19:59.575122+0000","last_became_active":"2024-05-21T01:19:54.550865+0000","last_became_peered":"2024-05-21T01:19:54.550865+0000","last_unstale":"2024-05-21T01:19:59.575122+0000","last_undegraded":"2024-05-21T01:19:59.575122+0000","last_fullsized":"2024-05-21T01:19:59.575122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:32:44.168265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"25'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:24.661044+0000","last_change":"2024-05-21T01:19:53.535936+0000","last_active":"2024-05-21T01:20:24.661044+0000","last_peered":"2024-05-21T01:20:24.661044+0000","last_clean":"2024-05-21T01:20:24.661044+0000","last_became_active":"2024-05-21T01:19:53.535143+0000","last_became_peered":"2024-05-21T01:19:53.535143+0000","last_unstale":"2024-05-21T01:20:24.661044+0000","last_undegraded":"2024-05-21T01:20:24.661044+0000","last_fullsized":"2024-05-21T01:20:24.661044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:50:51.433726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.567570+0000","last_change":"2024-05-21T01:19:58.622615+0000","last_active":"2024-05-21T01:19:59.567570+0000","last_peered":"2024-05-21T01:19:59.567570+0000","last_clean":"2024-05-21T01:19:59.567570+0000","last_became_active":"2024-05-21T01:19:58.622250+0000","last_became_peered":"2024-05-21T01:19:58.622250+0000","last_unstale":"2024-05-21T01:19:59.567570+0000","last_undegraded":"2024-05-21T01:19:59.567570+0000","last_fullsized":"2024-05-21T01:19:59.567570+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:05:22.913945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207577+0000","last_change":"2024-05-21T01:19:54.558348+0000","last_active":"2024-05-21T01:20:00.207577+0000","last_peered":"2024-05-21T01:20:00.207577+0000","last_clean":"2024-05-21T01:20:00.207577+0000","last_became_active":"2024-05-21T01:19:54.558095+0000","last_became_peered":"2024-05-21T01:19:54.558095+0000","last_unstale":"2024-05-21T01:20:00.207577+0000","last_undegraded":"2024-05-21T01:20:00.207577+0000","last_fullsized":"2024-05-21T01:20:00.207577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:43:48.625583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:09.561570+0000","last_change":"2024-05-21T01:19:53.534947+0000","last_active":"2024-05-21T01:20:09.561570+0000","last_peered":"2024-05-21T01:20:09.561570+0000","last_clean":"2024-05-21T01:20:09.561570+0000","last_became_active":"2024-05-21T01:19:53.534616+0000","last_became_peered":"2024-05-21T01:19:53.534616+0000","last_unstale":"2024-05-21T01:20:09.561570+0000","last_undegraded":"2024-05-21T01:20:09.561570+0000","last_fullsized":"2024-05-21T01:20:09.561570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:01:25.372035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.571116+0000","last_change":"2024-05-21T01:19:58.617970+0000","last_active":"2024-05-21T01:19:59.571116+0000","last_peered":"2024-05-21T01:19:59.571116+0000","last_clean":"2024-05-21T01:19:59.571116+0000","last_became_active":"2024-05-21T01:19:58.617061+0000","last_became_peered":"2024-05-21T01:19:58.617061+0000","last_unstale":"2024-05-21T01:19:59.571116+0000","last_undegraded":"2024-05-21T01:19:59.571116+0000","last_fullsized":"2024-05-21T01:19:59.571116+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:48:50.703577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.567205+0000","last_change":"2024-05-21T01:19:54.557175+0000","last_active":"2024-05-21T01:19:59.567205+0000","last_peered":"2024-05-21T01:19:59.567205+0000","last_clean":"2024-05-21T01:19:59.567205+0000","last_became_active":"2024-05-21T01:19:54.556933+0000","last_became_peered":"2024-05-21T01:19:54.556933+0000","last_unstale":"2024-05-21T01:19:59.567205+0000","last_undegraded":"2024-05-21T01:19:59.567205+0000","last_fullsized":"2024-05-21T01:19:59.567205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:15:44.089544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"25'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.208892+0000","last_change":"2024-05-21T01:19:53.536780+0000","last_active":"2024-05-21T01:20:00.208892+0000","last_peered":"2024-05-21T01:20:00.208892+0000","last_clean":"2024-05-21T01:20:00.208892+0000","last_became_active":"2024-05-21T01:19:53.535768+0000","last_became_peered":"2024-05-21T01:19:53.535768+0000","last_unstale":"2024-05-21T01:20:00.208892+0000","last_undegraded":"2024-05-21T01:20:00.208892+0000","last_fullsized":"2024-05-21T01:20:00.208892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:04:14.732801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207120+0000","last_change":"2024-05-21T01:19:58.606532+0000","last_active":"2024-05-21T01:20:00.207120+0000","last_peered":"2024-05-21T01:20:00.207120+0000","last_clean":"2024-05-21T01:20:00.207120+0000","last_became_active":"2024-05-21T01:19:58.606180+0000","last_became_peered":"2024-05-21T01:19:58.606180+0000","last_unstale":"2024-05-21T01:20:00.207120+0000","last_undegraded":"2024-05-21T01:20:00.207120+0000","last_fullsized":"2024-05-21T01:20:00.207120+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:25:31.161427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.211807+0000","last_change":"2024-05-21T01:19:54.571280+0000","last_active":"2024-05-21T01:20:00.211807+0000","last_peered":"2024-05-21T01:20:00.211807+0000","last_clean":"2024-05-21T01:20:00.211807+0000","last_became_active":"2024-05-21T01:19:54.568778+0000","last_became_peered":"2024-05-21T01:19:54.568778+0000","last_unstale":"2024-05-21T01:20:00.211807+0000","last_undegraded":"2024-05-21T01:20:00.211807+0000","last_fullsized":"2024-05-21T01:20:00.211807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:43:16.583632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.208476+0000","last_change":"2024-05-21T01:19:53.530770+0000","last_active":"2024-05-21T01:20:00.208476+0000","last_peered":"2024-05-21T01:20:00.208476+0000","last_clean":"2024-05-21T01:20:00.208476+0000","last_became_active":"2024-05-21T01:19:53.526431+0000","last_became_peered":"2024-05-21T01:19:53.526431+0000","last_unstale":"2024-05-21T01:20:00.208476+0000","last_undegraded":"2024-05-21T01:20:00.208476+0000","last_fullsized":"2024-05-21T01:20:00.208476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:08:59.892029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.208009+0000","last_change":"2024-05-21T01:19:58.611576+0000","last_active":"2024-05-21T01:20:00.208009+0000","last_peered":"2024-05-21T01:20:00.208009+0000","last_clean":"2024-05-21T01:20:00.208009+0000","last_became_active":"2024-05-21T01:19:58.610838+0000","last_became_peered":"2024-05-21T01:19:58.610838+0000","last_unstale":"2024-05-21T01:20:00.208009+0000","last_undegraded":"2024-05-21T01:20:00.208009+0000","last_fullsized":"2024-05-21T01:20:00.208009+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:07:31.736640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207957+0000","last_change":"2024-05-21T01:19:54.552709+0000","last_active":"2024-05-21T01:20:00.207957+0000","last_peered":"2024-05-21T01:20:00.207957+0000","last_clean":"2024-05-21T01:20:00.207957+0000","last_became_active":"2024-05-21T01:19:54.547898+0000","last_became_peered":"2024-05-21T01:19:54.547898+0000","last_unstale":"2024-05-21T01:20:00.207957+0000","last_undegraded":"2024-05-21T01:20:00.207957+0000","last_fullsized":"2024-05-21T01:20:00.207957+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:20:17.933506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.209704+0000","last_change":"2024-05-21T01:19:53.534507+0000","last_active":"2024-05-21T01:20:00.209704+0000","last_peered":"2024-05-21T01:20:00.209704+0000","last_clean":"2024-05-21T01:20:00.209704+0000","last_became_active":"2024-05-21T01:19:53.534036+0000","last_became_peered":"2024-05-21T01:19:53.534036+0000","last_unstale":"2024-05-21T01:20:00.209704+0000","last_undegraded":"2024-05-21T01:20:00.209704+0000","last_fullsized":"2024-05-21T01:20:00.209704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:01:08.218098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.572286+0000","last_change":"2024-05-21T01:19:58.608135+0000","last_active":"2024-05-21T01:19:59.572286+0000","last_peered":"2024-05-21T01:19:59.572286+0000","last_clean":"2024-05-21T01:19:59.572286+0000","last_became_active":"2024-05-21T01:19:58.607242+0000","last_became_peered":"2024-05-21T01:19:58.607242+0000","last_unstale":"2024-05-21T01:19:59.572286+0000","last_undegraded":"2024-05-21T01:19:59.572286+0000","last_fullsized":"2024-05-21T01:19:59.572286+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:05:26.197876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.572239+0000","last_change":"2024-05-21T01:19:58.624883+0000","last_active":"2024-05-21T01:19:59.572239+0000","last_peered":"2024-05-21T01:19:59.572239+0000","last_clean":"2024-05-21T01:19:59.572239+0000","last_became_active":"2024-05-21T01:19:58.623991+0000","last_became_peered":"2024-05-21T01:19:58.623991+0000","last_unstale":"2024-05-21T01:19:59.572239+0000","last_undegraded":"2024-05-21T01:19:59.572239+0000","last_fullsized":"2024-05-21T01:19:59.572239+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:29:26.251376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.572416+0000","last_change":"2024-05-21T01:19:54.549215+0000","last_active":"2024-05-21T01:19:59.572416+0000","last_peered":"2024-05-21T01:19:59.572416+0000","last_clean":"2024-05-21T01:19:59.572416+0000","last_became_active":"2024-05-21T01:19:54.548426+0000","last_became_peered":"2024-05-21T01:19:54.548426+0000","last_unstale":"2024-05-21T01:19:59.572416+0000","last_undegraded":"2024-05-21T01:19:59.572416+0000","last_fullsized":"2024-05-21T01:19:59.572416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:10:10.800391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"25'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.566886+0000","last_change":"2024-05-21T01:19:53.526106+0000","last_active":"2024-05-21T01:19:59.566886+0000","last_peered":"2024-05-21T01:19:59.566886+0000","last_clean":"2024-05-21T01:19:59.566886+0000","last_became_active":"2024-05-21T01:19:53.525786+0000","last_became_peered":"2024-05-21T01:19:53.525786+0000","last_unstale":"2024-05-21T01:19:59.566886+0000","last_undegraded":"2024-05-21T01:19:59.566886+0000","last_fullsized":"2024-05-21T01:19:59.566886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:01:05.180803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.567758+0000","last_change":"2024-05-21T01:19:58.615481+0000","last_active":"2024-05-21T01:19:59.567758+0000","last_peered":"2024-05-21T01:19:59.567758+0000","last_clean":"2024-05-21T01:19:59.567758+0000","last_became_active":"2024-05-21T01:19:58.614879+0000","last_became_peered":"2024-05-21T01:19:58.614879+0000","last_unstale":"2024-05-21T01:19:59.567758+0000","last_undegraded":"2024-05-21T01:19:59.567758+0000","last_fullsized":"2024-05-21T01:19:59.567758+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:45:57.208342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.209731+0000","last_change":"2024-05-21T01:19:54.570650+0000","last_active":"2024-05-21T01:20:00.209731+0000","last_peered":"2024-05-21T01:20:00.209731+0000","last_clean":"2024-05-21T01:20:00.209731+0000","last_became_active":"2024-05-21T01:19:54.570034+0000","last_became_peered":"2024-05-21T01:19:54.570034+0000","last_unstale":"2024-05-21T01:20:00.209731+0000","last_undegraded":"2024-05-21T01:20:00.209731+0000","last_fullsized":"2024-05-21T01:20:00.209731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:01:05.887729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.574517+0000","last_change":"2024-05-21T01:19:53.532017+0000","last_active":"2024-05-21T01:19:59.574517+0000","last_peered":"2024-05-21T01:19:59.574517+0000","last_clean":"2024-05-21T01:19:59.574517+0000","last_became_active":"2024-05-21T01:19:53.529457+0000","last_became_peered":"2024-05-21T01:19:53.529457+0000","last_unstale":"2024-05-21T01:19:59.574517+0000","last_undegraded":"2024-05-21T01:19:59.574517+0000","last_fullsized":"2024-05-21T01:19:59.574517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:58:03.979929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.567307+0000","last_change":"2024-05-21T01:19:53.525620+0000","last_active":"2024-05-21T01:19:59.567307+0000","last_peered":"2024-05-21T01:19:59.567307+0000","last_clean":"2024-05-21T01:19:59.567307+0000","last_became_active":"2024-05-21T01:19:53.525315+0000","last_became_peered":"2024-05-21T01:19:53.525315+0000","last_unstale":"2024-05-21T01:19:59.567307+0000","last_undegraded":"2024-05-21T01:19:59.567307+0000","last_fullsized":"2024-05-21T01:19:59.567307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:30:38.075463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.571359+0000","last_change":"2024-05-21T01:19:54.555344+0000","last_active":"2024-05-21T01:19:59.571359+0000","last_peered":"2024-05-21T01:19:59.571359+0000","last_clean":"2024-05-21T01:19:59.571359+0000","last_became_active":"2024-05-21T01:19:54.552817+0000","last_became_peered":"2024-05-21T01:19:54.552817+0000","last_unstale":"2024-05-21T01:19:59.571359+0000","last_undegraded":"2024-05-21T01:19:59.571359+0000","last_fullsized":"2024-05-21T01:19:59.571359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:10:03.810064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.572198+0000","last_change":"2024-05-21T01:19:58.619520+0000","last_active":"2024-05-21T01:19:59.572198+0000","last_peered":"2024-05-21T01:19:59.572198+0000","last_clean":"2024-05-21T01:19:59.572198+0000","last_became_active":"2024-05-21T01:19:58.617165+0000","last_became_peered":"2024-05-21T01:19:58.617165+0000","last_unstale":"2024-05-21T01:19:59.572198+0000","last_undegraded":"2024-05-21T01:19:59.572198+0000","last_fullsized":"2024-05-21T01:19:59.572198+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T13:07:51.530746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"25'5","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:24.652930+0000","last_change":"2024-05-21T01:19:53.551547+0000","last_active":"2024-05-21T01:20:24.652930+0000","last_peered":"2024-05-21T01:20:24.652930+0000","last_clean":"2024-05-21T01:20:24.652930+0000","last_became_active":"2024-05-21T01:19:53.550931+0000","last_became_peered":"2024-05-21T01:19:53.550931+0000","last_unstale":"2024-05-21T01:20:24.652930+0000","last_undegraded":"2024-05-21T01:20:24.652930+0000","last_fullsized":"2024-05-21T01:20:24.652930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:13:47.329230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.208939+0000","last_change":"2024-05-21T01:19:54.574552+0000","last_active":"2024-05-21T01:20:00.208939+0000","last_peered":"2024-05-21T01:20:00.208939+0000","last_clean":"2024-05-21T01:20:00.208939+0000","last_became_active":"2024-05-21T01:19:54.574246+0000","last_became_peered":"2024-05-21T01:19:54.574246+0000","last_unstale":"2024-05-21T01:20:00.208939+0000","last_undegraded":"2024-05-21T01:20:00.208939+0000","last_fullsized":"2024-05-21T01:20:00.208939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:23:33.685798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.208672+0000","last_change":"2024-05-21T01:19:58.624400+0000","last_active":"2024-05-21T01:20:00.208672+0000","last_peered":"2024-05-21T01:20:00.208672+0000","last_clean":"2024-05-21T01:20:00.208672+0000","last_became_active":"2024-05-21T01:19:58.623388+0000","last_became_peered":"2024-05-21T01:19:58.623388+0000","last_unstale":"2024-05-21T01:20:00.208672+0000","last_undegraded":"2024-05-21T01:20:00.208672+0000","last_fullsized":"2024-05-21T01:20:00.208672+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:59:30.019393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.206641+0000","last_change":"2024-05-21T01:19:54.553262+0000","last_active":"2024-05-21T01:20:00.206641+0000","last_peered":"2024-05-21T01:20:00.206641+0000","last_clean":"2024-05-21T01:20:00.206641+0000","last_became_active":"2024-05-21T01:19:54.553060+0000","last_became_peered":"2024-05-21T01:19:54.553060+0000","last_unstale":"2024-05-21T01:20:00.206641+0000","last_undegraded":"2024-05-21T01:20:00.206641+0000","last_fullsized":"2024-05-21T01:20:00.206641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:18:14.077480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207978+0000","last_change":"2024-05-21T01:19:54.566851+0000","last_active":"2024-05-21T01:20:00.207978+0000","last_peered":"2024-05-21T01:20:00.207978+0000","last_clean":"2024-05-21T01:20:00.207978+0000","last_became_active":"2024-05-21T01:19:54.565573+0000","last_became_peered":"2024-05-21T01:19:54.565573+0000","last_unstale":"2024-05-21T01:20:00.207978+0000","last_undegraded":"2024-05-21T01:20:00.207978+0000","last_fullsized":"2024-05-21T01:20:00.207978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:51:30.883954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.566981+0000","last_change":"2024-05-21T01:19:54.566934+0000","last_active":"2024-05-21T01:19:59.566981+0000","last_peered":"2024-05-21T01:19:59.566981+0000","last_clean":"2024-05-21T01:19:59.566981+0000","last_became_active":"2024-05-21T01:19:54.566503+0000","last_became_peered":"2024-05-21T01:19:54.566503+0000","last_unstale":"2024-05-21T01:19:59.566981+0000","last_undegraded":"2024-05-21T01:19:59.566981+0000","last_fullsized":"2024-05-21T01:19:59.566981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:14:54.262165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.210361+0000","last_change":"2024-05-21T01:19:54.573091+0000","last_active":"2024-05-21T01:20:00.210361+0000","last_peered":"2024-05-21T01:20:00.210361+0000","last_clean":"2024-05-21T01:20:00.210361+0000","last_became_active":"2024-05-21T01:19:54.572366+0000","last_became_peered":"2024-05-21T01:19:54.572366+0000","last_unstale":"2024-05-21T01:20:00.210361+0000","last_undegraded":"2024-05-21T01:20:00.210361+0000","last_fullsized":"2024-05-21T01:20:00.210361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:10:09.353807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.576980+0000","last_change":"2024-05-21T01:19:54.563339+0000","last_active":"2024-05-21T01:19:59.576980+0000","last_peered":"2024-05-21T01:19:59.576980+0000","last_clean":"2024-05-21T01:19:59.576980+0000","last_became_active":"2024-05-21T01:19:54.557934+0000","last_became_peered":"2024-05-21T01:19:54.557934+0000","last_unstale":"2024-05-21T01:19:59.576980+0000","last_undegraded":"2024-05-21T01:19:59.576980+0000","last_fullsized":"2024-05-21T01:19:59.576980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:46:21.598689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.577198+0000","last_change":"2024-05-21T01:19:54.553551+0000","last_active":"2024-05-21T01:19:59.577198+0000","last_peered":"2024-05-21T01:19:59.577198+0000","last_clean":"2024-05-21T01:19:59.577198+0000","last_became_active":"2024-05-21T01:19:54.552812+0000","last_became_peered":"2024-05-21T01:19:54.552812+0000","last_unstale":"2024-05-21T01:19:59.577198+0000","last_undegraded":"2024-05-21T01:19:59.577198+0000","last_fullsized":"2024-05-21T01:19:59.577198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:27:41.166606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207853+0000","last_change":"2024-05-21T01:19:54.548604+0000","last_active":"2024-05-21T01:20:00.207853+0000","last_peered":"2024-05-21T01:20:00.207853+0000","last_clean":"2024-05-21T01:20:00.207853+0000","last_became_active":"2024-05-21T01:19:54.548263+0000","last_became_peered":"2024-05-21T01:19:54.548263+0000","last_unstale":"2024-05-21T01:20:00.207853+0000","last_undegraded":"2024-05-21T01:20:00.207853+0000","last_fullsized":"2024-05-21T01:20:00.207853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:33:55.302088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.211381+0000","last_change":"2024-05-21T01:19:54.573995+0000","last_active":"2024-05-21T01:20:00.211381+0000","last_peered":"2024-05-21T01:20:00.211381+0000","last_clean":"2024-05-21T01:20:00.211381+0000","last_became_active":"2024-05-21T01:19:54.570373+0000","last_became_peered":"2024-05-21T01:19:54.570373+0000","last_unstale":"2024-05-21T01:20:00.211381+0000","last_undegraded":"2024-05-21T01:20:00.211381+0000","last_fullsized":"2024-05-21T01:20:00.211381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:44:23.194713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.566746+0000","last_change":"2024-05-21T01:19:54.575196+0000","last_active":"2024-05-21T01:19:59.566746+0000","last_peered":"2024-05-21T01:19:59.566746+0000","last_clean":"2024-05-21T01:19:59.566746+0000","last_became_active":"2024-05-21T01:19:54.574945+0000","last_became_peered":"2024-05-21T01:19:54.574945+0000","last_unstale":"2024-05-21T01:19:59.566746+0000","last_undegraded":"2024-05-21T01:19:59.566746+0000","last_fullsized":"2024-05-21T01:19:59.566746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:52:56.244771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.209915+0000","last_change":"2024-05-21T01:19:54.566719+0000","last_active":"2024-05-21T01:20:00.209915+0000","last_peered":"2024-05-21T01:20:00.209915+0000","last_clean":"2024-05-21T01:20:00.209915+0000","last_became_active":"2024-05-21T01:19:54.565922+0000","last_became_peered":"2024-05-21T01:19:54.565922+0000","last_unstale":"2024-05-21T01:20:00.209915+0000","last_undegraded":"2024-05-21T01:20:00.209915+0000","last_fullsized":"2024-05-21T01:20:00.209915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:39:19.454688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.208888+0000","last_change":"2024-05-21T01:19:54.536815+0000","last_active":"2024-05-21T01:20:00.208888+0000","last_peered":"2024-05-21T01:20:00.208888+0000","last_clean":"2024-05-21T01:20:00.208888+0000","last_became_active":"2024-05-21T01:19:54.535957+0000","last_became_peered":"2024-05-21T01:19:54.535957+0000","last_unstale":"2024-05-21T01:20:00.208888+0000","last_undegraded":"2024-05-21T01:20:00.208888+0000","last_fullsized":"2024-05-21T01:20:00.208888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:24:53.906256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.571247+0000","last_change":"2024-05-21T01:19:54.552466+0000","last_active":"2024-05-21T01:19:59.571247+0000","last_peered":"2024-05-21T01:19:59.571247+0000","last_clean":"2024-05-21T01:19:59.571247+0000","last_became_active":"2024-05-21T01:19:54.551790+0000","last_became_peered":"2024-05-21T01:19:54.551790+0000","last_unstale":"2024-05-21T01:19:59.571247+0000","last_undegraded":"2024-05-21T01:19:59.571247+0000","last_fullsized":"2024-05-21T01:19:59.571247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:24:34.737707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.206948+0000","last_change":"2024-05-21T01:19:54.535314+0000","last_active":"2024-05-21T01:20:00.206948+0000","last_peered":"2024-05-21T01:20:00.206948+0000","last_clean":"2024-05-21T01:20:00.206948+0000","last_became_active":"2024-05-21T01:19:54.534793+0000","last_became_peered":"2024-05-21T01:19:54.534793+0000","last_unstale":"2024-05-21T01:20:00.206948+0000","last_undegraded":"2024-05-21T01:20:00.206948+0000","last_fullsized":"2024-05-21T01:20:00.206948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:52:35.492250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.568120+0000","last_change":"2024-05-21T01:19:54.556323+0000","last_active":"2024-05-21T01:19:59.568120+0000","last_peered":"2024-05-21T01:19:59.568120+0000","last_clean":"2024-05-21T01:19:59.568120+0000","last_became_active":"2024-05-21T01:19:54.556043+0000","last_became_peered":"2024-05-21T01:19:54.556043+0000","last_unstale":"2024-05-21T01:19:59.568120+0000","last_undegraded":"2024-05-21T01:19:59.568120+0000","last_fullsized":"2024-05-21T01:19:59.568120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:34:02.068527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.209056+0000","last_change":"2024-05-21T01:19:54.567457+0000","last_active":"2024-05-21T01:20:00.209056+0000","last_peered":"2024-05-21T01:20:00.209056+0000","last_clean":"2024-05-21T01:20:00.209056+0000","last_became_active":"2024-05-21T01:19:54.565326+0000","last_became_peered":"2024-05-21T01:19:54.565326+0000","last_unstale":"2024-05-21T01:20:00.209056+0000","last_undegraded":"2024-05-21T01:20:00.209056+0000","last_fullsized":"2024-05-21T01:20:00.209056+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:11:05.775389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.568111+0000","last_change":"2024-05-21T01:19:54.562078+0000","last_active":"2024-05-21T01:19:59.568111+0000","last_peered":"2024-05-21T01:19:59.568111+0000","last_clean":"2024-05-21T01:19:59.568111+0000","last_became_active":"2024-05-21T01:19:54.558286+0000","last_became_peered":"2024-05-21T01:19:54.558286+0000","last_unstale":"2024-05-21T01:19:59.568111+0000","last_undegraded":"2024-05-21T01:19:59.568111+0000","last_fullsized":"2024-05-21T01:19:59.568111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T09:09:58.360014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.566714+0000","last_change":"2024-05-21T01:19:54.548274+0000","last_active":"2024-05-21T01:19:59.566714+0000","last_peered":"2024-05-21T01:19:59.566714+0000","last_clean":"2024-05-21T01:19:59.566714+0000","last_became_active":"2024-05-21T01:19:54.548079+0000","last_became_peered":"2024-05-21T01:19:54.548079+0000","last_unstale":"2024-05-21T01:19:59.566714+0000","last_undegraded":"2024-05-21T01:19:59.566714+0000","last_fullsized":"2024-05-21T01:19:59.566714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:49:03.296571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.209656+0000","last_change":"2024-05-21T01:19:54.568211+0000","last_active":"2024-05-21T01:20:00.209656+0000","last_peered":"2024-05-21T01:20:00.209656+0000","last_clean":"2024-05-21T01:20:00.209656+0000","last_became_active":"2024-05-21T01:19:54.567512+0000","last_became_peered":"2024-05-21T01:19:54.567512+0000","last_unstale":"2024-05-21T01:20:00.209656+0000","last_undegraded":"2024-05-21T01:20:00.209656+0000","last_fullsized":"2024-05-21T01:20:00.209656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:32:18.004763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.575120+0000","last_change":"2024-05-21T01:19:54.556683+0000","last_active":"2024-05-21T01:19:59.575120+0000","last_peered":"2024-05-21T01:19:59.575120+0000","last_clean":"2024-05-21T01:19:59.575120+0000","last_became_active":"2024-05-21T01:19:54.555947+0000","last_became_peered":"2024-05-21T01:19:54.555947+0000","last_unstale":"2024-05-21T01:19:59.575120+0000","last_undegraded":"2024-05-21T01:19:59.575120+0000","last_fullsized":"2024-05-21T01:19:59.575120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:59:04.593946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.575926+0000","last_change":"2024-05-21T01:19:54.560218+0000","last_active":"2024-05-21T01:19:59.575926+0000","last_peered":"2024-05-21T01:19:59.575926+0000","last_clean":"2024-05-21T01:19:59.575926+0000","last_became_active":"2024-05-21T01:19:54.557787+0000","last_became_peered":"2024-05-21T01:19:54.557787+0000","last_unstale":"2024-05-21T01:19:59.575926+0000","last_undegraded":"2024-05-21T01:19:59.575926+0000","last_fullsized":"2024-05-21T01:19:59.575926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:05:48.282563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.206865+0000","last_change":"2024-05-21T01:19:54.535096+0000","last_active":"2024-05-21T01:20:00.206865+0000","last_peered":"2024-05-21T01:20:00.206865+0000","last_clean":"2024-05-21T01:20:00.206865+0000","last_became_active":"2024-05-21T01:19:54.534472+0000","last_became_peered":"2024-05-21T01:19:54.534472+0000","last_unstale":"2024-05-21T01:20:00.206865+0000","last_undegraded":"2024-05-21T01:20:00.206865+0000","last_fullsized":"2024-05-21T01:20:00.206865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:05:40.018457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207495+0000","last_change":"2024-05-21T01:19:54.546352+0000","last_active":"2024-05-21T01:20:00.207495+0000","last_peered":"2024-05-21T01:20:00.207495+0000","last_clean":"2024-05-21T01:20:00.207495+0000","last_became_active":"2024-05-21T01:19:54.546055+0000","last_became_peered":"2024-05-21T01:19:54.546055+0000","last_unstale":"2024-05-21T01:20:00.207495+0000","last_undegraded":"2024-05-21T01:20:00.207495+0000","last_fullsized":"2024-05-21T01:20:00.207495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:14:56.268312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.208385+0000","last_change":"2024-05-21T01:19:54.539886+0000","last_active":"2024-05-21T01:20:00.208385+0000","last_peered":"2024-05-21T01:20:00.208385+0000","last_clean":"2024-05-21T01:20:00.208385+0000","last_became_active":"2024-05-21T01:19:54.539599+0000","last_became_peered":"2024-05-21T01:19:54.539599+0000","last_unstale":"2024-05-21T01:20:00.208385+0000","last_undegraded":"2024-05-21T01:20:00.208385+0000","last_fullsized":"2024-05-21T01:20:00.208385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:08:51.107275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.209668+0000","last_change":"2024-05-21T01:19:54.548954+0000","last_active":"2024-05-21T01:20:00.209668+0000","last_peered":"2024-05-21T01:20:00.209668+0000","last_clean":"2024-05-21T01:20:00.209668+0000","last_became_active":"2024-05-21T01:19:54.547528+0000","last_became_peered":"2024-05-21T01:19:54.547528+0000","last_unstale":"2024-05-21T01:20:00.209668+0000","last_undegraded":"2024-05-21T01:20:00.209668+0000","last_fullsized":"2024-05-21T01:20:00.209668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:47:24.598610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.209472+0000","last_change":"2024-05-21T01:19:54.575256+0000","last_active":"2024-05-21T01:20:00.209472+0000","last_peered":"2024-05-21T01:20:00.209472+0000","last_clean":"2024-05-21T01:20:00.209472+0000","last_became_active":"2024-05-21T01:19:54.570119+0000","last_became_peered":"2024-05-21T01:19:54.570119+0000","last_unstale":"2024-05-21T01:20:00.209472+0000","last_undegraded":"2024-05-21T01:20:00.209472+0000","last_fullsized":"2024-05-21T01:20:00.209472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:10:02.800110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.206200+0000","last_change":"2024-05-21T01:19:54.550134+0000","last_active":"2024-05-21T01:20:00.206200+0000","last_peered":"2024-05-21T01:20:00.206200+0000","last_clean":"2024-05-21T01:20:00.206200+0000","last_became_active":"2024-05-21T01:19:54.549617+0000","last_became_peered":"2024-05-21T01:19:54.549617+0000","last_unstale":"2024-05-21T01:20:00.206200+0000","last_undegraded":"2024-05-21T01:20:00.206200+0000","last_fullsized":"2024-05-21T01:20:00.206200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:34:59.845458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207085+0000","last_change":"2024-05-21T01:19:54.555653+0000","last_active":"2024-05-21T01:20:00.207085+0000","last_peered":"2024-05-21T01:20:00.207085+0000","last_clean":"2024-05-21T01:20:00.207085+0000","last_became_active":"2024-05-21T01:19:54.555274+0000","last_became_peered":"2024-05-21T01:19:54.555274+0000","last_unstale":"2024-05-21T01:20:00.207085+0000","last_undegraded":"2024-05-21T01:20:00.207085+0000","last_fullsized":"2024-05-21T01:20:00.207085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:43:43.237853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207101+0000","last_change":"2024-05-21T01:19:54.568866+0000","last_active":"2024-05-21T01:20:00.207101+0000","last_peered":"2024-05-21T01:20:00.207101+0000","last_clean":"2024-05-21T01:20:00.207101+0000","last_became_active":"2024-05-21T01:19:54.568605+0000","last_became_peered":"2024-05-21T01:19:54.568605+0000","last_unstale":"2024-05-21T01:20:00.207101+0000","last_undegraded":"2024-05-21T01:20:00.207101+0000","last_fullsized":"2024-05-21T01:20:00.207101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:21:20.820620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207281+0000","last_change":"2024-05-21T01:19:54.557468+0000","last_active":"2024-05-21T01:20:00.207281+0000","last_peered":"2024-05-21T01:20:00.207281+0000","last_clean":"2024-05-21T01:20:00.207281+0000","last_became_active":"2024-05-21T01:19:54.554976+0000","last_became_peered":"2024-05-21T01:19:54.554976+0000","last_unstale":"2024-05-21T01:20:00.207281+0000","last_undegraded":"2024-05-21T01:20:00.207281+0000","last_fullsized":"2024-05-21T01:20:00.207281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:25:08.737348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.210942+0000","last_change":"2024-05-21T01:19:54.566991+0000","last_active":"2024-05-21T01:20:00.210942+0000","last_peered":"2024-05-21T01:20:00.210942+0000","last_clean":"2024-05-21T01:20:00.210942+0000","last_became_active":"2024-05-21T01:19:54.566349+0000","last_became_peered":"2024-05-21T01:19:54.566349+0000","last_unstale":"2024-05-21T01:20:00.210942+0000","last_undegraded":"2024-05-21T01:20:00.210942+0000","last_fullsized":"2024-05-21T01:20:00.210942+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:25:43.468081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.211304+0000","last_change":"2024-05-21T01:19:54.576100+0000","last_active":"2024-05-21T01:20:00.211304+0000","last_peered":"2024-05-21T01:20:00.211304+0000","last_clean":"2024-05-21T01:20:00.211304+0000","last_became_active":"2024-05-21T01:19:54.574914+0000","last_became_peered":"2024-05-21T01:19:54.574914+0000","last_unstale":"2024-05-21T01:20:00.211304+0000","last_undegraded":"2024-05-21T01:20:00.211304+0000","last_fullsized":"2024-05-21T01:20:00.211304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:29:30.730283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.208436+0000","last_change":"2024-05-21T01:19:54.546570+0000","last_active":"2024-05-21T01:20:00.208436+0000","last_peered":"2024-05-21T01:20:00.208436+0000","last_clean":"2024-05-21T01:20:00.208436+0000","last_became_active":"2024-05-21T01:19:54.546284+0000","last_became_peered":"2024-05-21T01:19:54.546284+0000","last_unstale":"2024-05-21T01:20:00.208436+0000","last_undegraded":"2024-05-21T01:20:00.208436+0000","last_fullsized":"2024-05-21T01:20:00.208436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:36:30.219522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":5956,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":11912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":63,"ondisk_log_size":63,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66932,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509452,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":103393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509451,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":270336,"data_stored":106653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509450,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":327680,"data_stored":693249,"data_compressed":33466,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509450,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":102867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542155,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":102811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542154,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":339968,"data_stored":693893,"data_compressed":33466,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":102935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":107325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33466,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33466,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":5298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-21T01:20:27.557 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-21T01:20:27.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.733+0000 7f935f200640 1 Processor -- start 2024-05-21T01:20:27.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.733+0000 7f935f200640 1 -- start start 2024-05-21T01:20:27.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.733+0000 7f935f200640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f936015c180 0x7f93600ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:27.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.733+0000 7f935f200640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f936015ff80 con 0x7f93600ca410 2024-05-21T01:20:27.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.733+0000 7f935f200640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f936015c7e0 con 0x7f93600ce050 2024-05-21T01:20:27.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.733+0000 7f935f200640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f936015f1c0 con 0x7f936015c180 2024-05-21T01:20:27.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.733+0000 7f935de00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f93600ca410 0x7f9360072260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:40262/0 (socket says 172.21.15.63:40262) 2024-05-21T01:20:27.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.733+0000 7f935de00640 1 -- 172.21.15.63:0/334013086 learned_addr learned my addr 172.21.15.63:0/334013086 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-05-21T01:20:27.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.733+0000 7f935e800640 1 --2- 172.21.15.63:0/334013086 >> v2:172.21.15.131:3300/0 conn(0x7f936015c180 0x7f93600ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:27.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.733+0000 7f935d400640 1 -- 172.21.15.63:0/334013086 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3159152757 0 0) 0x7f936015ff80 con 0x7f93600ca410 2024-05-21T01:20:27.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.733+0000 7f935d400640 1 -- 172.21.15.63:0/334013086 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9344003530 con 0x7f93600ca410 2024-05-21T01:20:27.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.737+0000 7f935d400640 1 -- 172.21.15.63:0/334013086 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3134085320 0 0) 0x7f9344003530 con 0x7f93600ca410 2024-05-21T01:20:27.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.737+0000 7f935d400640 1 -- 172.21.15.63:0/334013086 >> v2:172.21.15.131:3300/0 conn(0x7f936015c180 msgr2=0x7f93600ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:27.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.737+0000 7f935d400640 1 --2- 172.21.15.63:0/334013086 >> v2:172.21.15.131:3300/0 conn(0x7f936015c180 0x7f93600ce450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:27.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.737+0000 7f935d400640 1 -- 172.21.15.63:0/334013086 >> v1:172.21.15.131:6789/0 conn(0x7f93600ce050 legacy=0x7f936015ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:27.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.737+0000 7f935d400640 1 -- 172.21.15.63:0/334013086 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f936015f4a0 con 0x7f93600ca410 2024-05-21T01:20:27.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.737+0000 7f935d400640 1 -- 172.21.15.63:0/334013086 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 466403955 0 0) 0x7f9350001700 con 0x7f93600ca410 2024-05-21T01:20:27.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.737+0000 7f935d400640 1 -- 172.21.15.63:0/334013086 >> v1:172.21.15.63:6789/0 conn(0x7f93600ca410 legacy=0x7f9360072260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:27.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.737+0000 7f935d400640 1 --2- 172.21.15.63:0/334013086 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9344003a60 0x7f9344003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:27.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.737+0000 7f935d400640 1 --2- 172.21.15.63:0/334013086 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9344004810 0x7f9344004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:27.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.737+0000 7f935d400640 1 --2- 172.21.15.63:0/334013086 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f93440051d0 0x7f934400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:27.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.737+0000 7f935d400640 1 -- 172.21.15.63:0/334013086 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f936015f1c0 con 0x7f93440051d0 2024-05-21T01:20:27.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.737+0000 7f935d400640 1 -- 172.21.15.63:0/334013086 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f934400c170 con 0x7f9344004810 2024-05-21T01:20:27.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.737+0000 7f935d400640 1 -- 172.21.15.63:0/334013086 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f934400c370 con 0x7f9344003a60 2024-05-21T01:20:27.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.737+0000 7f935e800640 1 --2- 172.21.15.63:0/334013086 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f93440051d0 0x7f934400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:27.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.737+0000 7f935de00640 1 --2- 172.21.15.63:0/334013086 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9344003a60 0x7f9344003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:27.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.737+0000 7f9357e00640 1 --2- 172.21.15.63:0/334013086 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9344004810 0x7f9344004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:27.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.737+0000 7f935e800640 1 -- 172.21.15.63:0/334013086 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9344003a60 msgr2=0x7f9344003e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:27.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.737+0000 7f935e800640 1 --2- 172.21.15.63:0/334013086 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9344003a60 0x7f9344003e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:27.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.737+0000 7f935e800640 1 -- 172.21.15.63:0/334013086 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9344004810 msgr2=0x7f9344004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:27.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.737+0000 7f935e800640 1 --2- 172.21.15.63:0/334013086 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9344004810 0x7f9344004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:27.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.737+0000 7f935e800640 1 -- 172.21.15.63:0/334013086 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9344003530 con 0x7f93440051d0 2024-05-21T01:20:27.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.737+0000 7f935e800640 1 -- 172.21.15.63:0/334013086 reap_dead start 2024-05-21T01:20:27.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.737+0000 7f935e800640 1 --2- 172.21.15.63:0/334013086 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f93440051d0 0x7f934400b9d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9358009fc0 tx=0x7f935801ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4079c00f707a7a11 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:27.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.741+0000 7f935d400640 1 -- 172.21.15.63:0/334013086 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9358009c10 con 0x7f93440051d0 2024-05-21T01:20:27.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.741+0000 7f935d400640 1 -- 172.21.15.63:0/334013086 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93580a5cd0 con 0x7f93440051d0 2024-05-21T01:20:27.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.741+0000 7f935d400640 1 -- 172.21.15.63:0/334013086 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9358003be0 con 0x7f93440051d0 2024-05-21T01:20:27.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.741+0000 7f935f200640 1 -- 172.21.15.63:0/334013086 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f93440051d0 msgr2=0x7f934400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:27.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.741+0000 7f935f200640 1 --2- 172.21.15.63:0/334013086 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f93440051d0 0x7f934400b9d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9358009fc0 tx=0x7f935801ccc0 comp rx=0 tx=0).stop 2024-05-21T01:20:27.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.741+0000 7f935f200640 1 -- 172.21.15.63:0/334013086 shutdown_connections 2024-05-21T01:20:27.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.741+0000 7f935f200640 1 --2- 172.21.15.63:0/334013086 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f93440051d0 0x7f934400b9d0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:27.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.741+0000 7f935f200640 1 -- 172.21.15.63:0/334013086 >> 172.21.15.63:0/334013086 conn(0x7f9360068690 msgr2=0x7f936006fd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:27.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.741+0000 7f935f200640 1 -- 172.21.15.63:0/334013086 shutdown_connections 2024-05-21T01:20:27.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.741+0000 7f935f200640 1 -- 172.21.15.63:0/334013086 wait complete. 2024-05-21T01:20:27.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.741+0000 7f935f200640 1 Processor -- start 2024-05-21T01:20:27.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.741+0000 7f935f200640 1 -- start start 2024-05-21T01:20:27.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.741+0000 7f935f200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f93440051d0 0x7f936015e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:27.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.741+0000 7f935f200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93601f22e0 0x7f9360159d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:27.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.741+0000 7f935f200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f93601563c0 0x7f93600caf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:27.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.741+0000 7f935f200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f936015fa60 con 0x7f93440051d0 2024-05-21T01:20:27.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.741+0000 7f935f200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f936015c610 con 0x7f93601f22e0 2024-05-21T01:20:27.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.741+0000 7f935f200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f936015c9b0 con 0x7f93601563c0 2024-05-21T01:20:27.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.741+0000 7f935de00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f93440051d0 0x7f936015e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:27.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.741+0000 7f935de00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f93440051d0 0x7f936015e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:49578/0 (socket says 172.21.15.63:49578) 2024-05-21T01:20:27.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.741+0000 7f935de00640 1 -- 172.21.15.63:0/1425799110 learned_addr learned my addr 172.21.15.63:0/1425799110 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:27.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.741+0000 7f935e800640 1 --2- 172.21.15.63:0/1425799110 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f93601563c0 0x7f93600caf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:27.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.741+0000 7f9357e00640 1 --2- 172.21.15.63:0/1425799110 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93601f22e0 0x7f9360159d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:27.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.741+0000 7f935de00640 1 -- 172.21.15.63:0/1425799110 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f93601563c0 msgr2=0x7f93600caf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:27.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.741+0000 7f935de00640 1 --2- 172.21.15.63:0/1425799110 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f93601563c0 0x7f93600caf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:27.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.741+0000 7f935de00640 1 -- 172.21.15.63:0/1425799110 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93601f22e0 msgr2=0x7f9360159d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:27.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.741+0000 7f935de00640 1 --2- 172.21.15.63:0/1425799110 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93601f22e0 0x7f9360159d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:27.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.741+0000 7f935de00640 1 -- 172.21.15.63:0/1425799110 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f936015e830 con 0x7f93440051d0 2024-05-21T01:20:27.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.741+0000 7f9357e00640 1 --2- 172.21.15.63:0/1425799110 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93601f22e0 0x7f9360159d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T01:20:27.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.745+0000 7f935de00640 1 --2- 172.21.15.63:0/1425799110 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f93440051d0 0x7f936015e210 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f935000e810 tx=0x7f935000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:27.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.745+0000 7f9356000640 1 -- 172.21.15.63:0/1425799110 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9350019070 con 0x7f93440051d0 2024-05-21T01:20:27.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.745+0000 7f9356000640 1 -- 172.21.15.63:0/1425799110 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f935000c870 con 0x7f93440051d0 2024-05-21T01:20:27.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.745+0000 7f9356000640 1 -- 172.21.15.63:0/1425799110 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f935000cc40 con 0x7f93440051d0 2024-05-21T01:20:27.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.745+0000 7f935f200640 1 -- 172.21.15.63:0/1425799110 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f936015ead0 con 0x7f93440051d0 2024-05-21T01:20:27.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.745+0000 7f935f200640 1 -- 172.21.15.63:0/1425799110 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f936015ed90 con 0x7f93440051d0 2024-05-21T01:20:27.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.745+0000 7f935f200640 1 -- 172.21.15.63:0/1425799110 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93601f26c0 con 0x7f93440051d0 2024-05-21T01:20:27.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.745+0000 7f9356000640 1 -- 172.21.15.63:0/1425799110 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7f935001c070 con 0x7f93440051d0 2024-05-21T01:20:27.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.745+0000 7f9356000640 1 --2- 172.21.15.63:0/1425799110 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f933c06f400 0x7f933c0718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:27.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.745+0000 7f9356000640 1 -- 172.21.15.63:0/1425799110 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f935008ec30 con 0x7f93440051d0 2024-05-21T01:20:27.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.745+0000 7f9357e00640 1 --2- 172.21.15.63:0/1425799110 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f933c06f400 0x7f933c0718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:27.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.749+0000 7f9357e00640 1 --2- 172.21.15.63:0/1425799110 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f933c06f400 0x7f933c0718c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9348000c10 tx=0x7f9348009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:27.756 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.753+0000 7f9356000640 1 -- 172.21.15.63:0/1425799110 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f935005b210 con 0x7f93440051d0 2024-05-21T01:20:27.917 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.913+0000 7f935f200640 1 -- 172.21.15.63:0/1425799110 --> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f936006c0c0 con 0x7f933c06f400 2024-05-21T01:20:27.940 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.937+0000 7f9356000640 1 -- 172.21.15.63:0/1425799110 <== mgr.4103 v2:172.21.15.131:6832/921953667 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332685 (secure 0 0 0) 0x7f936006c0c0 con 0x7f933c06f400 2024-05-21T01:20:27.944 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-05-21T01:20:27.946 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-05-21T01:20:27.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.941+0000 7f935f200640 1 -- 172.21.15.63:0/1425799110 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f933c06f400 msgr2=0x7f933c0718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:27.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.941+0000 7f935f200640 1 --2- 172.21.15.63:0/1425799110 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f933c06f400 0x7f933c0718c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9348000c10 tx=0x7f9348009040 comp rx=0 tx=0).stop 2024-05-21T01:20:27.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.941+0000 7f935f200640 1 -- 172.21.15.63:0/1425799110 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f93440051d0 msgr2=0x7f936015e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:27.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.941+0000 7f935f200640 1 --2- 172.21.15.63:0/1425799110 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f93440051d0 0x7f936015e210 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f935000e810 tx=0x7f935000ecd0 comp rx=0 tx=0).stop 2024-05-21T01:20:27.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.941+0000 7f935f200640 1 -- 172.21.15.63:0/1425799110 shutdown_connections 2024-05-21T01:20:27.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.941+0000 7f935f200640 1 --2- 172.21.15.63:0/1425799110 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f933c06f400 0x7f933c0718c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:27.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.941+0000 7f935f200640 1 --2- 172.21.15.63:0/1425799110 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f93601563c0 0x7f93600caf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:27.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.941+0000 7f935f200640 1 --2- 172.21.15.63:0/1425799110 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93601f22e0 0x7f9360159d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:27.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.941+0000 7f935f200640 1 --2- 172.21.15.63:0/1425799110 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f93440051d0 0x7f936015e210 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:27.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.941+0000 7f935f200640 1 -- 172.21.15.63:0/1425799110 >> 172.21.15.63:0/1425799110 conn(0x7f9360068690 msgr2=0x7f93600729e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:27.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.941+0000 7f935f200640 1 -- 172.21.15.63:0/1425799110 shutdown_connections 2024-05-21T01:20:27.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:27.941+0000 7f935f200640 1 -- 172.21.15.63:0/1425799110 wait complete. 2024-05-21T01:20:27.964 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2024-05-21T01:20:26.443517+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596324,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":169,"num_write_kb":1651,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":135,"ondisk_log_size":135,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218372,"kb_used_data":2216,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756348,"statfs":{"total":773094113280,"available":772870500352,"internally_reserved":0,"allocated":2269184,"data_stored":2013126,"data_compressed":66932,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3097,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005272"},"pg_stats":[{"pgid":"2.1f","version":"24'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.573917+0000","last_change":"2024-05-21T01:19:53.545236+0000","last_active":"2024-05-21T01:19:59.573917+0000","last_peered":"2024-05-21T01:19:59.573917+0000","last_clean":"2024-05-21T01:19:59.573917+0000","last_became_active":"2024-05-21T01:19:53.544469+0000","last_became_peered":"2024-05-21T01:19:53.544469+0000","last_unstale":"2024-05-21T01:19:59.573917+0000","last_undegraded":"2024-05-21T01:19:59.573917+0000","last_fullsized":"2024-05-21T01:19:59.573917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:33:09.421287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.211552+0000","last_change":"2024-05-21T01:19:54.568235+0000","last_active":"2024-05-21T01:20:00.211552+0000","last_peered":"2024-05-21T01:20:00.211552+0000","last_clean":"2024-05-21T01:20:00.211552+0000","last_became_active":"2024-05-21T01:19:54.567245+0000","last_became_peered":"2024-05-21T01:19:54.567245+0000","last_unstale":"2024-05-21T01:20:00.211552+0000","last_undegraded":"2024-05-21T01:20:00.211552+0000","last_fullsized":"2024-05-21T01:20:00.211552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:39:51.222819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207912+0000","last_change":"2024-05-21T01:19:58.618772+0000","last_active":"2024-05-21T01:20:00.207912+0000","last_peered":"2024-05-21T01:20:00.207912+0000","last_clean":"2024-05-21T01:20:00.207912+0000","last_became_active":"2024-05-21T01:19:58.617757+0000","last_became_peered":"2024-05-21T01:19:58.617757+0000","last_unstale":"2024-05-21T01:20:00.207912+0000","last_undegraded":"2024-05-21T01:20:00.207912+0000","last_fullsized":"2024-05-21T01:20:00.207912+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T13:07:31.666521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.211893+0000","last_change":"2024-05-21T01:19:53.551775+0000","last_active":"2024-05-21T01:20:00.211893+0000","last_peered":"2024-05-21T01:20:00.211893+0000","last_clean":"2024-05-21T01:20:00.211893+0000","last_became_active":"2024-05-21T01:19:53.551049+0000","last_became_peered":"2024-05-21T01:19:53.551049+0000","last_unstale":"2024-05-21T01:20:00.211893+0000","last_undegraded":"2024-05-21T01:20:00.211893+0000","last_fullsized":"2024-05-21T01:20:00.211893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:49:02.289202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.211755+0000","last_change":"2024-05-21T01:19:54.573420+0000","last_active":"2024-05-21T01:20:00.211755+0000","last_peered":"2024-05-21T01:20:00.211755+0000","last_clean":"2024-05-21T01:20:00.211755+0000","last_became_active":"2024-05-21T01:19:54.569573+0000","last_became_peered":"2024-05-21T01:19:54.569573+0000","last_unstale":"2024-05-21T01:20:00.211755+0000","last_undegraded":"2024-05-21T01:20:00.211755+0000","last_fullsized":"2024-05-21T01:20:00.211755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:00:12.257816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.206470+0000","last_change":"2024-05-21T01:19:58.604490+0000","last_active":"2024-05-21T01:20:00.206470+0000","last_peered":"2024-05-21T01:20:00.206470+0000","last_clean":"2024-05-21T01:20:00.206470+0000","last_became_active":"2024-05-21T01:19:58.604108+0000","last_became_peered":"2024-05-21T01:19:58.604108+0000","last_unstale":"2024-05-21T01:20:00.206470+0000","last_undegraded":"2024-05-21T01:20:00.206470+0000","last_fullsized":"2024-05-21T01:20:00.206470+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:11:10.963073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207737+0000","last_change":"2024-05-21T01:19:53.525403+0000","last_active":"2024-05-21T01:20:00.207737+0000","last_peered":"2024-05-21T01:20:00.207737+0000","last_clean":"2024-05-21T01:20:00.207737+0000","last_became_active":"2024-05-21T01:19:53.521265+0000","last_became_peered":"2024-05-21T01:19:53.521265+0000","last_unstale":"2024-05-21T01:20:00.207737+0000","last_undegraded":"2024-05-21T01:20:00.207737+0000","last_fullsized":"2024-05-21T01:20:00.207737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:52:16.488269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.209201+0000","last_change":"2024-05-21T01:19:54.536436+0000","last_active":"2024-05-21T01:20:00.209201+0000","last_peered":"2024-05-21T01:20:00.209201+0000","last_clean":"2024-05-21T01:20:00.209201+0000","last_became_active":"2024-05-21T01:19:54.536061+0000","last_became_peered":"2024-05-21T01:19:54.536061+0000","last_unstale":"2024-05-21T01:20:00.209201+0000","last_undegraded":"2024-05-21T01:20:00.209201+0000","last_fullsized":"2024-05-21T01:20:00.209201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:48:23.811712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.206960+0000","last_change":"2024-05-21T01:19:58.623087+0000","last_active":"2024-05-21T01:20:00.206960+0000","last_peered":"2024-05-21T01:20:00.206960+0000","last_clean":"2024-05-21T01:20:00.206960+0000","last_became_active":"2024-05-21T01:19:58.622672+0000","last_became_peered":"2024-05-21T01:19:58.622672+0000","last_unstale":"2024-05-21T01:20:00.206960+0000","last_undegraded":"2024-05-21T01:20:00.206960+0000","last_fullsized":"2024-05-21T01:20:00.206960+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:45:49.241750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207109+0000","last_change":"2024-05-21T01:19:53.522497+0000","last_active":"2024-05-21T01:20:00.207109+0000","last_peered":"2024-05-21T01:20:00.207109+0000","last_clean":"2024-05-21T01:20:00.207109+0000","last_became_active":"2024-05-21T01:19:53.521684+0000","last_became_peered":"2024-05-21T01:19:53.521684+0000","last_unstale":"2024-05-21T01:20:00.207109+0000","last_undegraded":"2024-05-21T01:20:00.207109+0000","last_fullsized":"2024-05-21T01:20:00.207109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:18:17.808255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.567660+0000","last_change":"2024-05-21T01:19:54.549512+0000","last_active":"2024-05-21T01:19:59.567660+0000","last_peered":"2024-05-21T01:19:59.567660+0000","last_clean":"2024-05-21T01:19:59.567660+0000","last_became_active":"2024-05-21T01:19:54.549291+0000","last_became_peered":"2024-05-21T01:19:54.549291+0000","last_unstale":"2024-05-21T01:19:59.567660+0000","last_undegraded":"2024-05-21T01:19:59.567660+0000","last_fullsized":"2024-05-21T01:19:59.567660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:48:34.571236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.206754+0000","last_change":"2024-05-21T01:19:58.614748+0000","last_active":"2024-05-21T01:20:00.206754+0000","last_peered":"2024-05-21T01:20:00.206754+0000","last_clean":"2024-05-21T01:20:00.206754+0000","last_became_active":"2024-05-21T01:19:58.614313+0000","last_became_peered":"2024-05-21T01:19:58.614313+0000","last_unstale":"2024-05-21T01:20:00.206754+0000","last_undegraded":"2024-05-21T01:20:00.206754+0000","last_fullsized":"2024-05-21T01:20:00.206754+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:45:34.204591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.567029+0000","last_change":"2024-05-21T01:19:54.545467+0000","last_active":"2024-05-21T01:19:59.567029+0000","last_peered":"2024-05-21T01:19:59.567029+0000","last_clean":"2024-05-21T01:19:59.567029+0000","last_became_active":"2024-05-21T01:19:54.545181+0000","last_became_peered":"2024-05-21T01:19:54.545181+0000","last_unstale":"2024-05-21T01:19:59.567029+0000","last_undegraded":"2024-05-21T01:19:59.567029+0000","last_fullsized":"2024-05-21T01:19:59.567029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:43:15.387067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.567246+0000","last_change":"2024-05-21T01:19:53.536139+0000","last_active":"2024-05-21T01:19:59.567246+0000","last_peered":"2024-05-21T01:19:59.567246+0000","last_clean":"2024-05-21T01:19:59.567246+0000","last_became_active":"2024-05-21T01:19:53.535899+0000","last_became_peered":"2024-05-21T01:19:53.535899+0000","last_unstale":"2024-05-21T01:19:59.567246+0000","last_undegraded":"2024-05-21T01:19:59.567246+0000","last_fullsized":"2024-05-21T01:19:59.567246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:40:12.033744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.567390+0000","last_change":"2024-05-21T01:19:58.621487+0000","last_active":"2024-05-21T01:19:59.567390+0000","last_peered":"2024-05-21T01:19:59.567390+0000","last_clean":"2024-05-21T01:19:59.567390+0000","last_became_active":"2024-05-21T01:19:58.621083+0000","last_became_peered":"2024-05-21T01:19:58.621083+0000","last_unstale":"2024-05-21T01:19:59.567390+0000","last_undegraded":"2024-05-21T01:19:59.567390+0000","last_fullsized":"2024-05-21T01:19:59.567390+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:18:44.587274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.208662+0000","last_change":"2024-05-21T01:19:54.572420+0000","last_active":"2024-05-21T01:20:00.208662+0000","last_peered":"2024-05-21T01:20:00.208662+0000","last_clean":"2024-05-21T01:20:00.208662+0000","last_became_active":"2024-05-21T01:19:54.571863+0000","last_became_peered":"2024-05-21T01:19:54.571863+0000","last_unstale":"2024-05-21T01:20:00.208662+0000","last_undegraded":"2024-05-21T01:20:00.208662+0000","last_fullsized":"2024-05-21T01:20:00.208662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:13:52.491903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.575374+0000","last_change":"2024-05-21T01:19:53.553351+0000","last_active":"2024-05-21T01:19:59.575374+0000","last_peered":"2024-05-21T01:19:59.575374+0000","last_clean":"2024-05-21T01:19:59.575374+0000","last_became_active":"2024-05-21T01:19:53.552694+0000","last_became_peered":"2024-05-21T01:19:53.552694+0000","last_unstale":"2024-05-21T01:19:59.575374+0000","last_undegraded":"2024-05-21T01:19:59.575374+0000","last_fullsized":"2024-05-21T01:19:59.575374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:46:55.273278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.206544+0000","last_change":"2024-05-21T01:19:58.594904+0000","last_active":"2024-05-21T01:20:00.206544+0000","last_peered":"2024-05-21T01:20:00.206544+0000","last_clean":"2024-05-21T01:20:00.206544+0000","last_became_active":"2024-05-21T01:19:58.594450+0000","last_became_peered":"2024-05-21T01:19:58.594450+0000","last_unstale":"2024-05-21T01:20:00.206544+0000","last_undegraded":"2024-05-21T01:20:00.206544+0000","last_fullsized":"2024-05-21T01:20:00.206544+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:37:30.286986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.571649+0000","last_change":"2024-05-21T01:19:54.554750+0000","last_active":"2024-05-21T01:19:59.571649+0000","last_peered":"2024-05-21T01:19:59.571649+0000","last_clean":"2024-05-21T01:19:59.571649+0000","last_became_active":"2024-05-21T01:19:54.551583+0000","last_became_peered":"2024-05-21T01:19:54.551583+0000","last_unstale":"2024-05-21T01:19:59.571649+0000","last_undegraded":"2024-05-21T01:19:59.571649+0000","last_fullsized":"2024-05-21T01:19:59.571649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:37:19.564099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"25'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:24.662369+0000","last_change":"2024-05-21T01:19:53.523277+0000","last_active":"2024-05-21T01:20:24.662369+0000","last_peered":"2024-05-21T01:20:24.662369+0000","last_clean":"2024-05-21T01:20:24.662369+0000","last_became_active":"2024-05-21T01:19:53.522525+0000","last_became_peered":"2024-05-21T01:19:53.522525+0000","last_unstale":"2024-05-21T01:20:24.662369+0000","last_undegraded":"2024-05-21T01:20:24.662369+0000","last_fullsized":"2024-05-21T01:20:24.662369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:23:59.949781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.209007+0000","last_change":"2024-05-21T01:19:58.615575+0000","last_active":"2024-05-21T01:20:00.209007+0000","last_peered":"2024-05-21T01:20:00.209007+0000","last_clean":"2024-05-21T01:20:00.209007+0000","last_became_active":"2024-05-21T01:19:58.614401+0000","last_became_peered":"2024-05-21T01:19:58.614401+0000","last_unstale":"2024-05-21T01:20:00.209007+0000","last_undegraded":"2024-05-21T01:20:00.209007+0000","last_fullsized":"2024-05-21T01:20:00.209007+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:51:09.839503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.566770+0000","last_change":"2024-05-21T01:19:54.555489+0000","last_active":"2024-05-21T01:19:59.566770+0000","last_peered":"2024-05-21T01:19:59.566770+0000","last_clean":"2024-05-21T01:19:59.566770+0000","last_became_active":"2024-05-21T01:19:54.555227+0000","last_became_peered":"2024-05-21T01:19:54.555227+0000","last_unstale":"2024-05-21T01:19:59.566770+0000","last_undegraded":"2024-05-21T01:19:59.566770+0000","last_fullsized":"2024-05-21T01:19:59.566770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:00:22.873520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.205893+0000","last_change":"2024-05-21T01:19:53.520840+0000","last_active":"2024-05-21T01:20:00.205893+0000","last_peered":"2024-05-21T01:20:00.205893+0000","last_clean":"2024-05-21T01:20:00.205893+0000","last_became_active":"2024-05-21T01:19:53.520540+0000","last_became_peered":"2024-05-21T01:19:53.520540+0000","last_unstale":"2024-05-21T01:20:00.205893+0000","last_undegraded":"2024-05-21T01:20:00.205893+0000","last_fullsized":"2024-05-21T01:20:00.205893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:08:36.426465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207823+0000","last_change":"2024-05-21T01:19:58.604357+0000","last_active":"2024-05-21T01:20:00.207823+0000","last_peered":"2024-05-21T01:20:00.207823+0000","last_clean":"2024-05-21T01:20:00.207823+0000","last_became_active":"2024-05-21T01:19:58.603922+0000","last_became_peered":"2024-05-21T01:19:58.603922+0000","last_unstale":"2024-05-21T01:20:00.207823+0000","last_undegraded":"2024-05-21T01:20:00.207823+0000","last_fullsized":"2024-05-21T01:20:00.207823+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:55:18.226031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.572430+0000","last_change":"2024-05-21T01:19:54.569315+0000","last_active":"2024-05-21T01:19:59.572430+0000","last_peered":"2024-05-21T01:19:59.572430+0000","last_clean":"2024-05-21T01:19:59.572430+0000","last_became_active":"2024-05-21T01:19:54.568232+0000","last_became_peered":"2024-05-21T01:19:54.568232+0000","last_unstale":"2024-05-21T01:19:59.572430+0000","last_undegraded":"2024-05-21T01:19:59.572430+0000","last_fullsized":"2024-05-21T01:19:59.572430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:19:01.819418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"25'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:24.660940+0000","last_change":"2024-05-21T01:19:53.525301+0000","last_active":"2024-05-21T01:20:24.660940+0000","last_peered":"2024-05-21T01:20:24.660940+0000","last_clean":"2024-05-21T01:20:24.660940+0000","last_became_active":"2024-05-21T01:19:53.525010+0000","last_became_peered":"2024-05-21T01:19:53.525010+0000","last_unstale":"2024-05-21T01:20:24.660940+0000","last_undegraded":"2024-05-21T01:20:24.660940+0000","last_fullsized":"2024-05-21T01:20:24.660940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:53:11.316975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.206622+0000","last_change":"2024-05-21T01:19:58.590354+0000","last_active":"2024-05-21T01:20:00.206622+0000","last_peered":"2024-05-21T01:20:00.206622+0000","last_clean":"2024-05-21T01:20:00.206622+0000","last_became_active":"2024-05-21T01:19:58.589985+0000","last_became_peered":"2024-05-21T01:19:58.589985+0000","last_unstale":"2024-05-21T01:20:00.206622+0000","last_undegraded":"2024-05-21T01:20:00.206622+0000","last_fullsized":"2024-05-21T01:20:00.206622+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:08:09.222858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.573671+0000","last_change":"2024-05-21T01:19:54.555318+0000","last_active":"2024-05-21T01:19:59.573671+0000","last_peered":"2024-05-21T01:19:59.573671+0000","last_clean":"2024-05-21T01:19:59.573671+0000","last_became_active":"2024-05-21T01:19:54.552947+0000","last_became_peered":"2024-05-21T01:19:54.552947+0000","last_unstale":"2024-05-21T01:19:59.573671+0000","last_undegraded":"2024-05-21T01:19:59.573671+0000","last_fullsized":"2024-05-21T01:19:59.573671+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:29:24.153986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.572949+0000","last_change":"2024-05-21T01:19:53.525004+0000","last_active":"2024-05-21T01:19:59.572949+0000","last_peered":"2024-05-21T01:19:59.572949+0000","last_clean":"2024-05-21T01:19:59.572949+0000","last_became_active":"2024-05-21T01:19:53.521014+0000","last_became_peered":"2024-05-21T01:19:53.521014+0000","last_unstale":"2024-05-21T01:19:59.572949+0000","last_undegraded":"2024-05-21T01:19:59.572949+0000","last_fullsized":"2024-05-21T01:19:59.572949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:02:46.668320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.571502+0000","last_change":"2024-05-21T01:19:58.599880+0000","last_active":"2024-05-21T01:19:59.571502+0000","last_peered":"2024-05-21T01:19:59.571502+0000","last_clean":"2024-05-21T01:19:59.571502+0000","last_became_active":"2024-05-21T01:19:58.598712+0000","last_became_peered":"2024-05-21T01:19:58.598712+0000","last_unstale":"2024-05-21T01:19:59.571502+0000","last_undegraded":"2024-05-21T01:19:59.571502+0000","last_fullsized":"2024-05-21T01:19:59.571502+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:43:05.995986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.577134+0000","last_change":"2024-05-21T01:19:54.576044+0000","last_active":"2024-05-21T01:19:59.577134+0000","last_peered":"2024-05-21T01:19:59.577134+0000","last_clean":"2024-05-21T01:19:59.577134+0000","last_became_active":"2024-05-21T01:19:54.575543+0000","last_became_peered":"2024-05-21T01:19:54.575543+0000","last_unstale":"2024-05-21T01:19:59.577134+0000","last_undegraded":"2024-05-21T01:19:59.577134+0000","last_fullsized":"2024-05-21T01:19:59.577134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T09:33:07.188470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"25'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.568216+0000","last_change":"2024-05-21T01:19:53.543705+0000","last_active":"2024-05-21T01:19:59.568216+0000","last_peered":"2024-05-21T01:19:59.568216+0000","last_clean":"2024-05-21T01:19:59.568216+0000","last_became_active":"2024-05-21T01:19:53.543450+0000","last_became_peered":"2024-05-21T01:19:53.543450+0000","last_unstale":"2024-05-21T01:19:59.568216+0000","last_undegraded":"2024-05-21T01:19:59.568216+0000","last_fullsized":"2024-05-21T01:19:59.568216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:05:49.465156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.575415+0000","last_change":"2024-05-21T01:19:58.612049+0000","last_active":"2024-05-21T01:19:59.575415+0000","last_peered":"2024-05-21T01:19:59.575415+0000","last_clean":"2024-05-21T01:19:59.575415+0000","last_became_active":"2024-05-21T01:19:58.610837+0000","last_became_peered":"2024-05-21T01:19:58.610837+0000","last_unstale":"2024-05-21T01:19:59.575415+0000","last_undegraded":"2024-05-21T01:19:59.575415+0000","last_fullsized":"2024-05-21T01:19:59.575415+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:24:14.332056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207496+0000","last_change":"2024-05-21T01:19:54.553083+0000","last_active":"2024-05-21T01:20:00.207496+0000","last_peered":"2024-05-21T01:20:00.207496+0000","last_clean":"2024-05-21T01:20:00.207496+0000","last_became_active":"2024-05-21T01:19:54.552812+0000","last_became_peered":"2024-05-21T01:19:54.552812+0000","last_unstale":"2024-05-21T01:20:00.207496+0000","last_undegraded":"2024-05-21T01:20:00.207496+0000","last_fullsized":"2024-05-21T01:20:00.207496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:37:25.835345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.210838+0000","last_change":"2024-05-21T01:19:53.551697+0000","last_active":"2024-05-21T01:20:00.210838+0000","last_peered":"2024-05-21T01:20:00.210838+0000","last_clean":"2024-05-21T01:20:00.210838+0000","last_became_active":"2024-05-21T01:19:53.550921+0000","last_became_peered":"2024-05-21T01:19:53.550921+0000","last_unstale":"2024-05-21T01:20:00.210838+0000","last_undegraded":"2024-05-21T01:20:00.210838+0000","last_fullsized":"2024-05-21T01:20:00.210838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T09:31:31.996638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.571559+0000","last_change":"2024-05-21T01:19:58.626472+0000","last_active":"2024-05-21T01:19:59.571559+0000","last_peered":"2024-05-21T01:19:59.571559+0000","last_clean":"2024-05-21T01:19:59.571559+0000","last_became_active":"2024-05-21T01:19:58.625720+0000","last_became_peered":"2024-05-21T01:19:58.625720+0000","last_unstale":"2024-05-21T01:19:59.571559+0000","last_undegraded":"2024-05-21T01:19:59.571559+0000","last_fullsized":"2024-05-21T01:19:59.571559+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:16:03.911585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207190+0000","last_change":"2024-05-21T01:19:54.547947+0000","last_active":"2024-05-21T01:20:00.207190+0000","last_peered":"2024-05-21T01:20:00.207190+0000","last_clean":"2024-05-21T01:20:00.207190+0000","last_became_active":"2024-05-21T01:19:54.547689+0000","last_became_peered":"2024-05-21T01:19:54.547689+0000","last_unstale":"2024-05-21T01:20:00.207190+0000","last_undegraded":"2024-05-21T01:20:00.207190+0000","last_fullsized":"2024-05-21T01:20:00.207190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:40:55.985899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.567365+0000","last_change":"2024-05-21T01:19:53.540973+0000","last_active":"2024-05-21T01:19:59.567365+0000","last_peered":"2024-05-21T01:19:59.567365+0000","last_clean":"2024-05-21T01:19:59.567365+0000","last_became_active":"2024-05-21T01:19:53.540670+0000","last_became_peered":"2024-05-21T01:19:53.540670+0000","last_unstale":"2024-05-21T01:19:59.567365+0000","last_undegraded":"2024-05-21T01:19:59.567365+0000","last_fullsized":"2024-05-21T01:19:59.567365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:08:21.802284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.576864+0000","last_change":"2024-05-21T01:19:58.611280+0000","last_active":"2024-05-21T01:19:59.576864+0000","last_peered":"2024-05-21T01:19:59.576864+0000","last_clean":"2024-05-21T01:19:59.576864+0000","last_became_active":"2024-05-21T01:19:58.610511+0000","last_became_peered":"2024-05-21T01:19:58.610511+0000","last_unstale":"2024-05-21T01:19:59.576864+0000","last_undegraded":"2024-05-21T01:19:59.576864+0000","last_fullsized":"2024-05-21T01:19:59.576864+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:49:19.660422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.209521+0000","last_change":"2024-05-21T01:19:54.572546+0000","last_active":"2024-05-21T01:20:00.209521+0000","last_peered":"2024-05-21T01:20:00.209521+0000","last_clean":"2024-05-21T01:20:00.209521+0000","last_became_active":"2024-05-21T01:19:54.572022+0000","last_became_peered":"2024-05-21T01:19:54.572022+0000","last_unstale":"2024-05-21T01:20:00.209521+0000","last_undegraded":"2024-05-21T01:20:00.209521+0000","last_fullsized":"2024-05-21T01:20:00.209521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:50:08.351383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"25'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.208285+0000","last_change":"2024-05-21T01:19:53.556786+0000","last_active":"2024-05-21T01:20:00.208285+0000","last_peered":"2024-05-21T01:20:00.208285+0000","last_clean":"2024-05-21T01:20:00.208285+0000","last_became_active":"2024-05-21T01:19:53.556143+0000","last_became_peered":"2024-05-21T01:19:53.556143+0000","last_unstale":"2024-05-21T01:20:00.208285+0000","last_undegraded":"2024-05-21T01:20:00.208285+0000","last_fullsized":"2024-05-21T01:20:00.208285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:02:17.391701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.577698+0000","last_change":"2024-05-21T01:19:58.599203+0000","last_active":"2024-05-21T01:19:59.577698+0000","last_peered":"2024-05-21T01:19:59.577698+0000","last_clean":"2024-05-21T01:19:59.577698+0000","last_became_active":"2024-05-21T01:19:58.598175+0000","last_became_peered":"2024-05-21T01:19:58.598175+0000","last_unstale":"2024-05-21T01:19:59.577698+0000","last_undegraded":"2024-05-21T01:19:59.577698+0000","last_fullsized":"2024-05-21T01:19:59.577698+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:45:17.138090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.574222+0000","last_change":"2024-05-21T01:19:54.551092+0000","last_active":"2024-05-21T01:19:59.574222+0000","last_peered":"2024-05-21T01:19:59.574222+0000","last_clean":"2024-05-21T01:19:59.574222+0000","last_became_active":"2024-05-21T01:19:54.550338+0000","last_became_peered":"2024-05-21T01:19:54.550338+0000","last_unstale":"2024-05-21T01:19:59.574222+0000","last_undegraded":"2024-05-21T01:19:59.574222+0000","last_fullsized":"2024-05-21T01:19:59.574222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:29:13.540719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"25'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.566905+0000","last_change":"2024-05-21T01:19:53.554835+0000","last_active":"2024-05-21T01:19:59.566905+0000","last_peered":"2024-05-21T01:19:59.566905+0000","last_clean":"2024-05-21T01:19:59.566905+0000","last_became_active":"2024-05-21T01:19:53.554598+0000","last_became_peered":"2024-05-21T01:19:53.554598+0000","last_unstale":"2024-05-21T01:19:59.566905+0000","last_undegraded":"2024-05-21T01:19:59.566905+0000","last_fullsized":"2024-05-21T01:19:59.566905+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:28:43.940978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.211238+0000","last_change":"2024-05-21T01:19:58.629747+0000","last_active":"2024-05-21T01:20:00.211238+0000","last_peered":"2024-05-21T01:20:00.211238+0000","last_clean":"2024-05-21T01:20:00.211238+0000","last_became_active":"2024-05-21T01:19:58.622106+0000","last_became_peered":"2024-05-21T01:19:58.622106+0000","last_unstale":"2024-05-21T01:20:00.211238+0000","last_undegraded":"2024-05-21T01:20:00.211238+0000","last_fullsized":"2024-05-21T01:20:00.211238+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:22:07.047914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.571255+0000","last_change":"2024-05-21T01:19:54.554303+0000","last_active":"2024-05-21T01:19:59.571255+0000","last_peered":"2024-05-21T01:19:59.571255+0000","last_clean":"2024-05-21T01:19:59.571255+0000","last_became_active":"2024-05-21T01:19:54.552126+0000","last_became_peered":"2024-05-21T01:19:54.552126+0000","last_unstale":"2024-05-21T01:19:59.571255+0000","last_undegraded":"2024-05-21T01:19:59.571255+0000","last_fullsized":"2024-05-21T01:19:59.571255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:59:46.383359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.567302+0000","last_change":"2024-05-21T01:19:53.536580+0000","last_active":"2024-05-21T01:19:59.567302+0000","last_peered":"2024-05-21T01:19:59.567302+0000","last_clean":"2024-05-21T01:19:59.567302+0000","last_became_active":"2024-05-21T01:19:53.535105+0000","last_became_peered":"2024-05-21T01:19:53.535105+0000","last_unstale":"2024-05-21T01:19:59.567302+0000","last_undegraded":"2024-05-21T01:19:59.567302+0000","last_fullsized":"2024-05-21T01:19:59.567302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:58:05.019025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":118,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207611+0000","last_change":"2024-05-21T01:19:49.490062+0000","last_active":"2024-05-21T01:20:00.207611+0000","last_peered":"2024-05-21T01:20:00.207611+0000","last_clean":"2024-05-21T01:20:00.207611+0000","last_became_active":"2024-05-21T01:19:49.488796+0000","last_became_peered":"2024-05-21T01:19:49.488796+0000","last_unstale":"2024-05-21T01:20:00.207611+0000","last_undegraded":"2024-05-21T01:20:00.207611+0000","last_fullsized":"2024-05-21T01:20:00.207611+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:47.457865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:47.457865+0000","last_clean_scrub_stamp":"2024-05-21T01:19:47.457865+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T09:37:06.199150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.568012+0000","last_change":"2024-05-21T01:19:58.590851+0000","last_active":"2024-05-21T01:19:59.568012+0000","last_peered":"2024-05-21T01:19:59.568012+0000","last_clean":"2024-05-21T01:19:59.568012+0000","last_became_active":"2024-05-21T01:19:58.589288+0000","last_became_peered":"2024-05-21T01:19:58.589288+0000","last_unstale":"2024-05-21T01:19:59.568012+0000","last_undegraded":"2024-05-21T01:19:59.568012+0000","last_fullsized":"2024-05-21T01:19:59.568012+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:36:46.992834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.567741+0000","last_change":"2024-05-21T01:19:54.543894+0000","last_active":"2024-05-21T01:19:59.567741+0000","last_peered":"2024-05-21T01:19:59.567741+0000","last_clean":"2024-05-21T01:19:59.567741+0000","last_became_active":"2024-05-21T01:19:54.543586+0000","last_became_peered":"2024-05-21T01:19:54.543586+0000","last_unstale":"2024-05-21T01:19:59.567741+0000","last_undegraded":"2024-05-21T01:19:59.567741+0000","last_fullsized":"2024-05-21T01:19:59.567741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:33:02.756634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.577243+0000","last_change":"2024-05-21T01:19:53.532115+0000","last_active":"2024-05-21T01:19:59.577243+0000","last_peered":"2024-05-21T01:19:59.577243+0000","last_clean":"2024-05-21T01:19:59.577243+0000","last_became_active":"2024-05-21T01:19:53.529879+0000","last_became_peered":"2024-05-21T01:19:53.529879+0000","last_unstale":"2024-05-21T01:19:59.577243+0000","last_undegraded":"2024-05-21T01:19:59.577243+0000","last_fullsized":"2024-05-21T01:19:59.577243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:42:07.436243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.206924+0000","last_change":"2024-05-21T01:19:58.604417+0000","last_active":"2024-05-21T01:20:00.206924+0000","last_peered":"2024-05-21T01:20:00.206924+0000","last_clean":"2024-05-21T01:20:00.206924+0000","last_became_active":"2024-05-21T01:19:58.603929+0000","last_became_peered":"2024-05-21T01:19:58.603929+0000","last_unstale":"2024-05-21T01:20:00.206924+0000","last_undegraded":"2024-05-21T01:20:00.206924+0000","last_fullsized":"2024-05-21T01:20:00.206924+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:15:59.031738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207029+0000","last_change":"2024-05-21T01:19:54.542096+0000","last_active":"2024-05-21T01:20:00.207029+0000","last_peered":"2024-05-21T01:20:00.207029+0000","last_clean":"2024-05-21T01:20:00.207029+0000","last_became_active":"2024-05-21T01:19:54.541837+0000","last_became_peered":"2024-05-21T01:19:54.541837+0000","last_unstale":"2024-05-21T01:20:00.207029+0000","last_undegraded":"2024-05-21T01:20:00.207029+0000","last_fullsized":"2024-05-21T01:20:00.207029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:55:30.807311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.211049+0000","last_change":"2024-05-21T01:19:53.551697+0000","last_active":"2024-05-21T01:20:00.211049+0000","last_peered":"2024-05-21T01:20:00.211049+0000","last_clean":"2024-05-21T01:20:00.211049+0000","last_became_active":"2024-05-21T01:19:53.550893+0000","last_became_peered":"2024-05-21T01:19:53.550893+0000","last_unstale":"2024-05-21T01:20:00.211049+0000","last_undegraded":"2024-05-21T01:20:00.211049+0000","last_fullsized":"2024-05-21T01:20:00.211049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:42:20.295229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.210457+0000","last_change":"2024-05-21T01:19:58.628526+0000","last_active":"2024-05-21T01:20:00.210457+0000","last_peered":"2024-05-21T01:20:00.210457+0000","last_clean":"2024-05-21T01:20:00.210457+0000","last_became_active":"2024-05-21T01:19:58.620667+0000","last_became_peered":"2024-05-21T01:19:58.620667+0000","last_unstale":"2024-05-21T01:20:00.210457+0000","last_undegraded":"2024-05-21T01:20:00.210457+0000","last_fullsized":"2024-05-21T01:20:00.210457+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:46:22.396063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.208496+0000","last_change":"2024-05-21T01:19:54.532551+0000","last_active":"2024-05-21T01:20:00.208496+0000","last_peered":"2024-05-21T01:20:00.208496+0000","last_clean":"2024-05-21T01:20:00.208496+0000","last_became_active":"2024-05-21T01:19:54.532251+0000","last_became_peered":"2024-05-21T01:19:54.532251+0000","last_unstale":"2024-05-21T01:20:00.208496+0000","last_undegraded":"2024-05-21T01:20:00.208496+0000","last_fullsized":"2024-05-21T01:20:00.208496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:00:30.042781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.572555+0000","last_change":"2024-05-21T01:19:53.554659+0000","last_active":"2024-05-21T01:19:59.572555+0000","last_peered":"2024-05-21T01:19:59.572555+0000","last_clean":"2024-05-21T01:19:59.572555+0000","last_became_active":"2024-05-21T01:19:53.553953+0000","last_became_peered":"2024-05-21T01:19:53.553953+0000","last_unstale":"2024-05-21T01:19:59.572555+0000","last_undegraded":"2024-05-21T01:19:59.572555+0000","last_fullsized":"2024-05-21T01:19:59.572555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:31:13.091061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.566596+0000","last_change":"2024-05-21T01:19:58.593243+0000","last_active":"2024-05-21T01:19:59.566596+0000","last_peered":"2024-05-21T01:19:59.566596+0000","last_clean":"2024-05-21T01:19:59.566596+0000","last_became_active":"2024-05-21T01:19:58.592758+0000","last_became_peered":"2024-05-21T01:19:58.592758+0000","last_unstale":"2024-05-21T01:19:59.566596+0000","last_undegraded":"2024-05-21T01:19:59.566596+0000","last_fullsized":"2024-05-21T01:19:59.566596+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:46:17.877736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207962+0000","last_change":"2024-05-21T01:19:54.538391+0000","last_active":"2024-05-21T01:20:00.207962+0000","last_peered":"2024-05-21T01:20:00.207962+0000","last_clean":"2024-05-21T01:20:00.207962+0000","last_became_active":"2024-05-21T01:19:54.538106+0000","last_became_peered":"2024-05-21T01:19:54.538106+0000","last_unstale":"2024-05-21T01:20:00.207962+0000","last_undegraded":"2024-05-21T01:20:00.207962+0000","last_fullsized":"2024-05-21T01:20:00.207962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:36:07.297496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.208540+0000","last_change":"2024-05-21T01:19:53.551917+0000","last_active":"2024-05-21T01:20:00.208540+0000","last_peered":"2024-05-21T01:20:00.208540+0000","last_clean":"2024-05-21T01:20:00.208540+0000","last_became_active":"2024-05-21T01:19:53.551608+0000","last_became_peered":"2024-05-21T01:19:53.551608+0000","last_unstale":"2024-05-21T01:20:00.208540+0000","last_undegraded":"2024-05-21T01:20:00.208540+0000","last_fullsized":"2024-05-21T01:20:00.208540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:20:54.093966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.208119+0000","last_change":"2024-05-21T01:19:58.613367+0000","last_active":"2024-05-21T01:20:00.208119+0000","last_peered":"2024-05-21T01:20:00.208119+0000","last_clean":"2024-05-21T01:20:00.208119+0000","last_became_active":"2024-05-21T01:19:58.612950+0000","last_became_peered":"2024-05-21T01:19:58.612950+0000","last_unstale":"2024-05-21T01:20:00.208119+0000","last_undegraded":"2024-05-21T01:20:00.208119+0000","last_fullsized":"2024-05-21T01:20:00.208119+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:32:12.365734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.566761+0000","last_change":"2024-05-21T01:19:54.548979+0000","last_active":"2024-05-21T01:19:59.566761+0000","last_peered":"2024-05-21T01:19:59.566761+0000","last_clean":"2024-05-21T01:19:59.566761+0000","last_became_active":"2024-05-21T01:19:54.548704+0000","last_became_peered":"2024-05-21T01:19:54.548704+0000","last_unstale":"2024-05-21T01:19:59.566761+0000","last_undegraded":"2024-05-21T01:19:59.566761+0000","last_fullsized":"2024-05-21T01:19:59.566761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:57:09.076705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"25'10","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:24.653856+0000","last_change":"2024-05-21T01:19:53.542425+0000","last_active":"2024-05-21T01:20:24.653856+0000","last_peered":"2024-05-21T01:20:24.653856+0000","last_clean":"2024-05-21T01:20:24.653856+0000","last_became_active":"2024-05-21T01:19:53.541577+0000","last_became_peered":"2024-05-21T01:19:53.541577+0000","last_unstale":"2024-05-21T01:20:24.653856+0000","last_undegraded":"2024-05-21T01:20:24.653856+0000","last_fullsized":"2024-05-21T01:20:24.653856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:47:54.892789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.211663+0000","last_change":"2024-05-21T01:19:58.630293+0000","last_active":"2024-05-21T01:20:00.211663+0000","last_peered":"2024-05-21T01:20:00.211663+0000","last_clean":"2024-05-21T01:20:00.211663+0000","last_became_active":"2024-05-21T01:19:58.629119+0000","last_became_peered":"2024-05-21T01:19:58.629119+0000","last_unstale":"2024-05-21T01:20:00.211663+0000","last_undegraded":"2024-05-21T01:20:00.211663+0000","last_fullsized":"2024-05-21T01:20:00.211663+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:10:45.318517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207523+0000","last_change":"2024-05-21T01:19:54.575541+0000","last_active":"2024-05-21T01:20:00.207523+0000","last_peered":"2024-05-21T01:20:00.207523+0000","last_clean":"2024-05-21T01:20:00.207523+0000","last_became_active":"2024-05-21T01:19:54.575314+0000","last_became_peered":"2024-05-21T01:19:54.575314+0000","last_unstale":"2024-05-21T01:20:00.207523+0000","last_undegraded":"2024-05-21T01:20:00.207523+0000","last_fullsized":"2024-05-21T01:20:00.207523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:02:36.840590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.206224+0000","last_change":"2024-05-21T01:19:53.523758+0000","last_active":"2024-05-21T01:20:00.206224+0000","last_peered":"2024-05-21T01:20:00.206224+0000","last_clean":"2024-05-21T01:20:00.206224+0000","last_became_active":"2024-05-21T01:19:53.523273+0000","last_became_peered":"2024-05-21T01:19:53.523273+0000","last_unstale":"2024-05-21T01:20:00.206224+0000","last_undegraded":"2024-05-21T01:20:00.206224+0000","last_fullsized":"2024-05-21T01:20:00.206224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:05:47.275193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.211601+0000","last_change":"2024-05-21T01:19:58.621996+0000","last_active":"2024-05-21T01:20:00.211601+0000","last_peered":"2024-05-21T01:20:00.211601+0000","last_clean":"2024-05-21T01:20:00.211601+0000","last_became_active":"2024-05-21T01:19:58.620552+0000","last_became_peered":"2024-05-21T01:19:58.620552+0000","last_unstale":"2024-05-21T01:20:00.211601+0000","last_undegraded":"2024-05-21T01:20:00.211601+0000","last_fullsized":"2024-05-21T01:20:00.211601+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:58:32.635003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.567139+0000","last_change":"2024-05-21T01:19:54.557379+0000","last_active":"2024-05-21T01:19:59.567139+0000","last_peered":"2024-05-21T01:19:59.567139+0000","last_clean":"2024-05-21T01:19:59.567139+0000","last_became_active":"2024-05-21T01:19:54.550335+0000","last_became_peered":"2024-05-21T01:19:54.550335+0000","last_unstale":"2024-05-21T01:19:59.567139+0000","last_undegraded":"2024-05-21T01:19:59.567139+0000","last_fullsized":"2024-05-21T01:19:59.567139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:24:52.297888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"25'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:24.658932+0000","last_change":"2024-05-21T01:19:53.534431+0000","last_active":"2024-05-21T01:20:24.658932+0000","last_peered":"2024-05-21T01:20:24.658932+0000","last_clean":"2024-05-21T01:20:24.658932+0000","last_became_active":"2024-05-21T01:19:53.534174+0000","last_became_peered":"2024-05-21T01:19:53.534174+0000","last_unstale":"2024-05-21T01:20:24.658932+0000","last_undegraded":"2024-05-21T01:20:24.658932+0000","last_fullsized":"2024-05-21T01:20:24.658932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:42:04.743914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.576325+0000","last_change":"2024-05-21T01:19:58.609289+0000","last_active":"2024-05-21T01:19:59.576325+0000","last_peered":"2024-05-21T01:19:59.576325+0000","last_clean":"2024-05-21T01:19:59.576325+0000","last_became_active":"2024-05-21T01:19:58.608371+0000","last_became_peered":"2024-05-21T01:19:58.608371+0000","last_unstale":"2024-05-21T01:19:59.576325+0000","last_undegraded":"2024-05-21T01:19:59.576325+0000","last_fullsized":"2024-05-21T01:19:59.576325+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:27:36.997803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.575122+0000","last_change":"2024-05-21T01:19:54.551617+0000","last_active":"2024-05-21T01:19:59.575122+0000","last_peered":"2024-05-21T01:19:59.575122+0000","last_clean":"2024-05-21T01:19:59.575122+0000","last_became_active":"2024-05-21T01:19:54.550865+0000","last_became_peered":"2024-05-21T01:19:54.550865+0000","last_unstale":"2024-05-21T01:19:59.575122+0000","last_undegraded":"2024-05-21T01:19:59.575122+0000","last_fullsized":"2024-05-21T01:19:59.575122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:32:44.168265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"25'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:24.661044+0000","last_change":"2024-05-21T01:19:53.535936+0000","last_active":"2024-05-21T01:20:24.661044+0000","last_peered":"2024-05-21T01:20:24.661044+0000","last_clean":"2024-05-21T01:20:24.661044+0000","last_became_active":"2024-05-21T01:19:53.535143+0000","last_became_peered":"2024-05-21T01:19:53.535143+0000","last_unstale":"2024-05-21T01:20:24.661044+0000","last_undegraded":"2024-05-21T01:20:24.661044+0000","last_fullsized":"2024-05-21T01:20:24.661044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:50:51.433726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.567570+0000","last_change":"2024-05-21T01:19:58.622615+0000","last_active":"2024-05-21T01:19:59.567570+0000","last_peered":"2024-05-21T01:19:59.567570+0000","last_clean":"2024-05-21T01:19:59.567570+0000","last_became_active":"2024-05-21T01:19:58.622250+0000","last_became_peered":"2024-05-21T01:19:58.622250+0000","last_unstale":"2024-05-21T01:19:59.567570+0000","last_undegraded":"2024-05-21T01:19:59.567570+0000","last_fullsized":"2024-05-21T01:19:59.567570+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:05:22.913945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207577+0000","last_change":"2024-05-21T01:19:54.558348+0000","last_active":"2024-05-21T01:20:00.207577+0000","last_peered":"2024-05-21T01:20:00.207577+0000","last_clean":"2024-05-21T01:20:00.207577+0000","last_became_active":"2024-05-21T01:19:54.558095+0000","last_became_peered":"2024-05-21T01:19:54.558095+0000","last_unstale":"2024-05-21T01:20:00.207577+0000","last_undegraded":"2024-05-21T01:20:00.207577+0000","last_fullsized":"2024-05-21T01:20:00.207577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:43:48.625583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:09.561570+0000","last_change":"2024-05-21T01:19:53.534947+0000","last_active":"2024-05-21T01:20:09.561570+0000","last_peered":"2024-05-21T01:20:09.561570+0000","last_clean":"2024-05-21T01:20:09.561570+0000","last_became_active":"2024-05-21T01:19:53.534616+0000","last_became_peered":"2024-05-21T01:19:53.534616+0000","last_unstale":"2024-05-21T01:20:09.561570+0000","last_undegraded":"2024-05-21T01:20:09.561570+0000","last_fullsized":"2024-05-21T01:20:09.561570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:01:25.372035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.571116+0000","last_change":"2024-05-21T01:19:58.617970+0000","last_active":"2024-05-21T01:19:59.571116+0000","last_peered":"2024-05-21T01:19:59.571116+0000","last_clean":"2024-05-21T01:19:59.571116+0000","last_became_active":"2024-05-21T01:19:58.617061+0000","last_became_peered":"2024-05-21T01:19:58.617061+0000","last_unstale":"2024-05-21T01:19:59.571116+0000","last_undegraded":"2024-05-21T01:19:59.571116+0000","last_fullsized":"2024-05-21T01:19:59.571116+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:48:50.703577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.567205+0000","last_change":"2024-05-21T01:19:54.557175+0000","last_active":"2024-05-21T01:19:59.567205+0000","last_peered":"2024-05-21T01:19:59.567205+0000","last_clean":"2024-05-21T01:19:59.567205+0000","last_became_active":"2024-05-21T01:19:54.556933+0000","last_became_peered":"2024-05-21T01:19:54.556933+0000","last_unstale":"2024-05-21T01:19:59.567205+0000","last_undegraded":"2024-05-21T01:19:59.567205+0000","last_fullsized":"2024-05-21T01:19:59.567205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:15:44.089544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"25'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.208892+0000","last_change":"2024-05-21T01:19:53.536780+0000","last_active":"2024-05-21T01:20:00.208892+0000","last_peered":"2024-05-21T01:20:00.208892+0000","last_clean":"2024-05-21T01:20:00.208892+0000","last_became_active":"2024-05-21T01:19:53.535768+0000","last_became_peered":"2024-05-21T01:19:53.535768+0000","last_unstale":"2024-05-21T01:20:00.208892+0000","last_undegraded":"2024-05-21T01:20:00.208892+0000","last_fullsized":"2024-05-21T01:20:00.208892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:04:14.732801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207120+0000","last_change":"2024-05-21T01:19:58.606532+0000","last_active":"2024-05-21T01:20:00.207120+0000","last_peered":"2024-05-21T01:20:00.207120+0000","last_clean":"2024-05-21T01:20:00.207120+0000","last_became_active":"2024-05-21T01:19:58.606180+0000","last_became_peered":"2024-05-21T01:19:58.606180+0000","last_unstale":"2024-05-21T01:20:00.207120+0000","last_undegraded":"2024-05-21T01:20:00.207120+0000","last_fullsized":"2024-05-21T01:20:00.207120+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:25:31.161427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.211807+0000","last_change":"2024-05-21T01:19:54.571280+0000","last_active":"2024-05-21T01:20:00.211807+0000","last_peered":"2024-05-21T01:20:00.211807+0000","last_clean":"2024-05-21T01:20:00.211807+0000","last_became_active":"2024-05-21T01:19:54.568778+0000","last_became_peered":"2024-05-21T01:19:54.568778+0000","last_unstale":"2024-05-21T01:20:00.211807+0000","last_undegraded":"2024-05-21T01:20:00.211807+0000","last_fullsized":"2024-05-21T01:20:00.211807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:43:16.583632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.208476+0000","last_change":"2024-05-21T01:19:53.530770+0000","last_active":"2024-05-21T01:20:00.208476+0000","last_peered":"2024-05-21T01:20:00.208476+0000","last_clean":"2024-05-21T01:20:00.208476+0000","last_became_active":"2024-05-21T01:19:53.526431+0000","last_became_peered":"2024-05-21T01:19:53.526431+0000","last_unstale":"2024-05-21T01:20:00.208476+0000","last_undegraded":"2024-05-21T01:20:00.208476+0000","last_fullsized":"2024-05-21T01:20:00.208476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:08:59.892029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.208009+0000","last_change":"2024-05-21T01:19:58.611576+0000","last_active":"2024-05-21T01:20:00.208009+0000","last_peered":"2024-05-21T01:20:00.208009+0000","last_clean":"2024-05-21T01:20:00.208009+0000","last_became_active":"2024-05-21T01:19:58.610838+0000","last_became_peered":"2024-05-21T01:19:58.610838+0000","last_unstale":"2024-05-21T01:20:00.208009+0000","last_undegraded":"2024-05-21T01:20:00.208009+0000","last_fullsized":"2024-05-21T01:20:00.208009+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:07:31.736640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207957+0000","last_change":"2024-05-21T01:19:54.552709+0000","last_active":"2024-05-21T01:20:00.207957+0000","last_peered":"2024-05-21T01:20:00.207957+0000","last_clean":"2024-05-21T01:20:00.207957+0000","last_became_active":"2024-05-21T01:19:54.547898+0000","last_became_peered":"2024-05-21T01:19:54.547898+0000","last_unstale":"2024-05-21T01:20:00.207957+0000","last_undegraded":"2024-05-21T01:20:00.207957+0000","last_fullsized":"2024-05-21T01:20:00.207957+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:20:17.933506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.209704+0000","last_change":"2024-05-21T01:19:53.534507+0000","last_active":"2024-05-21T01:20:00.209704+0000","last_peered":"2024-05-21T01:20:00.209704+0000","last_clean":"2024-05-21T01:20:00.209704+0000","last_became_active":"2024-05-21T01:19:53.534036+0000","last_became_peered":"2024-05-21T01:19:53.534036+0000","last_unstale":"2024-05-21T01:20:00.209704+0000","last_undegraded":"2024-05-21T01:20:00.209704+0000","last_fullsized":"2024-05-21T01:20:00.209704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:01:08.218098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.572286+0000","last_change":"2024-05-21T01:19:58.608135+0000","last_active":"2024-05-21T01:19:59.572286+0000","last_peered":"2024-05-21T01:19:59.572286+0000","last_clean":"2024-05-21T01:19:59.572286+0000","last_became_active":"2024-05-21T01:19:58.607242+0000","last_became_peered":"2024-05-21T01:19:58.607242+0000","last_unstale":"2024-05-21T01:19:59.572286+0000","last_undegraded":"2024-05-21T01:19:59.572286+0000","last_fullsized":"2024-05-21T01:19:59.572286+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:05:26.197876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.572239+0000","last_change":"2024-05-21T01:19:58.624883+0000","last_active":"2024-05-21T01:19:59.572239+0000","last_peered":"2024-05-21T01:19:59.572239+0000","last_clean":"2024-05-21T01:19:59.572239+0000","last_became_active":"2024-05-21T01:19:58.623991+0000","last_became_peered":"2024-05-21T01:19:58.623991+0000","last_unstale":"2024-05-21T01:19:59.572239+0000","last_undegraded":"2024-05-21T01:19:59.572239+0000","last_fullsized":"2024-05-21T01:19:59.572239+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:29:26.251376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.572416+0000","last_change":"2024-05-21T01:19:54.549215+0000","last_active":"2024-05-21T01:19:59.572416+0000","last_peered":"2024-05-21T01:19:59.572416+0000","last_clean":"2024-05-21T01:19:59.572416+0000","last_became_active":"2024-05-21T01:19:54.548426+0000","last_became_peered":"2024-05-21T01:19:54.548426+0000","last_unstale":"2024-05-21T01:19:59.572416+0000","last_undegraded":"2024-05-21T01:19:59.572416+0000","last_fullsized":"2024-05-21T01:19:59.572416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:10:10.800391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"25'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.566886+0000","last_change":"2024-05-21T01:19:53.526106+0000","last_active":"2024-05-21T01:19:59.566886+0000","last_peered":"2024-05-21T01:19:59.566886+0000","last_clean":"2024-05-21T01:19:59.566886+0000","last_became_active":"2024-05-21T01:19:53.525786+0000","last_became_peered":"2024-05-21T01:19:53.525786+0000","last_unstale":"2024-05-21T01:19:59.566886+0000","last_undegraded":"2024-05-21T01:19:59.566886+0000","last_fullsized":"2024-05-21T01:19:59.566886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:01:05.180803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.567758+0000","last_change":"2024-05-21T01:19:58.615481+0000","last_active":"2024-05-21T01:19:59.567758+0000","last_peered":"2024-05-21T01:19:59.567758+0000","last_clean":"2024-05-21T01:19:59.567758+0000","last_became_active":"2024-05-21T01:19:58.614879+0000","last_became_peered":"2024-05-21T01:19:58.614879+0000","last_unstale":"2024-05-21T01:19:59.567758+0000","last_undegraded":"2024-05-21T01:19:59.567758+0000","last_fullsized":"2024-05-21T01:19:59.567758+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:45:57.208342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.209731+0000","last_change":"2024-05-21T01:19:54.570650+0000","last_active":"2024-05-21T01:20:00.209731+0000","last_peered":"2024-05-21T01:20:00.209731+0000","last_clean":"2024-05-21T01:20:00.209731+0000","last_became_active":"2024-05-21T01:19:54.570034+0000","last_became_peered":"2024-05-21T01:19:54.570034+0000","last_unstale":"2024-05-21T01:20:00.209731+0000","last_undegraded":"2024-05-21T01:20:00.209731+0000","last_fullsized":"2024-05-21T01:20:00.209731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:01:05.887729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.574517+0000","last_change":"2024-05-21T01:19:53.532017+0000","last_active":"2024-05-21T01:19:59.574517+0000","last_peered":"2024-05-21T01:19:59.574517+0000","last_clean":"2024-05-21T01:19:59.574517+0000","last_became_active":"2024-05-21T01:19:53.529457+0000","last_became_peered":"2024-05-21T01:19:53.529457+0000","last_unstale":"2024-05-21T01:19:59.574517+0000","last_undegraded":"2024-05-21T01:19:59.574517+0000","last_fullsized":"2024-05-21T01:19:59.574517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:58:03.979929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.567307+0000","last_change":"2024-05-21T01:19:53.525620+0000","last_active":"2024-05-21T01:19:59.567307+0000","last_peered":"2024-05-21T01:19:59.567307+0000","last_clean":"2024-05-21T01:19:59.567307+0000","last_became_active":"2024-05-21T01:19:53.525315+0000","last_became_peered":"2024-05-21T01:19:53.525315+0000","last_unstale":"2024-05-21T01:19:59.567307+0000","last_undegraded":"2024-05-21T01:19:59.567307+0000","last_fullsized":"2024-05-21T01:19:59.567307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:30:38.075463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.571359+0000","last_change":"2024-05-21T01:19:54.555344+0000","last_active":"2024-05-21T01:19:59.571359+0000","last_peered":"2024-05-21T01:19:59.571359+0000","last_clean":"2024-05-21T01:19:59.571359+0000","last_became_active":"2024-05-21T01:19:54.552817+0000","last_became_peered":"2024-05-21T01:19:54.552817+0000","last_unstale":"2024-05-21T01:19:59.571359+0000","last_undegraded":"2024-05-21T01:19:59.571359+0000","last_fullsized":"2024-05-21T01:19:59.571359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:10:03.810064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.572198+0000","last_change":"2024-05-21T01:19:58.619520+0000","last_active":"2024-05-21T01:19:59.572198+0000","last_peered":"2024-05-21T01:19:59.572198+0000","last_clean":"2024-05-21T01:19:59.572198+0000","last_became_active":"2024-05-21T01:19:58.617165+0000","last_became_peered":"2024-05-21T01:19:58.617165+0000","last_unstale":"2024-05-21T01:19:59.572198+0000","last_undegraded":"2024-05-21T01:19:59.572198+0000","last_fullsized":"2024-05-21T01:19:59.572198+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T13:07:51.530746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"25'5","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:24.652930+0000","last_change":"2024-05-21T01:19:53.551547+0000","last_active":"2024-05-21T01:20:24.652930+0000","last_peered":"2024-05-21T01:20:24.652930+0000","last_clean":"2024-05-21T01:20:24.652930+0000","last_became_active":"2024-05-21T01:19:53.550931+0000","last_became_peered":"2024-05-21T01:19:53.550931+0000","last_unstale":"2024-05-21T01:20:24.652930+0000","last_undegraded":"2024-05-21T01:20:24.652930+0000","last_fullsized":"2024-05-21T01:20:24.652930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:13:47.329230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.208939+0000","last_change":"2024-05-21T01:19:54.574552+0000","last_active":"2024-05-21T01:20:00.208939+0000","last_peered":"2024-05-21T01:20:00.208939+0000","last_clean":"2024-05-21T01:20:00.208939+0000","last_became_active":"2024-05-21T01:19:54.574246+0000","last_became_peered":"2024-05-21T01:19:54.574246+0000","last_unstale":"2024-05-21T01:20:00.208939+0000","last_undegraded":"2024-05-21T01:20:00.208939+0000","last_fullsized":"2024-05-21T01:20:00.208939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:23:33.685798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.208672+0000","last_change":"2024-05-21T01:19:58.624400+0000","last_active":"2024-05-21T01:20:00.208672+0000","last_peered":"2024-05-21T01:20:00.208672+0000","last_clean":"2024-05-21T01:20:00.208672+0000","last_became_active":"2024-05-21T01:19:58.623388+0000","last_became_peered":"2024-05-21T01:19:58.623388+0000","last_unstale":"2024-05-21T01:20:00.208672+0000","last_undegraded":"2024-05-21T01:20:00.208672+0000","last_fullsized":"2024-05-21T01:20:00.208672+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:59:30.019393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.206641+0000","last_change":"2024-05-21T01:19:54.553262+0000","last_active":"2024-05-21T01:20:00.206641+0000","last_peered":"2024-05-21T01:20:00.206641+0000","last_clean":"2024-05-21T01:20:00.206641+0000","last_became_active":"2024-05-21T01:19:54.553060+0000","last_became_peered":"2024-05-21T01:19:54.553060+0000","last_unstale":"2024-05-21T01:20:00.206641+0000","last_undegraded":"2024-05-21T01:20:00.206641+0000","last_fullsized":"2024-05-21T01:20:00.206641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:18:14.077480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207978+0000","last_change":"2024-05-21T01:19:54.566851+0000","last_active":"2024-05-21T01:20:00.207978+0000","last_peered":"2024-05-21T01:20:00.207978+0000","last_clean":"2024-05-21T01:20:00.207978+0000","last_became_active":"2024-05-21T01:19:54.565573+0000","last_became_peered":"2024-05-21T01:19:54.565573+0000","last_unstale":"2024-05-21T01:20:00.207978+0000","last_undegraded":"2024-05-21T01:20:00.207978+0000","last_fullsized":"2024-05-21T01:20:00.207978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:51:30.883954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.566981+0000","last_change":"2024-05-21T01:19:54.566934+0000","last_active":"2024-05-21T01:19:59.566981+0000","last_peered":"2024-05-21T01:19:59.566981+0000","last_clean":"2024-05-21T01:19:59.566981+0000","last_became_active":"2024-05-21T01:19:54.566503+0000","last_became_peered":"2024-05-21T01:19:54.566503+0000","last_unstale":"2024-05-21T01:19:59.566981+0000","last_undegraded":"2024-05-21T01:19:59.566981+0000","last_fullsized":"2024-05-21T01:19:59.566981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:14:54.262165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.210361+0000","last_change":"2024-05-21T01:19:54.573091+0000","last_active":"2024-05-21T01:20:00.210361+0000","last_peered":"2024-05-21T01:20:00.210361+0000","last_clean":"2024-05-21T01:20:00.210361+0000","last_became_active":"2024-05-21T01:19:54.572366+0000","last_became_peered":"2024-05-21T01:19:54.572366+0000","last_unstale":"2024-05-21T01:20:00.210361+0000","last_undegraded":"2024-05-21T01:20:00.210361+0000","last_fullsized":"2024-05-21T01:20:00.210361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:10:09.353807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.576980+0000","last_change":"2024-05-21T01:19:54.563339+0000","last_active":"2024-05-21T01:19:59.576980+0000","last_peered":"2024-05-21T01:19:59.576980+0000","last_clean":"2024-05-21T01:19:59.576980+0000","last_became_active":"2024-05-21T01:19:54.557934+0000","last_became_peered":"2024-05-21T01:19:54.557934+0000","last_unstale":"2024-05-21T01:19:59.576980+0000","last_undegraded":"2024-05-21T01:19:59.576980+0000","last_fullsized":"2024-05-21T01:19:59.576980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:46:21.598689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.577198+0000","last_change":"2024-05-21T01:19:54.553551+0000","last_active":"2024-05-21T01:19:59.577198+0000","last_peered":"2024-05-21T01:19:59.577198+0000","last_clean":"2024-05-21T01:19:59.577198+0000","last_became_active":"2024-05-21T01:19:54.552812+0000","last_became_peered":"2024-05-21T01:19:54.552812+0000","last_unstale":"2024-05-21T01:19:59.577198+0000","last_undegraded":"2024-05-21T01:19:59.577198+0000","last_fullsized":"2024-05-21T01:19:59.577198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:27:41.166606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207853+0000","last_change":"2024-05-21T01:19:54.548604+0000","last_active":"2024-05-21T01:20:00.207853+0000","last_peered":"2024-05-21T01:20:00.207853+0000","last_clean":"2024-05-21T01:20:00.207853+0000","last_became_active":"2024-05-21T01:19:54.548263+0000","last_became_peered":"2024-05-21T01:19:54.548263+0000","last_unstale":"2024-05-21T01:20:00.207853+0000","last_undegraded":"2024-05-21T01:20:00.207853+0000","last_fullsized":"2024-05-21T01:20:00.207853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:33:55.302088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.211381+0000","last_change":"2024-05-21T01:19:54.573995+0000","last_active":"2024-05-21T01:20:00.211381+0000","last_peered":"2024-05-21T01:20:00.211381+0000","last_clean":"2024-05-21T01:20:00.211381+0000","last_became_active":"2024-05-21T01:19:54.570373+0000","last_became_peered":"2024-05-21T01:19:54.570373+0000","last_unstale":"2024-05-21T01:20:00.211381+0000","last_undegraded":"2024-05-21T01:20:00.211381+0000","last_fullsized":"2024-05-21T01:20:00.211381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:44:23.194713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.566746+0000","last_change":"2024-05-21T01:19:54.575196+0000","last_active":"2024-05-21T01:19:59.566746+0000","last_peered":"2024-05-21T01:19:59.566746+0000","last_clean":"2024-05-21T01:19:59.566746+0000","last_became_active":"2024-05-21T01:19:54.574945+0000","last_became_peered":"2024-05-21T01:19:54.574945+0000","last_unstale":"2024-05-21T01:19:59.566746+0000","last_undegraded":"2024-05-21T01:19:59.566746+0000","last_fullsized":"2024-05-21T01:19:59.566746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:52:56.244771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.209915+0000","last_change":"2024-05-21T01:19:54.566719+0000","last_active":"2024-05-21T01:20:00.209915+0000","last_peered":"2024-05-21T01:20:00.209915+0000","last_clean":"2024-05-21T01:20:00.209915+0000","last_became_active":"2024-05-21T01:19:54.565922+0000","last_became_peered":"2024-05-21T01:19:54.565922+0000","last_unstale":"2024-05-21T01:20:00.209915+0000","last_undegraded":"2024-05-21T01:20:00.209915+0000","last_fullsized":"2024-05-21T01:20:00.209915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:39:19.454688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.208888+0000","last_change":"2024-05-21T01:19:54.536815+0000","last_active":"2024-05-21T01:20:00.208888+0000","last_peered":"2024-05-21T01:20:00.208888+0000","last_clean":"2024-05-21T01:20:00.208888+0000","last_became_active":"2024-05-21T01:19:54.535957+0000","last_became_peered":"2024-05-21T01:19:54.535957+0000","last_unstale":"2024-05-21T01:20:00.208888+0000","last_undegraded":"2024-05-21T01:20:00.208888+0000","last_fullsized":"2024-05-21T01:20:00.208888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:24:53.906256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.571247+0000","last_change":"2024-05-21T01:19:54.552466+0000","last_active":"2024-05-21T01:19:59.571247+0000","last_peered":"2024-05-21T01:19:59.571247+0000","last_clean":"2024-05-21T01:19:59.571247+0000","last_became_active":"2024-05-21T01:19:54.551790+0000","last_became_peered":"2024-05-21T01:19:54.551790+0000","last_unstale":"2024-05-21T01:19:59.571247+0000","last_undegraded":"2024-05-21T01:19:59.571247+0000","last_fullsized":"2024-05-21T01:19:59.571247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:24:34.737707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.206948+0000","last_change":"2024-05-21T01:19:54.535314+0000","last_active":"2024-05-21T01:20:00.206948+0000","last_peered":"2024-05-21T01:20:00.206948+0000","last_clean":"2024-05-21T01:20:00.206948+0000","last_became_active":"2024-05-21T01:19:54.534793+0000","last_became_peered":"2024-05-21T01:19:54.534793+0000","last_unstale":"2024-05-21T01:20:00.206948+0000","last_undegraded":"2024-05-21T01:20:00.206948+0000","last_fullsized":"2024-05-21T01:20:00.206948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:52:35.492250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.568120+0000","last_change":"2024-05-21T01:19:54.556323+0000","last_active":"2024-05-21T01:19:59.568120+0000","last_peered":"2024-05-21T01:19:59.568120+0000","last_clean":"2024-05-21T01:19:59.568120+0000","last_became_active":"2024-05-21T01:19:54.556043+0000","last_became_peered":"2024-05-21T01:19:54.556043+0000","last_unstale":"2024-05-21T01:19:59.568120+0000","last_undegraded":"2024-05-21T01:19:59.568120+0000","last_fullsized":"2024-05-21T01:19:59.568120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:34:02.068527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.209056+0000","last_change":"2024-05-21T01:19:54.567457+0000","last_active":"2024-05-21T01:20:00.209056+0000","last_peered":"2024-05-21T01:20:00.209056+0000","last_clean":"2024-05-21T01:20:00.209056+0000","last_became_active":"2024-05-21T01:19:54.565326+0000","last_became_peered":"2024-05-21T01:19:54.565326+0000","last_unstale":"2024-05-21T01:20:00.209056+0000","last_undegraded":"2024-05-21T01:20:00.209056+0000","last_fullsized":"2024-05-21T01:20:00.209056+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:11:05.775389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.568111+0000","last_change":"2024-05-21T01:19:54.562078+0000","last_active":"2024-05-21T01:19:59.568111+0000","last_peered":"2024-05-21T01:19:59.568111+0000","last_clean":"2024-05-21T01:19:59.568111+0000","last_became_active":"2024-05-21T01:19:54.558286+0000","last_became_peered":"2024-05-21T01:19:54.558286+0000","last_unstale":"2024-05-21T01:19:59.568111+0000","last_undegraded":"2024-05-21T01:19:59.568111+0000","last_fullsized":"2024-05-21T01:19:59.568111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T09:09:58.360014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.566714+0000","last_change":"2024-05-21T01:19:54.548274+0000","last_active":"2024-05-21T01:19:59.566714+0000","last_peered":"2024-05-21T01:19:59.566714+0000","last_clean":"2024-05-21T01:19:59.566714+0000","last_became_active":"2024-05-21T01:19:54.548079+0000","last_became_peered":"2024-05-21T01:19:54.548079+0000","last_unstale":"2024-05-21T01:19:59.566714+0000","last_undegraded":"2024-05-21T01:19:59.566714+0000","last_fullsized":"2024-05-21T01:19:59.566714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:49:03.296571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.209656+0000","last_change":"2024-05-21T01:19:54.568211+0000","last_active":"2024-05-21T01:20:00.209656+0000","last_peered":"2024-05-21T01:20:00.209656+0000","last_clean":"2024-05-21T01:20:00.209656+0000","last_became_active":"2024-05-21T01:19:54.567512+0000","last_became_peered":"2024-05-21T01:19:54.567512+0000","last_unstale":"2024-05-21T01:20:00.209656+0000","last_undegraded":"2024-05-21T01:20:00.209656+0000","last_fullsized":"2024-05-21T01:20:00.209656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:32:18.004763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.575120+0000","last_change":"2024-05-21T01:19:54.556683+0000","last_active":"2024-05-21T01:19:59.575120+0000","last_peered":"2024-05-21T01:19:59.575120+0000","last_clean":"2024-05-21T01:19:59.575120+0000","last_became_active":"2024-05-21T01:19:54.555947+0000","last_became_peered":"2024-05-21T01:19:54.555947+0000","last_unstale":"2024-05-21T01:19:59.575120+0000","last_undegraded":"2024-05-21T01:19:59.575120+0000","last_fullsized":"2024-05-21T01:19:59.575120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:59:04.593946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.575926+0000","last_change":"2024-05-21T01:19:54.560218+0000","last_active":"2024-05-21T01:19:59.575926+0000","last_peered":"2024-05-21T01:19:59.575926+0000","last_clean":"2024-05-21T01:19:59.575926+0000","last_became_active":"2024-05-21T01:19:54.557787+0000","last_became_peered":"2024-05-21T01:19:54.557787+0000","last_unstale":"2024-05-21T01:19:59.575926+0000","last_undegraded":"2024-05-21T01:19:59.575926+0000","last_fullsized":"2024-05-21T01:19:59.575926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:05:48.282563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.206865+0000","last_change":"2024-05-21T01:19:54.535096+0000","last_active":"2024-05-21T01:20:00.206865+0000","last_peered":"2024-05-21T01:20:00.206865+0000","last_clean":"2024-05-21T01:20:00.206865+0000","last_became_active":"2024-05-21T01:19:54.534472+0000","last_became_peered":"2024-05-21T01:19:54.534472+0000","last_unstale":"2024-05-21T01:20:00.206865+0000","last_undegraded":"2024-05-21T01:20:00.206865+0000","last_fullsized":"2024-05-21T01:20:00.206865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:05:40.018457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207495+0000","last_change":"2024-05-21T01:19:54.546352+0000","last_active":"2024-05-21T01:20:00.207495+0000","last_peered":"2024-05-21T01:20:00.207495+0000","last_clean":"2024-05-21T01:20:00.207495+0000","last_became_active":"2024-05-21T01:19:54.546055+0000","last_became_peered":"2024-05-21T01:19:54.546055+0000","last_unstale":"2024-05-21T01:20:00.207495+0000","last_undegraded":"2024-05-21T01:20:00.207495+0000","last_fullsized":"2024-05-21T01:20:00.207495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:14:56.268312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.208385+0000","last_change":"2024-05-21T01:19:54.539886+0000","last_active":"2024-05-21T01:20:00.208385+0000","last_peered":"2024-05-21T01:20:00.208385+0000","last_clean":"2024-05-21T01:20:00.208385+0000","last_became_active":"2024-05-21T01:19:54.539599+0000","last_became_peered":"2024-05-21T01:19:54.539599+0000","last_unstale":"2024-05-21T01:20:00.208385+0000","last_undegraded":"2024-05-21T01:20:00.208385+0000","last_fullsized":"2024-05-21T01:20:00.208385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:08:51.107275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.209668+0000","last_change":"2024-05-21T01:19:54.548954+0000","last_active":"2024-05-21T01:20:00.209668+0000","last_peered":"2024-05-21T01:20:00.209668+0000","last_clean":"2024-05-21T01:20:00.209668+0000","last_became_active":"2024-05-21T01:19:54.547528+0000","last_became_peered":"2024-05-21T01:19:54.547528+0000","last_unstale":"2024-05-21T01:20:00.209668+0000","last_undegraded":"2024-05-21T01:20:00.209668+0000","last_fullsized":"2024-05-21T01:20:00.209668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:47:24.598610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.209472+0000","last_change":"2024-05-21T01:19:54.575256+0000","last_active":"2024-05-21T01:20:00.209472+0000","last_peered":"2024-05-21T01:20:00.209472+0000","last_clean":"2024-05-21T01:20:00.209472+0000","last_became_active":"2024-05-21T01:19:54.570119+0000","last_became_peered":"2024-05-21T01:19:54.570119+0000","last_unstale":"2024-05-21T01:20:00.209472+0000","last_undegraded":"2024-05-21T01:20:00.209472+0000","last_fullsized":"2024-05-21T01:20:00.209472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:10:02.800110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.206200+0000","last_change":"2024-05-21T01:19:54.550134+0000","last_active":"2024-05-21T01:20:00.206200+0000","last_peered":"2024-05-21T01:20:00.206200+0000","last_clean":"2024-05-21T01:20:00.206200+0000","last_became_active":"2024-05-21T01:19:54.549617+0000","last_became_peered":"2024-05-21T01:19:54.549617+0000","last_unstale":"2024-05-21T01:20:00.206200+0000","last_undegraded":"2024-05-21T01:20:00.206200+0000","last_fullsized":"2024-05-21T01:20:00.206200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:34:59.845458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207085+0000","last_change":"2024-05-21T01:19:54.555653+0000","last_active":"2024-05-21T01:20:00.207085+0000","last_peered":"2024-05-21T01:20:00.207085+0000","last_clean":"2024-05-21T01:20:00.207085+0000","last_became_active":"2024-05-21T01:19:54.555274+0000","last_became_peered":"2024-05-21T01:19:54.555274+0000","last_unstale":"2024-05-21T01:20:00.207085+0000","last_undegraded":"2024-05-21T01:20:00.207085+0000","last_fullsized":"2024-05-21T01:20:00.207085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:43:43.237853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207101+0000","last_change":"2024-05-21T01:19:54.568866+0000","last_active":"2024-05-21T01:20:00.207101+0000","last_peered":"2024-05-21T01:20:00.207101+0000","last_clean":"2024-05-21T01:20:00.207101+0000","last_became_active":"2024-05-21T01:19:54.568605+0000","last_became_peered":"2024-05-21T01:19:54.568605+0000","last_unstale":"2024-05-21T01:20:00.207101+0000","last_undegraded":"2024-05-21T01:20:00.207101+0000","last_fullsized":"2024-05-21T01:20:00.207101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:21:20.820620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207281+0000","last_change":"2024-05-21T01:19:54.557468+0000","last_active":"2024-05-21T01:20:00.207281+0000","last_peered":"2024-05-21T01:20:00.207281+0000","last_clean":"2024-05-21T01:20:00.207281+0000","last_became_active":"2024-05-21T01:19:54.554976+0000","last_became_peered":"2024-05-21T01:19:54.554976+0000","last_unstale":"2024-05-21T01:20:00.207281+0000","last_undegraded":"2024-05-21T01:20:00.207281+0000","last_fullsized":"2024-05-21T01:20:00.207281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:25:08.737348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.210942+0000","last_change":"2024-05-21T01:19:54.566991+0000","last_active":"2024-05-21T01:20:00.210942+0000","last_peered":"2024-05-21T01:20:00.210942+0000","last_clean":"2024-05-21T01:20:00.210942+0000","last_became_active":"2024-05-21T01:19:54.566349+0000","last_became_peered":"2024-05-21T01:19:54.566349+0000","last_unstale":"2024-05-21T01:20:00.210942+0000","last_undegraded":"2024-05-21T01:20:00.210942+0000","last_fullsized":"2024-05-21T01:20:00.210942+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:25:43.468081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.211304+0000","last_change":"2024-05-21T01:19:54.576100+0000","last_active":"2024-05-21T01:20:00.211304+0000","last_peered":"2024-05-21T01:20:00.211304+0000","last_clean":"2024-05-21T01:20:00.211304+0000","last_became_active":"2024-05-21T01:19:54.574914+0000","last_became_peered":"2024-05-21T01:19:54.574914+0000","last_unstale":"2024-05-21T01:20:00.211304+0000","last_undegraded":"2024-05-21T01:20:00.211304+0000","last_fullsized":"2024-05-21T01:20:00.211304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:29:30.730283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.208436+0000","last_change":"2024-05-21T01:19:54.546570+0000","last_active":"2024-05-21T01:20:00.208436+0000","last_peered":"2024-05-21T01:20:00.208436+0000","last_clean":"2024-05-21T01:20:00.208436+0000","last_became_active":"2024-05-21T01:19:54.546284+0000","last_became_peered":"2024-05-21T01:19:54.546284+0000","last_unstale":"2024-05-21T01:20:00.208436+0000","last_undegraded":"2024-05-21T01:20:00.208436+0000","last_fullsized":"2024-05-21T01:20:00.208436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:36:30.219522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":5956,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":11912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":63,"ondisk_log_size":63,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66932,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509452,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":103393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509451,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":270336,"data_stored":106653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509450,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":327680,"data_stored":693249,"data_compressed":33466,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509450,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":102867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542155,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":102811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542154,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":339968,"data_stored":693893,"data_compressed":33466,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":102935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":107325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33466,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33466,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":5298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-21T01:20:27.968 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-21T01:20:27.969 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-21T01:20:27.969 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-05-21T01:20:27.969 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-21T01:20:28.147 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.141+0000 7fdc1a200640 1 Processor -- start 2024-05-21T01:20:28.147 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.141+0000 7fdc1a200640 1 -- start start 2024-05-21T01:20:28.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.145+0000 7fdc1a200640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fdc140cfb70 0x7fdc14153b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:28.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.145+0000 7fdc1a200640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fdc140ca810 0x7fdc14154080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:28.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.145+0000 7fdc1a200640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc140c8be0 con 0x7fdc140cf790 2024-05-21T01:20:28.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.145+0000 7fdc1a200640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7fdc140c8e80 con 0x7fdc140cfb70 2024-05-21T01:20:28.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.145+0000 7fdc1a200640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fdc140c9160 con 0x7fdc140ca810 2024-05-21T01:20:28.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.145+0000 7fdc0be00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fdc140cfb70 0x7fdc14153b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:28.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.145+0000 7fdc13400640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fdc140cf790 0x7fdc140c69a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:40276/0 (socket says 172.21.15.63:40276) 2024-05-21T01:20:28.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.145+0000 7fdc13400640 1 -- 172.21.15.63:0/2525438108 learned_addr learned my addr 172.21.15.63:0/2525438108 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-05-21T01:20:28.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.145+0000 7fdc13e00640 1 --2- 172.21.15.63:0/2525438108 >> v2:172.21.15.131:3300/0 conn(0x7fdc140ca810 0x7fdc14154080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:28.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.145+0000 7fdc0be00640 1 -- 172.21.15.63:0/2525438108 >> v2:172.21.15.131:3300/0 conn(0x7fdc140ca810 msgr2=0x7fdc14154080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:28.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.145+0000 7fdc0be00640 1 --2- 172.21.15.63:0/2525438108 >> v2:172.21.15.131:3300/0 conn(0x7fdc140ca810 0x7fdc14154080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:28.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.145+0000 7fdc0be00640 1 -- 172.21.15.63:0/2525438108 >> v1:172.21.15.63:6789/0 conn(0x7fdc140cf790 legacy=0x7fdc140c69a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:28.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.145+0000 7fdc12a00640 1 -- 172.21.15.63:0/2525438108 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 678243480 0 0) 0x7fdc140c8be0 con 0x7fdc140cf790 2024-05-21T01:20:28.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.145+0000 7fdc0be00640 1 -- 172.21.15.63:0/2525438108 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc140c9440 con 0x7fdc140cfb70 2024-05-21T01:20:28.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.145+0000 7fdc0be00640 1 --2- 172.21.15.63:0/2525438108 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdc140cfb70 0x7fdc14153b40 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fdc1406d4e0 tx=0x7fdbfc01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fafd9622514ad51 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:28.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.145+0000 7fdc12a00640 1 -- 172.21.15.63:0/2525438108 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbfc0b0070 con 0x7fdc140cfb70 2024-05-21T01:20:28.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.149+0000 7fdc12a00640 1 -- 172.21.15.63:0/2525438108 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbfc0ab600 con 0x7fdc140cfb70 2024-05-21T01:20:28.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.149+0000 7fdc12a00640 1 -- 172.21.15.63:0/2525438108 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbfc0ab9d0 con 0x7fdc140cfb70 2024-05-21T01:20:28.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.149+0000 7fdc1a200640 1 -- 172.21.15.63:0/2525438108 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdc140cfb70 msgr2=0x7fdc14153b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:28.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.149+0000 7fdc1a200640 1 --2- 172.21.15.63:0/2525438108 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdc140cfb70 0x7fdc14153b40 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fdc1406d4e0 tx=0x7fdbfc01c3f0 comp rx=0 tx=0).stop 2024-05-21T01:20:28.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.149+0000 7fdc1a200640 1 -- 172.21.15.63:0/2525438108 shutdown_connections 2024-05-21T01:20:28.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.149+0000 7fdc1a200640 1 --2- 172.21.15.63:0/2525438108 >> v2:172.21.15.131:3300/0 conn(0x7fdc140ca810 0x7fdc14154080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:28.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.149+0000 7fdc1a200640 1 --2- 172.21.15.63:0/2525438108 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdc140cfb70 0x7fdc14153b40 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:28.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.149+0000 7fdc1a200640 1 -- 172.21.15.63:0/2525438108 >> 172.21.15.63:0/2525438108 conn(0x7fdc140735f0 msgr2=0x7fdc14073a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:28.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.149+0000 7fdc1a200640 1 -- 172.21.15.63:0/2525438108 shutdown_connections 2024-05-21T01:20:28.153 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.149+0000 7fdc1a200640 1 -- 172.21.15.63:0/2525438108 wait complete. 2024-05-21T01:20:28.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.149+0000 7fdc1a200640 1 Processor -- start 2024-05-21T01:20:28.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.149+0000 7fdc1a200640 1 -- start start 2024-05-21T01:20:28.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.149+0000 7fdc1a200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc140ca810 0x7fdc1406d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:28.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.149+0000 7fdc1a200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdc140cf790 0x7fdc141454b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:28.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.149+0000 7fdc1a200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdc140cfb70 0x7fdc141459f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:28.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.149+0000 7fdc1a200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fdc14166830 con 0x7fdc140cf790 2024-05-21T01:20:28.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.149+0000 7fdc1a200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fdc141666b0 con 0x7fdc140ca810 2024-05-21T01:20:28.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.149+0000 7fdc1a200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fdc141669b0 con 0x7fdc140cfb70 2024-05-21T01:20:28.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.149+0000 7fdc0be00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdc140cf790 0x7fdc141454b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:28.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.149+0000 7fdc0be00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdc140cf790 0x7fdc141454b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:49594/0 (socket says 172.21.15.63:49594) 2024-05-21T01:20:28.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.149+0000 7fdc0be00640 1 -- 172.21.15.63:0/416903553 learned_addr learned my addr 172.21.15.63:0/416903553 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:28.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.149+0000 7fdc13400640 1 --2- 172.21.15.63:0/416903553 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc140ca810 0x7fdc1406d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:28.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.149+0000 7fdc13e00640 1 --2- 172.21.15.63:0/416903553 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdc140cfb70 0x7fdc141459f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:28.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.153+0000 7fdc0be00640 1 -- 172.21.15.63:0/416903553 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdc140cfb70 msgr2=0x7fdc141459f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:28.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.153+0000 7fdc0be00640 1 --2- 172.21.15.63:0/416903553 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdc140cfb70 0x7fdc141459f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:28.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.153+0000 7fdc0be00640 1 -- 172.21.15.63:0/416903553 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc140ca810 msgr2=0x7fdc1406d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:28.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.153+0000 7fdc0be00640 1 --2- 172.21.15.63:0/416903553 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc140ca810 0x7fdc1406d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:28.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.153+0000 7fdc0be00640 1 -- 172.21.15.63:0/416903553 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc1406f050 con 0x7fdc140cf790 2024-05-21T01:20:28.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.153+0000 7fdc13400640 1 --2- 172.21.15.63:0/416903553 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc140ca810 0x7fdc1406d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T01:20:28.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.153+0000 7fdc0be00640 1 --2- 172.21.15.63:0/416903553 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdc140cf790 0x7fdc141454b0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc0ae040 tx=0x7fdbfc019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:28.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.153+0000 7fdc0b400640 1 -- 172.21.15.63:0/416903553 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbfc0b0040 con 0x7fdc140cf790 2024-05-21T01:20:28.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.153+0000 7fdc0b400640 1 -- 172.21.15.63:0/416903553 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbfc0ba070 con 0x7fdc140cf790 2024-05-21T01:20:28.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.153+0000 7fdc0b400640 1 -- 172.21.15.63:0/416903553 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbfc0b4870 con 0x7fdc140cf790 2024-05-21T01:20:28.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.153+0000 7fdc1a200640 1 -- 172.21.15.63:0/416903553 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc140cc110 con 0x7fdc140cf790 2024-05-21T01:20:28.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.153+0000 7fdc1a200640 1 -- 172.21.15.63:0/416903553 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc140c61f0 con 0x7fdc140cf790 2024-05-21T01:20:28.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.153+0000 7fdc1a200640 1 -- 172.21.15.63:0/416903553 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc140ca3e0 con 0x7fdc140cf790 2024-05-21T01:20:28.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.153+0000 7fdc0b400640 1 -- 172.21.15.63:0/416903553 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7fdbfc0ab4c0 con 0x7fdc140cf790 2024-05-21T01:20:28.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.153+0000 7fdc0b400640 1 --2- 172.21.15.63:0/416903553 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fdbf006f400 0x7fdbf00718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:28.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.153+0000 7fdc0b400640 1 -- 172.21.15.63:0/416903553 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fdbfc1291e0 con 0x7fdc140cf790 2024-05-21T01:20:28.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.157+0000 7fdc13400640 1 --2- 172.21.15.63:0/416903553 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fdbf006f400 0x7fdbf00718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:28.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.157+0000 7fdc13400640 1 --2- 172.21.15.63:0/416903553 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fdbf006f400 0x7fdbf00718c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fdc04000f70 tx=0x7fdc04007be0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:28.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.157+0000 7fdc0b400640 1 -- 172.21.15.63:0/416903553 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fdbfc016070 con 0x7fdc140cf790 2024-05-21T01:20:28.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.357+0000 7fdc1a200640 1 -- 172.21.15.63:0/416903553 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fdc14152ec0 con 0x7fdc140cf790 2024-05-21T01:20:28.361 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.357+0000 7fdc0b400640 1 -- 172.21.15.63:0/416903553 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fdbfc0f5e20 con 0x7fdc140cf790 2024-05-21T01:20:28.362 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-05-21T01:20:28.362 INFO:teuthology.orchestra.run.smithi063.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-21T01:20:28.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.357+0000 7fdc1a200640 1 -- 172.21.15.63:0/416903553 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fdbf006f400 msgr2=0x7fdbf00718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:28.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.357+0000 7fdc1a200640 1 --2- 172.21.15.63:0/416903553 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fdbf006f400 0x7fdbf00718c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fdc04000f70 tx=0x7fdc04007be0 comp rx=0 tx=0).stop 2024-05-21T01:20:28.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.357+0000 7fdc1a200640 1 -- 172.21.15.63:0/416903553 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdc140cf790 msgr2=0x7fdc141454b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:28.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.357+0000 7fdc1a200640 1 --2- 172.21.15.63:0/416903553 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdc140cf790 0x7fdc141454b0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc0ae040 tx=0x7fdbfc019190 comp rx=0 tx=0).stop 2024-05-21T01:20:28.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.357+0000 7fdc1a200640 1 -- 172.21.15.63:0/416903553 shutdown_connections 2024-05-21T01:20:28.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.357+0000 7fdc1a200640 1 --2- 172.21.15.63:0/416903553 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fdbf006f400 0x7fdbf00718c0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:28.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.357+0000 7fdc1a200640 1 --2- 172.21.15.63:0/416903553 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdc140cfb70 0x7fdc141459f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:28.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.357+0000 7fdc1a200640 1 --2- 172.21.15.63:0/416903553 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdc140cf790 0x7fdc141454b0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:28.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.357+0000 7fdc1a200640 1 --2- 172.21.15.63:0/416903553 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc140ca810 0x7fdc1406d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:28.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.357+0000 7fdc1a200640 1 -- 172.21.15.63:0/416903553 >> 172.21.15.63:0/416903553 conn(0x7fdc140735f0 msgr2=0x7fdc140739d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:28.364 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.357+0000 7fdc1a200640 1 -- 172.21.15.63:0/416903553 shutdown_connections 2024-05-21T01:20:28.365 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.357+0000 7fdc1a200640 1 -- 172.21.15.63:0/416903553 wait complete. 2024-05-21T01:20:28.383 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-05-21T01:20:28.383 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-21T01:20:28.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.521+0000 7f8535000640 1 Processor -- start 2024-05-21T01:20:28.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.521+0000 7f8535000640 1 -- start start 2024-05-21T01:20:28.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.521+0000 7f8535000640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8530153ce0 0x7f8530070d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:28.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.521+0000 7f8535000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f8530159960 0x7f853015d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:28.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.521+0000 7f8535000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f85300c9a90 0x7f85300c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:28.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.521+0000 7f8535000640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f85301540c0 con 0x7f8530153ce0 2024-05-21T01:20:28.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.521+0000 7f8535000640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f85300c6590 con 0x7f8530159960 2024-05-21T01:20:28.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.521+0000 7f8535000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f853015d420 con 0x7f85300c9a90 2024-05-21T01:20:28.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.521+0000 7f852f400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8530153ce0 0x7f8530070d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:28.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.521+0000 7f852f400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8530153ce0 0x7f8530070d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:44990/0 (socket says 172.21.15.63:44990) 2024-05-21T01:20:28.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.521+0000 7f852f400640 1 -- 172.21.15.63:0/3796072714 learned_addr learned my addr 172.21.15.63:0/3796072714 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:28.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.521+0000 7f852fe00640 1 --2- 172.21.15.63:0/3796072714 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f85300c9a90 0x7f85300c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:28.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.521+0000 7f8526a00640 1 --2- 172.21.15.63:0/3796072714 >> v2:172.21.15.131:3300/0 conn(0x7f8530159960 0x7f853015d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:28.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.521+0000 7f852f400640 1 -- 172.21.15.63:0/3796072714 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f85300c9a90 msgr2=0x7f85300c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:28.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.521+0000 7f852f400640 1 --2- 172.21.15.63:0/3796072714 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f85300c9a90 0x7f85300c82a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:28.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.521+0000 7f852f400640 1 -- 172.21.15.63:0/3796072714 >> v2:172.21.15.131:3300/0 conn(0x7f8530159960 msgr2=0x7f853015d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:28.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.521+0000 7f852f400640 1 --2- 172.21.15.63:0/3796072714 >> v2:172.21.15.131:3300/0 conn(0x7f8530159960 0x7f853015d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:28.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.521+0000 7f852f400640 1 -- 172.21.15.63:0/3796072714 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f853015ddf0 con 0x7f8530153ce0 2024-05-21T01:20:28.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.525+0000 7f852f400640 1 --2- 172.21.15.63:0/3796072714 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8530153ce0 0x7f8530070d60 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f85300690a0 tx=0x7f852001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb89c05b33433a82 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:28.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.525+0000 7f852ea00640 1 -- 172.21.15.63:0/3796072714 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85200a5670 con 0x7f8530153ce0 2024-05-21T01:20:28.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.525+0000 7f852ea00640 1 -- 172.21.15.63:0/3796072714 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85200a5810 con 0x7f8530153ce0 2024-05-21T01:20:28.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.525+0000 7f852ea00640 1 -- 172.21.15.63:0/3796072714 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85200a5be0 con 0x7f8530153ce0 2024-05-21T01:20:28.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.525+0000 7f8535000640 1 -- 172.21.15.63:0/3796072714 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8530153ce0 msgr2=0x7f8530070d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:28.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.525+0000 7f8535000640 1 --2- 172.21.15.63:0/3796072714 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8530153ce0 0x7f8530070d60 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f85300690a0 tx=0x7f852001c9f0 comp rx=0 tx=0).stop 2024-05-21T01:20:28.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.525+0000 7f8535000640 1 -- 172.21.15.63:0/3796072714 shutdown_connections 2024-05-21T01:20:28.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.525+0000 7f8535000640 1 --2- 172.21.15.63:0/3796072714 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f85300c9a90 0x7f85300c82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:28.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.525+0000 7f8535000640 1 --2- 172.21.15.63:0/3796072714 >> v2:172.21.15.131:3300/0 conn(0x7f8530159960 0x7f853015d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:28.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.525+0000 7f8535000640 1 --2- 172.21.15.63:0/3796072714 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8530153ce0 0x7f8530070d60 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:28.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.525+0000 7f8535000640 1 -- 172.21.15.63:0/3796072714 >> 172.21.15.63:0/3796072714 conn(0x7f853006caa0 msgr2=0x7f8530068290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:28.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.525+0000 7f8535000640 1 -- 172.21.15.63:0/3796072714 shutdown_connections 2024-05-21T01:20:28.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.525+0000 7f8535000640 1 -- 172.21.15.63:0/3796072714 wait complete. 2024-05-21T01:20:28.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.529+0000 7f8535000640 1 Processor -- start 2024-05-21T01:20:28.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.529+0000 7f8535000640 1 -- start start 2024-05-21T01:20:28.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.529+0000 7f8535000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f85300c9a90 0x7f853015b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:28.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.529+0000 7f8535000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8530153ce0 0x7f8530142ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:28.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.529+0000 7f8535000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8530159960 0x7f85301504c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:28.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.529+0000 7f8535000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f85300c6da0 con 0x7f8530153ce0 2024-05-21T01:20:28.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.529+0000 7f8535000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f85300712a0 con 0x7f85300c9a90 2024-05-21T01:20:28.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.529+0000 7f8535000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f8530071ac0 con 0x7f8530159960 2024-05-21T01:20:28.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.529+0000 7f8526a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8530153ce0 0x7f8530142ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:28.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.529+0000 7f8526a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8530153ce0 0x7f8530142ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45002/0 (socket says 172.21.15.63:45002) 2024-05-21T01:20:28.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.529+0000 7f8526a00640 1 -- 172.21.15.63:0/199504772 learned_addr learned my addr 172.21.15.63:0/199504772 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:28.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.529+0000 7f852fe00640 1 --2- 172.21.15.63:0/199504772 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8530159960 0x7f85301504c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:28.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.529+0000 7f852f400640 1 --2- 172.21.15.63:0/199504772 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f85300c9a90 0x7f853015b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:28.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.529+0000 7f8526a00640 1 -- 172.21.15.63:0/199504772 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8530159960 msgr2=0x7f85301504c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:28.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.529+0000 7f8526a00640 1 --2- 172.21.15.63:0/199504772 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8530159960 0x7f85301504c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:28.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.529+0000 7f8526a00640 1 -- 172.21.15.63:0/199504772 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f85300c9a90 msgr2=0x7f853015b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:28.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.529+0000 7f8526a00640 1 --2- 172.21.15.63:0/199504772 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f85300c9a90 0x7f853015b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:28.536 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.529+0000 7f8526a00640 1 -- 172.21.15.63:0/199504772 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85301f6160 con 0x7f8530153ce0 2024-05-21T01:20:28.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.529+0000 7f852f400640 1 --2- 172.21.15.63:0/199504772 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f85300c9a90 0x7f853015b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T01:20:28.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.529+0000 7f852fe00640 1 --2- 172.21.15.63:0/199504772 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8530159960 0x7f85301504c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T01:20:28.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.529+0000 7f8526a00640 1 --2- 172.21.15.63:0/199504772 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8530153ce0 0x7f8530142ea0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f851800d800 tx=0x7f851800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:28.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.529+0000 7f8527e00640 1 -- 172.21.15.63:0/199504772 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f851800b6c0 con 0x7f8530153ce0 2024-05-21T01:20:28.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.529+0000 7f8527e00640 1 -- 172.21.15.63:0/199504772 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8518019070 con 0x7f8530153ce0 2024-05-21T01:20:28.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.529+0000 7f8527e00640 1 -- 172.21.15.63:0/199504772 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f851800ba60 con 0x7f8530153ce0 2024-05-21T01:20:28.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.529+0000 7f8535000640 1 -- 172.21.15.63:0/199504772 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85301f6440 con 0x7f8530153ce0 2024-05-21T01:20:28.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.529+0000 7f8535000640 1 -- 172.21.15.63:0/199504772 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85301f6a00 con 0x7f8530153ce0 2024-05-21T01:20:28.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.533+0000 7f8535000640 1 -- 172.21.15.63:0/199504772 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f853006c0c0 con 0x7f8530153ce0 2024-05-21T01:20:28.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.533+0000 7f8527e00640 1 -- 172.21.15.63:0/199504772 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7f851800bc00 con 0x7f8530153ce0 2024-05-21T01:20:28.539 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.533+0000 7f8527e00640 1 --2- 172.21.15.63:0/199504772 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f850c06f430 0x7f850c0718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:28.539 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.533+0000 7f8527e00640 1 -- 172.21.15.63:0/199504772 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f851808fad0 con 0x7f8530153ce0 2024-05-21T01:20:28.539 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.533+0000 7f852f400640 1 --2- 172.21.15.63:0/199504772 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f850c06f430 0x7f850c0718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:28.540 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.533+0000 7f852f400640 1 --2- 172.21.15.63:0/199504772 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f850c06f430 0x7f850c0718f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f85200ae000 tx=0x7f85200a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:28.542 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.537+0000 7f8527e00640 1 -- 172.21.15.63:0/199504772 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f851805c5e0 con 0x7f8530153ce0 2024-05-21T01:20:28.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.737+0000 7f8535000640 1 -- 172.21.15.63:0/199504772 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f85301f2b10 con 0x7f8530153ce0 2024-05-21T01:20:28.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.737+0000 7f8527e00640 1 -- 172.21.15.63:0/199504772 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6872 (secure 0 0 0) 0x7f851805bee0 con 0x7f8530153ce0 2024-05-21T01:20:28.744 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-05-21T01:20:28.744 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6839/3045714273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6837","nonce":3045714273},{"type":"v1","addr":"172.21.15.131:6839","nonce":3045714273}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/2978367338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":2978367338},{"type":"v1","addr":"172.21.15.131:6835","nonce":2978367338}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/3005995321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6835","nonce":3005995321},{"type":"v1","addr":"172.21.15.63:6837","nonce":3005995321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-21T01:19:53.915775+0000","modified":"2024-05-21T01:20:25.673715+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4276,"mds_1":4270,"mds_2":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"e","rank":2,"incarnation":14,"state":"up:creating","state_seq":1,"addr":"172.21.15.63:6833/574189772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":574189772},{"type":"v1","addr":"172.21.15.63:6833","nonce":574189772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4270":{"gid":4270,"name":"f","rank":1,"incarnation":10,"state":"up:active","state_seq":11,"addr":"172.21.15.131:6838/3071941741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":3071941741},{"type":"v1","addr":"172.21.15.131:6838","nonce":3071941741}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.63:6836/2892727989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":2892727989},{"type":"v1","addr":"172.21.15.63:6836","nonce":2892727989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4276,"qdb_cluster":[4276,4270]},"id":1}]} 2024-05-21T01:20:28.745 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 14 2024-05-21T01:20:28.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.741+0000 7f8535000640 1 -- 172.21.15.63:0/199504772 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f850c06f430 msgr2=0x7f850c0718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:28.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.741+0000 7f8535000640 1 --2- 172.21.15.63:0/199504772 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f850c06f430 0x7f850c0718f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f85200ae000 tx=0x7f85200a7070 comp rx=0 tx=0).stop 2024-05-21T01:20:28.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.741+0000 7f8535000640 1 -- 172.21.15.63:0/199504772 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8530153ce0 msgr2=0x7f8530142ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:28.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.741+0000 7f8535000640 1 --2- 172.21.15.63:0/199504772 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8530153ce0 0x7f8530142ea0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f851800d800 tx=0x7f851800dcc0 comp rx=0 tx=0).stop 2024-05-21T01:20:28.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.741+0000 7f8535000640 1 -- 172.21.15.63:0/199504772 shutdown_connections 2024-05-21T01:20:28.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.741+0000 7f8535000640 1 --2- 172.21.15.63:0/199504772 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f850c06f430 0x7f850c0718f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:28.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.741+0000 7f8535000640 1 --2- 172.21.15.63:0/199504772 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8530159960 0x7f85301504c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:28.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.741+0000 7f8535000640 1 --2- 172.21.15.63:0/199504772 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8530153ce0 0x7f8530142ea0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:28.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.741+0000 7f8535000640 1 --2- 172.21.15.63:0/199504772 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f85300c9a90 0x7f853015b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:28.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.741+0000 7f8535000640 1 -- 172.21.15.63:0/199504772 >> 172.21.15.63:0/199504772 conn(0x7f853006caa0 msgr2=0x7f8530144b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:28.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.741+0000 7f8535000640 1 -- 172.21.15.63:0/199504772 shutdown_connections 2024-05-21T01:20:28.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.741+0000 7f8535000640 1 -- 172.21.15.63:0/199504772 wait complete. 2024-05-21T01:20:28.765 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-21T01:20:28.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.901+0000 7f5110600640 1 Processor -- start 2024-05-21T01:20:28.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.901+0000 7f5110600640 1 -- start start 2024-05-21T01:20:28.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.901+0000 7f5110600640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5108153d70 0x7f510815a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:28.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.901+0000 7f5110600640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f51080cb6e0 0x7f51080c6910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:28.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.901+0000 7f5110600640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51080ca5f0 con 0x7f51080cbb20 2024-05-21T01:20:28.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.905+0000 7f5110600640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f51080cb450 con 0x7f51080cb6e0 2024-05-21T01:20:28.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.905+0000 7f5110600640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f51080ca8d0 con 0x7f5108153d70 2024-05-21T01:20:28.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.905+0000 7f510e600640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f51080cbb20 0x7f51080737f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58238/0 (socket says 172.21.15.63:58238) 2024-05-21T01:20:28.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.905+0000 7f510e600640 1 -- 172.21.15.63:0/1252086101 learned_addr learned my addr 172.21.15.63:0/1252086101 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-05-21T01:20:28.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.905+0000 7f510d200640 1 --2- 172.21.15.63:0/1252086101 >> v2:172.21.15.131:3300/0 conn(0x7f51080cb6e0 0x7f51080c6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:28.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.905+0000 7f510dc00640 1 --2- 172.21.15.63:0/1252086101 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5108153d70 0x7f510815a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:28.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.905+0000 7f5107e00640 1 -- 172.21.15.63:0/1252086101 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2080574382 0 0) 0x7f51080ca5f0 con 0x7f51080cbb20 2024-05-21T01:20:28.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.905+0000 7f5107e00640 1 -- 172.21.15.63:0/1252086101 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f50f0003530 con 0x7f51080cbb20 2024-05-21T01:20:28.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.905+0000 7f510dc00640 1 -- 172.21.15.63:0/1252086101 >> v2:172.21.15.131:3300/0 conn(0x7f51080cb6e0 msgr2=0x7f51080c6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:28.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.905+0000 7f510dc00640 1 --2- 172.21.15.63:0/1252086101 >> v2:172.21.15.131:3300/0 conn(0x7f51080cb6e0 0x7f51080c6910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:28.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.905+0000 7f510dc00640 1 -- 172.21.15.63:0/1252086101 >> v1:172.21.15.63:6789/0 conn(0x7f51080cbb20 legacy=0x7f51080737f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:28.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.905+0000 7f5107e00640 1 -- 172.21.15.63:0/1252086101 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1219682619 0 0) 0x7f50f0003530 con 0x7f51080cbb20 2024-05-21T01:20:28.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.905+0000 7f510dc00640 1 -- 172.21.15.63:0/1252086101 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51080cabb0 con 0x7f5108153d70 2024-05-21T01:20:28.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.909+0000 7f510dc00640 1 --2- 172.21.15.63:0/1252086101 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5108153d70 0x7f510815a5b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f50fc0097c0 tx=0x7f50fc01c300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e845c0b7d5cb5bee server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:28.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.909+0000 7f5107e00640 1 -- 172.21.15.63:0/1252086101 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50fc0b0070 con 0x7f5108153d70 2024-05-21T01:20:28.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.909+0000 7f5107e00640 1 -- 172.21.15.63:0/1252086101 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50fc0ab400 con 0x7f5108153d70 2024-05-21T01:20:28.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.909+0000 7f5107e00640 1 -- 172.21.15.63:0/1252086101 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5100001a80 con 0x7f5108153d70 2024-05-21T01:20:28.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.909+0000 7f5110600640 1 -- 172.21.15.63:0/1252086101 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5108153d70 msgr2=0x7f510815a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:28.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.909+0000 7f5110600640 1 --2- 172.21.15.63:0/1252086101 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5108153d70 0x7f510815a5b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f50fc0097c0 tx=0x7f50fc01c300 comp rx=0 tx=0).stop 2024-05-21T01:20:28.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.909+0000 7f5110600640 1 -- 172.21.15.63:0/1252086101 shutdown_connections 2024-05-21T01:20:28.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.909+0000 7f5110600640 1 --2- 172.21.15.63:0/1252086101 >> v2:172.21.15.131:3300/0 conn(0x7f51080cb6e0 0x7f51080c6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:28.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.909+0000 7f5110600640 1 --2- 172.21.15.63:0/1252086101 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5108153d70 0x7f510815a5b0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:28.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.909+0000 7f5110600640 1 -- 172.21.15.63:0/1252086101 >> 172.21.15.63:0/1252086101 conn(0x7f51080cbf10 msgr2=0x7f51080cc320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:28.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.909+0000 7f5110600640 1 -- 172.21.15.63:0/1252086101 shutdown_connections 2024-05-21T01:20:28.916 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.909+0000 7f5110600640 1 -- 172.21.15.63:0/1252086101 wait complete. 2024-05-21T01:20:28.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.909+0000 7f5110600640 1 Processor -- start 2024-05-21T01:20:28.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.909+0000 7f5110600640 1 -- start start 2024-05-21T01:20:28.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.909+0000 7f5110600640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f51080cb6e0 0x7f51080cfe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:28.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.909+0000 7f5110600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5108153d70 0x7f5108156fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:28.920 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.909+0000 7f5110600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5108150d30 0x7f51080cd480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:28.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.909+0000 7f5110600640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f5108166e50 con 0x7f5108153d70 2024-05-21T01:20:28.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.909+0000 7f5110600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f5108166cd0 con 0x7f5108150d30 2024-05-21T01:20:28.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.909+0000 7f5110600640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f5108166fd0 con 0x7f51080cb6e0 2024-05-21T01:20:28.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.913+0000 7f510d200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5108153d70 0x7f5108156fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:28.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.913+0000 7f510d200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5108153d70 0x7f5108156fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45018/0 (socket says 172.21.15.63:45018) 2024-05-21T01:20:28.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.913+0000 7f510d200640 1 -- 172.21.15.63:0/442327291 learned_addr learned my addr 172.21.15.63:0/442327291 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:28.921 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.913+0000 7f510dc00640 1 --2- 172.21.15.63:0/442327291 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f51080cb6e0 0x7f51080cfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:28.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.913+0000 7f510e600640 1 --2- 172.21.15.63:0/442327291 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5108150d30 0x7f51080cd480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:28.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.913+0000 7f510d200640 1 -- 172.21.15.63:0/442327291 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f51080cb6e0 msgr2=0x7f51080cfe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:28.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.913+0000 7f510d200640 1 --2- 172.21.15.63:0/442327291 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f51080cb6e0 0x7f51080cfe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:28.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.913+0000 7f510d200640 1 -- 172.21.15.63:0/442327291 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5108150d30 msgr2=0x7f51080cd480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:28.922 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.913+0000 7f510d200640 1 --2- 172.21.15.63:0/442327291 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5108150d30 0x7f51080cd480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:28.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.913+0000 7f510d200640 1 -- 172.21.15.63:0/442327291 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51081f2400 con 0x7f5108153d70 2024-05-21T01:20:28.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.913+0000 7f510dc00640 1 --2- 172.21.15.63:0/442327291 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f51080cb6e0 0x7f51080cfe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T01:20:28.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.913+0000 7f510d200640 1 --2- 172.21.15.63:0/442327291 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5108153d70 0x7f5108156fc0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f50f400e8a0 tx=0x7f50f400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:28.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.913+0000 7f5105600640 1 -- 172.21.15.63:0/442327291 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50f4017070 con 0x7f5108153d70 2024-05-21T01:20:28.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.913+0000 7f5105600640 1 -- 172.21.15.63:0/442327291 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50f400c8e0 con 0x7f5108153d70 2024-05-21T01:20:28.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.913+0000 7f5105600640 1 -- 172.21.15.63:0/442327291 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50f400cc90 con 0x7f5108153d70 2024-05-21T01:20:28.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.913+0000 7f5110600640 1 -- 172.21.15.63:0/442327291 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51081f6420 con 0x7f5108153d70 2024-05-21T01:20:28.923 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.913+0000 7f5110600640 1 -- 172.21.15.63:0/442327291 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51081f26c0 con 0x7f5108153d70 2024-05-21T01:20:28.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.913+0000 7f5110600640 1 -- 172.21.15.63:0/442327291 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51080507f0 con 0x7f5108153d70 2024-05-21T01:20:28.924 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.913+0000 7f5105600640 1 -- 172.21.15.63:0/442327291 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7f50f401a070 con 0x7f5108153d70 2024-05-21T01:20:28.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.917+0000 7f5105600640 1 --2- 172.21.15.63:0/442327291 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f50e806f400 0x7f50e80718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:28.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.917+0000 7f5105600640 1 -- 172.21.15.63:0/442327291 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f50f408f850 con 0x7f5108153d70 2024-05-21T01:20:28.925 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.917+0000 7f510dc00640 1 --2- 172.21.15.63:0/442327291 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f50e806f400 0x7f50e80718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:28.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.917+0000 7f510dc00640 1 --2- 172.21.15.63:0/442327291 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f50e806f400 0x7f50e80718c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f50fc0ad000 tx=0x7f50fc0a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:28.926 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:28.921+0000 7f5105600640 1 -- 172.21.15.63:0/442327291 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f50f405c3f0 con 0x7f5108153d70 2024-05-21T01:20:29.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.121+0000 7f5110600640 1 -- 172.21.15.63:0/442327291 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f51080746b0 con 0x7f5108153d70 2024-05-21T01:20:29.125 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.121+0000 7f5105600640 1 -- 172.21.15.63:0/442327291 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6872 (secure 0 0 0) 0x7f50f405bcf0 con 0x7f5108153d70 2024-05-21T01:20:29.126 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-05-21T01:20:29.126 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6839/3045714273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6837","nonce":3045714273},{"type":"v1","addr":"172.21.15.131:6839","nonce":3045714273}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/2978367338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":2978367338},{"type":"v1","addr":"172.21.15.131:6835","nonce":2978367338}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/3005995321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6835","nonce":3005995321},{"type":"v1","addr":"172.21.15.63:6837","nonce":3005995321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-21T01:19:53.915775+0000","modified":"2024-05-21T01:20:25.673715+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4276,"mds_1":4270,"mds_2":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"e","rank":2,"incarnation":14,"state":"up:creating","state_seq":1,"addr":"172.21.15.63:6833/574189772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":574189772},{"type":"v1","addr":"172.21.15.63:6833","nonce":574189772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4270":{"gid":4270,"name":"f","rank":1,"incarnation":10,"state":"up:active","state_seq":11,"addr":"172.21.15.131:6838/3071941741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":3071941741},{"type":"v1","addr":"172.21.15.131:6838","nonce":3071941741}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.63:6836/2892727989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":2892727989},{"type":"v1","addr":"172.21.15.63:6836","nonce":2892727989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4276,"qdb_cluster":[4276,4270]},"id":1}]} 2024-05-21T01:20:29.126 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 14 2024-05-21T01:20:29.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.121+0000 7f5110600640 1 -- 172.21.15.63:0/442327291 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f50e806f400 msgr2=0x7f50e80718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:29.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.121+0000 7f5110600640 1 --2- 172.21.15.63:0/442327291 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f50e806f400 0x7f50e80718c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f50fc0ad000 tx=0x7f50fc0a6000 comp rx=0 tx=0).stop 2024-05-21T01:20:29.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.121+0000 7f5110600640 1 -- 172.21.15.63:0/442327291 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5108153d70 msgr2=0x7f5108156fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:29.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.121+0000 7f5110600640 1 --2- 172.21.15.63:0/442327291 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5108153d70 0x7f5108156fc0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f50f400e8a0 tx=0x7f50f400eca0 comp rx=0 tx=0).stop 2024-05-21T01:20:29.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.121+0000 7f5110600640 1 -- 172.21.15.63:0/442327291 shutdown_connections 2024-05-21T01:20:29.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.121+0000 7f5110600640 1 --2- 172.21.15.63:0/442327291 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f50e806f400 0x7f50e80718c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:29.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.121+0000 7f5110600640 1 --2- 172.21.15.63:0/442327291 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5108150d30 0x7f51080cd480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:29.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.121+0000 7f5110600640 1 --2- 172.21.15.63:0/442327291 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5108153d70 0x7f5108156fc0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:29.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.121+0000 7f5110600640 1 --2- 172.21.15.63:0/442327291 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f51080cb6e0 0x7f51080cfe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:29.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.121+0000 7f5110600640 1 -- 172.21.15.63:0/442327291 >> 172.21.15.63:0/442327291 conn(0x7f51080cbf10 msgr2=0x7f5108141950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:29.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.121+0000 7f5110600640 1 -- 172.21.15.63:0/442327291 shutdown_connections 2024-05-21T01:20:29.128 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.121+0000 7f5110600640 1 -- 172.21.15.63:0/442327291 wait complete. 2024-05-21T01:20:29.148 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-21T01:20:29.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.285+0000 7fa86ac00640 1 Processor -- start 2024-05-21T01:20:29.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.285+0000 7fa86ac00640 1 -- start start 2024-05-21T01:20:29.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.285+0000 7fa86ac00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa86406c4a0 0x7fa8640c7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:29.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.285+0000 7fa86ac00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8640c6220 con 0x7fa864152ac0 2024-05-21T01:20:29.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.285+0000 7fa86ac00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa86415cb20 con 0x7fa8640c5cf0 2024-05-21T01:20:29.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.285+0000 7fa86ac00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7fa8640c6dc0 con 0x7fa86406c4a0 2024-05-21T01:20:29.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.285+0000 7fa868e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa86406c4a0 0x7fa8640c7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:29.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.285+0000 7fa869800640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fa864152ac0 0x7fa8640c5020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58240/0 (socket says 172.21.15.63:58240) 2024-05-21T01:20:29.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.285+0000 7fa869800640 1 -- 172.21.15.63:0/539269870 learned_addr learned my addr 172.21.15.63:0/539269870 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-05-21T01:20:29.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.285+0000 7fa868e00640 1 -- 172.21.15.63:0/539269870 >> v1:172.21.15.131:6789/0 conn(0x7fa8640c5cf0 legacy=0x7fa864163120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:29.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.285+0000 7fa868e00640 1 -- 172.21.15.63:0/539269870 >> v1:172.21.15.63:6789/0 conn(0x7fa864152ac0 legacy=0x7fa8640c5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:29.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.285+0000 7fa868e00640 1 -- 172.21.15.63:0/539269870 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8640c6490 con 0x7fa86406c4a0 2024-05-21T01:20:29.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.285+0000 7fa863e00640 1 -- 172.21.15.63:0/539269870 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2781851326 0 0) 0x7fa8640c6220 con 0x7fa864152ac0 2024-05-21T01:20:29.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.289+0000 7fa868e00640 1 --2- 172.21.15.63:0/539269870 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa86406c4a0 0x7fa8640c7ed0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa8500097c0 tx=0x7fa85001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfa19df9d8920e25 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:29.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.289+0000 7fa863e00640 1 -- 172.21.15.63:0/539269870 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8500b2070 con 0x7fa86406c4a0 2024-05-21T01:20:29.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.289+0000 7fa863e00640 1 -- 172.21.15.63:0/539269870 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8500ad640 con 0x7fa86406c4a0 2024-05-21T01:20:29.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.289+0000 7fa863e00640 1 -- 172.21.15.63:0/539269870 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8500ada10 con 0x7fa86406c4a0 2024-05-21T01:20:29.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.289+0000 7fa86ac00640 1 -- 172.21.15.63:0/539269870 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa86406c4a0 msgr2=0x7fa8640c7ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:29.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.289+0000 7fa86ac00640 1 --2- 172.21.15.63:0/539269870 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa86406c4a0 0x7fa8640c7ed0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa8500097c0 tx=0x7fa85001c4a0 comp rx=0 tx=0).stop 2024-05-21T01:20:29.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.289+0000 7fa86ac00640 1 -- 172.21.15.63:0/539269870 shutdown_connections 2024-05-21T01:20:29.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.289+0000 7fa86ac00640 1 --2- 172.21.15.63:0/539269870 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa86406c4a0 0x7fa8640c7ed0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:29.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.289+0000 7fa86ac00640 1 -- 172.21.15.63:0/539269870 >> 172.21.15.63:0/539269870 conn(0x7fa8640cdde0 msgr2=0x7fa86406f070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:29.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.289+0000 7fa86ac00640 1 -- 172.21.15.63:0/539269870 shutdown_connections 2024-05-21T01:20:29.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.289+0000 7fa86ac00640 1 -- 172.21.15.63:0/539269870 wait complete. 2024-05-21T01:20:29.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.289+0000 7fa86ac00640 1 Processor -- start 2024-05-21T01:20:29.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.289+0000 7fa86ac00640 1 -- start start 2024-05-21T01:20:29.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.293+0000 7fa86ac00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa86406c4a0 0x7fa864157610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:29.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.293+0000 7fa86ac00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa8640c5cf0 0x7fa864161920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:29.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.293+0000 7fa86ac00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa864152ac0 0x7fa864150540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:29.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.293+0000 7fa86ac00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fa864152ea0 con 0x7fa864152ac0 2024-05-21T01:20:29.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.293+0000 7fa86ac00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa8640c7660 con 0x7fa86406c4a0 2024-05-21T01:20:29.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.293+0000 7fa86ac00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fa864162590 con 0x7fa8640c5cf0 2024-05-21T01:20:29.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.293+0000 7fa86a200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa864152ac0 0x7fa864150540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:29.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.293+0000 7fa86a200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa864152ac0 0x7fa864150540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45032/0 (socket says 172.21.15.63:45032) 2024-05-21T01:20:29.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.293+0000 7fa86a200640 1 -- 172.21.15.63:0/629103566 learned_addr learned my addr 172.21.15.63:0/629103566 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:29.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.293+0000 7fa869800640 1 --2- 172.21.15.63:0/629103566 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa86406c4a0 0x7fa864157610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:29.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.293+0000 7fa868e00640 1 --2- 172.21.15.63:0/629103566 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa8640c5cf0 0x7fa864161920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:29.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.293+0000 7fa86a200640 1 -- 172.21.15.63:0/629103566 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa8640c5cf0 msgr2=0x7fa864161920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:29.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.293+0000 7fa86a200640 1 --2- 172.21.15.63:0/629103566 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa8640c5cf0 0x7fa864161920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:29.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.293+0000 7fa86a200640 1 -- 172.21.15.63:0/629103566 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa86406c4a0 msgr2=0x7fa864157610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:29.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.293+0000 7fa86a200640 1 --2- 172.21.15.63:0/629103566 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa86406c4a0 0x7fa864157610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:29.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.293+0000 7fa86a200640 1 -- 172.21.15.63:0/629103566 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8641581f0 con 0x7fa864152ac0 2024-05-21T01:20:29.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.293+0000 7fa869800640 1 --2- 172.21.15.63:0/629103566 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa86406c4a0 0x7fa864157610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T01:20:29.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.293+0000 7fa868e00640 1 --2- 172.21.15.63:0/629103566 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa8640c5cf0 0x7fa864161920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T01:20:29.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.293+0000 7fa86a200640 1 --2- 172.21.15.63:0/629103566 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa864152ac0 0x7fa864150540 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa85c00c7b0 tx=0x7fa85c00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:29.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.293+0000 7fa861600640 1 -- 172.21.15.63:0/629103566 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa85c004b70 con 0x7fa864152ac0 2024-05-21T01:20:29.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.293+0000 7fa861600640 1 -- 172.21.15.63:0/629103566 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa85c004d10 con 0x7fa864152ac0 2024-05-21T01:20:29.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.293+0000 7fa861600640 1 -- 172.21.15.63:0/629103566 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa85c00aa90 con 0x7fa864152ac0 2024-05-21T01:20:29.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.293+0000 7fa86ac00640 1 -- 172.21.15.63:0/629103566 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8641633b0 con 0x7fa864152ac0 2024-05-21T01:20:29.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.293+0000 7fa86ac00640 1 -- 172.21.15.63:0/629103566 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa864152130 con 0x7fa864152ac0 2024-05-21T01:20:29.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.293+0000 7fa86ac00640 1 -- 172.21.15.63:0/629103566 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa86406c0c0 con 0x7fa864152ac0 2024-05-21T01:20:29.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.293+0000 7fa861600640 1 -- 172.21.15.63:0/629103566 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7fa85c00ac30 con 0x7fa864152ac0 2024-05-21T01:20:29.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.297+0000 7fa861600640 1 --2- 172.21.15.63:0/629103566 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fa84406f430 0x7fa8440718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:29.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.297+0000 7fa861600640 1 -- 172.21.15.63:0/629103566 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fa85c08f7d0 con 0x7fa864152ac0 2024-05-21T01:20:29.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.297+0000 7fa869800640 1 --2- 172.21.15.63:0/629103566 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fa84406f430 0x7fa8440718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:29.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.297+0000 7fa869800640 1 --2- 172.21.15.63:0/629103566 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fa84406f430 0x7fa8440718f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa858000f70 tx=0x7fa858007cb0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:29.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.301+0000 7fa861600640 1 -- 172.21.15.63:0/629103566 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fa85c020070 con 0x7fa864152ac0 2024-05-21T01:20:29.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.469+0000 7fa86ac00640 1 -- 172.21.15.63:0/629103566 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa8641569e0 con 0x7fa864152ac0 2024-05-21T01:20:29.477 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.473+0000 7fa861600640 1 -- 172.21.15.63:0/629103566 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18482 (secure 0 0 0) 0x7fa85c05c410 con 0x7fa864152ac0 2024-05-21T01:20:29.477 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-05-21T01:20:29.477 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":25,"fsid":"9a7cbd84-ceb2-41c8-8b6e-ab931f86c51a","created":"2024-05-21T01:19:37.688082+0000","modified":"2024-05-21T01:19:58.978125+0000","last_up_change":"2024-05-21T01:19:48.472107+0000","last_in_change":"2024-05-21T01:19:39.973975+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-21T01:19:46.485266+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-21T01:19:52.032741+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-21T01:19:52.867322+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-21T01:19:56.562363+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cda28135-00bb-4194-adcb-e0abf3ae43f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":3740454920},{"type":"v1","addr":"172.21.15.63:6801","nonce":3740454920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":3740454920},{"type":"v1","addr":"172.21.15.63:6804","nonce":3740454920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":3740454920},{"type":"v1","addr":"172.21.15.63:6812","nonce":3740454920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":3740454920},{"type":"v1","addr":"172.21.15.63:6808","nonce":3740454920}]},"public_addr":"172.21.15.63:6801/3740454920","cluster_addr":"172.21.15.63:6804/3740454920","heartbeat_back_addr":"172.21.15.63:6812/3740454920","heartbeat_front_addr":"172.21.15.63:6808/3740454920","state":["exists","up"]},{"osd":1,"uuid":"4aeb370d-ec2f-4a91-b17b-035fd72bdaea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6803","nonce":896993303},{"type":"v1","addr":"172.21.15.63:6805","nonce":896993303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6807","nonce":896993303},{"type":"v1","addr":"172.21.15.63:6809","nonce":896993303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":896993303},{"type":"v1","addr":"172.21.15.63:6816","nonce":896993303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6811","nonce":896993303},{"type":"v1","addr":"172.21.15.63:6813","nonce":896993303}]},"public_addr":"172.21.15.63:6805/896993303","cluster_addr":"172.21.15.63:6809/896993303","heartbeat_back_addr":"172.21.15.63:6816/896993303","heartbeat_front_addr":"172.21.15.63:6813/896993303","state":["exists","up"]},{"osd":2,"uuid":"8368b112-35a3-43cf-ad1c-803f05708091","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":845807419},{"type":"v1","addr":"172.21.15.63:6817","nonce":845807419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":845807419},{"type":"v1","addr":"172.21.15.63:6819","nonce":845807419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":845807419},{"type":"v1","addr":"172.21.15.63:6823","nonce":845807419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":845807419},{"type":"v1","addr":"172.21.15.63:6821","nonce":845807419}]},"public_addr":"172.21.15.63:6817/845807419","cluster_addr":"172.21.15.63:6819/845807419","heartbeat_back_addr":"172.21.15.63:6823/845807419","heartbeat_front_addr":"172.21.15.63:6821/845807419","state":["exists","up"]},{"osd":3,"uuid":"26208950-e3ca-4b9a-94cd-c159453a5dfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":521563809},{"type":"v1","addr":"172.21.15.63:6825","nonce":521563809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":521563809},{"type":"v1","addr":"172.21.15.63:6827","nonce":521563809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":521563809},{"type":"v1","addr":"172.21.15.63:6831","nonce":521563809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":521563809},{"type":"v1","addr":"172.21.15.63:6829","nonce":521563809}]},"public_addr":"172.21.15.63:6825/521563809","cluster_addr":"172.21.15.63:6827/521563809","heartbeat_back_addr":"172.21.15.63:6831/521563809","heartbeat_front_addr":"172.21.15.63:6829/521563809","state":["exists","up"]},{"osd":4,"uuid":"d8c93283-1e10-4419-9934-d5048c5d0ad1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":2660673588},{"type":"v1","addr":"172.21.15.131:6801","nonce":2660673588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":2660673588},{"type":"v1","addr":"172.21.15.131:6803","nonce":2660673588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":2660673588},{"type":"v1","addr":"172.21.15.131:6807","nonce":2660673588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":2660673588},{"type":"v1","addr":"172.21.15.131:6805","nonce":2660673588}]},"public_addr":"172.21.15.131:6801/2660673588","cluster_addr":"172.21.15.131:6803/2660673588","heartbeat_back_addr":"172.21.15.131:6807/2660673588","heartbeat_front_addr":"172.21.15.131:6805/2660673588","state":["exists","up"]},{"osd":5,"uuid":"93a6fe9b-eaa6-4474-bf9b-ae0571feacf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6809","nonce":2508702891},{"type":"v1","addr":"172.21.15.131:6811","nonce":2508702891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6813","nonce":2508702891},{"type":"v1","addr":"172.21.15.131:6815","nonce":2508702891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6821","nonce":2508702891},{"type":"v1","addr":"172.21.15.131:6823","nonce":2508702891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6817","nonce":2508702891},{"type":"v1","addr":"172.21.15.131:6819","nonce":2508702891}]},"public_addr":"172.21.15.131:6811/2508702891","cluster_addr":"172.21.15.131:6815/2508702891","heartbeat_back_addr":"172.21.15.131:6823/2508702891","heartbeat_front_addr":"172.21.15.131:6819/2508702891","state":["exists","up"]},{"osd":6,"uuid":"e05e6c8c-2dda-49ab-8116-5ea9038d0f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":614380392},{"type":"v1","addr":"172.21.15.131:6810","nonce":614380392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":614380392},{"type":"v1","addr":"172.21.15.131:6814","nonce":614380392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":614380392},{"type":"v1","addr":"172.21.15.131:6822","nonce":614380392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":614380392},{"type":"v1","addr":"172.21.15.131:6818","nonce":614380392}]},"public_addr":"172.21.15.131:6810/614380392","cluster_addr":"172.21.15.131:6814/614380392","heartbeat_back_addr":"172.21.15.131:6822/614380392","heartbeat_front_addr":"172.21.15.131:6818/614380392","state":["exists","up"]},{"osd":7,"uuid":"0b393e5e-eeef-4e32-b23a-d405a8b0e7b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":4219797450},{"type":"v1","addr":"172.21.15.131:6825","nonce":4219797450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":4219797450},{"type":"v1","addr":"172.21.15.131:6827","nonce":4219797450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":4219797450},{"type":"v1","addr":"172.21.15.131:6831","nonce":4219797450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":4219797450},{"type":"v1","addr":"172.21.15.131:6829","nonce":4219797450}]},"public_addr":"172.21.15.131:6825/4219797450","cluster_addr":"172.21.15.131:6827/4219797450","heartbeat_back_addr":"172.21.15.131:6831/4219797450","heartbeat_front_addr":"172.21.15.131:6829/4219797450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.647841+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.912560+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.684614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.936286+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.380500+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.553497+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.517866+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.310320+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-21T01:20:29.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.473+0000 7fa86ac00640 1 -- 172.21.15.63:0/629103566 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fa84406f430 msgr2=0x7fa8440718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:29.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.473+0000 7fa86ac00640 1 --2- 172.21.15.63:0/629103566 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fa84406f430 0x7fa8440718f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa858000f70 tx=0x7fa858007cb0 comp rx=0 tx=0).stop 2024-05-21T01:20:29.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.473+0000 7fa86ac00640 1 -- 172.21.15.63:0/629103566 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa864152ac0 msgr2=0x7fa864150540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:29.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.473+0000 7fa86ac00640 1 --2- 172.21.15.63:0/629103566 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa864152ac0 0x7fa864150540 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa85c00c7b0 tx=0x7fa85c00cc70 comp rx=0 tx=0).stop 2024-05-21T01:20:29.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.473+0000 7fa86ac00640 1 -- 172.21.15.63:0/629103566 shutdown_connections 2024-05-21T01:20:29.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.473+0000 7fa86ac00640 1 --2- 172.21.15.63:0/629103566 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fa84406f430 0x7fa8440718f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:29.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.473+0000 7fa86ac00640 1 --2- 172.21.15.63:0/629103566 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa864152ac0 0x7fa864150540 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:29.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.473+0000 7fa86ac00640 1 --2- 172.21.15.63:0/629103566 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa8640c5cf0 0x7fa864161920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:29.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.473+0000 7fa86ac00640 1 --2- 172.21.15.63:0/629103566 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa86406c4a0 0x7fa864157610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:29.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.473+0000 7fa86ac00640 1 -- 172.21.15.63:0/629103566 >> 172.21.15.63:0/629103566 conn(0x7fa8640cdde0 msgr2=0x7fa8640cb830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:29.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.473+0000 7fa86ac00640 1 -- 172.21.15.63:0/629103566 shutdown_connections 2024-05-21T01:20:29.480 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.473+0000 7fa86ac00640 1 -- 172.21.15.63:0/629103566 wait complete. 2024-05-21T01:20:29.497 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-21T01:20:29.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.633+0000 7f85d9000640 1 Processor -- start 2024-05-21T01:20:29.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.633+0000 7f85d9000640 1 -- start start 2024-05-21T01:20:29.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.633+0000 7f85d9000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f85d4156150 0x7f85d415bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:29.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.633+0000 7f85d9000640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f85d4073480 0x7f85d4071190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:29.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.633+0000 7f85d9000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f85d40716d0 0x7f85d406d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:29.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.633+0000 7f85d9000640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f85d4070a20 con 0x7f85d4073480 2024-05-21T01:20:29.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.633+0000 7f85d9000640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f85d406f510 con 0x7f85d40716d0 2024-05-21T01:20:29.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.633+0000 7f85d9000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f85d4073ac0 con 0x7f85d4156150 2024-05-21T01:20:29.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.633+0000 7f85cbe00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f85d4073480 0x7f85d4071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:29.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.633+0000 7f85cbe00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f85d4073480 0x7f85d4071190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45040/0 (socket says 172.21.15.63:45040) 2024-05-21T01:20:29.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.633+0000 7f85cbe00640 1 -- 172.21.15.63:0/2498633489 learned_addr learned my addr 172.21.15.63:0/2498633489 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:29.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.633+0000 7f85d1e00640 1 --2- 172.21.15.63:0/2498633489 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f85d4156150 0x7f85d415bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:29.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.633+0000 7f85d2800640 1 --2- 172.21.15.63:0/2498633489 >> v2:172.21.15.131:3300/0 conn(0x7f85d40716d0 0x7f85d406d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:29.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.633+0000 7f85cbe00640 1 -- 172.21.15.63:0/2498633489 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f85d4156150 msgr2=0x7f85d415bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:29.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.633+0000 7f85cbe00640 1 --2- 172.21.15.63:0/2498633489 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f85d4156150 0x7f85d415bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:29.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.633+0000 7f85cbe00640 1 -- 172.21.15.63:0/2498633489 >> v2:172.21.15.131:3300/0 conn(0x7f85d40716d0 msgr2=0x7f85d406d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:29.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.633+0000 7f85cbe00640 1 --2- 172.21.15.63:0/2498633489 >> v2:172.21.15.131:3300/0 conn(0x7f85d40716d0 0x7f85d406d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:29.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.633+0000 7f85cbe00640 1 -- 172.21.15.63:0/2498633489 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85d4073da0 con 0x7f85d4073480 2024-05-21T01:20:29.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.637+0000 7f85cbe00640 1 --2- 172.21.15.63:0/2498633489 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85d4073480 0x7f85d4071190 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f85d4076810 tx=0x7f85bc01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=461789cd4e530ac0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:29.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.637+0000 7f85d1400640 1 -- 172.21.15.63:0/2498633489 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85bc0b0070 con 0x7f85d4073480 2024-05-21T01:20:29.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.637+0000 7f85d1400640 1 -- 172.21.15.63:0/2498633489 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85bc0ab600 con 0x7f85d4073480 2024-05-21T01:20:29.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.637+0000 7f85d1400640 1 -- 172.21.15.63:0/2498633489 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85bc0ab9d0 con 0x7f85d4073480 2024-05-21T01:20:29.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.637+0000 7f85d9000640 1 -- 172.21.15.63:0/2498633489 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85d4073480 msgr2=0x7f85d4071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:29.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.637+0000 7f85d9000640 1 --2- 172.21.15.63:0/2498633489 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85d4073480 0x7f85d4071190 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f85d4076810 tx=0x7f85bc01c490 comp rx=0 tx=0).stop 2024-05-21T01:20:29.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.637+0000 7f85d9000640 1 -- 172.21.15.63:0/2498633489 shutdown_connections 2024-05-21T01:20:29.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.637+0000 7f85d9000640 1 --2- 172.21.15.63:0/2498633489 >> v2:172.21.15.131:3300/0 conn(0x7f85d40716d0 0x7f85d406d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:29.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.637+0000 7f85d9000640 1 --2- 172.21.15.63:0/2498633489 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85d4073480 0x7f85d4071190 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:29.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.637+0000 7f85d9000640 1 --2- 172.21.15.63:0/2498633489 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f85d4156150 0x7f85d415bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:29.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.637+0000 7f85d9000640 1 -- 172.21.15.63:0/2498633489 >> 172.21.15.63:0/2498633489 conn(0x7f85d40cbf10 msgr2=0x7f85d40cc320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:29.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.637+0000 7f85d9000640 1 -- 172.21.15.63:0/2498633489 shutdown_connections 2024-05-21T01:20:29.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.637+0000 7f85d9000640 1 -- 172.21.15.63:0/2498633489 wait complete. 2024-05-21T01:20:29.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.641+0000 7f85d9000640 1 Processor -- start 2024-05-21T01:20:29.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.641+0000 7f85d9000640 1 -- start start 2024-05-21T01:20:29.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.641+0000 7f85d9000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f85d40716d0 0x7f85d415bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:29.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.641+0000 7f85d9000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85d4073480 0x7f85d40c6810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:29.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.641+0000 7f85d9000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f85d4156150 0x7f85d41f7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:29.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.641+0000 7f85d9000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f85d415fc60 con 0x7f85d4073480 2024-05-21T01:20:29.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.641+0000 7f85d9000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f85d415fae0 con 0x7f85d40716d0 2024-05-21T01:20:29.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.641+0000 7f85d9000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f85d415fde0 con 0x7f85d4156150 2024-05-21T01:20:29.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.641+0000 7f85cbe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85d4073480 0x7f85d40c6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:29.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.641+0000 7f85cbe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85d4073480 0x7f85d40c6810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45052/0 (socket says 172.21.15.63:45052) 2024-05-21T01:20:29.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.641+0000 7f85cbe00640 1 -- 172.21.15.63:0/2654996407 learned_addr learned my addr 172.21.15.63:0/2654996407 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:29.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.641+0000 7f85d1e00640 1 --2- 172.21.15.63:0/2654996407 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f85d40716d0 0x7f85d415bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:29.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.641+0000 7f85d2800640 1 --2- 172.21.15.63:0/2654996407 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f85d4156150 0x7f85d41f7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:29.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.641+0000 7f85cbe00640 1 -- 172.21.15.63:0/2654996407 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f85d4156150 msgr2=0x7f85d41f7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:29.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.641+0000 7f85cbe00640 1 --2- 172.21.15.63:0/2654996407 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f85d4156150 0x7f85d41f7ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:29.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.641+0000 7f85cbe00640 1 -- 172.21.15.63:0/2654996407 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f85d40716d0 msgr2=0x7f85d415bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:29.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.641+0000 7f85cbe00640 1 --2- 172.21.15.63:0/2654996407 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f85d40716d0 0x7f85d415bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:29.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.641+0000 7f85cbe00640 1 -- 172.21.15.63:0/2654996407 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85d41f8f10 con 0x7f85d4073480 2024-05-21T01:20:29.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.641+0000 7f85cbe00640 1 --2- 172.21.15.63:0/2654996407 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85d4073480 0x7f85d40c6810 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f85bc01cd30 tx=0x7f85bc019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:29.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.641+0000 7f85ca000640 1 -- 172.21.15.63:0/2654996407 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85bc0b0040 con 0x7f85d4073480 2024-05-21T01:20:29.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.641+0000 7f85ca000640 1 -- 172.21.15.63:0/2654996407 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85bc0b9070 con 0x7f85d4073480 2024-05-21T01:20:29.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.641+0000 7f85ca000640 1 -- 172.21.15.63:0/2654996407 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85bc0b4660 con 0x7f85d4073480 2024-05-21T01:20:29.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.641+0000 7f85d9000640 1 -- 172.21.15.63:0/2654996407 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85d41f59c0 con 0x7f85d4073480 2024-05-21T01:20:29.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.641+0000 7f85d9000640 1 -- 172.21.15.63:0/2654996407 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85d41f4c00 con 0x7f85d4073480 2024-05-21T01:20:29.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.645+0000 7f85d9000640 1 -- 172.21.15.63:0/2654996407 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85d40507f0 con 0x7f85d4073480 2024-05-21T01:20:29.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.645+0000 7f85ca000640 1 -- 172.21.15.63:0/2654996407 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7f85bc0b4800 con 0x7f85d4073480 2024-05-21T01:20:29.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.645+0000 7f85ca000640 1 --2- 172.21.15.63:0/2654996407 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f85b006f400 0x7f85b00718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:29.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.645+0000 7f85ca000640 1 -- 172.21.15.63:0/2654996407 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f85bc128ff0 con 0x7f85d4073480 2024-05-21T01:20:29.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.645+0000 7f85d1e00640 1 --2- 172.21.15.63:0/2654996407 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f85b006f400 0x7f85b00718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:29.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.645+0000 7f85d1e00640 1 --2- 172.21.15.63:0/2654996407 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f85b006f400 0x7f85b00718c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f85c40079c0 tx=0x7f85c4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:29.655 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.649+0000 7f85ca000640 1 -- 172.21.15.63:0/2654996407 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f85bc016110 con 0x7f85d4073480 2024-05-21T01:20:29.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.853+0000 7f85d9000640 1 -- 172.21.15.63:0/2654996407 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f85d40746b0 con 0x7f85d4073480 2024-05-21T01:20:29.860 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.853+0000 7f85ca000640 1 -- 172.21.15.63:0/2654996407 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6872 (secure 0 0 0) 0x7f85bc0f5750 con 0x7f85d4073480 2024-05-21T01:20:29.860 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-05-21T01:20:29.860 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6839/3045714273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6837","nonce":3045714273},{"type":"v1","addr":"172.21.15.131:6839","nonce":3045714273}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/2978367338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":2978367338},{"type":"v1","addr":"172.21.15.131:6835","nonce":2978367338}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/3005995321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6835","nonce":3005995321},{"type":"v1","addr":"172.21.15.63:6837","nonce":3005995321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-21T01:19:53.915775+0000","modified":"2024-05-21T01:20:25.673715+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4276,"mds_1":4270,"mds_2":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"e","rank":2,"incarnation":14,"state":"up:creating","state_seq":1,"addr":"172.21.15.63:6833/574189772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":574189772},{"type":"v1","addr":"172.21.15.63:6833","nonce":574189772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4270":{"gid":4270,"name":"f","rank":1,"incarnation":10,"state":"up:active","state_seq":11,"addr":"172.21.15.131:6838/3071941741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":3071941741},{"type":"v1","addr":"172.21.15.131:6838","nonce":3071941741}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.63:6836/2892727989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":2892727989},{"type":"v1","addr":"172.21.15.63:6836","nonce":2892727989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4276,"qdb_cluster":[4276,4270]},"id":1}]} 2024-05-21T01:20:29.861 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 14 2024-05-21T01:20:29.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.857+0000 7f85d9000640 1 -- 172.21.15.63:0/2654996407 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f85b006f400 msgr2=0x7f85b00718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:29.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.857+0000 7f85d9000640 1 --2- 172.21.15.63:0/2654996407 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f85b006f400 0x7f85b00718c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f85c40079c0 tx=0x7f85c4008040 comp rx=0 tx=0).stop 2024-05-21T01:20:29.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.857+0000 7f85d9000640 1 -- 172.21.15.63:0/2654996407 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85d4073480 msgr2=0x7f85d40c6810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:29.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.857+0000 7f85d9000640 1 --2- 172.21.15.63:0/2654996407 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85d4073480 0x7f85d40c6810 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f85bc01cd30 tx=0x7f85bc019230 comp rx=0 tx=0).stop 2024-05-21T01:20:29.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.857+0000 7f85d9000640 1 -- 172.21.15.63:0/2654996407 shutdown_connections 2024-05-21T01:20:29.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.857+0000 7f85d9000640 1 --2- 172.21.15.63:0/2654996407 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f85b006f400 0x7f85b00718c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:29.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.857+0000 7f85d9000640 1 --2- 172.21.15.63:0/2654996407 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f85d4156150 0x7f85d41f7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:29.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.857+0000 7f85d9000640 1 --2- 172.21.15.63:0/2654996407 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f85d4073480 0x7f85d40c6810 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:29.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.857+0000 7f85d9000640 1 --2- 172.21.15.63:0/2654996407 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f85d40716d0 0x7f85d415bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:29.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.857+0000 7f85d9000640 1 -- 172.21.15.63:0/2654996407 >> 172.21.15.63:0/2654996407 conn(0x7f85d40cbf10 msgr2=0x7f85d406df00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:29.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.857+0000 7f85d9000640 1 -- 172.21.15.63:0/2654996407 shutdown_connections 2024-05-21T01:20:29.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:29.857+0000 7f85d9000640 1 -- 172.21.15.63:0/2654996407 wait complete. 2024-05-21T01:20:30.485 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 14, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-21T01:19:53.915775+0000', 'modified': '2024-05-21T01:20:25.673715+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 4276, 'mds_1': 4270, 'mds_2': 4267}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4267': {'gid': 4267, 'name': 'e', 'rank': 2, 'incarnation': 14, 'state': 'up:creating', 'state_seq': 1, 'addr': '172.21.15.63:6833/574189772', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6832', 'nonce': 574189772}, {'type': 'v1', 'addr': '172.21.15.63:6833', 'nonce': 574189772}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4270': {'gid': 4270, 'name': 'f', 'rank': 1, 'incarnation': 10, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.131:6838/3071941741', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.131:6836', 'nonce': 3071941741}, {'type': 'v1', 'addr': '172.21.15.131:6838', 'nonce': 3071941741}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4276': {'gid': 4276, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.63:6836/2892727989', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6834', 'nonce': 2892727989}, {'type': 'v1', 'addr': '172.21.15.63:6836', 'nonce': 2892727989}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4276, 'qdb_cluster': [4276, 4270]} 2024-05-21T01:20:30.486 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4267:up:creating 2024-05-21T01:20:31.487 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-21T01:20:31.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:31.633+0000 7f8ae5600640 1 Processor -- start 2024-05-21T01:20:31.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:31.633+0000 7f8ae5600640 1 -- start start 2024-05-21T01:20:31.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:31.637+0000 7f8ae5600640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8ae0156150 0x7f8ae015bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:31.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:31.637+0000 7f8ae5600640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8ae0073480 0x7f8ae0071190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:31.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:31.637+0000 7f8ae5600640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ae006f510 con 0x7f8ae00716d0 2024-05-21T01:20:31.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:31.637+0000 7f8ae5600640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f8ae0070a20 con 0x7f8ae0156150 2024-05-21T01:20:31.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:31.637+0000 7f8ae5600640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f8ae0073ac0 con 0x7f8ae0073480 2024-05-21T01:20:31.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:31.637+0000 7f8adea00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8ae0156150 0x7f8ae015bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:31.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:31.637+0000 7f8adf400640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f8ae00716d0 0x7f8ae006d5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58252/0 (socket says 172.21.15.63:58252) 2024-05-21T01:20:31.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:31.637+0000 7f8adea00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8ae0156150 0x7f8ae015bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45068/0 (socket says 172.21.15.63:45068) 2024-05-21T01:20:31.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:31.637+0000 7f8adf400640 1 -- 172.21.15.63:0/1581710626 learned_addr learned my addr 172.21.15.63:0/1581710626 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-05-21T01:20:31.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:31.637+0000 7f8ad6000640 1 --2- 172.21.15.63:0/1581710626 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8ae0073480 0x7f8ae0071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:31.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:31.637+0000 7f8adea00640 1 -- 172.21.15.63:0/1581710626 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8ae0073480 msgr2=0x7f8ae0071190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:31.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:31.637+0000 7f8adea00640 1 --2- 172.21.15.63:0/1581710626 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8ae0073480 0x7f8ae0071190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:31.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:31.637+0000 7f8adea00640 1 -- 172.21.15.63:0/1581710626 >> v1:172.21.15.63:6789/0 conn(0x7f8ae00716d0 legacy=0x7f8ae006d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:31.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:31.637+0000 7f8adea00640 1 -- 172.21.15.63:0/1581710626 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ae0073da0 con 0x7f8ae0156150 2024-05-21T01:20:31.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:31.637+0000 7f8ade000640 1 -- 172.21.15.63:0/1581710626 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2300211373 0 0) 0x7f8ae006f510 con 0x7f8ae00716d0 2024-05-21T01:20:31.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:31.641+0000 7f8adea00640 1 --2- 172.21.15.63:0/1581710626 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8ae0156150 0x7f8ae015bd30 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8ae0070ba0 tx=0x7f8ad001c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce68d2424de832f0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:31.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:31.641+0000 7f8ade000640 1 -- 172.21.15.63:0/1581710626 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ad00b2070 con 0x7f8ae0156150 2024-05-21T01:20:31.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:31.641+0000 7f8ade000640 1 -- 172.21.15.63:0/1581710626 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ad00a5890 con 0x7f8ae0156150 2024-05-21T01:20:31.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:31.641+0000 7f8ade000640 1 -- 172.21.15.63:0/1581710626 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ad00a5c60 con 0x7f8ae0156150 2024-05-21T01:20:31.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:31.641+0000 7f8ae5600640 1 -- 172.21.15.63:0/1581710626 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8ae0156150 msgr2=0x7f8ae015bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:31.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:31.641+0000 7f8ae5600640 1 --2- 172.21.15.63:0/1581710626 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8ae0156150 0x7f8ae015bd30 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8ae0070ba0 tx=0x7f8ad001c8c0 comp rx=0 tx=0).stop 2024-05-21T01:20:31.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:31.641+0000 7f8ae5600640 1 -- 172.21.15.63:0/1581710626 shutdown_connections 2024-05-21T01:20:31.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:31.641+0000 7f8ae5600640 1 --2- 172.21.15.63:0/1581710626 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8ae0073480 0x7f8ae0071190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:31.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:31.641+0000 7f8ae5600640 1 --2- 172.21.15.63:0/1581710626 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8ae0156150 0x7f8ae015bd30 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:31.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:31.641+0000 7f8ae5600640 1 -- 172.21.15.63:0/1581710626 >> 172.21.15.63:0/1581710626 conn(0x7f8ae00cbf10 msgr2=0x7f8ae00cc320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:31.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:31.641+0000 7f8ae5600640 1 -- 172.21.15.63:0/1581710626 shutdown_connections 2024-05-21T01:20:31.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:31.641+0000 7f8ae5600640 1 -- 172.21.15.63:0/1581710626 wait complete. 2024-05-21T01:20:31.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:31.641+0000 7f8ae5600640 1 Processor -- start 2024-05-21T01:20:31.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:31.641+0000 7f8ae5600640 1 -- start start 2024-05-21T01:20:31.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:31.645+0000 7f8ae5600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8ae00716d0 0x7f8ae00ce000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:31.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:31.645+0000 7f8ae5600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8ae0073480 0x7f8ae014d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:31.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:31.645+0000 7f8ae5600640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8ae0156150 0x7f8ae00c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:31.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:31.645+0000 7f8ae5600640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f8ae006de40 con 0x7f8ae0073480 2024-05-21T01:20:31.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:31.645+0000 7f8ae5600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f8ae006dcc0 con 0x7f8ae00716d0 2024-05-21T01:20:31.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:31.645+0000 7f8ae5600640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f8ae0168ed0 con 0x7f8ae0156150 2024-05-21T01:20:31.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:31.645+0000 7f8ad6000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8ae0073480 0x7f8ae014d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:31.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:31.645+0000 7f8ad6000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8ae0073480 0x7f8ae014d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45070/0 (socket says 172.21.15.63:45070) 2024-05-21T01:20:31.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:31.645+0000 7f8ad6000640 1 -- 172.21.15.63:0/865198346 learned_addr learned my addr 172.21.15.63:0/865198346 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:31.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:31.645+0000 7f8adea00640 1 --2- 172.21.15.63:0/865198346 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8ae00716d0 0x7f8ae00ce000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:31.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:31.645+0000 7f8adf400640 1 --2- 172.21.15.63:0/865198346 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8ae0156150 0x7f8ae00c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:31.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:31.645+0000 7f8ad6000640 1 -- 172.21.15.63:0/865198346 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8ae0156150 msgr2=0x7f8ae00c91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:31.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:31.645+0000 7f8ad6000640 1 --2- 172.21.15.63:0/865198346 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8ae0156150 0x7f8ae00c91d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:31.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:31.645+0000 7f8ad6000640 1 -- 172.21.15.63:0/865198346 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8ae00716d0 msgr2=0x7f8ae00ce000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:31.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:31.645+0000 7f8ad6000640 1 --2- 172.21.15.63:0/865198346 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8ae00716d0 0x7f8ae00ce000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:31.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:31.645+0000 7f8ad6000640 1 -- 172.21.15.63:0/865198346 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ae00cf200 con 0x7f8ae0073480 2024-05-21T01:20:31.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:31.645+0000 7f8adf400640 1 --2- 172.21.15.63:0/865198346 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8ae0156150 0x7f8ae00c91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T01:20:31.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:31.645+0000 7f8ad6000640 1 --2- 172.21.15.63:0/865198346 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8ae0073480 0x7f8ae014d550 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8ac800d5f0 tx=0x7f8ac800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:31.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:31.645+0000 7f8ad7400640 1 -- 172.21.15.63:0/865198346 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ac80125f0 con 0x7f8ae0073480 2024-05-21T01:20:31.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:31.645+0000 7f8ad7400640 1 -- 172.21.15.63:0/865198346 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ac8019070 con 0x7f8ae0073480 2024-05-21T01:20:31.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:31.645+0000 7f8ae5600640 1 -- 172.21.15.63:0/865198346 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ae00cf4e0 con 0x7f8ae0073480 2024-05-21T01:20:31.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:31.645+0000 7f8ad7400640 1 -- 172.21.15.63:0/865198346 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ac80129b0 con 0x7f8ae0073480 2024-05-21T01:20:31.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:31.645+0000 7f8ae5600640 1 -- 172.21.15.63:0/865198346 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ae00cfaa0 con 0x7f8ae0073480 2024-05-21T01:20:31.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:31.645+0000 7f8ae5600640 1 -- 172.21.15.63:0/865198346 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ae00507f0 con 0x7f8ae0073480 2024-05-21T01:20:31.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:31.645+0000 7f8ad7400640 1 -- 172.21.15.63:0/865198346 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7f8ac8012b50 con 0x7f8ae0073480 2024-05-21T01:20:31.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:31.649+0000 7f8ad7400640 1 --2- 172.21.15.63:0/865198346 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f8abc06f400 0x7f8abc0718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:31.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:31.649+0000 7f8ad7400640 1 -- 172.21.15.63:0/865198346 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f8ac808f930 con 0x7f8ae0073480 2024-05-21T01:20:31.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:31.649+0000 7f8adea00640 1 --2- 172.21.15.63:0/865198346 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f8abc06f400 0x7f8abc0718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:31.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:31.649+0000 7f8adea00640 1 --2- 172.21.15.63:0/865198346 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f8abc06f400 0x7f8abc0718c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8ad00af000 tx=0x7f8ad00a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:31.656 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:31.653+0000 7f8ad7400640 1 -- 172.21.15.63:0/865198346 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f8ac805c560 con 0x7f8ae0073480 2024-05-21T01:20:31.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:31.853+0000 7f8ae5600640 1 -- 172.21.15.63:0/865198346 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8ae01501e0 con 0x7f8ae0073480 2024-05-21T01:20:31.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:31.853+0000 7f8ad7400640 1 -- 172.21.15.63:0/865198346 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+6876 (secure 0 0 0) 0x7f8ac805be60 con 0x7f8ae0073480 2024-05-21T01:20:31.860 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-05-21T01:20:31.860 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6839/3045714273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6837","nonce":3045714273},{"type":"v1","addr":"172.21.15.131:6839","nonce":3045714273}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/2978367338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":2978367338},{"type":"v1","addr":"172.21.15.131:6835","nonce":2978367338}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/3005995321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6835","nonce":3005995321},{"type":"v1","addr":"172.21.15.63:6837","nonce":3005995321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-21T01:19:53.915775+0000","modified":"2024-05-21T01:20:31.724475+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4276,"mds_1":4270,"mds_2":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"e","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.63:6833/574189772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":574189772},{"type":"v1","addr":"172.21.15.63:6833","nonce":574189772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4270":{"gid":4270,"name":"f","rank":1,"incarnation":10,"state":"up:active","state_seq":11,"addr":"172.21.15.131:6838/3071941741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":3071941741},{"type":"v1","addr":"172.21.15.131:6838","nonce":3071941741}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.63:6836/2892727989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":2892727989},{"type":"v1","addr":"172.21.15.63:6836","nonce":2892727989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4276,"qdb_cluster":[4267,4270,4276]},"id":1}]} 2024-05-21T01:20:31.860 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 15 2024-05-21T01:20:31.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:31.857+0000 7f8ae5600640 1 -- 172.21.15.63:0/865198346 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f8abc06f400 msgr2=0x7f8abc0718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:31.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:31.857+0000 7f8ae5600640 1 --2- 172.21.15.63:0/865198346 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f8abc06f400 0x7f8abc0718c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8ad00af000 tx=0x7f8ad00a7070 comp rx=0 tx=0).stop 2024-05-21T01:20:31.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:31.857+0000 7f8ae5600640 1 -- 172.21.15.63:0/865198346 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8ae0073480 msgr2=0x7f8ae014d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:31.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:31.857+0000 7f8ae5600640 1 --2- 172.21.15.63:0/865198346 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8ae0073480 0x7f8ae014d550 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8ac800d5f0 tx=0x7f8ac800dab0 comp rx=0 tx=0).stop 2024-05-21T01:20:31.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:31.857+0000 7f8ae5600640 1 -- 172.21.15.63:0/865198346 shutdown_connections 2024-05-21T01:20:31.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:31.857+0000 7f8ae5600640 1 --2- 172.21.15.63:0/865198346 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f8abc06f400 0x7f8abc0718c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:31.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:31.857+0000 7f8ae5600640 1 --2- 172.21.15.63:0/865198346 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8ae0156150 0x7f8ae00c91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:31.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:31.857+0000 7f8ae5600640 1 --2- 172.21.15.63:0/865198346 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8ae0073480 0x7f8ae014d550 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:31.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:31.857+0000 7f8ae5600640 1 --2- 172.21.15.63:0/865198346 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8ae00716d0 0x7f8ae00ce000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:31.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:31.857+0000 7f8ae5600640 1 -- 172.21.15.63:0/865198346 >> 172.21.15.63:0/865198346 conn(0x7f8ae00cbf10 msgr2=0x7f8ae0146a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:31.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:31.857+0000 7f8ae5600640 1 -- 172.21.15.63:0/865198346 shutdown_connections 2024-05-21T01:20:31.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:31.857+0000 7f8ae5600640 1 -- 172.21.15.63:0/865198346 wait complete. 2024-05-21T01:20:32.485 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 15, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-21T01:19:53.915775+0000', 'modified': '2024-05-21T01:20:31.724475+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 4276, 'mds_1': 4270, 'mds_2': 4267}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4267': {'gid': 4267, 'name': 'e', 'rank': 2, 'incarnation': 14, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.63:6833/574189772', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6832', 'nonce': 574189772}, {'type': 'v1', 'addr': '172.21.15.63:6833', 'nonce': 574189772}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4270': {'gid': 4270, 'name': 'f', 'rank': 1, 'incarnation': 10, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.131:6838/3071941741', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.131:6836', 'nonce': 3071941741}, {'type': 'v1', 'addr': '172.21.15.131:6838', 'nonce': 3071941741}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4276': {'gid': 4276, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.63:6836/2892727989', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6834', 'nonce': 2892727989}, {'type': 'v1', 'addr': '172.21.15.63:6836', 'nonce': 2892727989}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4276, 'qdb_cluster': [4267, 4270, 4276]} 2024-05-21T01:20:32.485 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-05-21T01:20:32.485 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2024-05-21T01:20:32.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.633+0000 7fd694e00640 1 Processor -- start 2024-05-21T01:20:32.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.633+0000 7fd694e00640 1 -- start start 2024-05-21T01:20:32.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.633+0000 7fd694e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd690156010 0x7fd69015c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:32.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.633+0000 7fd694e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd6901563f0 0x7fd6900c8e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:32.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.633+0000 7fd694e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd6900c93b0 0x7fd69006ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:32.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.633+0000 7fd694e00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7fd69015f560 con 0x7fd6901563f0 2024-05-21T01:20:32.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.633+0000 7fd694e00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fd69015f800 con 0x7fd6900c93b0 2024-05-21T01:20:32.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.633+0000 7fd694e00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fd69015fae0 con 0x7fd690156010 2024-05-21T01:20:32.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.633+0000 7fd685400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd6901563f0 0x7fd6900c8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:32.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.633+0000 7fd685400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd6901563f0 0x7fd6900c8e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45084/0 (socket says 172.21.15.63:45084) 2024-05-21T01:20:32.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.633+0000 7fd685400640 1 -- 172.21.15.63:0/4137578893 learned_addr learned my addr 172.21.15.63:0/4137578893 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:32.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.633+0000 7fd68de00640 1 --2- 172.21.15.63:0/4137578893 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd690156010 0x7fd69015c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:32.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.633+0000 7fd68e800640 1 --2- 172.21.15.63:0/4137578893 >> v2:172.21.15.131:3300/0 conn(0x7fd6900c93b0 0x7fd69006ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:32.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.633+0000 7fd685400640 1 -- 172.21.15.63:0/4137578893 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd690156010 msgr2=0x7fd69015c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:32.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.633+0000 7fd685400640 1 --2- 172.21.15.63:0/4137578893 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd690156010 0x7fd69015c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:32.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.633+0000 7fd685400640 1 -- 172.21.15.63:0/4137578893 >> v2:172.21.15.131:3300/0 conn(0x7fd6900c93b0 msgr2=0x7fd69006ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:32.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.633+0000 7fd685400640 1 --2- 172.21.15.63:0/4137578893 >> v2:172.21.15.131:3300/0 conn(0x7fd6900c93b0 0x7fd69006ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:32.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.637+0000 7fd685400640 1 -- 172.21.15.63:0/4137578893 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd69015fdc0 con 0x7fd6901563f0 2024-05-21T01:20:32.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.637+0000 7fd68e800640 1 --2- 172.21.15.63:0/4137578893 >> v2:172.21.15.131:3300/0 conn(0x7fd6900c93b0 0x7fd69006ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T01:20:32.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.637+0000 7fd685400640 1 --2- 172.21.15.63:0/4137578893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd6901563f0 0x7fd6900c8e70 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd690070d10 tx=0x7fd67801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f29142baf326c601 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:32.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.637+0000 7fd68d400640 1 -- 172.21.15.63:0/4137578893 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6780b0070 con 0x7fd6901563f0 2024-05-21T01:20:32.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.637+0000 7fd68d400640 1 -- 172.21.15.63:0/4137578893 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6780ab600 con 0x7fd6901563f0 2024-05-21T01:20:32.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.637+0000 7fd68d400640 1 -- 172.21.15.63:0/4137578893 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6780ab9d0 con 0x7fd6901563f0 2024-05-21T01:20:32.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.637+0000 7fd694e00640 1 -- 172.21.15.63:0/4137578893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd6901563f0 msgr2=0x7fd6900c8e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:32.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.637+0000 7fd694e00640 1 --2- 172.21.15.63:0/4137578893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd6901563f0 0x7fd6900c8e70 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd690070d10 tx=0x7fd67801c520 comp rx=0 tx=0).stop 2024-05-21T01:20:32.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.637+0000 7fd694e00640 1 -- 172.21.15.63:0/4137578893 shutdown_connections 2024-05-21T01:20:32.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.637+0000 7fd694e00640 1 --2- 172.21.15.63:0/4137578893 >> v2:172.21.15.131:3300/0 conn(0x7fd6900c93b0 0x7fd69006ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:32.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.637+0000 7fd694e00640 1 --2- 172.21.15.63:0/4137578893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd6901563f0 0x7fd6900c8e70 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:32.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.637+0000 7fd694e00640 1 --2- 172.21.15.63:0/4137578893 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd690156010 0x7fd69015c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:32.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.637+0000 7fd694e00640 1 -- 172.21.15.63:0/4137578893 >> 172.21.15.63:0/4137578893 conn(0x7fd6900ce640 msgr2=0x7fd6900cea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:32.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.637+0000 7fd694e00640 1 -- 172.21.15.63:0/4137578893 shutdown_connections 2024-05-21T01:20:32.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.637+0000 7fd694e00640 1 -- 172.21.15.63:0/4137578893 wait complete. 2024-05-21T01:20:32.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.641+0000 7fd694e00640 1 Processor -- start 2024-05-21T01:20:32.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.641+0000 7fd694e00640 1 -- start start 2024-05-21T01:20:32.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.641+0000 7fd694e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6900c93b0 0x7fd6901f57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:32.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.641+0000 7fd694e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd690156010 0x7fd690154870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:32.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.641+0000 7fd694e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd6901563f0 0x7fd69015a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:32.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.641+0000 7fd694e00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fd6900c9de0 con 0x7fd690156010 2024-05-21T01:20:32.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.641+0000 7fd694e00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd6900c9c60 con 0x7fd6900c93b0 2024-05-21T01:20:32.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.641+0000 7fd694e00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fd6900c9f60 con 0x7fd6901563f0 2024-05-21T01:20:32.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.641+0000 7fd685400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd690156010 0x7fd690154870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:32.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.641+0000 7fd685400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd690156010 0x7fd690154870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45098/0 (socket says 172.21.15.63:45098) 2024-05-21T01:20:32.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.641+0000 7fd685400640 1 -- 172.21.15.63:0/2761273010 learned_addr learned my addr 172.21.15.63:0/2761273010 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:32.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.641+0000 7fd68e800640 1 --2- 172.21.15.63:0/2761273010 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd6901563f0 0x7fd69015a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:32.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.641+0000 7fd68de00640 1 --2- 172.21.15.63:0/2761273010 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6900c93b0 0x7fd6901f57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:32.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.641+0000 7fd685400640 1 -- 172.21.15.63:0/2761273010 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd6901563f0 msgr2=0x7fd69015a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:32.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.641+0000 7fd685400640 1 --2- 172.21.15.63:0/2761273010 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd6901563f0 0x7fd69015a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:32.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.641+0000 7fd685400640 1 -- 172.21.15.63:0/2761273010 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6900c93b0 msgr2=0x7fd6901f57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:32.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.641+0000 7fd685400640 1 --2- 172.21.15.63:0/2761273010 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6900c93b0 0x7fd6901f57b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:32.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.641+0000 7fd685400640 1 -- 172.21.15.63:0/2761273010 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6901f9220 con 0x7fd690156010 2024-05-21T01:20:32.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.641+0000 7fd68de00640 1 --2- 172.21.15.63:0/2761273010 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6900c93b0 0x7fd6901f57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T01:20:32.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.641+0000 7fd685400640 1 --2- 172.21.15.63:0/2761273010 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd690156010 0x7fd690154870 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd6780ae040 tx=0x7fd6780192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:32.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.641+0000 7fd686a00640 1 -- 172.21.15.63:0/2761273010 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6780b0040 con 0x7fd690156010 2024-05-21T01:20:32.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.641+0000 7fd686a00640 1 -- 172.21.15.63:0/2761273010 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6780bc070 con 0x7fd690156010 2024-05-21T01:20:32.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.641+0000 7fd686a00640 1 -- 172.21.15.63:0/2761273010 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6780b6640 con 0x7fd690156010 2024-05-21T01:20:32.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.641+0000 7fd694e00640 1 -- 172.21.15.63:0/2761273010 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6901595e0 con 0x7fd690156010 2024-05-21T01:20:32.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.645+0000 7fd694e00640 1 -- 172.21.15.63:0/2761273010 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6901f8740 con 0x7fd690156010 2024-05-21T01:20:32.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.645+0000 7fd686a00640 1 -- 172.21.15.63:0/2761273010 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7fd6780b67e0 con 0x7fd690156010 2024-05-21T01:20:32.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.645+0000 7fd686a00640 1 --2- 172.21.15.63:0/2761273010 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fd66c06f400 0x7fd66c0718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:32.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.645+0000 7fd6981f4000 1 Processor -- start 2024-05-21T01:20:32.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.645+0000 7fd686a00640 1 -- 172.21.15.63:0/2761273010 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fd678129830 con 0x7fd690156010 2024-05-21T01:20:32.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.649+0000 7fd6981f4000 1 -- start start 2024-05-21T01:20:32.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.649+0000 7fd68de00640 1 --2- 172.21.15.63:0/2761273010 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fd66c06f400 0x7fd66c0718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:32.654 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.649+0000 7fd6981f4000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555f3e8d64a0 0x555f3e89f200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:32.654 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.649+0000 7fd6981f4000 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555f3e89f740 0x555f3e8be9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:32.654 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.649+0000 7fd6981f4000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555f3e8beef0 0x555f3e8bf2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:32.654 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.649+0000 7fd6981f4000 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x555f3e6f36d0 con 0x555f3e89f740 2024-05-21T01:20:32.654 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.649+0000 7fd6981f4000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x555f3e6e3270 con 0x555f3e8beef0 2024-05-21T01:20:32.655 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.649+0000 7fd6981f4000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x555f3e6e72b0 con 0x555f3e8d64a0 2024-05-21T01:20:32.655 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.649+0000 7fd68de00640 1 --2- 172.21.15.63:0/2761273010 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fd66c06f400 0x7fd66c0718c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd6800074c0 tx=0x7fd68000b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:32.655 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.649+0000 7fd685400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555f3e89f740 0x555f3e8be9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:32.655 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.649+0000 7fd685400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555f3e89f740 0x555f3e8be9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45112/0 (socket says 172.21.15.63:45112) 2024-05-21T01:20:32.655 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.649+0000 7fd685400640 1 -- 172.21.15.63:0/1344405608 learned_addr learned my addr 172.21.15.63:0/1344405608 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:32.655 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.649+0000 7fd68de00640 1 --2- 172.21.15.63:0/1344405608 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555f3e8d64a0 0x555f3e89f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:32.655 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.649+0000 7fd68e800640 1 --2- 172.21.15.63:0/1344405608 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555f3e8beef0 0x555f3e8bf2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:32.655 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.649+0000 7fd685400640 1 -- 172.21.15.63:0/1344405608 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555f3e8d64a0 msgr2=0x555f3e89f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:32.655 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.649+0000 7fd685400640 1 --2- 172.21.15.63:0/1344405608 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555f3e8d64a0 0x555f3e89f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:32.655 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.649+0000 7fd685400640 1 -- 172.21.15.63:0/1344405608 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555f3e8beef0 msgr2=0x555f3e8bf2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:32.655 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.649+0000 7fd685400640 1 --2- 172.21.15.63:0/1344405608 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555f3e8beef0 0x555f3e8bf2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:32.655 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.649+0000 7fd685400640 1 -- 172.21.15.63:0/1344405608 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f3e6c1bf0 con 0x555f3e89f740 2024-05-21T01:20:32.655 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.649+0000 7fd685400640 1 --2- 172.21.15.63:0/1344405608 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555f3e89f740 0x555f3e8be9b0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd6780f5bd0 tx=0x7fd6780f23c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7f35bf8b46bcadb server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:32.655 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.649+0000 7fd67ea00640 1 -- 172.21.15.63:0/1344405608 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6780fe3e0 con 0x555f3e89f740 2024-05-21T01:20:32.656 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.649+0000 7fd67ea00640 1 -- 172.21.15.63:0/1344405608 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd67810e070 con 0x555f3e89f740 2024-05-21T01:20:32.656 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.649+0000 7fd67ea00640 1 -- 172.21.15.63:0/1344405608 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6780fe810 con 0x555f3e89f740 2024-05-21T01:20:32.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.649+0000 7fd6981f4000 1 -- 172.21.15.63:0/1344405608 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555f3e89f740 msgr2=0x555f3e8be9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:32.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.649+0000 7fd6981f4000 1 --2- 172.21.15.63:0/1344405608 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555f3e89f740 0x555f3e8be9b0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd6780f5bd0 tx=0x7fd6780f23c0 comp rx=0 tx=0).stop 2024-05-21T01:20:32.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.649+0000 7fd6981f4000 1 -- 172.21.15.63:0/1344405608 shutdown_connections 2024-05-21T01:20:32.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.649+0000 7fd6981f4000 1 --2- 172.21.15.63:0/1344405608 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555f3e8beef0 0x555f3e8bf2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:32.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.649+0000 7fd6981f4000 1 --2- 172.21.15.63:0/1344405608 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555f3e89f740 0x555f3e8be9b0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:32.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.649+0000 7fd6981f4000 1 --2- 172.21.15.63:0/1344405608 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555f3e8d64a0 0x555f3e89f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:32.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.649+0000 7fd6981f4000 1 -- 172.21.15.63:0/1344405608 >> 172.21.15.63:0/1344405608 conn(0x555f3e77eef0 msgr2=0x555f3e8d5b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:32.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.649+0000 7fd6981f4000 1 -- 172.21.15.63:0/1344405608 shutdown_connections 2024-05-21T01:20:32.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.649+0000 7fd6981f4000 1 -- 172.21.15.63:0/1344405608 wait complete. 2024-05-21T01:20:32.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.649+0000 7fd6981f4000 1 -- start start 2024-05-21T01:20:32.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.649+0000 7fd6981f4000 1 Processor -- start 2024-05-21T01:20:32.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.653+0000 7fd6981f4000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555f3e89f740 0x555f3e8e3050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:32.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.653+0000 7fd6981f4000 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555f3e8beef0 0x555f3e8e3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:32.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.653+0000 7fd6981f4000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555f3e8d64a0 0x555f3e89a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:32.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.653+0000 7fd6981f4000 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x555f3e6a6630 con 0x555f3e8beef0 2024-05-21T01:20:32.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.653+0000 7fd6981f4000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x555f3e767570 con 0x555f3e89f740 2024-05-21T01:20:32.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.653+0000 7fd6981f4000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x555f3e6f24a0 con 0x555f3e8d64a0 2024-05-21T01:20:32.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.653+0000 7fd6981f4000 10 client.0 _ll_register_callbacks cb 0x555f3e882540 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-21T01:20:32.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.653+0000 7fd685400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555f3e8beef0 0x555f3e8e3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:32.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.653+0000 7fd685400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555f3e8beef0 0x555f3e8e3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45126/0 (socket says 172.21.15.63:45126) 2024-05-21T01:20:32.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.653+0000 7fd685400640 1 -- 172.21.15.63:0/3899020557 learned_addr learned my addr 172.21.15.63:0/3899020557 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:32.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.653+0000 7fd68de00640 1 --2- 172.21.15.63:0/3899020557 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555f3e89f740 0x555f3e8e3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:32.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.653+0000 7fd68e800640 1 --2- 172.21.15.63:0/3899020557 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555f3e8d64a0 0x555f3e89a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:32.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.653+0000 7fd685400640 1 -- 172.21.15.63:0/3899020557 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555f3e8d64a0 msgr2=0x555f3e89a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:32.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.653+0000 7fd685400640 1 --2- 172.21.15.63:0/3899020557 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555f3e8d64a0 0x555f3e89a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:32.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.653+0000 7fd685400640 1 -- 172.21.15.63:0/3899020557 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555f3e89f740 msgr2=0x555f3e8e3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:32.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.653+0000 7fd685400640 1 --2- 172.21.15.63:0/3899020557 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555f3e89f740 0x555f3e8e3050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:32.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.653+0000 7fd685400640 1 -- 172.21.15.63:0/3899020557 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f3e72b9b0 con 0x555f3e8beef0 2024-05-21T01:20:32.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.653+0000 7fd685400640 1 --2- 172.21.15.63:0/3899020557 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555f3e8beef0 0x555f3e8e3590 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd6780f5bd0 tx=0x7fd6780acf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eaa6596af3f1ac3 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:32.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.653+0000 7fd673400640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-05-21T01:20:32.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.653+0000 7fd673400640 1 -- 172.21.15.63:0/3899020557 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6780f2290 con 0x555f3e8beef0 2024-05-21T01:20:32.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.653+0000 7fd673400640 1 -- 172.21.15.63:0/3899020557 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fd678120b20 con 0x555f3e8beef0 2024-05-21T01:20:32.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.653+0000 7fd6981f4000 1 -- 172.21.15.63:0/3899020557 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd67810e070 con 0x555f3e8beef0 2024-05-21T01:20:32.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.653+0000 7fd673400640 1 -- 172.21.15.63:0/3899020557 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7fd6780fe3e0 con 0x555f3e8beef0 2024-05-21T01:20:32.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.653+0000 7fd6981f4000 10 client.4671 fetch_fsmap learned FSMap version 15 2024-05-21T01:20:32.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.653+0000 7fd6981f4000 1 -- 172.21.15.63:0/3899020557 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x555f3e6be510 con 0x555f3e8beef0 2024-05-21T01:20:32.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.653+0000 7fd673400640 1 -- 172.21.15.63:0/3899020557 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd67810e070 con 0x555f3e8beef0 2024-05-21T01:20:32.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.653+0000 7fd673400640 1 -- 172.21.15.63:0/3899020557 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 15) ==== 4752+0+0 (secure 0 0 0) 0x7fd6780b3030 con 0x555f3e8beef0 2024-05-21T01:20:32.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.653+0000 7fd6981f4000 10 client.4671 fetch_fsmap finished waiting for FSMap version 15 2024-05-21T01:20:32.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.653+0000 7fd6981f4000 10 client.4671 resolve_mds: resolved name 'e' to daemon mds.e 2024-05-21T01:20:32.662 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.653+0000 7fd6981f4000 20 client.4671 populate_metadata read hostname 'smithi063' 2024-05-21T01:20:32.662 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.653+0000 7fd6981f4000 1 --2- 172.21.15.63:0/3899020557 >> [v2:172.21.15.63:6832/574189772,v1:172.21.15.63:6833/574189772] conn(0x555f3e89b660 0x555f3e89ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:32.662 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.653+0000 7fd6981f4000 4 client.4671 mds_command: new command op to 4267 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-21T01:20:32.662 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.653+0000 7fd6981f4000 1 -- 172.21.15.63:0/3899020557 --> [v2:172.21.15.63:6832/574189772,v1:172.21.15.63:6833/574189772] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555f3e67ebc0 con 0x555f3e89b660 2024-05-21T01:20:32.662 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.653+0000 7fd68de00640 1 --2- 172.21.15.63:0/3899020557 >> [v2:172.21.15.63:6832/574189772,v1:172.21.15.63:6833/574189772] conn(0x555f3e89b660 0x555f3e89ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:32.662 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.653+0000 7fd68de00640 1 --2- 172.21.15.63:0/3899020557 >> [v2:172.21.15.63:6832/574189772,v1:172.21.15.63:6833/574189772] conn(0x555f3e89b660 0x555f3e89ba40 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a12285093e10c213 server_cookie=b8560ad4506ca933 in_seq=0 out_seq=0 2024-05-21T01:20:32.662 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:32.653+0000 7fd673400640 10 client.4671 ms_handle_connect on v2:172.21.15.63:6832/574189772 2024-05-21T01:20:36.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.737+0000 7fd673400640 1 -- 172.21.15.63:0/3899020557 <== mds.2 v2:172.21.15.63:6832/574189772 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x555f3e67ebc0 con 0x555f3e89b660 2024-05-21T01:20:36.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.737+0000 7fd673400640 10 client.4671 handle_command_reply: tid=0 2024-05-21T01:20:36.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.737+0000 7fd68de00640 1 -- 172.21.15.63:0/3899020557 >> [v2:172.21.15.63:6832/574189772,v1:172.21.15.63:6833/574189772] conn(0x555f3e89b660 msgr2=0x555f3e89ba40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 18 2024-05-21T01:20:36.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.737+0000 7fd68de00640 1 -- 172.21.15.63:0/3899020557 >> [v2:172.21.15.63:6832/574189772,v1:172.21.15.63:6833/574189772] conn(0x555f3e89b660 msgr2=0x555f3e89ba40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-21T01:20:36.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.737+0000 7fd68de00640 1 --2- 172.21.15.63:0/3899020557 >> [v2:172.21.15.63:6832/574189772,v1:172.21.15.63:6833/574189772] conn(0x555f3e89b660 0x555f3e89ba40 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-21T01:20:36.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.737+0000 7fd6981f4000 1 client.4671 shutdown 2024-05-21T01:20:36.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.737+0000 7fd68de00640 1 --2- 172.21.15.63:0/3899020557 >> [v2:172.21.15.63:6832/574189772,v1:172.21.15.63:6833/574189772] conn(0x555f3e89b660 0x555f3e89ba40 unknown :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-05-21T01:20:36.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.737+0000 7fd68de00640 1 --2- 172.21.15.63:0/3899020557 >> [v2:172.21.15.63:6832/574189772,v1:172.21.15.63:6833/574189772] conn(0x555f3e89b660 0x555f3e89ba40 unknown :-1 s=BANNER_CONNECTING pgs=12 cs=1 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:36.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.737+0000 7fd6981f4000 1 -- 172.21.15.63:0/3899020557 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555f3e8beef0 msgr2=0x555f3e8e3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:36.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.737+0000 7fd6981f4000 1 --2- 172.21.15.63:0/3899020557 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555f3e8beef0 0x555f3e8e3590 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd6780f5bd0 tx=0x7fd6780acf90 comp rx=0 tx=0).stop 2024-05-21T01:20:36.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.737+0000 7fd68de00640 -1 monclient: handle_auth_reply_more no authorizer? 2024-05-21T01:20:36.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.737+0000 7fd68de00640 -1 --2- 172.21.15.63:0/3899020557 >> [v2:172.21.15.63:6832/574189772,v1:172.21.15.63:6833/574189772] conn(0x555f3e89b660 0x555f3e89ba40 unknown :-1 s=AUTH_CONNECTING pgs=12 cs=1 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more auth_client handle_auth_reply_more returned -1 2024-05-21T01:20:36.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.737+0000 7fd68de00640 1 --2- 172.21.15.63:0/3899020557 >> [v2:172.21.15.63:6832/574189772,v1:172.21.15.63:6833/574189772] conn(0x555f3e89b660 0x555f3e89ba40 unknown :-1 s=START_CONNECT pgs=12 cs=2 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-21T01:20:36.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.737+0000 7fd6981f4000 1 -- 172.21.15.63:0/3899020557 shutdown_connections 2024-05-21T01:20:36.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.737+0000 7fd6981f4000 1 --2- 172.21.15.63:0/3899020557 >> [v2:172.21.15.63:6832/574189772,v1:172.21.15.63:6833/574189772] conn(0x555f3e89b660 0x555f3e89ba40 unknown :-1 s=START_CONNECT pgs=12 cs=2 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:36.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.737+0000 7fd6981f4000 1 --2- 172.21.15.63:0/3899020557 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555f3e8d64a0 0x555f3e89a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:36.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.737+0000 7fd6981f4000 1 --2- 172.21.15.63:0/3899020557 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555f3e8beef0 0x555f3e8e3590 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:36.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.737+0000 7fd673400640 0 client.4671 ms_handle_reset on v2:172.21.15.63:6832/574189772 2024-05-21T01:20:36.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.737+0000 7fd6981f4000 1 --2- 172.21.15.63:0/3899020557 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555f3e89f740 0x555f3e8e3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:36.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.737+0000 7fd6981f4000 1 -- 172.21.15.63:0/3899020557 >> 172.21.15.63:0/3899020557 conn(0x555f3e77eef0 msgr2=0x555f3e8958e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:36.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.737+0000 7fd6981f4000 1 -- 172.21.15.63:0/3899020557 shutdown_connections 2024-05-21T01:20:36.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.737+0000 7fd6981f4000 1 -- 172.21.15.63:0/3899020557 wait complete. 2024-05-21T01:20:36.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.737+0000 7fd6981f4000 20 client.4671 trim_cache size 0 max 16384 2024-05-21T01:20:36.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.757+0000 7fd6981f4000 1 Processor -- start 2024-05-21T01:20:36.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.757+0000 7fd6981f4000 1 -- start start 2024-05-21T01:20:36.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.757+0000 7fd6981f4000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555f3e89b660 0x555f3e8f3610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:36.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.757+0000 7fd6981f4000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555f3e89f740 0x555f3e8978f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:36.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.757+0000 7fd6981f4000 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555f3e8beef0 0x555f3e897e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:36.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.757+0000 7fd6981f4000 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x555f3e6e61a0 con 0x555f3e8beef0 2024-05-21T01:20:36.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.757+0000 7fd6981f4000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x555f3e6a6630 con 0x555f3e89f740 2024-05-21T01:20:36.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.757+0000 7fd6981f4000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x555f3e767570 con 0x555f3e89b660 2024-05-21T01:20:36.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.757+0000 7fd68e800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555f3e8beef0 0x555f3e897e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:36.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.757+0000 7fd68e800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555f3e8beef0 0x555f3e897e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45130/0 (socket says 172.21.15.63:45130) 2024-05-21T01:20:36.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.757+0000 7fd68e800640 1 -- 172.21.15.63:0/1992447494 learned_addr learned my addr 172.21.15.63:0/1992447494 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:36.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.757+0000 7fd68de00640 1 --2- 172.21.15.63:0/1992447494 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555f3e89b660 0x555f3e8f3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:36.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.757+0000 7fd685400640 1 --2- 172.21.15.63:0/1992447494 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555f3e89f740 0x555f3e8978f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:36.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.761+0000 7fd68e800640 1 -- 172.21.15.63:0/1992447494 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555f3e89b660 msgr2=0x555f3e8f3610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:36.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.761+0000 7fd68e800640 1 --2- 172.21.15.63:0/1992447494 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555f3e89b660 0x555f3e8f3610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:36.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.761+0000 7fd68e800640 1 -- 172.21.15.63:0/1992447494 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555f3e89f740 msgr2=0x555f3e8978f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:36.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.761+0000 7fd68e800640 1 --2- 172.21.15.63:0/1992447494 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555f3e89f740 0x555f3e8978f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:36.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.761+0000 7fd68e800640 1 -- 172.21.15.63:0/1992447494 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f3e684860 con 0x555f3e8beef0 2024-05-21T01:20:36.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.761+0000 7fd685400640 1 --2- 172.21.15.63:0/1992447494 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555f3e89f740 0x555f3e8978f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T01:20:36.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.761+0000 7fd68e800640 1 --2- 172.21.15.63:0/1992447494 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555f3e8beef0 0x555f3e897e30 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd6880097e0 tx=0x7fd688009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dce19b59cbb96913 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:36.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.761+0000 7fd67e000640 1 -- 172.21.15.63:0/1992447494 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd68800f040 con 0x555f3e8beef0 2024-05-21T01:20:36.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.761+0000 7fd67e000640 1 -- 172.21.15.63:0/1992447494 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd688004230 con 0x555f3e8beef0 2024-05-21T01:20:36.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.761+0000 7fd67e000640 1 -- 172.21.15.63:0/1992447494 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6880158c0 con 0x555f3e8beef0 2024-05-21T01:20:36.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.761+0000 7fd6981f4000 1 -- 172.21.15.63:0/1992447494 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555f3e8beef0 msgr2=0x555f3e897e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:36.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.761+0000 7fd6981f4000 1 --2- 172.21.15.63:0/1992447494 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555f3e8beef0 0x555f3e897e30 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd6880097e0 tx=0x7fd688009ca0 comp rx=0 tx=0).stop 2024-05-21T01:20:36.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.761+0000 7fd6981f4000 1 -- 172.21.15.63:0/1992447494 shutdown_connections 2024-05-21T01:20:36.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.761+0000 7fd6981f4000 1 --2- 172.21.15.63:0/1992447494 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555f3e8beef0 0x555f3e897e30 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:36.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.761+0000 7fd6981f4000 1 --2- 172.21.15.63:0/1992447494 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555f3e89f740 0x555f3e8978f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:36.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.761+0000 7fd6981f4000 1 --2- 172.21.15.63:0/1992447494 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555f3e89b660 0x555f3e8f3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:36.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.761+0000 7fd6981f4000 1 -- 172.21.15.63:0/1992447494 >> 172.21.15.63:0/1992447494 conn(0x555f3e77eef0 msgr2=0x555f3e8bdd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:36.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.761+0000 7fd6981f4000 1 -- 172.21.15.63:0/1992447494 shutdown_connections 2024-05-21T01:20:36.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.761+0000 7fd6981f4000 1 -- 172.21.15.63:0/1992447494 wait complete. 2024-05-21T01:20:36.767 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.761+0000 7fd6981f4000 1 -- start start 2024-05-21T01:20:36.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.761+0000 7fd6981f4000 1 Processor -- start 2024-05-21T01:20:36.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.761+0000 7fd6981f4000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555f3e89b660 0x555f3e8f3620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:36.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.761+0000 7fd6981f4000 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555f3e89f740 0x555f3e94a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:36.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.761+0000 7fd6981f4000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555f3e8beef0 0x555f3e94ad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:36.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.761+0000 7fd6981f4000 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x555f3e78aa20 con 0x555f3e89f740 2024-05-21T01:20:36.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.761+0000 7fd6981f4000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x555f3e6f24a0 con 0x555f3e89b660 2024-05-21T01:20:36.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.761+0000 7fd6981f4000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x555f3e68be60 con 0x555f3e8beef0 2024-05-21T01:20:36.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.765+0000 7fd6981f4000 10 client.0 _ll_register_callbacks cb 0x7fd6780f1b90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-21T01:20:36.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.765+0000 7fd685400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555f3e89f740 0x555f3e94a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:36.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.765+0000 7fd685400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555f3e89f740 0x555f3e94a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45132/0 (socket says 172.21.15.63:45132) 2024-05-21T01:20:36.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.765+0000 7fd685400640 1 -- 172.21.15.63:0/2371902812 learned_addr learned my addr 172.21.15.63:0/2371902812 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:36.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.765+0000 7fd68de00640 1 --2- 172.21.15.63:0/2371902812 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555f3e89b660 0x555f3e8f3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:36.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.765+0000 7fd68e800640 1 --2- 172.21.15.63:0/2371902812 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555f3e8beef0 0x555f3e94ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:36.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.765+0000 7fd685400640 1 -- 172.21.15.63:0/2371902812 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555f3e8beef0 msgr2=0x555f3e94ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:36.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.765+0000 7fd685400640 1 --2- 172.21.15.63:0/2371902812 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555f3e8beef0 0x555f3e94ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:36.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.765+0000 7fd685400640 1 -- 172.21.15.63:0/2371902812 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555f3e89b660 msgr2=0x555f3e8f3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:36.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.765+0000 7fd685400640 1 --2- 172.21.15.63:0/2371902812 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555f3e89b660 0x555f3e8f3620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:36.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.765+0000 7fd685400640 1 -- 172.21.15.63:0/2371902812 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f3e69ae80 con 0x555f3e89f740 2024-05-21T01:20:36.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.765+0000 7fd685400640 1 --2- 172.21.15.63:0/2371902812 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555f3e89f740 0x555f3e94a840 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd6780f2eb0 tx=0x7fd6780f7000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4574dce360d15075 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:36.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.765+0000 7fd673400640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-05-21T01:20:36.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.765+0000 7fd673400640 1 -- 172.21.15.63:0/2371902812 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6780f2290 con 0x555f3e89f740 2024-05-21T01:20:36.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.765+0000 7fd673400640 1 -- 172.21.15.63:0/2371902812 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fd6780f50b0 con 0x555f3e89f740 2024-05-21T01:20:36.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.765+0000 7fd6981f4000 1 -- 172.21.15.63:0/2371902812 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd688004230 con 0x555f3e89f740 2024-05-21T01:20:36.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.765+0000 7fd673400640 1 -- 172.21.15.63:0/2371902812 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7fd6780f53b0 con 0x555f3e89f740 2024-05-21T01:20:36.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.765+0000 7fd6981f4000 10 client.4677 fetch_fsmap learned FSMap version 15 2024-05-21T01:20:36.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.765+0000 7fd6981f4000 1 -- 172.21.15.63:0/2371902812 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x555f3e767a00 con 0x555f3e89f740 2024-05-21T01:20:36.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.765+0000 7fd673400640 1 -- 172.21.15.63:0/2371902812 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd688004230 con 0x555f3e89f740 2024-05-21T01:20:36.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.765+0000 7fd673400640 1 -- 172.21.15.63:0/2371902812 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 15) ==== 4752+0+0 (secure 0 0 0) 0x7fd6780b6ad0 con 0x555f3e89f740 2024-05-21T01:20:36.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.765+0000 7fd6981f4000 10 client.4677 fetch_fsmap finished waiting for FSMap version 15 2024-05-21T01:20:36.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.765+0000 7fd6981f4000 10 client.4677 resolve_mds: resolved name 'e' to daemon mds.e 2024-05-21T01:20:36.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.765+0000 7fd6981f4000 20 client.4677 populate_metadata read hostname 'smithi063' 2024-05-21T01:20:36.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.765+0000 7fd6981f4000 1 --2- 172.21.15.63:0/2371902812 >> [v2:172.21.15.63:6832/574189772,v1:172.21.15.63:6833/574189772] conn(0x555f3e8d64a0 0x555f3e949410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:36.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.765+0000 7fd6981f4000 4 client.4677 mds_command: new command op to 4267 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-21T01:20:36.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.765+0000 7fd6981f4000 1 -- 172.21.15.63:0/2371902812 --> [v2:172.21.15.63:6832/574189772,v1:172.21.15.63:6833/574189772] -- command(tid 0: {"prefix": "status"}) -- 0x555f3e682dc0 con 0x555f3e8d64a0 2024-05-21T01:20:36.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.765+0000 7fd68de00640 1 --2- 172.21.15.63:0/2371902812 >> [v2:172.21.15.63:6832/574189772,v1:172.21.15.63:6833/574189772] conn(0x555f3e8d64a0 0x555f3e949410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:36.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.765+0000 7fd68de00640 1 --2- 172.21.15.63:0/2371902812 >> [v2:172.21.15.63:6832/574189772,v1:172.21.15.63:6833/574189772] conn(0x555f3e8d64a0 0x555f3e949410 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d94289cd59c36d3f server_cookie=551814686b68bd97 in_seq=0 out_seq=0 2024-05-21T01:20:36.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.765+0000 7fd673400640 10 client.4677 ms_handle_connect on v2:172.21.15.63:6832/574189772 2024-05-21T01:20:36.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.765+0000 7fd673400640 1 -- 172.21.15.63:0/2371902812 <== mds.2 v2:172.21.15.63:6832/574189772 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x555f3e682dc0 con 0x555f3e8d64a0 2024-05-21T01:20:36.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.765+0000 7fd673400640 10 client.4677 handle_command_reply: tid=0 2024-05-21T01:20:36.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.765+0000 7fd6981f4000 1 client.4677 shutdown 2024-05-21T01:20:36.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.765+0000 7fd6981f4000 1 -- 172.21.15.63:0/2371902812 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555f3e89f740 msgr2=0x555f3e94a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:36.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.765+0000 7fd6981f4000 1 --2- 172.21.15.63:0/2371902812 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555f3e89f740 0x555f3e94a840 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd6780f2eb0 tx=0x7fd6780f7000 comp rx=0 tx=0).stop 2024-05-21T01:20:36.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.765+0000 7fd6981f4000 1 -- 172.21.15.63:0/2371902812 shutdown_connections 2024-05-21T01:20:36.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.765+0000 7fd6981f4000 1 --2- 172.21.15.63:0/2371902812 >> [v2:172.21.15.63:6832/574189772,v1:172.21.15.63:6833/574189772] conn(0x555f3e8d64a0 0x555f3e949410 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:36.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.765+0000 7fd6981f4000 1 --2- 172.21.15.63:0/2371902812 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x555f3e8beef0 0x555f3e94ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:36.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.765+0000 7fd6981f4000 1 --2- 172.21.15.63:0/2371902812 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x555f3e89f740 0x555f3e94a840 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:36.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.765+0000 7fd6981f4000 1 --2- 172.21.15.63:0/2371902812 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555f3e89b660 0x555f3e8f3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:36.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.765+0000 7fd673400640 0 client.4677 ms_handle_reset on v2:172.21.15.63:6832/574189772 2024-05-21T01:20:36.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.765+0000 7fd6981f4000 1 -- 172.21.15.63:0/2371902812 >> 172.21.15.63:0/2371902812 conn(0x555f3e77eef0 msgr2=0x555f3e8d1360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:36.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.769+0000 7fd6981f4000 1 -- 172.21.15.63:0/2371902812 shutdown_connections 2024-05-21T01:20:36.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.769+0000 7fd6981f4000 1 -- 172.21.15.63:0/2371902812 wait complete. 2024-05-21T01:20:36.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.769+0000 7fd6981f4000 20 client.4677 trim_cache size 0 max 16384 2024-05-21T01:20:36.775 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-05-21T01:20:36.775 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_fsid": "9a7cbd84-ceb2-41c8-8b6e-ab931f86c51a", 2024-05-21T01:20:36.775 INFO:teuthology.orchestra.run.smithi063.stdout: "whoami": 2, 2024-05-21T01:20:36.775 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 4267, 2024-05-21T01:20:36.775 INFO:teuthology.orchestra.run.smithi063.stdout: "want_state": "up:active", 2024-05-21T01:20:36.775 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "up:active", 2024-05-21T01:20:36.776 INFO:teuthology.orchestra.run.smithi063.stdout: "fs_name": "cephfs", 2024-05-21T01:20:36.776 INFO:teuthology.orchestra.run.smithi063.stdout: "rank_uptime": 11.090635769, 2024-05-21T01:20:36.776 INFO:teuthology.orchestra.run.smithi063.stdout: "mdsmap_epoch": 15, 2024-05-21T01:20:36.776 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch": 25, 2024-05-21T01:20:36.776 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch_barrier": 25, 2024-05-21T01:20:36.776 INFO:teuthology.orchestra.run.smithi063.stdout: "uptime": 48.112288102000001 2024-05-21T01:20:36.776 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-05-21T01:20:36.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.769+0000 7fd694e00640 1 -- 172.21.15.63:0/2761273010 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fd66c06f400 msgr2=0x7fd66c0718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:36.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.769+0000 7fd694e00640 1 --2- 172.21.15.63:0/2761273010 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fd66c06f400 0x7fd66c0718c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd6800074c0 tx=0x7fd68000b040 comp rx=0 tx=0).stop 2024-05-21T01:20:36.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.769+0000 7fd694e00640 1 -- 172.21.15.63:0/2761273010 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd690156010 msgr2=0x7fd690154870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:36.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.769+0000 7fd694e00640 1 --2- 172.21.15.63:0/2761273010 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd690156010 0x7fd690154870 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd6780ae040 tx=0x7fd6780192c0 comp rx=0 tx=0).stop 2024-05-21T01:20:36.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.769+0000 7fd694e00640 1 -- 172.21.15.63:0/2761273010 shutdown_connections 2024-05-21T01:20:36.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.769+0000 7fd694e00640 1 --2- 172.21.15.63:0/2761273010 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fd66c06f400 0x7fd66c0718c0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:36.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.769+0000 7fd694e00640 1 --2- 172.21.15.63:0/2761273010 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd6901563f0 0x7fd69015a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:36.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.769+0000 7fd694e00640 1 --2- 172.21.15.63:0/2761273010 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd690156010 0x7fd690154870 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:36.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.769+0000 7fd694e00640 1 --2- 172.21.15.63:0/2761273010 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6900c93b0 0x7fd6901f57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:36.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.769+0000 7fd694e00640 1 -- 172.21.15.63:0/2761273010 >> 172.21.15.63:0/2761273010 conn(0x7fd6900ce640 msgr2=0x7fd69015c720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:36.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.769+0000 7fd694e00640 1 -- 172.21.15.63:0/2761273010 shutdown_connections 2024-05-21T01:20:36.777 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.769+0000 7fd694e00640 1 -- 172.21.15.63:0/2761273010 wait complete. 2024-05-21T01:20:36.797 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2024-05-21T01:20:36.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.937+0000 7ff241e00640 1 Processor -- start 2024-05-21T01:20:36.944 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.937+0000 7ff241e00640 1 -- start start 2024-05-21T01:20:36.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.941+0000 7ff241e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff23c15bfc0 0x7ff23c0cb810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:36.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.941+0000 7ff241e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff23c0ca640 0x7ff23c15c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:36.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.941+0000 7ff241e00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff23c0c9f40 con 0x7ff23c06d0f0 2024-05-21T01:20:36.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.941+0000 7ff241e00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7ff23c0c9490 con 0x7ff23c0ca640 2024-05-21T01:20:36.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.941+0000 7ff241e00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7ff23c06f930 con 0x7ff23c15bfc0 2024-05-21T01:20:36.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.941+0000 7ff23be00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff23c0ca640 0x7ff23c15c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:36.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.941+0000 7ff23be00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff23c0ca640 0x7ff23c15c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45146/0 (socket says 172.21.15.63:45146) 2024-05-21T01:20:36.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.941+0000 7ff23be00640 1 -- 172.21.15.63:0/490653334 learned_addr learned my addr 172.21.15.63:0/490653334 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:36.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.941+0000 7ff240a00640 1 --2- 172.21.15.63:0/490653334 >> v2:172.21.15.131:3300/0 conn(0x7ff23c15bfc0 0x7ff23c0cb810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:36.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.941+0000 7ff23be00640 1 -- 172.21.15.63:0/490653334 >> v2:172.21.15.131:3300/0 conn(0x7ff23c15bfc0 msgr2=0x7ff23c0cb810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:36.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.941+0000 7ff23be00640 1 --2- 172.21.15.63:0/490653334 >> v2:172.21.15.131:3300/0 conn(0x7ff23c15bfc0 0x7ff23c0cb810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:36.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.941+0000 7ff23be00640 1 -- 172.21.15.63:0/490653334 >> v1:172.21.15.131:6789/0 conn(0x7ff23c06d0f0 legacy=0x7ff23c155a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:36.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.941+0000 7ff23be00640 1 -- 172.21.15.63:0/490653334 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff23c15cc10 con 0x7ff23c0ca640 2024-05-21T01:20:36.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.941+0000 7ff23be00640 1 --2- 172.21.15.63:0/490653334 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff23c0ca640 0x7ff23c15c3a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff23c069d20 tx=0x7ff22801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e37a57075bf2723 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:36.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.945+0000 7ff23b400640 1 -- 172.21.15.63:0/490653334 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2280ab600 con 0x7ff23c0ca640 2024-05-21T01:20:36.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.945+0000 7ff23b400640 1 -- 172.21.15.63:0/490653334 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2280b0070 con 0x7ff23c0ca640 2024-05-21T01:20:36.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.945+0000 7ff23b400640 1 -- 172.21.15.63:0/490653334 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2280ab9c0 con 0x7ff23c0ca640 2024-05-21T01:20:36.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.945+0000 7ff241e00640 1 -- 172.21.15.63:0/490653334 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff23c0ca640 msgr2=0x7ff23c15c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:36.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.945+0000 7ff241e00640 1 --2- 172.21.15.63:0/490653334 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff23c0ca640 0x7ff23c15c3a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff23c069d20 tx=0x7ff22801c440 comp rx=0 tx=0).stop 2024-05-21T01:20:36.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.945+0000 7ff241e00640 1 -- 172.21.15.63:0/490653334 shutdown_connections 2024-05-21T01:20:36.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.945+0000 7ff241e00640 1 --2- 172.21.15.63:0/490653334 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff23c0ca640 0x7ff23c15c3a0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:36.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.945+0000 7ff241e00640 1 --2- 172.21.15.63:0/490653334 >> v2:172.21.15.131:3300/0 conn(0x7ff23c15bfc0 0x7ff23c0cb810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:36.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.945+0000 7ff241e00640 1 -- 172.21.15.63:0/490653334 >> 172.21.15.63:0/490653334 conn(0x7ff23c0cacf0 msgr2=0x7ff23c0cb100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:36.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.945+0000 7ff241e00640 1 -- 172.21.15.63:0/490653334 shutdown_connections 2024-05-21T01:20:36.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.945+0000 7ff241e00640 1 -- 172.21.15.63:0/490653334 wait complete. 2024-05-21T01:20:36.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.945+0000 7ff241e00640 1 Processor -- start 2024-05-21T01:20:36.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.945+0000 7ff241e00640 1 -- start start 2024-05-21T01:20:36.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.945+0000 7ff241e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff23c06d0f0 0x7ff23c146110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:36.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.945+0000 7ff241e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff23c0ca640 0x7ff23c158a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:36.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.945+0000 7ff241e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff23c15bfc0 0x7ff23c158fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:36.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.945+0000 7ff241e00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff23c0722e0 con 0x7ff23c15bfc0 2024-05-21T01:20:36.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.945+0000 7ff241e00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7ff23c072160 con 0x7ff23c06d0f0 2024-05-21T01:20:36.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.945+0000 7ff241e00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7ff23c168e30 con 0x7ff23c0ca640 2024-05-21T01:20:36.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.945+0000 7ff241400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff23c15bfc0 0x7ff23c158fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:36.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.945+0000 7ff241400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff23c15bfc0 0x7ff23c158fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45148/0 (socket says 172.21.15.63:45148) 2024-05-21T01:20:36.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.945+0000 7ff241400640 1 -- 172.21.15.63:0/4224280788 learned_addr learned my addr 172.21.15.63:0/4224280788 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:36.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.945+0000 7ff23be00640 1 --2- 172.21.15.63:0/4224280788 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff23c0ca640 0x7ff23c158a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:36.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.945+0000 7ff240a00640 1 --2- 172.21.15.63:0/4224280788 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff23c06d0f0 0x7ff23c146110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:36.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.949+0000 7ff241400640 1 -- 172.21.15.63:0/4224280788 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff23c0ca640 msgr2=0x7ff23c158a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:36.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.949+0000 7ff241400640 1 --2- 172.21.15.63:0/4224280788 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff23c0ca640 0x7ff23c158a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:36.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.949+0000 7ff241400640 1 -- 172.21.15.63:0/4224280788 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff23c06d0f0 msgr2=0x7ff23c146110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:36.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.949+0000 7ff241400640 1 --2- 172.21.15.63:0/4224280788 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff23c06d0f0 0x7ff23c146110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:36.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.949+0000 7ff241400640 1 -- 172.21.15.63:0/4224280788 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff23c157d20 con 0x7ff23c15bfc0 2024-05-21T01:20:36.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.949+0000 7ff241400640 1 --2- 172.21.15.63:0/4224280788 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff23c15bfc0 0x7ff23c158fb0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff23400c7b0 tx=0x7ff23400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:36.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.949+0000 7ff238c00640 1 -- 172.21.15.63:0/4224280788 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff234004b70 con 0x7ff23c15bfc0 2024-05-21T01:20:36.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.949+0000 7ff238c00640 1 -- 172.21.15.63:0/4224280788 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff234004d10 con 0x7ff23c15bfc0 2024-05-21T01:20:36.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.949+0000 7ff238c00640 1 -- 172.21.15.63:0/4224280788 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff23400aa90 con 0x7ff23c15bfc0 2024-05-21T01:20:36.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.949+0000 7ff241e00640 1 -- 172.21.15.63:0/4224280788 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff23c15d0a0 con 0x7ff23c15bfc0 2024-05-21T01:20:36.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.949+0000 7ff241e00640 1 -- 172.21.15.63:0/4224280788 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff23c157f90 con 0x7ff23c15bfc0 2024-05-21T01:20:36.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.949+0000 7ff238c00640 1 -- 172.21.15.63:0/4224280788 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7ff23400ac30 con 0x7ff23c15bfc0 2024-05-21T01:20:36.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.949+0000 7ff238c00640 1 --2- 172.21.15.63:0/4224280788 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7ff21c06f400 0x7ff21c0718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:36.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.949+0000 7ff238c00640 1 -- 172.21.15.63:0/4224280788 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7ff23408fae0 con 0x7ff23c15bfc0 2024-05-21T01:20:36.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.953+0000 7ff246935000 1 Processor -- start 2024-05-21T01:20:36.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.953+0000 7ff240a00640 1 --2- 172.21.15.63:0/4224280788 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7ff21c06f400 0x7ff21c0718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:36.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.953+0000 7ff246935000 1 -- start start 2024-05-21T01:20:36.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.953+0000 7ff240a00640 1 --2- 172.21.15.63:0/4224280788 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7ff21c06f400 0x7ff21c0718c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff23000b930 tx=0x7ff230008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:36.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.953+0000 7ff246935000 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55726631d4a0 0x5572662e6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:36.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.953+0000 7ff246935000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5572662e6740 0x5572663059b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:36.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.953+0000 7ff246935000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557266305ef0 0x5572663062d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:36.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.953+0000 7ff246935000 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55726613a6d0 con 0x55726631d4a0 2024-05-21T01:20:36.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.953+0000 7ff246935000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55726612a270 con 0x557266305ef0 2024-05-21T01:20:36.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.953+0000 7ff246935000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55726612e2b0 con 0x5572662e6740 2024-05-21T01:20:36.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.953+0000 7ff240a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55726631d4a0 0x5572662e6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:36.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.953+0000 7ff240a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55726631d4a0 0x5572662e6200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45162/0 (socket says 172.21.15.63:45162) 2024-05-21T01:20:36.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.953+0000 7ff240a00640 1 -- 172.21.15.63:0/2786207776 learned_addr learned my addr 172.21.15.63:0/2786207776 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:36.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.953+0000 7ff241400640 1 --2- 172.21.15.63:0/2786207776 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557266305ef0 0x5572663062d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:36.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.953+0000 7ff23be00640 1 --2- 172.21.15.63:0/2786207776 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5572662e6740 0x5572663059b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:36.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.953+0000 7ff240a00640 1 -- 172.21.15.63:0/2786207776 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5572662e6740 msgr2=0x5572663059b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:36.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.953+0000 7ff240a00640 1 --2- 172.21.15.63:0/2786207776 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5572662e6740 0x5572663059b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:36.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.953+0000 7ff240a00640 1 -- 172.21.15.63:0/2786207776 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557266305ef0 msgr2=0x5572663062d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:36.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.953+0000 7ff240a00640 1 --2- 172.21.15.63:0/2786207776 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557266305ef0 0x5572663062d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:36.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.953+0000 7ff240a00640 1 -- 172.21.15.63:0/2786207776 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557266108bf0 con 0x55726631d4a0 2024-05-21T01:20:36.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.953+0000 7ff241400640 1 --2- 172.21.15.63:0/2786207776 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557266305ef0 0x5572663062d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T01:20:36.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.953+0000 7ff240a00640 1 --2- 172.21.15.63:0/2786207776 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55726631d4a0 0x5572662e6200 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff23000b2d0 tx=0x7ff230012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32e041faf6973b0a server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:36.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.953+0000 7ff22d600640 1 -- 172.21.15.63:0/2786207776 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff23001b050 con 0x55726631d4a0 2024-05-21T01:20:36.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.953+0000 7ff22d600640 1 -- 172.21.15.63:0/2786207776 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff230025070 con 0x55726631d4a0 2024-05-21T01:20:36.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.953+0000 7ff22d600640 1 -- 172.21.15.63:0/2786207776 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff230014de0 con 0x55726631d4a0 2024-05-21T01:20:36.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.953+0000 7ff246935000 1 -- 172.21.15.63:0/2786207776 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55726631d4a0 msgr2=0x5572662e6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:36.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.953+0000 7ff246935000 1 --2- 172.21.15.63:0/2786207776 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55726631d4a0 0x5572662e6200 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff23000b2d0 tx=0x7ff230012000 comp rx=0 tx=0).stop 2024-05-21T01:20:36.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.953+0000 7ff246935000 1 -- 172.21.15.63:0/2786207776 shutdown_connections 2024-05-21T01:20:36.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.953+0000 7ff246935000 1 --2- 172.21.15.63:0/2786207776 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557266305ef0 0x5572663062d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:36.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.953+0000 7ff246935000 1 --2- 172.21.15.63:0/2786207776 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5572662e6740 0x5572663059b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:36.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.953+0000 7ff246935000 1 --2- 172.21.15.63:0/2786207776 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55726631d4a0 0x5572662e6200 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:36.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.953+0000 7ff246935000 1 -- 172.21.15.63:0/2786207776 >> 172.21.15.63:0/2786207776 conn(0x5572661c5ef0 msgr2=0x55726631cb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:36.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.953+0000 7ff246935000 1 -- 172.21.15.63:0/2786207776 shutdown_connections 2024-05-21T01:20:36.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.953+0000 7ff246935000 1 -- 172.21.15.63:0/2786207776 wait complete. 2024-05-21T01:20:36.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.953+0000 7ff246935000 1 -- start start 2024-05-21T01:20:36.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.957+0000 7ff246935000 1 Processor -- start 2024-05-21T01:20:36.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.957+0000 7ff246935000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5572662e6740 0x55726632a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:36.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.957+0000 7ff246935000 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557266305ef0 0x55726632a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:36.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.957+0000 7ff246935000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55726631d4a0 0x5572662e1c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:36.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.957+0000 7ff246935000 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5572660ed630 con 0x557266305ef0 2024-05-21T01:20:36.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.957+0000 7ff246935000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5572661ae570 con 0x55726631d4a0 2024-05-21T01:20:36.966 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.957+0000 7ff246935000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5572661394a0 con 0x5572662e6740 2024-05-21T01:20:36.966 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.957+0000 7ff246935000 10 client.0 _ll_register_callbacks cb 0x5572662c9540 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-21T01:20:36.966 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.957+0000 7ff23be00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557266305ef0 0x55726632a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:36.966 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.957+0000 7ff23be00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557266305ef0 0x55726632a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45176/0 (socket says 172.21.15.63:45176) 2024-05-21T01:20:36.966 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.957+0000 7ff23be00640 1 -- 172.21.15.63:0/1617388120 learned_addr learned my addr 172.21.15.63:0/1617388120 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:36.966 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.957+0000 7ff240a00640 1 --2- 172.21.15.63:0/1617388120 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5572662e6740 0x55726632a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:36.966 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.957+0000 7ff241400640 1 --2- 172.21.15.63:0/1617388120 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55726631d4a0 0x5572662e1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:36.966 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.957+0000 7ff23be00640 1 -- 172.21.15.63:0/1617388120 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5572662e6740 msgr2=0x55726632a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:36.966 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.957+0000 7ff23be00640 1 --2- 172.21.15.63:0/1617388120 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5572662e6740 0x55726632a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:36.966 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.957+0000 7ff23be00640 1 -- 172.21.15.63:0/1617388120 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55726631d4a0 msgr2=0x5572662e1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:36.966 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.957+0000 7ff23be00640 1 --2- 172.21.15.63:0/1617388120 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55726631d4a0 0x5572662e1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:36.966 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.957+0000 7ff23be00640 1 -- 172.21.15.63:0/1617388120 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572661729b0 con 0x557266305ef0 2024-05-21T01:20:36.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.957+0000 7ff241400640 1 --2- 172.21.15.63:0/1617388120 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55726631d4a0 0x5572662e1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T01:20:36.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.957+0000 7ff23be00640 1 --2- 172.21.15.63:0/1617388120 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557266305ef0 0x55726632a590 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff22801c480 tx=0x7ff2280046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56a468cdad291505 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:36.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.957+0000 7ff222000640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-05-21T01:20:36.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.957+0000 7ff222000640 1 -- 172.21.15.63:0/1617388120 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2280abae0 con 0x557266305ef0 2024-05-21T01:20:36.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.957+0000 7ff222000640 1 -- 172.21.15.63:0/1617388120 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7ff2280abc80 con 0x557266305ef0 2024-05-21T01:20:36.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.957+0000 7ff246935000 1 -- 172.21.15.63:0/1617388120 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff230025070 con 0x557266305ef0 2024-05-21T01:20:36.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.957+0000 7ff222000640 1 -- 172.21.15.63:0/1617388120 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7ff2280b43f0 con 0x557266305ef0 2024-05-21T01:20:36.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.957+0000 7ff246935000 10 client.4689 fetch_fsmap learned FSMap version 15 2024-05-21T01:20:36.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.957+0000 7ff246935000 1 -- 172.21.15.63:0/1617388120 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x557266105510 con 0x557266305ef0 2024-05-21T01:20:36.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.957+0000 7ff222000640 1 -- 172.21.15.63:0/1617388120 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff230025070 con 0x557266305ef0 2024-05-21T01:20:36.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.957+0000 7ff222000640 1 -- 172.21.15.63:0/1617388120 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 15) ==== 4752+0+0 (secure 0 0 0) 0x7ff2280c7050 con 0x557266305ef0 2024-05-21T01:20:36.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.957+0000 7ff246935000 10 client.4689 fetch_fsmap finished waiting for FSMap version 15 2024-05-21T01:20:36.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.957+0000 7ff246935000 10 client.4689 resolve_mds: resolved name 'f' to daemon mds.f 2024-05-21T01:20:36.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.957+0000 7ff246935000 20 client.4689 populate_metadata read hostname 'smithi063' 2024-05-21T01:20:36.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.957+0000 7ff246935000 1 --2- 172.21.15.63:0/1617388120 >> [v2:172.21.15.131:6836/3071941741,v1:172.21.15.131:6838/3071941741] conn(0x5572662e29a0 0x5572662e2d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:36.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.957+0000 7ff246935000 4 client.4689 mds_command: new command op to 4270 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-21T01:20:36.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.957+0000 7ff246935000 1 -- 172.21.15.63:0/1617388120 --> [v2:172.21.15.131:6836/3071941741,v1:172.21.15.131:6838/3071941741] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5572660c5bc0 con 0x5572662e29a0 2024-05-21T01:20:36.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.957+0000 7ff240a00640 1 --2- 172.21.15.63:0/1617388120 >> [v2:172.21.15.131:6836/3071941741,v1:172.21.15.131:6838/3071941741] conn(0x5572662e29a0 0x5572662e2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:36.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.961+0000 7ff240a00640 1 --2- 172.21.15.63:0/1617388120 >> [v2:172.21.15.131:6836/3071941741,v1:172.21.15.131:6838/3071941741] conn(0x5572662e29a0 0x5572662e2d80 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9e0271666cbea8c0 server_cookie=570afab8477a42b7 in_seq=0 out_seq=0 2024-05-21T01:20:36.968 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.961+0000 7ff222000640 10 client.4689 ms_handle_connect on v2:172.21.15.131:6836/3071941741 2024-05-21T01:20:36.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.961+0000 7ff222000640 1 -- 172.21.15.63:0/1617388120 <== mds.1 v2:172.21.15.131:6836/3071941741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x5572660c5bc0 con 0x5572662e29a0 2024-05-21T01:20:36.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.961+0000 7ff222000640 10 client.4689 handle_command_reply: tid=0 2024-05-21T01:20:36.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.961+0000 7ff246935000 1 client.4689 shutdown 2024-05-21T01:20:36.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.961+0000 7ff246935000 1 -- 172.21.15.63:0/1617388120 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557266305ef0 msgr2=0x55726632a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:36.969 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.961+0000 7ff246935000 1 --2- 172.21.15.63:0/1617388120 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557266305ef0 0x55726632a590 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff22801c480 tx=0x7ff2280046d0 comp rx=0 tx=0).stop 2024-05-21T01:20:36.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.961+0000 7ff246935000 1 -- 172.21.15.63:0/1617388120 shutdown_connections 2024-05-21T01:20:36.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.961+0000 7ff246935000 1 --2- 172.21.15.63:0/1617388120 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55726631d4a0 0x5572662e1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:36.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.961+0000 7ff246935000 1 --2- 172.21.15.63:0/1617388120 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557266305ef0 0x55726632a590 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:36.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.961+0000 7ff246935000 1 --2- 172.21.15.63:0/1617388120 >> [v2:172.21.15.131:6836/3071941741,v1:172.21.15.131:6838/3071941741] conn(0x5572662e29a0 0x5572662e2d80 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:36.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.961+0000 7ff246935000 1 --2- 172.21.15.63:0/1617388120 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5572662e6740 0x55726632a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:36.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.961+0000 7ff222000640 0 client.4689 ms_handle_reset on v2:172.21.15.131:6836/3071941741 2024-05-21T01:20:36.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.961+0000 7ff246935000 1 -- 172.21.15.63:0/1617388120 >> 172.21.15.63:0/1617388120 conn(0x5572661c5ef0 msgr2=0x5572662dc8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:36.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.961+0000 7ff246935000 1 -- 172.21.15.63:0/1617388120 shutdown_connections 2024-05-21T01:20:36.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.961+0000 7ff246935000 1 -- 172.21.15.63:0/1617388120 wait complete. 2024-05-21T01:20:36.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.961+0000 7ff246935000 20 client.4689 trim_cache size 0 max 16384 2024-05-21T01:20:36.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.981+0000 7ff246935000 1 Processor -- start 2024-05-21T01:20:36.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.981+0000 7ff246935000 1 -- start start 2024-05-21T01:20:36.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.981+0000 7ff246935000 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5572662e6740 0x55726633a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:36.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.981+0000 7ff246935000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557266305ef0 0x5572663391e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:36.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.981+0000 7ff246935000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55726631d4a0 0x557266339720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:36.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.981+0000 7ff246935000 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff23c144070 con 0x5572662e6740 2024-05-21T01:20:36.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.981+0000 7ff246935000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7ff23c201630 con 0x557266305ef0 2024-05-21T01:20:36.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.981+0000 7ff246935000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5572660c7200 con 0x55726631d4a0 2024-05-21T01:20:36.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.981+0000 7ff240a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5572662e6740 0x55726633a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:36.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.981+0000 7ff240a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5572662e6740 0x55726633a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45180/0 (socket says 172.21.15.63:45180) 2024-05-21T01:20:36.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.981+0000 7ff240a00640 1 -- 172.21.15.63:0/558781913 learned_addr learned my addr 172.21.15.63:0/558781913 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:36.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.981+0000 7ff23be00640 1 --2- 172.21.15.63:0/558781913 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557266305ef0 0x5572663391e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:36.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.981+0000 7ff241400640 1 --2- 172.21.15.63:0/558781913 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55726631d4a0 0x557266339720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:36.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.981+0000 7ff240a00640 1 -- 172.21.15.63:0/558781913 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55726631d4a0 msgr2=0x557266339720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:36.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.981+0000 7ff240a00640 1 --2- 172.21.15.63:0/558781913 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55726631d4a0 0x557266339720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:36.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.981+0000 7ff240a00640 1 -- 172.21.15.63:0/558781913 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557266305ef0 msgr2=0x5572663391e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:36.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.981+0000 7ff240a00640 1 --2- 172.21.15.63:0/558781913 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557266305ef0 0x5572663391e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:36.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.981+0000 7ff240a00640 1 -- 172.21.15.63:0/558781913 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572660cb860 con 0x5572662e6740 2024-05-21T01:20:36.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.981+0000 7ff240a00640 1 --2- 172.21.15.63:0/558781913 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5572662e6740 0x55726633a610 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff23000f5b0 tx=0x7ff230014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e991ddc8a8ab772d server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:36.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.981+0000 7ff22cc00640 1 -- 172.21.15.63:0/558781913 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff23003c070 con 0x5572662e6740 2024-05-21T01:20:36.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.981+0000 7ff22cc00640 1 -- 172.21.15.63:0/558781913 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff230025040 con 0x5572662e6740 2024-05-21T01:20:36.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.981+0000 7ff22cc00640 1 -- 172.21.15.63:0/558781913 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff23001b050 con 0x5572662e6740 2024-05-21T01:20:36.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.985+0000 7ff246935000 1 -- 172.21.15.63:0/558781913 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5572662e6740 msgr2=0x55726633a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:36.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.985+0000 7ff246935000 1 --2- 172.21.15.63:0/558781913 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5572662e6740 0x55726633a610 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff23000f5b0 tx=0x7ff230014000 comp rx=0 tx=0).stop 2024-05-21T01:20:36.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.985+0000 7ff246935000 1 -- 172.21.15.63:0/558781913 shutdown_connections 2024-05-21T01:20:36.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.985+0000 7ff246935000 1 --2- 172.21.15.63:0/558781913 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55726631d4a0 0x557266339720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:36.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.985+0000 7ff246935000 1 --2- 172.21.15.63:0/558781913 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557266305ef0 0x5572663391e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:36.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.985+0000 7ff246935000 1 --2- 172.21.15.63:0/558781913 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5572662e6740 0x55726633a610 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:36.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.985+0000 7ff246935000 1 -- 172.21.15.63:0/558781913 >> 172.21.15.63:0/558781913 conn(0x5572661c5ef0 msgr2=0x557266318360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:36.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.985+0000 7ff246935000 1 -- 172.21.15.63:0/558781913 shutdown_connections 2024-05-21T01:20:37.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.985+0000 7ff246935000 1 -- 172.21.15.63:0/558781913 wait complete. 2024-05-21T01:20:37.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.985+0000 7ff246935000 1 -- start start 2024-05-21T01:20:37.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.985+0000 7ff246935000 1 Processor -- start 2024-05-21T01:20:37.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.985+0000 7ff246935000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5572662e6740 0x557266394630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:37.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.985+0000 7ff246935000 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557266305ef0 0x557266394b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:37.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.985+0000 7ff246935000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55726631d4a0 0x557266395460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:37.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.985+0000 7ff246935000 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55726612d5c0 con 0x557266305ef0 2024-05-21T01:20:37.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.985+0000 7ff246935000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5572660c27b0 con 0x55726631d4a0 2024-05-21T01:20:37.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.985+0000 7ff246935000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5572661328e0 con 0x5572662e6740 2024-05-21T01:20:37.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.985+0000 7ff246935000 10 client.0 _ll_register_callbacks cb 0x7ff2280096f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-21T01:20:37.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.985+0000 7ff23be00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557266305ef0 0x557266394b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:37.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.985+0000 7ff23be00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557266305ef0 0x557266394b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45194/0 (socket says 172.21.15.63:45194) 2024-05-21T01:20:37.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.985+0000 7ff23be00640 1 -- 172.21.15.63:0/2308635543 learned_addr learned my addr 172.21.15.63:0/2308635543 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:37.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.985+0000 7ff241400640 1 --2- 172.21.15.63:0/2308635543 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55726631d4a0 0x557266395460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:37.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.985+0000 7ff240a00640 1 --2- 172.21.15.63:0/2308635543 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5572662e6740 0x557266394630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:37.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.985+0000 7ff23be00640 1 -- 172.21.15.63:0/2308635543 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5572662e6740 msgr2=0x557266394630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:37.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.985+0000 7ff23be00640 1 --2- 172.21.15.63:0/2308635543 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5572662e6740 0x557266394630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:37.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.985+0000 7ff23be00640 1 -- 172.21.15.63:0/2308635543 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55726631d4a0 msgr2=0x557266395460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:37.002 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.985+0000 7ff23be00640 1 --2- 172.21.15.63:0/2308635543 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55726631d4a0 0x557266395460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:37.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.985+0000 7ff23be00640 1 -- 172.21.15.63:0/2308635543 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572660e1e80 con 0x557266305ef0 2024-05-21T01:20:37.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.985+0000 7ff23be00640 1 --2- 172.21.15.63:0/2308635543 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557266305ef0 0x557266394b70 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff22801c270 tx=0x7ff22801ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ee86b36de0c8441 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:37.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.985+0000 7ff222000640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-05-21T01:20:37.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.985+0000 7ff222000640 1 -- 172.21.15.63:0/2308635543 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2280ce030 con 0x557266305ef0 2024-05-21T01:20:37.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.985+0000 7ff222000640 1 -- 172.21.15.63:0/2308635543 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7ff228004250 con 0x557266305ef0 2024-05-21T01:20:37.003 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.985+0000 7ff246935000 1 -- 172.21.15.63:0/2308635543 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff230025040 con 0x557266305ef0 2024-05-21T01:20:37.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.985+0000 7ff222000640 1 -- 172.21.15.63:0/2308635543 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7ff2280d7050 con 0x557266305ef0 2024-05-21T01:20:37.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.989+0000 7ff246935000 10 client.4695 fetch_fsmap learned FSMap version 15 2024-05-21T01:20:37.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.989+0000 7ff246935000 1 -- 172.21.15.63:0/2308635543 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x5572661aea00 con 0x557266305ef0 2024-05-21T01:20:37.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.989+0000 7ff222000640 1 -- 172.21.15.63:0/2308635543 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff230025040 con 0x557266305ef0 2024-05-21T01:20:37.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.989+0000 7ff222000640 1 -- 172.21.15.63:0/2308635543 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 15) ==== 4752+0+0 (secure 0 0 0) 0x7ff2280da020 con 0x557266305ef0 2024-05-21T01:20:37.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.989+0000 7ff246935000 10 client.4695 fetch_fsmap finished waiting for FSMap version 15 2024-05-21T01:20:37.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.989+0000 7ff246935000 10 client.4695 resolve_mds: resolved name 'f' to daemon mds.f 2024-05-21T01:20:37.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.989+0000 7ff246935000 20 client.4695 populate_metadata read hostname 'smithi063' 2024-05-21T01:20:37.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.989+0000 7ff246935000 1 --2- 172.21.15.63:0/2308635543 >> [v2:172.21.15.131:6836/3071941741,v1:172.21.15.131:6838/3071941741] conn(0x557266395f40 0x557266396320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:37.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.989+0000 7ff246935000 4 client.4695 mds_command: new command op to 4270 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-21T01:20:37.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.989+0000 7ff246935000 1 -- 172.21.15.63:0/2308635543 --> [v2:172.21.15.131:6836/3071941741,v1:172.21.15.131:6838/3071941741] -- command(tid 0: {"prefix": "status"}) -- 0x5572660c9dc0 con 0x557266395f40 2024-05-21T01:20:37.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.989+0000 7ff240a00640 1 --2- 172.21.15.63:0/2308635543 >> [v2:172.21.15.131:6836/3071941741,v1:172.21.15.131:6838/3071941741] conn(0x557266395f40 0x557266396320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:37.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.989+0000 7ff240a00640 1 --2- 172.21.15.63:0/2308635543 >> [v2:172.21.15.131:6836/3071941741,v1:172.21.15.131:6838/3071941741] conn(0x557266395f40 0x557266396320 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1ecf1f8465004b0e server_cookie=ed101bb9c4dbb56c in_seq=0 out_seq=0 2024-05-21T01:20:37.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.989+0000 7ff222000640 10 client.4695 ms_handle_connect on v2:172.21.15.131:6836/3071941741 2024-05-21T01:20:37.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.989+0000 7ff222000640 1 -- 172.21.15.63:0/2308635543 <== mds.1 v2:172.21.15.131:6836/3071941741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x5572660c9dc0 con 0x557266395f40 2024-05-21T01:20:37.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.989+0000 7ff222000640 10 client.4695 handle_command_reply: tid=0 2024-05-21T01:20:37.006 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.989+0000 7ff246935000 1 client.4695 shutdown 2024-05-21T01:20:37.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.989+0000 7ff246935000 1 -- 172.21.15.63:0/2308635543 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557266305ef0 msgr2=0x557266394b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:37.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.989+0000 7ff246935000 1 --2- 172.21.15.63:0/2308635543 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557266305ef0 0x557266394b70 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff22801c270 tx=0x7ff22801ac80 comp rx=0 tx=0).stop 2024-05-21T01:20:37.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.989+0000 7ff246935000 1 -- 172.21.15.63:0/2308635543 shutdown_connections 2024-05-21T01:20:37.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.989+0000 7ff246935000 1 --2- 172.21.15.63:0/2308635543 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55726631d4a0 0x557266395460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:37.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.989+0000 7ff246935000 1 --2- 172.21.15.63:0/2308635543 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557266305ef0 0x557266394b70 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:37.007 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.989+0000 7ff246935000 1 --2- 172.21.15.63:0/2308635543 >> [v2:172.21.15.131:6836/3071941741,v1:172.21.15.131:6838/3071941741] conn(0x557266395f40 0x557266396320 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:37.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.989+0000 7ff246935000 1 --2- 172.21.15.63:0/2308635543 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5572662e6740 0x557266394630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:37.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.989+0000 7ff246935000 1 -- 172.21.15.63:0/2308635543 >> 172.21.15.63:0/2308635543 conn(0x5572661c5ef0 msgr2=0x5572662de8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:37.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.989+0000 7ff222000640 0 client.4695 ms_handle_reset on v2:172.21.15.131:6836/3071941741 2024-05-21T01:20:37.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.989+0000 7ff246935000 1 -- 172.21.15.63:0/2308635543 shutdown_connections 2024-05-21T01:20:37.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.989+0000 7ff246935000 1 -- 172.21.15.63:0/2308635543 wait complete. 2024-05-21T01:20:37.008 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.989+0000 7ff246935000 20 client.4695 trim_cache size 0 max 16384 2024-05-21T01:20:37.009 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-05-21T01:20:37.009 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_fsid": "9a7cbd84-ceb2-41c8-8b6e-ab931f86c51a", 2024-05-21T01:20:37.009 INFO:teuthology.orchestra.run.smithi063.stdout: "whoami": 1, 2024-05-21T01:20:37.010 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 4270, 2024-05-21T01:20:37.010 INFO:teuthology.orchestra.run.smithi063.stdout: "want_state": "up:active", 2024-05-21T01:20:37.010 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "up:active", 2024-05-21T01:20:37.010 INFO:teuthology.orchestra.run.smithi063.stdout: "fs_name": "cephfs", 2024-05-21T01:20:37.010 INFO:teuthology.orchestra.run.smithi063.stdout: "rank_uptime": 17.355107647000001, 2024-05-21T01:20:37.010 INFO:teuthology.orchestra.run.smithi063.stdout: "mdsmap_epoch": 15, 2024-05-21T01:20:37.011 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch": 25, 2024-05-21T01:20:37.011 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch_barrier": 25, 2024-05-21T01:20:37.011 INFO:teuthology.orchestra.run.smithi063.stdout: "uptime": 48.333161066999999 2024-05-21T01:20:37.011 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-05-21T01:20:37.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.989+0000 7ff241e00640 1 -- 172.21.15.63:0/4224280788 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7ff21c06f400 msgr2=0x7ff21c0718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:37.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.989+0000 7ff241e00640 1 --2- 172.21.15.63:0/4224280788 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7ff21c06f400 0x7ff21c0718c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff23000b930 tx=0x7ff230008040 comp rx=0 tx=0).stop 2024-05-21T01:20:37.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.989+0000 7ff241e00640 1 -- 172.21.15.63:0/4224280788 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff23c15bfc0 msgr2=0x7ff23c158fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:37.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.989+0000 7ff241e00640 1 --2- 172.21.15.63:0/4224280788 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff23c15bfc0 0x7ff23c158fb0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff23400c7b0 tx=0x7ff23400cc70 comp rx=0 tx=0).stop 2024-05-21T01:20:37.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.989+0000 7ff241e00640 1 -- 172.21.15.63:0/4224280788 shutdown_connections 2024-05-21T01:20:37.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.989+0000 7ff241e00640 1 --2- 172.21.15.63:0/4224280788 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7ff21c06f400 0x7ff21c0718c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:37.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.989+0000 7ff241e00640 1 --2- 172.21.15.63:0/4224280788 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff23c15bfc0 0x7ff23c158fb0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:37.013 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.989+0000 7ff241e00640 1 --2- 172.21.15.63:0/4224280788 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff23c0ca640 0x7ff23c158a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:37.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.989+0000 7ff241e00640 1 --2- 172.21.15.63:0/4224280788 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff23c06d0f0 0x7ff23c146110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:37.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.989+0000 7ff241e00640 1 -- 172.21.15.63:0/4224280788 >> 172.21.15.63:0/4224280788 conn(0x7ff23c0cacf0 msgr2=0x7ff23c072520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:37.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.989+0000 7ff241e00640 1 -- 172.21.15.63:0/4224280788 shutdown_connections 2024-05-21T01:20:37.014 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:36.989+0000 7ff241e00640 1 -- 172.21.15.63:0/4224280788 wait complete. 2024-05-21T01:20:37.016 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-05-21T01:20:37.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.153+0000 7f22aac00640 1 Processor -- start 2024-05-21T01:20:37.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.153+0000 7f22aac00640 1 -- start start 2024-05-21T01:20:37.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.153+0000 7f22aac00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f22a4156350 0x7f22a40c9960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:37.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.153+0000 7f22aac00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f22a415f880 0x7f22a415fd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:37.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.153+0000 7f22aac00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22a4160250 con 0x7f22a40c9280 2024-05-21T01:20:37.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.153+0000 7f22aac00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f22a40c9ea0 con 0x7f22a415f880 2024-05-21T01:20:37.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.153+0000 7f22aac00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f22a40ca0c0 con 0x7f22a4156350 2024-05-21T01:20:37.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.153+0000 7f22a3400640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f22a40c9280 0x7f22a40c8290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58266/0 (socket says 172.21.15.63:58266) 2024-05-21T01:20:37.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.153+0000 7f22a3400640 1 -- 172.21.15.63:0/2807076837 learned_addr learned my addr 172.21.15.63:0/2807076837 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-05-21T01:20:37.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.153+0000 7f22a3e00640 1 --2- 172.21.15.63:0/2807076837 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f22a4156350 0x7f22a40c9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:37.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.153+0000 7f22a8c00640 1 --2- 172.21.15.63:0/2807076837 >> v2:172.21.15.131:3300/0 conn(0x7f22a415f880 0x7f22a415fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:37.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.153+0000 7f22a2a00640 1 -- 172.21.15.63:0/2807076837 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1924731718 0 0) 0x7f22a4160250 con 0x7f22a40c9280 2024-05-21T01:20:37.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.153+0000 7f22a2a00640 1 -- 172.21.15.63:0/2807076837 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2288003530 con 0x7f22a40c9280 2024-05-21T01:20:37.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.153+0000 7f22a8c00640 1 -- 172.21.15.63:0/2807076837 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f22a4156350 msgr2=0x7f22a40c9960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:37.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.153+0000 7f22a8c00640 1 --2- 172.21.15.63:0/2807076837 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f22a4156350 0x7f22a40c9960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:37.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.153+0000 7f22a8c00640 1 -- 172.21.15.63:0/2807076837 >> v1:172.21.15.63:6789/0 conn(0x7f22a40c9280 legacy=0x7f22a40c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:37.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.153+0000 7f22a8c00640 1 -- 172.21.15.63:0/2807076837 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22a40bfbd0 con 0x7f22a415f880 2024-05-21T01:20:37.162 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.157+0000 7f22a8c00640 1 --2- 172.21.15.63:0/2807076837 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22a415f880 0x7f22a415fd10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f229c009d90 tx=0x7f229c01f150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5fb8b035ad8ffa65 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:37.162 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.157+0000 7f22a2a00640 1 -- 172.21.15.63:0/2807076837 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f229c0b4070 con 0x7f22a415f880 2024-05-21T01:20:37.162 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.157+0000 7f22a2a00640 1 -- 172.21.15.63:0/2807076837 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f229c0af600 con 0x7f22a415f880 2024-05-21T01:20:37.162 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.157+0000 7f22a2a00640 1 -- 172.21.15.63:0/2807076837 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f229c0af9b0 con 0x7f22a415f880 2024-05-21T01:20:37.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.157+0000 7f22aac00640 1 -- 172.21.15.63:0/2807076837 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22a415f880 msgr2=0x7f22a415fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:37.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.157+0000 7f22aac00640 1 --2- 172.21.15.63:0/2807076837 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22a415f880 0x7f22a415fd10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f229c009d90 tx=0x7f229c01f150 comp rx=0 tx=0).stop 2024-05-21T01:20:37.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.157+0000 7f22aac00640 1 -- 172.21.15.63:0/2807076837 shutdown_connections 2024-05-21T01:20:37.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.157+0000 7f22aac00640 1 --2- 172.21.15.63:0/2807076837 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22a415f880 0x7f22a415fd10 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:37.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.157+0000 7f22aac00640 1 --2- 172.21.15.63:0/2807076837 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f22a4156350 0x7f22a40c9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:37.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.157+0000 7f22aac00640 1 -- 172.21.15.63:0/2807076837 >> 172.21.15.63:0/2807076837 conn(0x7f22a40cde10 msgr2=0x7f22a40ce220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:37.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.157+0000 7f22aac00640 1 -- 172.21.15.63:0/2807076837 shutdown_connections 2024-05-21T01:20:37.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.157+0000 7f22aac00640 1 -- 172.21.15.63:0/2807076837 wait complete. 2024-05-21T01:20:37.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.161+0000 7f22aac00640 1 Processor -- start 2024-05-21T01:20:37.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.161+0000 7f22aac00640 1 -- start start 2024-05-21T01:20:37.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.161+0000 7f22aac00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22a40c9280 0x7f22a414a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:37.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.161+0000 7f22aac00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f22a4156350 0x7f22a414aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:37.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.161+0000 7f22aac00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f22a415f880 0x7f22a41497e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:37.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.161+0000 7f22aac00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f22a40c0470 con 0x7f22a4156350 2024-05-21T01:20:37.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.161+0000 7f22aac00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f22a40c0190 con 0x7f22a40c9280 2024-05-21T01:20:37.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.161+0000 7f22aac00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f22a4074870 con 0x7f22a415f880 2024-05-21T01:20:37.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.161+0000 7f22a3400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f22a4156350 0x7f22a414aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:37.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.161+0000 7f22a3400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f22a4156350 0x7f22a414aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45200/0 (socket says 172.21.15.63:45200) 2024-05-21T01:20:37.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.161+0000 7f22a3400640 1 -- 172.21.15.63:0/674240794 learned_addr learned my addr 172.21.15.63:0/674240794 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:37.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.161+0000 7f22a8c00640 1 --2- 172.21.15.63:0/674240794 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f22a415f880 0x7f22a41497e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:37.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.161+0000 7f22a3e00640 1 --2- 172.21.15.63:0/674240794 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22a40c9280 0x7f22a414a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:37.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.161+0000 7f22a3400640 1 -- 172.21.15.63:0/674240794 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f22a415f880 msgr2=0x7f22a41497e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:37.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.161+0000 7f22a3400640 1 --2- 172.21.15.63:0/674240794 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f22a415f880 0x7f22a41497e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:37.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.161+0000 7f22a3400640 1 -- 172.21.15.63:0/674240794 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22a40c9280 msgr2=0x7f22a414a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:37.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.161+0000 7f22a3400640 1 --2- 172.21.15.63:0/674240794 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22a40c9280 0x7f22a414a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:37.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.161+0000 7f22a3400640 1 -- 172.21.15.63:0/674240794 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22a4149300 con 0x7f22a4156350 2024-05-21T01:20:37.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.161+0000 7f22a3400640 1 --2- 172.21.15.63:0/674240794 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f22a4156350 0x7f22a414aaf0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f229000c4d0 tx=0x7f229000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:37.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.161+0000 7f229be00640 1 -- 172.21.15.63:0/674240794 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2290005cf0 con 0x7f22a4156350 2024-05-21T01:20:37.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.161+0000 7f229be00640 1 -- 172.21.15.63:0/674240794 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2290007070 con 0x7f22a4156350 2024-05-21T01:20:37.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.161+0000 7f229be00640 1 -- 172.21.15.63:0/674240794 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2290007420 con 0x7f22a4156350 2024-05-21T01:20:37.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.161+0000 7f22aac00640 1 -- 172.21.15.63:0/674240794 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22a415f1a0 con 0x7f22a4156350 2024-05-21T01:20:37.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.161+0000 7f22aac00640 1 -- 172.21.15.63:0/674240794 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22a41542e0 con 0x7f22a4156350 2024-05-21T01:20:37.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.165+0000 7f229be00640 1 -- 172.21.15.63:0/674240794 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7f22900075c0 con 0x7f22a4156350 2024-05-21T01:20:37.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.165+0000 7f229be00640 1 --2- 172.21.15.63:0/674240794 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f228406f430 0x7f22840718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:37.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.165+0000 7f229be00640 1 -- 172.21.15.63:0/674240794 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f229008f1d0 con 0x7f22a4156350 2024-05-21T01:20:37.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.165+0000 7f22ae017000 1 Processor -- start 2024-05-21T01:20:37.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.165+0000 7f22ae017000 1 -- start start 2024-05-21T01:20:37.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.165+0000 7f22a3e00640 1 --2- 172.21.15.63:0/674240794 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f228406f430 0x7f22840718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:37.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.165+0000 7f22ae017000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c95edcc4a0 0x55c95ed95200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:37.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.165+0000 7f22ae017000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c95ed95740 0x55c95edb49b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:37.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.165+0000 7f22ae017000 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c95edb4ef0 0x55c95edb52d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:37.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.165+0000 7f22ae017000 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55c95ebe96d0 con 0x55c95edb4ef0 2024-05-21T01:20:37.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.165+0000 7f22ae017000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55c95ebd9270 con 0x55c95ed95740 2024-05-21T01:20:37.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.165+0000 7f22ae017000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55c95ebdd2b0 con 0x55c95edcc4a0 2024-05-21T01:20:37.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.165+0000 7f22a3e00640 1 --2- 172.21.15.63:0/674240794 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f228406f430 0x7f22840718f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2294009af0 tx=0x7f2294008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:37.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.165+0000 7f22a8c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c95edb4ef0 0x55c95edb52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:37.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.165+0000 7f22a8c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c95edb4ef0 0x55c95edb52d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45214/0 (socket says 172.21.15.63:45214) 2024-05-21T01:20:37.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.165+0000 7f22a8c00640 1 -- 172.21.15.63:0/3637660623 learned_addr learned my addr 172.21.15.63:0/3637660623 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:37.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.165+0000 7f22a3e00640 1 --2- 172.21.15.63:0/3637660623 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c95edcc4a0 0x55c95ed95200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:37.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.165+0000 7f22a3400640 1 --2- 172.21.15.63:0/3637660623 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c95ed95740 0x55c95edb49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:37.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.165+0000 7f22a8c00640 1 -- 172.21.15.63:0/3637660623 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c95edcc4a0 msgr2=0x55c95ed95200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:37.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.165+0000 7f22a8c00640 1 --2- 172.21.15.63:0/3637660623 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c95edcc4a0 0x55c95ed95200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:37.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.165+0000 7f22a8c00640 1 -- 172.21.15.63:0/3637660623 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c95ed95740 msgr2=0x55c95edb49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:37.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.165+0000 7f22a8c00640 1 --2- 172.21.15.63:0/3637660623 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c95ed95740 0x55c95edb49b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:37.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.165+0000 7f22a8c00640 1 -- 172.21.15.63:0/3637660623 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c95ebb7bf0 con 0x55c95edb4ef0 2024-05-21T01:20:37.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.165+0000 7f22a3400640 1 --2- 172.21.15.63:0/3637660623 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c95ed95740 0x55c95edb49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T01:20:37.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.169+0000 7f22a8c00640 1 --2- 172.21.15.63:0/3637660623 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c95edb4ef0 0x55c95edb52d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f229c01cd80 tx=0x7f229c004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e49ee289e3dd94e3 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:37.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.169+0000 7f2298c00640 1 -- 172.21.15.63:0/3637660623 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f229c0be030 con 0x55c95edb4ef0 2024-05-21T01:20:37.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.169+0000 7f2298c00640 1 -- 172.21.15.63:0/3637660623 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f229c003a20 con 0x55c95edb4ef0 2024-05-21T01:20:37.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.169+0000 7f2298c00640 1 -- 172.21.15.63:0/3637660623 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f229c0b4040 con 0x55c95edb4ef0 2024-05-21T01:20:37.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.169+0000 7f22ae017000 1 -- 172.21.15.63:0/3637660623 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c95edb4ef0 msgr2=0x55c95edb52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:37.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.169+0000 7f22ae017000 1 --2- 172.21.15.63:0/3637660623 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c95edb4ef0 0x55c95edb52d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f229c01cd80 tx=0x7f229c004ac0 comp rx=0 tx=0).stop 2024-05-21T01:20:37.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.169+0000 7f22ae017000 1 -- 172.21.15.63:0/3637660623 shutdown_connections 2024-05-21T01:20:37.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.169+0000 7f22ae017000 1 --2- 172.21.15.63:0/3637660623 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c95edb4ef0 0x55c95edb52d0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:37.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.169+0000 7f22ae017000 1 --2- 172.21.15.63:0/3637660623 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c95ed95740 0x55c95edb49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:37.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.169+0000 7f22ae017000 1 --2- 172.21.15.63:0/3637660623 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c95edcc4a0 0x55c95ed95200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:37.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.169+0000 7f22ae017000 1 -- 172.21.15.63:0/3637660623 >> 172.21.15.63:0/3637660623 conn(0x55c95ec74ef0 msgr2=0x55c95edcbb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:37.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.169+0000 7f22ae017000 1 -- 172.21.15.63:0/3637660623 shutdown_connections 2024-05-21T01:20:37.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.169+0000 7f22ae017000 1 -- 172.21.15.63:0/3637660623 wait complete. 2024-05-21T01:20:37.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.169+0000 7f22ae017000 1 -- start start 2024-05-21T01:20:37.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.169+0000 7f22ae017000 1 Processor -- start 2024-05-21T01:20:37.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.169+0000 7f22ae017000 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c95ed95740 0x55c95edd9050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:37.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.169+0000 7f22ae017000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c95edb4ef0 0x55c95edd9590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:37.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.169+0000 7f22ae017000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c95edcc4a0 0x55c95ed908b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:37.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.169+0000 7f22ae017000 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55c95eb9c630 con 0x55c95ed95740 2024-05-21T01:20:37.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.169+0000 7f22ae017000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55c95ec5d570 con 0x55c95edcc4a0 2024-05-21T01:20:37.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.169+0000 7f22ae017000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55c95ebe84a0 con 0x55c95edb4ef0 2024-05-21T01:20:37.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.169+0000 7f22ae017000 10 client.0 _ll_register_callbacks cb 0x55c95ed78540 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-21T01:20:37.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.169+0000 7f22a3e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c95ed95740 0x55c95edd9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:37.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.169+0000 7f22a3e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c95ed95740 0x55c95edd9050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45220/0 (socket says 172.21.15.63:45220) 2024-05-21T01:20:37.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.169+0000 7f22a3e00640 1 -- 172.21.15.63:0/23271070 learned_addr learned my addr 172.21.15.63:0/23271070 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:37.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.169+0000 7f22a3400640 1 --2- 172.21.15.63:0/23271070 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c95edb4ef0 0x55c95edd9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:37.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.169+0000 7f22a8c00640 1 --2- 172.21.15.63:0/23271070 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c95edcc4a0 0x55c95ed908b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:37.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.169+0000 7f22a3e00640 1 -- 172.21.15.63:0/23271070 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c95edb4ef0 msgr2=0x55c95edd9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:37.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.169+0000 7f22a3e00640 1 --2- 172.21.15.63:0/23271070 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c95edb4ef0 0x55c95edd9590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:37.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.169+0000 7f22a3e00640 1 -- 172.21.15.63:0/23271070 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c95edcc4a0 msgr2=0x55c95ed908b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:37.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.169+0000 7f22a3e00640 1 --2- 172.21.15.63:0/23271070 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c95edcc4a0 0x55c95ed908b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:37.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.169+0000 7f22a3e00640 1 -- 172.21.15.63:0/23271070 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c95ec219b0 con 0x55c95ed95740 2024-05-21T01:20:37.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.169+0000 7f22a3e00640 1 --2- 172.21.15.63:0/23271070 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c95ed95740 0x55c95edd9050 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2294006a60 tx=0x7f22940046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be0487323e80bc33 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:37.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.169+0000 7f228d600640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-05-21T01:20:37.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.169+0000 7f228d600640 1 -- 172.21.15.63:0/23271070 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2294026070 con 0x55c95ed95740 2024-05-21T01:20:37.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.173+0000 7f22ae017000 1 -- 172.21.15.63:0/23271070 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f229c003a20 con 0x55c95ed95740 2024-05-21T01:20:37.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.173+0000 7f228d600640 1 -- 172.21.15.63:0/23271070 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f2294014830 con 0x55c95ed95740 2024-05-21T01:20:37.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.173+0000 7f228d600640 1 -- 172.21.15.63:0/23271070 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f2294031050 con 0x55c95ed95740 2024-05-21T01:20:37.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.173+0000 7f22ae017000 10 client.4707 fetch_fsmap learned FSMap version 15 2024-05-21T01:20:37.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.173+0000 7f22ae017000 1 -- 172.21.15.63:0/23271070 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x55c95ebb4510 con 0x55c95ed95740 2024-05-21T01:20:37.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.173+0000 7f228d600640 1 -- 172.21.15.63:0/23271070 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f229c003a20 con 0x55c95ed95740 2024-05-21T01:20:37.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.173+0000 7f228d600640 1 -- 172.21.15.63:0/23271070 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 15) ==== 4752+0+0 (secure 0 0 0) 0x7f2294034020 con 0x55c95ed95740 2024-05-21T01:20:37.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.173+0000 7f22ae017000 10 client.4707 fetch_fsmap finished waiting for FSMap version 15 2024-05-21T01:20:37.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.173+0000 7f22ae017000 10 client.4707 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-21T01:20:37.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.173+0000 7f22ae017000 20 client.4707 populate_metadata read hostname 'smithi063' 2024-05-21T01:20:37.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.173+0000 7f22ae017000 1 --2- 172.21.15.63:0/23271070 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x55c95ed91650 0x55c95ed91a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:37.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.173+0000 7f22ae017000 4 client.4707 mds_command: new command op to 4276 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-21T01:20:37.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.173+0000 7f22ae017000 1 -- 172.21.15.63:0/23271070 --> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c95eb74bc0 con 0x55c95ed91650 2024-05-21T01:20:37.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.173+0000 7f22a3400640 1 --2- 172.21.15.63:0/23271070 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x55c95ed91650 0x55c95ed91a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:37.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.173+0000 7f22a3400640 1 --2- 172.21.15.63:0/23271070 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x55c95ed91650 0x55c95ed91a30 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf82ae52dafe4256 server_cookie=a204fd3b6309176f in_seq=0 out_seq=0 2024-05-21T01:20:37.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.173+0000 7f228d600640 10 client.4707 ms_handle_connect on v2:172.21.15.63:6834/2892727989 2024-05-21T01:20:37.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.173+0000 7f228d600640 1 -- 172.21.15.63:0/23271070 <== mds.0 v2:172.21.15.63:6834/2892727989 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x55c95eb74bc0 con 0x55c95ed91650 2024-05-21T01:20:37.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.173+0000 7f228d600640 10 client.4707 handle_command_reply: tid=0 2024-05-21T01:20:37.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.173+0000 7f22ae017000 1 client.4707 shutdown 2024-05-21T01:20:37.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.173+0000 7f22ae017000 1 -- 172.21.15.63:0/23271070 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c95ed95740 msgr2=0x55c95edd9050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:37.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.173+0000 7f22ae017000 1 --2- 172.21.15.63:0/23271070 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c95ed95740 0x55c95edd9050 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2294006a60 tx=0x7f22940046d0 comp rx=0 tx=0).stop 2024-05-21T01:20:37.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.173+0000 7f22ae017000 1 -- 172.21.15.63:0/23271070 shutdown_connections 2024-05-21T01:20:37.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.173+0000 7f22ae017000 1 --2- 172.21.15.63:0/23271070 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x55c95ed91650 0x55c95ed91a30 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:37.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.173+0000 7f22ae017000 1 --2- 172.21.15.63:0/23271070 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c95edcc4a0 0x55c95ed908b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:37.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.173+0000 7f22ae017000 1 --2- 172.21.15.63:0/23271070 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c95edb4ef0 0x55c95edd9590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:37.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.173+0000 7f228d600640 0 client.4707 ms_handle_reset on v2:172.21.15.63:6834/2892727989 2024-05-21T01:20:37.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.173+0000 7f22ae017000 1 --2- 172.21.15.63:0/23271070 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c95ed95740 0x55c95edd9050 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:37.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.173+0000 7f22ae017000 1 -- 172.21.15.63:0/23271070 >> 172.21.15.63:0/23271070 conn(0x55c95ec74ef0 msgr2=0x55c95ed8b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:37.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.173+0000 7f22ae017000 1 -- 172.21.15.63:0/23271070 shutdown_connections 2024-05-21T01:20:37.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.173+0000 7f22ae017000 1 -- 172.21.15.63:0/23271070 wait complete. 2024-05-21T01:20:37.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.173+0000 7f22ae017000 20 client.4707 trim_cache size 0 max 16384 2024-05-21T01:20:37.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.193+0000 7f22ae017000 1 Processor -- start 2024-05-21T01:20:37.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.193+0000 7f22ae017000 1 -- start start 2024-05-21T01:20:37.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.193+0000 7f22ae017000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c95ed95740 0x55c95ed8d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:37.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.193+0000 7f22ae017000 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c95edb4ef0 0x55c95ed8de30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:37.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.193+0000 7f22ae017000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c95edcc4a0 0x55c95eddecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:37.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.193+0000 7f22ae017000 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f22a41f2480 con 0x55c95edb4ef0 2024-05-21T01:20:37.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.193+0000 7f22ae017000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f22a41fde10 con 0x55c95edcc4a0 2024-05-21T01:20:37.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.193+0000 7f22ae017000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55c95eb76200 con 0x55c95ed95740 2024-05-21T01:20:37.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.193+0000 7f22a3400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c95edb4ef0 0x55c95ed8de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:37.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.193+0000 7f22a3400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c95edb4ef0 0x55c95ed8de30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45228/0 (socket says 172.21.15.63:45228) 2024-05-21T01:20:37.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.193+0000 7f22a3400640 1 -- 172.21.15.63:0/2030382292 learned_addr learned my addr 172.21.15.63:0/2030382292 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:37.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.193+0000 7f22a8c00640 1 --2- 172.21.15.63:0/2030382292 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c95edcc4a0 0x55c95eddecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:37.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.193+0000 7f22a3e00640 1 --2- 172.21.15.63:0/2030382292 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c95ed95740 0x55c95ed8d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:37.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.193+0000 7f22a3400640 1 -- 172.21.15.63:0/2030382292 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c95ed95740 msgr2=0x55c95ed8d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:37.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.193+0000 7f22a3400640 1 --2- 172.21.15.63:0/2030382292 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c95ed95740 0x55c95ed8d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:37.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.193+0000 7f22a3400640 1 -- 172.21.15.63:0/2030382292 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c95edcc4a0 msgr2=0x55c95eddecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:37.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.193+0000 7f22a3400640 1 --2- 172.21.15.63:0/2030382292 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c95edcc4a0 0x55c95eddecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:37.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.193+0000 7f22a3400640 1 -- 172.21.15.63:0/2030382292 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c95eb7a860 con 0x55c95edb4ef0 2024-05-21T01:20:37.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.193+0000 7f22a3400640 1 --2- 172.21.15.63:0/2030382292 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c95edb4ef0 0x55c95ed8de30 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f229000ce90 tx=0x7f2290005e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d61307099e2e7fd server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:37.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.193+0000 7f228fe00640 1 -- 172.21.15.63:0/2030382292 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2290074e60 con 0x55c95edb4ef0 2024-05-21T01:20:37.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.193+0000 7f228fe00640 1 -- 172.21.15.63:0/2030382292 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f229005b700 con 0x55c95edb4ef0 2024-05-21T01:20:37.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.193+0000 7f228fe00640 1 -- 172.21.15.63:0/2030382292 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f229005fab0 con 0x55c95edb4ef0 2024-05-21T01:20:37.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.193+0000 7f22ae017000 1 -- 172.21.15.63:0/2030382292 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c95edb4ef0 msgr2=0x55c95ed8de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:37.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.193+0000 7f22ae017000 1 --2- 172.21.15.63:0/2030382292 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c95edb4ef0 0x55c95ed8de30 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f229000ce90 tx=0x7f2290005e90 comp rx=0 tx=0).stop 2024-05-21T01:20:37.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.193+0000 7f22ae017000 1 -- 172.21.15.63:0/2030382292 shutdown_connections 2024-05-21T01:20:37.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.193+0000 7f22ae017000 1 --2- 172.21.15.63:0/2030382292 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c95edcc4a0 0x55c95eddecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:37.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.193+0000 7f22ae017000 1 --2- 172.21.15.63:0/2030382292 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c95edb4ef0 0x55c95ed8de30 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:37.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.193+0000 7f22ae017000 1 --2- 172.21.15.63:0/2030382292 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c95ed95740 0x55c95ed8d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:37.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.193+0000 7f22ae017000 1 -- 172.21.15.63:0/2030382292 >> 172.21.15.63:0/2030382292 conn(0x55c95ec74ef0 msgr2=0x55c95ed8e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:37.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.197+0000 7f22ae017000 1 -- 172.21.15.63:0/2030382292 shutdown_connections 2024-05-21T01:20:37.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.197+0000 7f22ae017000 1 -- 172.21.15.63:0/2030382292 wait complete. 2024-05-21T01:20:37.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.197+0000 7f22ae017000 1 -- start start 2024-05-21T01:20:37.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.197+0000 7f22ae017000 1 Processor -- start 2024-05-21T01:20:37.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.197+0000 7f22ae017000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c95ed95740 0x55c95ee46660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:37.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.197+0000 7f22ae017000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c95edb4ef0 0x55c95ee46ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:37.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.197+0000 7f22ae017000 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c95edcc4a0 0x55c95eddba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:37.204 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.197+0000 7f22ae017000 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55c95ebdc5c0 con 0x55c95edcc4a0 2024-05-21T01:20:37.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.197+0000 7f22ae017000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55c95eb717b0 con 0x55c95edb4ef0 2024-05-21T01:20:37.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.197+0000 7f22ae017000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55c95ebe18e0 con 0x55c95ed95740 2024-05-21T01:20:37.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.197+0000 7f22ae017000 10 client.0 _ll_register_callbacks cb 0x7f2294009900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-21T01:20:37.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.197+0000 7f22a8c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c95edcc4a0 0x55c95eddba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:37.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.197+0000 7f22a8c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c95edcc4a0 0x55c95eddba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45244/0 (socket says 172.21.15.63:45244) 2024-05-21T01:20:37.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.197+0000 7f22a8c00640 1 -- 172.21.15.63:0/3562533791 learned_addr learned my addr 172.21.15.63:0/3562533791 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:37.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.197+0000 7f22a3e00640 1 --2- 172.21.15.63:0/3562533791 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c95ed95740 0x55c95ee46660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:37.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.197+0000 7f22a3400640 1 --2- 172.21.15.63:0/3562533791 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c95edb4ef0 0x55c95ee46ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:37.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.197+0000 7f22a8c00640 1 -- 172.21.15.63:0/3562533791 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c95ed95740 msgr2=0x55c95ee46660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:37.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.197+0000 7f22a8c00640 1 --2- 172.21.15.63:0/3562533791 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c95ed95740 0x55c95ee46660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:37.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.197+0000 7f22a8c00640 1 -- 172.21.15.63:0/3562533791 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c95edb4ef0 msgr2=0x55c95ee46ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:37.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.197+0000 7f22a8c00640 1 --2- 172.21.15.63:0/3562533791 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c95edb4ef0 0x55c95ee46ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:37.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.197+0000 7f22a8c00640 1 -- 172.21.15.63:0/3562533791 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c95eb90e80 con 0x55c95edcc4a0 2024-05-21T01:20:37.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.197+0000 7f22a8c00640 1 --2- 172.21.15.63:0/3562533791 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c95edcc4a0 0x55c95eddba70 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f229c01cd80 tx=0x7f229c01d990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7abaa731fd84b096 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:37.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.197+0000 7f228d600640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-05-21T01:20:37.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.197+0000 7f228d600640 1 -- 172.21.15.63:0/3562533791 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f229c0be040 con 0x55c95edcc4a0 2024-05-21T01:20:37.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.197+0000 7f228d600640 1 -- 172.21.15.63:0/3562533791 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f229c0cde00 con 0x55c95edcc4a0 2024-05-21T01:20:37.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.197+0000 7f22ae017000 1 -- 172.21.15.63:0/3562533791 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f229005b700 con 0x55c95edcc4a0 2024-05-21T01:20:37.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.197+0000 7f228d600640 1 -- 172.21.15.63:0/3562533791 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f229c0b4040 con 0x55c95edcc4a0 2024-05-21T01:20:37.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.197+0000 7f22ae017000 10 client.4713 fetch_fsmap learned FSMap version 15 2024-05-21T01:20:37.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.197+0000 7f22ae017000 1 -- 172.21.15.63:0/3562533791 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x55c95ec5da00 con 0x55c95edcc4a0 2024-05-21T01:20:37.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.197+0000 7f228d600640 1 -- 172.21.15.63:0/3562533791 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f229005b700 con 0x55c95edcc4a0 2024-05-21T01:20:37.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.197+0000 7f228d600640 1 -- 172.21.15.63:0/3562533791 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 15) ==== 4752+0+0 (secure 0 0 0) 0x7f229c0d6720 con 0x55c95edcc4a0 2024-05-21T01:20:37.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.197+0000 7f22ae017000 10 client.4713 fetch_fsmap finished waiting for FSMap version 15 2024-05-21T01:20:37.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.197+0000 7f22ae017000 10 client.4713 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-21T01:20:37.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.197+0000 7f22ae017000 20 client.4713 populate_metadata read hostname 'smithi063' 2024-05-21T01:20:37.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.197+0000 7f22ae017000 1 --2- 172.21.15.63:0/3562533791 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x55c95eddc3a0 0x55c95eddc780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:37.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.197+0000 7f22ae017000 4 client.4713 mds_command: new command op to 4276 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-21T01:20:37.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.197+0000 7f22ae017000 1 -- 172.21.15.63:0/3562533791 --> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] -- command(tid 0: {"prefix": "status"}) -- 0x55c95eb78dc0 con 0x55c95eddc3a0 2024-05-21T01:20:37.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.197+0000 7f22a3e00640 1 --2- 172.21.15.63:0/3562533791 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x55c95eddc3a0 0x55c95eddc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:37.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.201+0000 7f22a3e00640 1 --2- 172.21.15.63:0/3562533791 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x55c95eddc3a0 0x55c95eddc780 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c438cba7c8a4eeae server_cookie=92d63a3e11bcf215 in_seq=0 out_seq=0 2024-05-21T01:20:37.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.201+0000 7f228d600640 10 client.4713 ms_handle_connect on v2:172.21.15.63:6834/2892727989 2024-05-21T01:20:37.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.201+0000 7f228d600640 1 -- 172.21.15.63:0/3562533791 <== mds.0 v2:172.21.15.63:6834/2892727989 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55c95eb78dc0 con 0x55c95eddc3a0 2024-05-21T01:20:37.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.201+0000 7f228d600640 10 client.4713 handle_command_reply: tid=0 2024-05-21T01:20:37.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.201+0000 7f22ae017000 1 client.4713 shutdown 2024-05-21T01:20:37.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.201+0000 7f22ae017000 1 -- 172.21.15.63:0/3562533791 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c95edcc4a0 msgr2=0x55c95eddba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:37.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.201+0000 7f22ae017000 1 --2- 172.21.15.63:0/3562533791 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c95edcc4a0 0x55c95eddba70 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f229c01cd80 tx=0x7f229c01d990 comp rx=0 tx=0).stop 2024-05-21T01:20:37.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.201+0000 7f22ae017000 1 -- 172.21.15.63:0/3562533791 shutdown_connections 2024-05-21T01:20:37.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.201+0000 7f22ae017000 1 --2- 172.21.15.63:0/3562533791 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x55c95eddc3a0 0x55c95eddc780 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:37.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.201+0000 7f22ae017000 1 --2- 172.21.15.63:0/3562533791 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c95edcc4a0 0x55c95eddba70 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:37.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.201+0000 7f22ae017000 1 --2- 172.21.15.63:0/3562533791 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c95edb4ef0 0x55c95ee46ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:37.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.201+0000 7f22ae017000 1 --2- 172.21.15.63:0/3562533791 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c95ed95740 0x55c95ee46660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:37.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.201+0000 7f228d600640 0 client.4713 ms_handle_reset on v2:172.21.15.63:6834/2892727989 2024-05-21T01:20:37.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.201+0000 7f22ae017000 1 -- 172.21.15.63:0/3562533791 >> 172.21.15.63:0/3562533791 conn(0x55c95ec74ef0 msgr2=0x55c95edc7360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:37.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.201+0000 7f22ae017000 1 -- 172.21.15.63:0/3562533791 shutdown_connections 2024-05-21T01:20:37.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.201+0000 7f22ae017000 1 -- 172.21.15.63:0/3562533791 wait complete. 2024-05-21T01:20:37.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.201+0000 7f22ae017000 20 client.4713 trim_cache size 0 max 16384 2024-05-21T01:20:37.209 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-05-21T01:20:37.209 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_fsid": "9a7cbd84-ceb2-41c8-8b6e-ab931f86c51a", 2024-05-21T01:20:37.209 INFO:teuthology.orchestra.run.smithi063.stdout: "whoami": 0, 2024-05-21T01:20:37.209 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 4276, 2024-05-21T01:20:37.209 INFO:teuthology.orchestra.run.smithi063.stdout: "want_state": "up:active", 2024-05-21T01:20:37.209 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "up:active", 2024-05-21T01:20:37.209 INFO:teuthology.orchestra.run.smithi063.stdout: "fs_name": "cephfs", 2024-05-21T01:20:37.209 INFO:teuthology.orchestra.run.smithi063.stdout: "rank_uptime": 42.667858688000003, 2024-05-21T01:20:37.210 INFO:teuthology.orchestra.run.smithi063.stdout: "mdsmap_epoch": 15, 2024-05-21T01:20:37.210 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch": 25, 2024-05-21T01:20:37.210 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch_barrier": 25, 2024-05-21T01:20:37.210 INFO:teuthology.orchestra.run.smithi063.stdout: "uptime": 48.541821868 2024-05-21T01:20:37.210 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-05-21T01:20:37.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.201+0000 7f22aac00640 1 -- 172.21.15.63:0/674240794 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f228406f430 msgr2=0x7f22840718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:37.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.201+0000 7f22aac00640 1 --2- 172.21.15.63:0/674240794 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f228406f430 0x7f22840718f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2294009af0 tx=0x7f2294008040 comp rx=0 tx=0).stop 2024-05-21T01:20:37.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.201+0000 7f22aac00640 1 -- 172.21.15.63:0/674240794 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f22a4156350 msgr2=0x7f22a414aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:37.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.201+0000 7f22aac00640 1 --2- 172.21.15.63:0/674240794 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f22a4156350 0x7f22a414aaf0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f229000c4d0 tx=0x7f229000c990 comp rx=0 tx=0).stop 2024-05-21T01:20:37.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.201+0000 7f22aac00640 1 -- 172.21.15.63:0/674240794 shutdown_connections 2024-05-21T01:20:37.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.201+0000 7f22aac00640 1 --2- 172.21.15.63:0/674240794 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f228406f430 0x7f22840718f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:37.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.201+0000 7f22aac00640 1 --2- 172.21.15.63:0/674240794 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f22a415f880 0x7f22a41497e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:37.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.201+0000 7f22aac00640 1 --2- 172.21.15.63:0/674240794 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f22a4156350 0x7f22a414aaf0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:37.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.201+0000 7f22aac00640 1 --2- 172.21.15.63:0/674240794 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22a40c9280 0x7f22a414a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:37.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.201+0000 7f22aac00640 1 -- 172.21.15.63:0/674240794 >> 172.21.15.63:0/674240794 conn(0x7f22a40cde10 msgr2=0x7f22a40c8290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:37.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.201+0000 7f22aac00640 1 -- 172.21.15.63:0/674240794 shutdown_connections 2024-05-21T01:20:37.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.201+0000 7f22aac00640 1 -- 172.21.15.63:0/674240794 wait complete. 2024-05-21T01:20:37.226 INFO:teuthology.run_tasks:Running task sequential... 2024-05-21T01:20:37.239 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-05-21T01:20:37.239 INFO:teuthology.task.sequential:In sequential, running task print... 2024-05-21T01:20:37.240 INFO:teuthology.task.print:Enabling mgr modules 2024-05-21T01:20:37.240 INFO:teuthology.run_tasks:Running task kclient... 2024-05-21T01:20:37.329 INFO:tasks.kclient:Mounting kernel clients... 2024-05-21T01:20:37.329 INFO:tasks.kclient:config is {'client.0': {}} 2024-05-21T01:20:37.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-21T01:20:37.330 DEBUG:teuthology.orchestra.run.smithi063:> ip netns list 2024-05-21T01:20:37.340 INFO:teuthology.orchestra.run.smithi063.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-05-21T01:20:37.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-21T01:20:37.341 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-21T01:20:37.405 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-21T01:20:37.406 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link delete ceph-brx 2024-05-21T01:20:37.567 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-05-21T01:20:37.567 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-21T01:20:37.567 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-21T01:20:37.567 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-21T01:20:37.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.705+0000 7f18ad000640 1 Processor -- start 2024-05-21T01:20:37.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.705+0000 7f18ad000640 1 -- start start 2024-05-21T01:20:37.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.705+0000 7f18ad000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f18a806f5d0 0x7f18a80c8a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:37.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.705+0000 7f18ad000640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f18a815ce40 0x7f18a8072d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:37.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.705+0000 7f18ad000640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18a8072550 con 0x7f18a806f9b0 2024-05-21T01:20:37.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.705+0000 7f18ad000640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f18a8159100 con 0x7f18a815ce40 2024-05-21T01:20:37.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.705+0000 7f18ad000640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f18a81593e0 con 0x7f18a806f5d0 2024-05-21T01:20:37.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.705+0000 7f18a6800640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f18a815ce40 0x7f18a8072d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:37.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.705+0000 7f18a6800640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f18a815ce40 0x7f18a8072d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45260/0 (socket says 172.21.15.63:45260) 2024-05-21T01:20:37.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.705+0000 7f18a6800640 1 -- 172.21.15.63:0/315868045 learned_addr learned my addr 172.21.15.63:0/315868045 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:37.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.705+0000 7f18a5e00640 1 --2- 172.21.15.63:0/315868045 >> v2:172.21.15.131:3300/0 conn(0x7f18a806f5d0 0x7f18a80c8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:37.712 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.705+0000 7f18a6800640 1 -- 172.21.15.63:0/315868045 >> v2:172.21.15.131:3300/0 conn(0x7f18a806f5d0 msgr2=0x7f18a80c8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:37.712 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.705+0000 7f18a6800640 1 --2- 172.21.15.63:0/315868045 >> v2:172.21.15.131:3300/0 conn(0x7f18a806f5d0 0x7f18a80c8a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:37.712 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.705+0000 7f18a6800640 1 -- 172.21.15.63:0/315868045 >> v1:172.21.15.131:6789/0 conn(0x7f18a806f9b0 legacy=0x7f18a8152a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:37.712 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.705+0000 7f18a6800640 1 -- 172.21.15.63:0/315868045 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18a81596c0 con 0x7f18a815ce40 2024-05-21T01:20:37.712 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.705+0000 7f18a5e00640 1 --2- 172.21.15.63:0/315868045 >> v2:172.21.15.131:3300/0 conn(0x7f18a806f5d0 0x7f18a80c8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T01:20:37.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.709+0000 7f18a6800640 1 --2- 172.21.15.63:0/315868045 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f18a815ce40 0x7f18a8072d20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f18a80caef0 tx=0x7f18a001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=802e528a41a2c8ea server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:37.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.709+0000 7f18a5400640 1 -- 172.21.15.63:0/315868045 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18a00ab610 con 0x7f18a815ce40 2024-05-21T01:20:37.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.709+0000 7f18a5400640 1 -- 172.21.15.63:0/315868045 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18a00b0070 con 0x7f18a815ce40 2024-05-21T01:20:37.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.709+0000 7f18a5400640 1 -- 172.21.15.63:0/315868045 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18a00ab9d0 con 0x7f18a815ce40 2024-05-21T01:20:37.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.709+0000 7f18ad000640 1 -- 172.21.15.63:0/315868045 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f18a815ce40 msgr2=0x7f18a8072d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:37.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.709+0000 7f18ad000640 1 --2- 172.21.15.63:0/315868045 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f18a815ce40 0x7f18a8072d20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f18a80caef0 tx=0x7f18a001c520 comp rx=0 tx=0).stop 2024-05-21T01:20:37.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.709+0000 7f18ad000640 1 -- 172.21.15.63:0/315868045 shutdown_connections 2024-05-21T01:20:37.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.709+0000 7f18ad000640 1 --2- 172.21.15.63:0/315868045 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f18a815ce40 0x7f18a8072d20 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:37.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.709+0000 7f18ad000640 1 --2- 172.21.15.63:0/315868045 >> v2:172.21.15.131:3300/0 conn(0x7f18a806f5d0 0x7f18a80c8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:37.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.709+0000 7f18ad000640 1 -- 172.21.15.63:0/315868045 >> 172.21.15.63:0/315868045 conn(0x7f18a8068460 msgr2=0x7f18a8068870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:37.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.709+0000 7f18ad000640 1 -- 172.21.15.63:0/315868045 shutdown_connections 2024-05-21T01:20:37.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.709+0000 7f18ad000640 1 -- 172.21.15.63:0/315868045 wait complete. 2024-05-21T01:20:37.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.713+0000 7f18ad000640 1 Processor -- start 2024-05-21T01:20:37.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.713+0000 7f18ad000640 1 -- start start 2024-05-21T01:20:37.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.713+0000 7f18ad000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f18a806f5d0 0x7f18a80c91a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:37.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.713+0000 7f18ad000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f18a806f9b0 0x7f18a81f88d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:37.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.713+0000 7f18ad000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f18a815ce40 0x7f18a814c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:37.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.713+0000 7f18ad000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f18a8153150 con 0x7f18a815ce40 2024-05-21T01:20:37.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.713+0000 7f18ad000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f18a8073670 con 0x7f18a806f5d0 2024-05-21T01:20:37.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.713+0000 7f18ad000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f18a81532d0 con 0x7f18a806f9b0 2024-05-21T01:20:37.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.713+0000 7f18a6800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f18a815ce40 0x7f18a814c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:37.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.713+0000 7f18a6800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f18a815ce40 0x7f18a814c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:45274/0 (socket says 172.21.15.63:45274) 2024-05-21T01:20:37.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.713+0000 7f18a6800640 1 -- 172.21.15.63:0/338733200 learned_addr learned my addr 172.21.15.63:0/338733200 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:37.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.713+0000 7f18a5e00640 1 --2- 172.21.15.63:0/338733200 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f18a806f5d0 0x7f18a80c91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:37.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.713+0000 7f189d400640 1 --2- 172.21.15.63:0/338733200 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f18a806f9b0 0x7f18a81f88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:37.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.713+0000 7f18a6800640 1 -- 172.21.15.63:0/338733200 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f18a806f9b0 msgr2=0x7f18a81f88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:37.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.713+0000 7f18a6800640 1 --2- 172.21.15.63:0/338733200 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f18a806f9b0 0x7f18a81f88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:37.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.713+0000 7f18a6800640 1 -- 172.21.15.63:0/338733200 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f18a806f5d0 msgr2=0x7f18a80c91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:37.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.713+0000 7f18a6800640 1 --2- 172.21.15.63:0/338733200 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f18a806f5d0 0x7f18a80c91a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:37.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.713+0000 7f18a6800640 1 -- 172.21.15.63:0/338733200 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18a814c750 con 0x7f18a815ce40 2024-05-21T01:20:37.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.713+0000 7f18a6800640 1 --2- 172.21.15.63:0/338733200 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f18a815ce40 0x7f18a814c080 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f18a001a150 tx=0x7f18a001ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:37.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.713+0000 7f189ea00640 1 -- 172.21.15.63:0/338733200 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18a00be5f0 con 0x7f18a815ce40 2024-05-21T01:20:37.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.713+0000 7f189ea00640 1 -- 172.21.15.63:0/338733200 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18a00be790 con 0x7f18a815ce40 2024-05-21T01:20:37.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.713+0000 7f189ea00640 1 -- 172.21.15.63:0/338733200 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18a00beb80 con 0x7f18a815ce40 2024-05-21T01:20:37.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.713+0000 7f18ad000640 1 -- 172.21.15.63:0/338733200 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18a814ca30 con 0x7f18a815ce40 2024-05-21T01:20:37.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.713+0000 7f18ad000640 1 -- 172.21.15.63:0/338733200 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18a81f7df0 con 0x7f18a815ce40 2024-05-21T01:20:37.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.717+0000 7f18ad000640 1 -- 172.21.15.63:0/338733200 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18a80507f0 con 0x7f18a815ce40 2024-05-21T01:20:37.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.717+0000 7f189ea00640 1 -- 172.21.15.63:0/338733200 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7f18a00b43f0 con 0x7f18a815ce40 2024-05-21T01:20:37.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.717+0000 7f189ea00640 1 --2- 172.21.15.63:0/338733200 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f188406f400 0x7f18840718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:37.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.717+0000 7f189ea00640 1 -- 172.21.15.63:0/338733200 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f18a0129ec0 con 0x7f18a815ce40 2024-05-21T01:20:37.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.717+0000 7f18a5e00640 1 --2- 172.21.15.63:0/338733200 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f188406f400 0x7f18840718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:37.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.717+0000 7f18a5e00640 1 --2- 172.21.15.63:0/338733200 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f188406f400 0x7f18840718c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f18980045f0 tx=0x7f1898008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:37.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.721+0000 7f189ea00640 1 -- 172.21.15.63:0/338733200 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f18a00a8050 con 0x7f18a815ce40 2024-05-21T01:20:37.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.925+0000 7f18ad000640 1 -- 172.21.15.63:0/338733200 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f18a8076630 con 0x7f18a815ce40 2024-05-21T01:20:37.929 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.925+0000 7f189ea00640 1 -- 172.21.15.63:0/338733200 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) ==== 53+0+88 (secure 0 0 0) 0x7f18a0016110 con 0x7f18a815ce40 2024-05-21T01:20:37.929 INFO:teuthology.orchestra.run.smithi063.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-05-21T01:20:37.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.925+0000 7f18ad000640 1 -- 172.21.15.63:0/338733200 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f188406f400 msgr2=0x7f18840718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:37.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.925+0000 7f18ad000640 1 --2- 172.21.15.63:0/338733200 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f188406f400 0x7f18840718c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f18980045f0 tx=0x7f1898008040 comp rx=0 tx=0).stop 2024-05-21T01:20:37.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.925+0000 7f18ad000640 1 -- 172.21.15.63:0/338733200 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f18a815ce40 msgr2=0x7f18a814c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:37.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.925+0000 7f18ad000640 1 --2- 172.21.15.63:0/338733200 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f18a815ce40 0x7f18a814c080 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f18a001a150 tx=0x7f18a001ad60 comp rx=0 tx=0).stop 2024-05-21T01:20:37.931 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.925+0000 7f18ad000640 1 -- 172.21.15.63:0/338733200 shutdown_connections 2024-05-21T01:20:37.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.925+0000 7f18ad000640 1 --2- 172.21.15.63:0/338733200 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f188406f400 0x7f18840718c0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:37.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.925+0000 7f18ad000640 1 --2- 172.21.15.63:0/338733200 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f18a815ce40 0x7f18a814c080 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:37.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.925+0000 7f18ad000640 1 --2- 172.21.15.63:0/338733200 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f18a806f9b0 0x7f18a81f88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:37.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.925+0000 7f18ad000640 1 --2- 172.21.15.63:0/338733200 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f18a806f5d0 0x7f18a80c91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:37.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.925+0000 7f18ad000640 1 -- 172.21.15.63:0/338733200 >> 172.21.15.63:0/338733200 conn(0x7f18a8068460 msgr2=0x7f18a8068840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:37.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.925+0000 7f18ad000640 1 -- 172.21.15.63:0/338733200 shutdown_connections 2024-05-21T01:20:37.932 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:37.925+0000 7f18ad000640 1 -- 172.21.15.63:0/338733200 wait complete. 2024-05-21T01:20:37.951 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-21T01:20:37.951 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-21T01:20:37.951 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi063.front.sepia.ceph.com 2024-05-21T01:20:37.951 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-21T01:20:37.951 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-21T01:20:37.951 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-21T01:20:37.951 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-21T01:20:37.951 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-21T01:20:37.951 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-21T01:20:37.952 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-21T01:20:37.952 DEBUG:teuthology.orchestra.run.smithi063:> ip addr 2024-05-21T01:20:37.961 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-21T01:20:37.961 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-21T01:20:37.961 INFO:teuthology.orchestra.run.smithi063.stdout: inet 127.0.0.1/8 scope host lo 2024-05-21T01:20:37.961 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-05-21T01:20:37.961 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 ::1/128 scope host 2024-05-21T01:20:37.961 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-05-21T01:20:37.961 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-21T01:20:37.961 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2024-05-21T01:20:37.961 INFO:teuthology.orchestra.run.smithi063.stdout: altname enp7s0f0 2024-05-21T01:20:37.961 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-21T01:20:37.961 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2024-05-21T01:20:37.962 INFO:teuthology.orchestra.run.smithi063.stdout: altname enp7s0f1 2024-05-21T01:20:37.962 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-21T01:20:37.962 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2024-05-21T01:20:37.962 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-21T01:20:37.962 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2024-05-21T01:20:37.962 INFO:teuthology.orchestra.run.smithi063.stdout: inet 172.21.15.63/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-21T01:20:37.962 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft 42426sec preferred_lft 42426sec 2024-05-21T01:20:37.962 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::ec4:7aff:feb6:f8d7/64 scope link 2024-05-21T01:20:37.962 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-05-21T01:20:37.962 INFO:teuthology.orchestra.run.smithi063.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-05-21T01:20:37.962 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 02:42:43:63:2c:d7 brd ff:ff:ff:ff:ff:ff 2024-05-21T01:20:37.962 INFO:teuthology.orchestra.run.smithi063.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-05-21T01:20:37.962 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2024-05-21T01:20:37.963 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-21T01:20:37.963 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-21T01:20:37.964 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2024-05-21T01:20:37.964 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link add name ceph-brx type bridge 2024-05-21T01:20:37.964 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip addr flush dev ceph-brx 2024-05-21T01:20:37.964 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link set ceph-brx up 2024-05-21T01:20:37.964 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-21T01:20:37.964 DEBUG:teuthology.orchestra.run.smithi063:> ') 2024-05-21T01:20:38.051 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:38 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-21T01:20:38.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-21T01:20:38.117 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-21T01:20:38.118 DEBUG:teuthology.orchestra.run.smithi063:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-21T01:20:38.137 INFO:teuthology.orchestra.run.smithi063.stdout:1 2024-05-21T01:20:38.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-21T01:20:38.139 DEBUG:teuthology.orchestra.run.smithi063:> route 2024-05-21T01:20:38.191 INFO:teuthology.orchestra.run.smithi063.stdout:Kernel IP routing table 2024-05-21T01:20:38.191 INFO:teuthology.orchestra.run.smithi063.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-21T01:20:38.191 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-05-21T01:20:38.191 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-21T01:20:38.191 INFO:teuthology.orchestra.run.smithi063.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-05-21T01:20:38.191 INFO:teuthology.orchestra.run.smithi063.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-05-21T01:20:38.191 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-21T01:20:38.191 INFO:teuthology.orchestra.run.smithi063.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-21T01:20:38.191 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-21T01:20:38.192 INFO:teuthology.orchestra.run.smithi063.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-05-21T01:20:38.192 INFO:teuthology.orchestra.run.smithi063.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-21T01:20:38.192 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-21T01:20:38.192 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2024-05-21T01:20:38.192 DEBUG:teuthology.orchestra.run.smithi063:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-21T01:20:38.192 DEBUG:teuthology.orchestra.run.smithi063:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-21T01:20:38.192 DEBUG:teuthology.orchestra.run.smithi063:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-21T01:20:38.192 DEBUG:teuthology.orchestra.run.smithi063:> ') 2024-05-21T01:20:38.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:38 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-21T01:20:38.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-21T01:20:38.329 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-21T01:20:38.330 DEBUG:teuthology.orchestra.run.smithi063:> ip netns list 2024-05-21T01:20:38.339 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-21T01:20:38.339 DEBUG:teuthology.orchestra.run.smithi063:> ip netns list-id 2024-05-21T01:20:38.392 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-21T01:20:38.393 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2024-05-21T01:20:38.393 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-21T01:20:38.393 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-05-21T01:20:38.393 DEBUG:teuthology.orchestra.run.smithi063:> ') 2024-05-21T01:20:38.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:38 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-21T01:20:38.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-21T01:20:38.521 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-05-21T01:20:38.521 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-21T01:20:38.521 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2024-05-21T01:20:38.521 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-05-21T01:20:38.521 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-21T01:20:38.522 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-05-21T01:20:38.522 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-05-21T01:20:38.522 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-05-21T01:20:38.522 DEBUG:teuthology.orchestra.run.smithi063:> ') 2024-05-21T01:20:38.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:38 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-21T01:20:38.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-21T01:20:38.708 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-21T01:20:38.708 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2024-05-21T01:20:38.708 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link set brx.0 up 2024-05-21T01:20:38.708 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link set dev brx.0 master ceph-brx 2024-05-21T01:20:38.708 DEBUG:teuthology.orchestra.run.smithi063:> ') 2024-05-21T01:20:38.756 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:38 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-21T01:20:38.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-21T01:20:38.794 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-21T01:20:38.794 DEBUG:teuthology.orchestra.run.smithi063:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-21T01:20:38.803 INFO:teuthology.orchestra.run.smithi063.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-21T01:20:38.803 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-21T01:20:38.803 DEBUG:teuthology.orchestra.run.smithi063:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-21T01:20:38.855 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-05-21T01:20:38.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-21T01:20:38.856 DEBUG:teuthology.orchestra.run.smithi063:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-21T01:20:38.949 INFO:teuthology.orchestra.run.smithi063.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-21T01:20:38.949 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-21T01:20:38.949 INFO:teuthology.orchestra.run.smithi063.stdout:invalid new device string format 2024-05-21T01:20:39.537 INFO:teuthology.orchestra.run.smithi063.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-21T01:20:39.537 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-21T01:20:39.537 INFO:teuthology.orchestra.run.smithi063.stdout:invalid new device string format 2024-05-21T01:20:39.537 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: resolved to: "172.21.15.63:3300,172.21.15.131:3300,172.21.15.131:3301" 2024-05-21T01:20:39.537 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-21T01:20:39.552 INFO:teuthology.orchestra.run.smithi063.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-05-21T01:20:39.552 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-05-21T01:20:39.552 INFO:teuthology.orchestra.run.smithi063.stdout:invalid new device string format 2024-05-21T01:20:39.552 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: resolved to: "172.21.15.63:3300,172.21.15.131:3300,172.21.15.131:3301" 2024-05-21T01:20:39.552 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: switching to using v1 address with old syntax 2024-05-21T01:20:39.553 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: resolved to: "172.21.15.63:6789,172.21.15.131:6789,172.21.15.131:6790" 2024-05-21T01:20:39.553 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.63:6789,172.21.15.131:6789,172.21.15.131:6790:/ 2024-05-21T01:20:39.553 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=9a7cbd84-ceb2-41c8-8b6e-ab931f86c51a" will pass to kernel 2024-05-21T01:20:39.557 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-21T01:20:39.557 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-21T01:20:39.557 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-21T01:20:39.578 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-21T01:20:39.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:39 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-21T01:20:39.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-21T01:20:39.683 INFO:teuthology.orchestra.run.smithi063.stdout:client4774 2024-05-21T01:20:39.683 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-05-21T01:20:39.683 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-21T01:20:39.692 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-21T01:20:39.784 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:39 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-21T01:20:39.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-21T01:20:39.794 INFO:teuthology.orchestra.run.smithi063.stdout:client4774 2024-05-21T01:20:39.794 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-21T01:20:39.842 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:39 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-21T01:20:39.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-21T01:20:39.852 INFO:teuthology.orchestra.run.smithi063.stdout:client4774 2024-05-21T01:20:39.853 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/9a7cbd84-ceb2-41c8-8b6e-ab931f86c51a.client4774/status') 2024-05-21T01:20:39.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-21T01:20:39.913 INFO:teuthology.orchestra.run.smithi063.stdout:instance: client.4774 (3)172.21.15.63:0/2886066995 2024-05-21T01:20:39.913 INFO:teuthology.orchestra.run.smithi063.stdout:blocklisted: false 2024-05-21T01:20:39.913 INFO:teuthology.orchestra.run.smithi063.stderr:0+1 records in 2024-05-21T01:20:39.913 INFO:teuthology.orchestra.run.smithi063.stderr:0+1 records out 2024-05-21T01:20:39.913 INFO:teuthology.orchestra.run.smithi063.stderr:70 bytes copied, 5.1191e-05 s, 1.4 MB/s 2024-05-21T01:20:39.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-21T01:20:39.921 INFO:teuthology.run_tasks:Running task quiescer... 2024-05-21T01:20:39.934 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-21T01:20:39.934 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-21T01:20:40.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.101+0000 7f231f400640 1 Processor -- start 2024-05-21T01:20:40.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.101+0000 7f231f400640 1 -- start start 2024-05-21T01:20:40.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.101+0000 7f231f400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f23180cf790 0x7f23180c69a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:40.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.101+0000 7f231f400640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23180c8be0 con 0x7f2318154250 2024-05-21T01:20:40.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.101+0000 7f231f400640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23180c8e80 con 0x7f23180cfb70 2024-05-21T01:20:40.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.101+0000 7f231f400640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f23180c9160 con 0x7f23180cf790 2024-05-21T01:20:40.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.101+0000 7f231d400640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f2318154250 0x7f2318159e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:38926/0 (socket says 172.21.15.63:38926) 2024-05-21T01:20:40.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.101+0000 7f231d400640 1 -- 172.21.15.63:0/3694934392 learned_addr learned my addr 172.21.15.63:0/3694934392 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-05-21T01:20:40.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.101+0000 7f231ca00640 1 --2- 172.21.15.63:0/3694934392 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f23180cf790 0x7f23180c69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:40.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.101+0000 7f2317e00640 1 -- 172.21.15.63:0/3694934392 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3396609320 0 0) 0x7f23180c8be0 con 0x7f2318154250 2024-05-21T01:20:40.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.101+0000 7f2317e00640 1 -- 172.21.15.63:0/3694934392 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f22fc003530 con 0x7f2318154250 2024-05-21T01:20:40.109 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.101+0000 7f2317e00640 1 -- 172.21.15.63:0/3694934392 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3743600783 0 0) 0x7f23180c8e80 con 0x7f23180cfb70 2024-05-21T01:20:40.109 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.101+0000 7f2317e00640 1 -- 172.21.15.63:0/3694934392 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f23180c8be0 con 0x7f23180cfb70 2024-05-21T01:20:40.109 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.101+0000 7f2317e00640 1 -- 172.21.15.63:0/3694934392 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4188011349 0 0) 0x7f22fc003530 con 0x7f2318154250 2024-05-21T01:20:40.109 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.101+0000 7f2317e00640 1 -- 172.21.15.63:0/3694934392 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f23180cf790 msgr2=0x7f23180c69a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:40.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.101+0000 7f2317e00640 1 --2- 172.21.15.63:0/3694934392 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f23180cf790 0x7f23180c69a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:40.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.101+0000 7f2317e00640 1 -- 172.21.15.63:0/3694934392 >> v1:172.21.15.131:6789/0 conn(0x7f23180cfb70 legacy=0x7f2318153b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:40.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.101+0000 7f2317e00640 1 -- 172.21.15.63:0/3694934392 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23180c9440 con 0x7f2318154250 2024-05-21T01:20:40.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.105+0000 7f2317e00640 1 -- 172.21.15.63:0/3694934392 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 466403955 0 0) 0x7f2310001a80 con 0x7f2318154250 2024-05-21T01:20:40.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.105+0000 7f2317e00640 1 -- 172.21.15.63:0/3694934392 >> v1:172.21.15.63:6789/0 conn(0x7f2318154250 legacy=0x7f2318159e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:40.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.105+0000 7f2317e00640 1 --2- 172.21.15.63:0/3694934392 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f22fc003c70 0x7f22fc004070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:40.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.105+0000 7f2317e00640 1 --2- 172.21.15.63:0/3694934392 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22fc004810 0x7f22fc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:40.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.105+0000 7f2317e00640 1 --2- 172.21.15.63:0/3694934392 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f23180cf790 0x7f22fc00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:40.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.105+0000 7f2317e00640 1 -- 172.21.15.63:0/3694934392 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f23180c9160 con 0x7f22fc003c70 2024-05-21T01:20:40.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.105+0000 7f2317e00640 1 -- 172.21.15.63:0/3694934392 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f22fc005520 con 0x7f22fc004810 2024-05-21T01:20:40.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.105+0000 7f2317e00640 1 -- 172.21.15.63:0/3694934392 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f22fc00bf10 con 0x7f23180cf790 2024-05-21T01:20:40.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.105+0000 7f231ca00640 1 --2- 172.21.15.63:0/3694934392 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f22fc003c70 0x7f22fc004070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:40.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.105+0000 7f231d400640 1 --2- 172.21.15.63:0/3694934392 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f23180cf790 0x7f22fc00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:40.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.105+0000 7f230fe00640 1 --2- 172.21.15.63:0/3694934392 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22fc004810 0x7f22fc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:40.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.105+0000 7f231ca00640 1 -- 172.21.15.63:0/3694934392 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f23180cf790 msgr2=0x7f22fc00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:40.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.105+0000 7f231ca00640 1 --2- 172.21.15.63:0/3694934392 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f23180cf790 0x7f22fc00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:40.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.105+0000 7f231ca00640 1 -- 172.21.15.63:0/3694934392 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22fc004810 msgr2=0x7f22fc004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:40.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.105+0000 7f231ca00640 1 --2- 172.21.15.63:0/3694934392 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22fc004810 0x7f22fc004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:40.111 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.105+0000 7f231ca00640 1 -- 172.21.15.63:0/3694934392 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22fc003530 con 0x7f22fc003c70 2024-05-21T01:20:40.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.105+0000 7f231ca00640 1 --2- 172.21.15.63:0/3694934392 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f22fc003c70 0x7f22fc004070 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2308009ae0 tx=0x7f230801ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd389b45e9d527a4 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:40.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.105+0000 7f2317e00640 1 -- 172.21.15.63:0/3694934392 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23080b2070 con 0x7f22fc003c70 2024-05-21T01:20:40.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.105+0000 7f2317e00640 1 -- 172.21.15.63:0/3694934392 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23080a5550 con 0x7f22fc003c70 2024-05-21T01:20:40.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.105+0000 7f2317e00640 1 -- 172.21.15.63:0/3694934392 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23080096b0 con 0x7f22fc003c70 2024-05-21T01:20:40.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.109+0000 7f231f400640 1 -- 172.21.15.63:0/3694934392 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f22fc003c70 msgr2=0x7f22fc004070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:40.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.109+0000 7f231f400640 1 --2- 172.21.15.63:0/3694934392 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f22fc003c70 0x7f22fc004070 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2308009ae0 tx=0x7f230801ca70 comp rx=0 tx=0).stop 2024-05-21T01:20:40.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.109+0000 7f231d400640 1 -- 172.21.15.63:0/3694934392 reap_dead start 2024-05-21T01:20:40.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.109+0000 7f231f400640 1 -- 172.21.15.63:0/3694934392 shutdown_connections 2024-05-21T01:20:40.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.109+0000 7f231f400640 1 -- 172.21.15.63:0/3694934392 >> 172.21.15.63:0/3694934392 conn(0x7f23180735f0 msgr2=0x7f2318073a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:40.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.109+0000 7f231f400640 1 -- 172.21.15.63:0/3694934392 shutdown_connections 2024-05-21T01:20:40.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.109+0000 7f231f400640 1 -- 172.21.15.63:0/3694934392 wait complete. 2024-05-21T01:20:40.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.109+0000 7f231f400640 1 Processor -- start 2024-05-21T01:20:40.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.109+0000 7f231f400640 1 -- start start 2024-05-21T01:20:40.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.109+0000 7f231f400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f22fc003c70 0x7f231814d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:40.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.109+0000 7f231f400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f23181465f0 0x7f231815ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:40.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.109+0000 7f231f400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2318147530 0x7f23181479c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:40.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.109+0000 7f231f400640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f2318165830 con 0x7f22fc003c70 2024-05-21T01:20:40.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.109+0000 7f231f400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f23181656b0 con 0x7f23181465f0 2024-05-21T01:20:40.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.109+0000 7f231f400640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f23181659b0 con 0x7f2318147530 2024-05-21T01:20:40.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.109+0000 7f231ca00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f22fc003c70 0x7f231814d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:40.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.109+0000 7f231ca00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f22fc003c70 0x7f231814d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38238/0 (socket says 172.21.15.63:38238) 2024-05-21T01:20:40.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.109+0000 7f231ca00640 1 -- 172.21.15.63:0/1410106006 learned_addr learned my addr 172.21.15.63:0/1410106006 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:40.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.109+0000 7f230fe00640 1 --2- 172.21.15.63:0/1410106006 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f23181465f0 0x7f231815ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:40.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.109+0000 7f231d400640 1 --2- 172.21.15.63:0/1410106006 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2318147530 0x7f23181479c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:40.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.109+0000 7f231ca00640 1 -- 172.21.15.63:0/1410106006 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2318147530 msgr2=0x7f23181479c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:40.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.109+0000 7f231ca00640 1 --2- 172.21.15.63:0/1410106006 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2318147530 0x7f23181479c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:40.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.109+0000 7f231ca00640 1 -- 172.21.15.63:0/1410106006 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f23181465f0 msgr2=0x7f231815ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:40.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.109+0000 7f231ca00640 1 --2- 172.21.15.63:0/1410106006 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f23181465f0 0x7f231815ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:40.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.109+0000 7f231ca00640 1 -- 172.21.15.63:0/1410106006 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f231806d730 con 0x7f22fc003c70 2024-05-21T01:20:40.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.113+0000 7f231ca00640 1 --2- 172.21.15.63:0/1410106006 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f22fc003c70 0x7f231814d130 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2308009ae0 tx=0x7f22fc005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:40.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.113+0000 7f2315600640 1 -- 172.21.15.63:0/1410106006 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23080b2040 con 0x7f22fc003c70 2024-05-21T01:20:40.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.113+0000 7f2315600640 1 -- 172.21.15.63:0/1410106006 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f230800f000 con 0x7f22fc003c70 2024-05-21T01:20:40.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.113+0000 7f2315600640 1 -- 172.21.15.63:0/1410106006 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2308004020 con 0x7f22fc003c70 2024-05-21T01:20:40.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.113+0000 7f231f400640 1 -- 172.21.15.63:0/1410106006 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f231806e6e0 con 0x7f22fc003c70 2024-05-21T01:20:40.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.113+0000 7f231f400640 1 -- 172.21.15.63:0/1410106006 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f231806eca0 con 0x7f22fc003c70 2024-05-21T01:20:40.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.113+0000 7f231f400640 1 -- 172.21.15.63:0/1410106006 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23180507f0 con 0x7f22fc003c70 2024-05-21T01:20:40.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.113+0000 7f2315600640 1 -- 172.21.15.63:0/1410106006 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7f23080c0020 con 0x7f22fc003c70 2024-05-21T01:20:40.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.113+0000 7f2315600640 1 --2- 172.21.15.63:0/1410106006 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f22f406f400 0x7f22f40718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:40.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.117+0000 7f2315600640 1 -- 172.21.15.63:0/1410106006 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f2308129520 con 0x7f22fc003c70 2024-05-21T01:20:40.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.117+0000 7f230fe00640 1 --2- 172.21.15.63:0/1410106006 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f22f406f400 0x7f22f40718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:40.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.117+0000 7f230fe00640 1 --2- 172.21.15.63:0/1410106006 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f22f406f400 0x7f22f40718c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f23181655b0 tx=0x7f2300009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:40.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.121+0000 7f2315600640 1 -- 172.21.15.63:0/1410106006 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f2308016780 con 0x7f22fc003c70 2024-05-21T01:20:40.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.285+0000 7f231f400640 1 -- 172.21.15.63:0/1410106006 --> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f231806e480 con 0x7f22f406f400 2024-05-21T01:20:40.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.309+0000 7f2315600640 1 -- 172.21.15.63:0/1410106006 <== mgr.4103 v2:172.21.15.131:6832/921953667 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332748 (secure 0 0 0) 0x7f2300001470 con 0x7f22f406f400 2024-05-21T01:20:40.316 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-05-21T01:20:40.318 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-05-21T01:20:40.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.313+0000 7f231f400640 1 -- 172.21.15.63:0/1410106006 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f22f406f400 msgr2=0x7f22f40718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:40.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.313+0000 7f231f400640 1 --2- 172.21.15.63:0/1410106006 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f22f406f400 0x7f22f40718c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f23181655b0 tx=0x7f2300009040 comp rx=0 tx=0).stop 2024-05-21T01:20:40.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.313+0000 7f231f400640 1 -- 172.21.15.63:0/1410106006 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f22fc003c70 msgr2=0x7f231814d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:40.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.313+0000 7f231f400640 1 --2- 172.21.15.63:0/1410106006 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f22fc003c70 0x7f231814d130 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2308009ae0 tx=0x7f22fc005840 comp rx=0 tx=0).stop 2024-05-21T01:20:40.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.313+0000 7f231f400640 1 -- 172.21.15.63:0/1410106006 shutdown_connections 2024-05-21T01:20:40.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.313+0000 7f231f400640 1 --2- 172.21.15.63:0/1410106006 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f22f406f400 0x7f22f40718c0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:40.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.313+0000 7f231f400640 1 --2- 172.21.15.63:0/1410106006 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2318147530 0x7f23181479c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:40.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.313+0000 7f231f400640 1 --2- 172.21.15.63:0/1410106006 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f23181465f0 0x7f231815ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:40.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.313+0000 7f231f400640 1 --2- 172.21.15.63:0/1410106006 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f22fc003c70 0x7f231814d130 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:40.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.313+0000 7f231f400640 1 -- 172.21.15.63:0/1410106006 >> 172.21.15.63:0/1410106006 conn(0x7f23180735f0 msgr2=0x7f2318158cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:40.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.313+0000 7f231f400640 1 -- 172.21.15.63:0/1410106006 shutdown_connections 2024-05-21T01:20:40.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.313+0000 7f231f400640 1 -- 172.21.15.63:0/1410106006 wait complete. 2024-05-21T01:20:40.337 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":44,"stamp":"2024-05-21T01:20:38.449131+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597820,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":228,"num_write_kb":1670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218432,"kb_used_data":2304,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756288,"statfs":{"total":773094113280,"available":772870438912,"internally_reserved":0,"allocated":2359296,"data_stored":2018128,"data_compressed":66932,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1496,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005613"},"pg_stats":[{"pgid":"2.1f","version":"25'9","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:30.697944+0000","last_change":"2024-05-21T01:19:53.545236+0000","last_active":"2024-05-21T01:20:30.697944+0000","last_peered":"2024-05-21T01:20:30.697944+0000","last_clean":"2024-05-21T01:20:30.697944+0000","last_became_active":"2024-05-21T01:19:53.544469+0000","last_became_peered":"2024-05-21T01:19:53.544469+0000","last_unstale":"2024-05-21T01:20:30.697944+0000","last_undegraded":"2024-05-21T01:20:30.697944+0000","last_fullsized":"2024-05-21T01:20:30.697944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:33:09.421287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.211552+0000","last_change":"2024-05-21T01:19:54.568235+0000","last_active":"2024-05-21T01:20:00.211552+0000","last_peered":"2024-05-21T01:20:00.211552+0000","last_clean":"2024-05-21T01:20:00.211552+0000","last_became_active":"2024-05-21T01:19:54.567245+0000","last_became_peered":"2024-05-21T01:19:54.567245+0000","last_unstale":"2024-05-21T01:20:00.211552+0000","last_undegraded":"2024-05-21T01:20:00.211552+0000","last_fullsized":"2024-05-21T01:20:00.211552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:39:51.222819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207912+0000","last_change":"2024-05-21T01:19:58.618772+0000","last_active":"2024-05-21T01:20:00.207912+0000","last_peered":"2024-05-21T01:20:00.207912+0000","last_clean":"2024-05-21T01:20:00.207912+0000","last_became_active":"2024-05-21T01:19:58.617757+0000","last_became_peered":"2024-05-21T01:19:58.617757+0000","last_unstale":"2024-05-21T01:20:00.207912+0000","last_undegraded":"2024-05-21T01:20:00.207912+0000","last_fullsized":"2024-05-21T01:20:00.207912+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T13:07:31.666521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"25'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.211964+0000","last_change":"2024-05-21T01:19:53.551775+0000","last_active":"2024-05-21T01:20:00.211964+0000","last_peered":"2024-05-21T01:20:00.211964+0000","last_clean":"2024-05-21T01:20:00.211964+0000","last_became_active":"2024-05-21T01:19:53.551049+0000","last_became_peered":"2024-05-21T01:19:53.551049+0000","last_unstale":"2024-05-21T01:20:00.211964+0000","last_undegraded":"2024-05-21T01:20:00.211964+0000","last_fullsized":"2024-05-21T01:20:00.211964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:49:02.289202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.211755+0000","last_change":"2024-05-21T01:19:54.573420+0000","last_active":"2024-05-21T01:20:00.211755+0000","last_peered":"2024-05-21T01:20:00.211755+0000","last_clean":"2024-05-21T01:20:00.211755+0000","last_became_active":"2024-05-21T01:19:54.569573+0000","last_became_peered":"2024-05-21T01:19:54.569573+0000","last_unstale":"2024-05-21T01:20:00.211755+0000","last_undegraded":"2024-05-21T01:20:00.211755+0000","last_fullsized":"2024-05-21T01:20:00.211755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:00:12.257816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.206470+0000","last_change":"2024-05-21T01:19:58.604490+0000","last_active":"2024-05-21T01:20:00.206470+0000","last_peered":"2024-05-21T01:20:00.206470+0000","last_clean":"2024-05-21T01:20:00.206470+0000","last_became_active":"2024-05-21T01:19:58.604108+0000","last_became_peered":"2024-05-21T01:19:58.604108+0000","last_unstale":"2024-05-21T01:20:00.206470+0000","last_undegraded":"2024-05-21T01:20:00.206470+0000","last_fullsized":"2024-05-21T01:20:00.206470+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:11:10.963073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"25'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:30.691629+0000","last_change":"2024-05-21T01:19:53.525403+0000","last_active":"2024-05-21T01:20:30.691629+0000","last_peered":"2024-05-21T01:20:30.691629+0000","last_clean":"2024-05-21T01:20:30.691629+0000","last_became_active":"2024-05-21T01:19:53.521265+0000","last_became_peered":"2024-05-21T01:19:53.521265+0000","last_unstale":"2024-05-21T01:20:30.691629+0000","last_undegraded":"2024-05-21T01:20:30.691629+0000","last_fullsized":"2024-05-21T01:20:30.691629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:52:16.488269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.209201+0000","last_change":"2024-05-21T01:19:54.536436+0000","last_active":"2024-05-21T01:20:00.209201+0000","last_peered":"2024-05-21T01:20:00.209201+0000","last_clean":"2024-05-21T01:20:00.209201+0000","last_became_active":"2024-05-21T01:19:54.536061+0000","last_became_peered":"2024-05-21T01:19:54.536061+0000","last_unstale":"2024-05-21T01:20:00.209201+0000","last_undegraded":"2024-05-21T01:20:00.209201+0000","last_fullsized":"2024-05-21T01:20:00.209201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:48:23.811712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.206960+0000","last_change":"2024-05-21T01:19:58.623087+0000","last_active":"2024-05-21T01:20:00.206960+0000","last_peered":"2024-05-21T01:20:00.206960+0000","last_clean":"2024-05-21T01:20:00.206960+0000","last_became_active":"2024-05-21T01:19:58.622672+0000","last_became_peered":"2024-05-21T01:19:58.622672+0000","last_unstale":"2024-05-21T01:20:00.206960+0000","last_undegraded":"2024-05-21T01:20:00.206960+0000","last_fullsized":"2024-05-21T01:20:00.206960+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:45:49.241750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207109+0000","last_change":"2024-05-21T01:19:53.522497+0000","last_active":"2024-05-21T01:20:00.207109+0000","last_peered":"2024-05-21T01:20:00.207109+0000","last_clean":"2024-05-21T01:20:00.207109+0000","last_became_active":"2024-05-21T01:19:53.521684+0000","last_became_peered":"2024-05-21T01:19:53.521684+0000","last_unstale":"2024-05-21T01:20:00.207109+0000","last_undegraded":"2024-05-21T01:20:00.207109+0000","last_fullsized":"2024-05-21T01:20:00.207109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:18:17.808255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.567660+0000","last_change":"2024-05-21T01:19:54.549512+0000","last_active":"2024-05-21T01:19:59.567660+0000","last_peered":"2024-05-21T01:19:59.567660+0000","last_clean":"2024-05-21T01:19:59.567660+0000","last_became_active":"2024-05-21T01:19:54.549291+0000","last_became_peered":"2024-05-21T01:19:54.549291+0000","last_unstale":"2024-05-21T01:19:59.567660+0000","last_undegraded":"2024-05-21T01:19:59.567660+0000","last_fullsized":"2024-05-21T01:19:59.567660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:48:34.571236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.206754+0000","last_change":"2024-05-21T01:19:58.614748+0000","last_active":"2024-05-21T01:20:00.206754+0000","last_peered":"2024-05-21T01:20:00.206754+0000","last_clean":"2024-05-21T01:20:00.206754+0000","last_became_active":"2024-05-21T01:19:58.614313+0000","last_became_peered":"2024-05-21T01:19:58.614313+0000","last_unstale":"2024-05-21T01:20:00.206754+0000","last_undegraded":"2024-05-21T01:20:00.206754+0000","last_fullsized":"2024-05-21T01:20:00.206754+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:45:34.204591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.567029+0000","last_change":"2024-05-21T01:19:54.545467+0000","last_active":"2024-05-21T01:19:59.567029+0000","last_peered":"2024-05-21T01:19:59.567029+0000","last_clean":"2024-05-21T01:19:59.567029+0000","last_became_active":"2024-05-21T01:19:54.545181+0000","last_became_peered":"2024-05-21T01:19:54.545181+0000","last_unstale":"2024-05-21T01:19:59.567029+0000","last_undegraded":"2024-05-21T01:19:59.567029+0000","last_fullsized":"2024-05-21T01:19:59.567029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:43:15.387067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"25'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:24.666732+0000","last_change":"2024-05-21T01:19:53.536139+0000","last_active":"2024-05-21T01:20:24.666732+0000","last_peered":"2024-05-21T01:20:24.666732+0000","last_clean":"2024-05-21T01:20:24.666732+0000","last_became_active":"2024-05-21T01:19:53.535899+0000","last_became_peered":"2024-05-21T01:19:53.535899+0000","last_unstale":"2024-05-21T01:20:24.666732+0000","last_undegraded":"2024-05-21T01:20:24.666732+0000","last_fullsized":"2024-05-21T01:20:24.666732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:40:12.033744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.567390+0000","last_change":"2024-05-21T01:19:58.621487+0000","last_active":"2024-05-21T01:19:59.567390+0000","last_peered":"2024-05-21T01:19:59.567390+0000","last_clean":"2024-05-21T01:19:59.567390+0000","last_became_active":"2024-05-21T01:19:58.621083+0000","last_became_peered":"2024-05-21T01:19:58.621083+0000","last_unstale":"2024-05-21T01:19:59.567390+0000","last_undegraded":"2024-05-21T01:19:59.567390+0000","last_fullsized":"2024-05-21T01:19:59.567390+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:18:44.587274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.208662+0000","last_change":"2024-05-21T01:19:54.572420+0000","last_active":"2024-05-21T01:20:00.208662+0000","last_peered":"2024-05-21T01:20:00.208662+0000","last_clean":"2024-05-21T01:20:00.208662+0000","last_became_active":"2024-05-21T01:19:54.571863+0000","last_became_peered":"2024-05-21T01:19:54.571863+0000","last_unstale":"2024-05-21T01:20:00.208662+0000","last_undegraded":"2024-05-21T01:20:00.208662+0000","last_fullsized":"2024-05-21T01:20:00.208662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:13:52.491903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"25'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.575460+0000","last_change":"2024-05-21T01:19:53.553351+0000","last_active":"2024-05-21T01:19:59.575460+0000","last_peered":"2024-05-21T01:19:59.575460+0000","last_clean":"2024-05-21T01:19:59.575460+0000","last_became_active":"2024-05-21T01:19:53.552694+0000","last_became_peered":"2024-05-21T01:19:53.552694+0000","last_unstale":"2024-05-21T01:19:59.575460+0000","last_undegraded":"2024-05-21T01:19:59.575460+0000","last_fullsized":"2024-05-21T01:19:59.575460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:46:55.273278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.206544+0000","last_change":"2024-05-21T01:19:58.594904+0000","last_active":"2024-05-21T01:20:00.206544+0000","last_peered":"2024-05-21T01:20:00.206544+0000","last_clean":"2024-05-21T01:20:00.206544+0000","last_became_active":"2024-05-21T01:19:58.594450+0000","last_became_peered":"2024-05-21T01:19:58.594450+0000","last_unstale":"2024-05-21T01:20:00.206544+0000","last_undegraded":"2024-05-21T01:20:00.206544+0000","last_fullsized":"2024-05-21T01:20:00.206544+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:37:30.286986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.571649+0000","last_change":"2024-05-21T01:19:54.554750+0000","last_active":"2024-05-21T01:19:59.571649+0000","last_peered":"2024-05-21T01:19:59.571649+0000","last_clean":"2024-05-21T01:19:59.571649+0000","last_became_active":"2024-05-21T01:19:54.551583+0000","last_became_peered":"2024-05-21T01:19:54.551583+0000","last_unstale":"2024-05-21T01:19:59.571649+0000","last_undegraded":"2024-05-21T01:19:59.571649+0000","last_fullsized":"2024-05-21T01:19:59.571649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:37:19.564099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"25'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:24.662369+0000","last_change":"2024-05-21T01:19:53.523277+0000","last_active":"2024-05-21T01:20:24.662369+0000","last_peered":"2024-05-21T01:20:24.662369+0000","last_clean":"2024-05-21T01:20:24.662369+0000","last_became_active":"2024-05-21T01:19:53.522525+0000","last_became_peered":"2024-05-21T01:19:53.522525+0000","last_unstale":"2024-05-21T01:20:24.662369+0000","last_undegraded":"2024-05-21T01:20:24.662369+0000","last_fullsized":"2024-05-21T01:20:24.662369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:23:59.949781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.209007+0000","last_change":"2024-05-21T01:19:58.615575+0000","last_active":"2024-05-21T01:20:00.209007+0000","last_peered":"2024-05-21T01:20:00.209007+0000","last_clean":"2024-05-21T01:20:00.209007+0000","last_became_active":"2024-05-21T01:19:58.614401+0000","last_became_peered":"2024-05-21T01:19:58.614401+0000","last_unstale":"2024-05-21T01:20:00.209007+0000","last_undegraded":"2024-05-21T01:20:00.209007+0000","last_fullsized":"2024-05-21T01:20:00.209007+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:51:09.839503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.566770+0000","last_change":"2024-05-21T01:19:54.555489+0000","last_active":"2024-05-21T01:19:59.566770+0000","last_peered":"2024-05-21T01:19:59.566770+0000","last_clean":"2024-05-21T01:19:59.566770+0000","last_became_active":"2024-05-21T01:19:54.555227+0000","last_became_peered":"2024-05-21T01:19:54.555227+0000","last_unstale":"2024-05-21T01:19:59.566770+0000","last_undegraded":"2024-05-21T01:19:59.566770+0000","last_fullsized":"2024-05-21T01:19:59.566770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:00:22.873520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"25'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:24.663101+0000","last_change":"2024-05-21T01:19:53.520840+0000","last_active":"2024-05-21T01:20:24.663101+0000","last_peered":"2024-05-21T01:20:24.663101+0000","last_clean":"2024-05-21T01:20:24.663101+0000","last_became_active":"2024-05-21T01:19:53.520540+0000","last_became_peered":"2024-05-21T01:19:53.520540+0000","last_unstale":"2024-05-21T01:20:24.663101+0000","last_undegraded":"2024-05-21T01:20:24.663101+0000","last_fullsized":"2024-05-21T01:20:24.663101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:08:36.426465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207823+0000","last_change":"2024-05-21T01:19:58.604357+0000","last_active":"2024-05-21T01:20:00.207823+0000","last_peered":"2024-05-21T01:20:00.207823+0000","last_clean":"2024-05-21T01:20:00.207823+0000","last_became_active":"2024-05-21T01:19:58.603922+0000","last_became_peered":"2024-05-21T01:19:58.603922+0000","last_unstale":"2024-05-21T01:20:00.207823+0000","last_undegraded":"2024-05-21T01:20:00.207823+0000","last_fullsized":"2024-05-21T01:20:00.207823+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:55:18.226031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.572430+0000","last_change":"2024-05-21T01:19:54.569315+0000","last_active":"2024-05-21T01:19:59.572430+0000","last_peered":"2024-05-21T01:19:59.572430+0000","last_clean":"2024-05-21T01:19:59.572430+0000","last_became_active":"2024-05-21T01:19:54.568232+0000","last_became_peered":"2024-05-21T01:19:54.568232+0000","last_unstale":"2024-05-21T01:19:59.572430+0000","last_undegraded":"2024-05-21T01:19:59.572430+0000","last_fullsized":"2024-05-21T01:19:59.572430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:19:01.819418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"25'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:24.660940+0000","last_change":"2024-05-21T01:19:53.525301+0000","last_active":"2024-05-21T01:20:24.660940+0000","last_peered":"2024-05-21T01:20:24.660940+0000","last_clean":"2024-05-21T01:20:24.660940+0000","last_became_active":"2024-05-21T01:19:53.525010+0000","last_became_peered":"2024-05-21T01:19:53.525010+0000","last_unstale":"2024-05-21T01:20:24.660940+0000","last_undegraded":"2024-05-21T01:20:24.660940+0000","last_fullsized":"2024-05-21T01:20:24.660940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:53:11.316975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.206622+0000","last_change":"2024-05-21T01:19:58.590354+0000","last_active":"2024-05-21T01:20:00.206622+0000","last_peered":"2024-05-21T01:20:00.206622+0000","last_clean":"2024-05-21T01:20:00.206622+0000","last_became_active":"2024-05-21T01:19:58.589985+0000","last_became_peered":"2024-05-21T01:19:58.589985+0000","last_unstale":"2024-05-21T01:20:00.206622+0000","last_undegraded":"2024-05-21T01:20:00.206622+0000","last_fullsized":"2024-05-21T01:20:00.206622+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:08:09.222858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.573671+0000","last_change":"2024-05-21T01:19:54.555318+0000","last_active":"2024-05-21T01:19:59.573671+0000","last_peered":"2024-05-21T01:19:59.573671+0000","last_clean":"2024-05-21T01:19:59.573671+0000","last_became_active":"2024-05-21T01:19:54.552947+0000","last_became_peered":"2024-05-21T01:19:54.552947+0000","last_unstale":"2024-05-21T01:19:59.573671+0000","last_undegraded":"2024-05-21T01:19:59.573671+0000","last_fullsized":"2024-05-21T01:19:59.573671+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:29:24.153986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"25'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:30.692794+0000","last_change":"2024-05-21T01:19:53.525004+0000","last_active":"2024-05-21T01:20:30.692794+0000","last_peered":"2024-05-21T01:20:30.692794+0000","last_clean":"2024-05-21T01:20:30.692794+0000","last_became_active":"2024-05-21T01:19:53.521014+0000","last_became_peered":"2024-05-21T01:19:53.521014+0000","last_unstale":"2024-05-21T01:20:30.692794+0000","last_undegraded":"2024-05-21T01:20:30.692794+0000","last_fullsized":"2024-05-21T01:20:30.692794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:02:46.668320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.571502+0000","last_change":"2024-05-21T01:19:58.599880+0000","last_active":"2024-05-21T01:19:59.571502+0000","last_peered":"2024-05-21T01:19:59.571502+0000","last_clean":"2024-05-21T01:19:59.571502+0000","last_became_active":"2024-05-21T01:19:58.598712+0000","last_became_peered":"2024-05-21T01:19:58.598712+0000","last_unstale":"2024-05-21T01:19:59.571502+0000","last_undegraded":"2024-05-21T01:19:59.571502+0000","last_fullsized":"2024-05-21T01:19:59.571502+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:43:05.995986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.577134+0000","last_change":"2024-05-21T01:19:54.576044+0000","last_active":"2024-05-21T01:19:59.577134+0000","last_peered":"2024-05-21T01:19:59.577134+0000","last_clean":"2024-05-21T01:19:59.577134+0000","last_became_active":"2024-05-21T01:19:54.575543+0000","last_became_peered":"2024-05-21T01:19:54.575543+0000","last_unstale":"2024-05-21T01:19:59.577134+0000","last_undegraded":"2024-05-21T01:19:59.577134+0000","last_fullsized":"2024-05-21T01:19:59.577134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T09:33:07.188470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"25'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.568216+0000","last_change":"2024-05-21T01:19:53.543705+0000","last_active":"2024-05-21T01:19:59.568216+0000","last_peered":"2024-05-21T01:19:59.568216+0000","last_clean":"2024-05-21T01:19:59.568216+0000","last_became_active":"2024-05-21T01:19:53.543450+0000","last_became_peered":"2024-05-21T01:19:53.543450+0000","last_unstale":"2024-05-21T01:19:59.568216+0000","last_undegraded":"2024-05-21T01:19:59.568216+0000","last_fullsized":"2024-05-21T01:19:59.568216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:05:49.465156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.575415+0000","last_change":"2024-05-21T01:19:58.612049+0000","last_active":"2024-05-21T01:19:59.575415+0000","last_peered":"2024-05-21T01:19:59.575415+0000","last_clean":"2024-05-21T01:19:59.575415+0000","last_became_active":"2024-05-21T01:19:58.610837+0000","last_became_peered":"2024-05-21T01:19:58.610837+0000","last_unstale":"2024-05-21T01:19:59.575415+0000","last_undegraded":"2024-05-21T01:19:59.575415+0000","last_fullsized":"2024-05-21T01:19:59.575415+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:24:14.332056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207496+0000","last_change":"2024-05-21T01:19:54.553083+0000","last_active":"2024-05-21T01:20:00.207496+0000","last_peered":"2024-05-21T01:20:00.207496+0000","last_clean":"2024-05-21T01:20:00.207496+0000","last_became_active":"2024-05-21T01:19:54.552812+0000","last_became_peered":"2024-05-21T01:19:54.552812+0000","last_unstale":"2024-05-21T01:20:00.207496+0000","last_undegraded":"2024-05-21T01:20:00.207496+0000","last_fullsized":"2024-05-21T01:20:00.207496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:37:25.835345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.210838+0000","last_change":"2024-05-21T01:19:53.551697+0000","last_active":"2024-05-21T01:20:00.210838+0000","last_peered":"2024-05-21T01:20:00.210838+0000","last_clean":"2024-05-21T01:20:00.210838+0000","last_became_active":"2024-05-21T01:19:53.550921+0000","last_became_peered":"2024-05-21T01:19:53.550921+0000","last_unstale":"2024-05-21T01:20:00.210838+0000","last_undegraded":"2024-05-21T01:20:00.210838+0000","last_fullsized":"2024-05-21T01:20:00.210838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T09:31:31.996638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.571559+0000","last_change":"2024-05-21T01:19:58.626472+0000","last_active":"2024-05-21T01:19:59.571559+0000","last_peered":"2024-05-21T01:19:59.571559+0000","last_clean":"2024-05-21T01:19:59.571559+0000","last_became_active":"2024-05-21T01:19:58.625720+0000","last_became_peered":"2024-05-21T01:19:58.625720+0000","last_unstale":"2024-05-21T01:19:59.571559+0000","last_undegraded":"2024-05-21T01:19:59.571559+0000","last_fullsized":"2024-05-21T01:19:59.571559+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:16:03.911585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207190+0000","last_change":"2024-05-21T01:19:54.547947+0000","last_active":"2024-05-21T01:20:00.207190+0000","last_peered":"2024-05-21T01:20:00.207190+0000","last_clean":"2024-05-21T01:20:00.207190+0000","last_became_active":"2024-05-21T01:19:54.547689+0000","last_became_peered":"2024-05-21T01:19:54.547689+0000","last_unstale":"2024-05-21T01:20:00.207190+0000","last_undegraded":"2024-05-21T01:20:00.207190+0000","last_fullsized":"2024-05-21T01:20:00.207190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:40:55.985899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"25'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.567398+0000","last_change":"2024-05-21T01:19:53.540973+0000","last_active":"2024-05-21T01:19:59.567398+0000","last_peered":"2024-05-21T01:19:59.567398+0000","last_clean":"2024-05-21T01:19:59.567398+0000","last_became_active":"2024-05-21T01:19:53.540670+0000","last_became_peered":"2024-05-21T01:19:53.540670+0000","last_unstale":"2024-05-21T01:19:59.567398+0000","last_undegraded":"2024-05-21T01:19:59.567398+0000","last_fullsized":"2024-05-21T01:19:59.567398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:08:21.802284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.576864+0000","last_change":"2024-05-21T01:19:58.611280+0000","last_active":"2024-05-21T01:19:59.576864+0000","last_peered":"2024-05-21T01:19:59.576864+0000","last_clean":"2024-05-21T01:19:59.576864+0000","last_became_active":"2024-05-21T01:19:58.610511+0000","last_became_peered":"2024-05-21T01:19:58.610511+0000","last_unstale":"2024-05-21T01:19:59.576864+0000","last_undegraded":"2024-05-21T01:19:59.576864+0000","last_fullsized":"2024-05-21T01:19:59.576864+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:49:19.660422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.209521+0000","last_change":"2024-05-21T01:19:54.572546+0000","last_active":"2024-05-21T01:20:00.209521+0000","last_peered":"2024-05-21T01:20:00.209521+0000","last_clean":"2024-05-21T01:20:00.209521+0000","last_became_active":"2024-05-21T01:19:54.572022+0000","last_became_peered":"2024-05-21T01:19:54.572022+0000","last_unstale":"2024-05-21T01:20:00.209521+0000","last_undegraded":"2024-05-21T01:20:00.209521+0000","last_fullsized":"2024-05-21T01:20:00.209521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:50:08.351383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"25'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:30.697731+0000","last_change":"2024-05-21T01:19:53.556786+0000","last_active":"2024-05-21T01:20:30.697731+0000","last_peered":"2024-05-21T01:20:30.697731+0000","last_clean":"2024-05-21T01:20:30.697731+0000","last_became_active":"2024-05-21T01:19:53.556143+0000","last_became_peered":"2024-05-21T01:19:53.556143+0000","last_unstale":"2024-05-21T01:20:30.697731+0000","last_undegraded":"2024-05-21T01:20:30.697731+0000","last_fullsized":"2024-05-21T01:20:30.697731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:02:17.391701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.577698+0000","last_change":"2024-05-21T01:19:58.599203+0000","last_active":"2024-05-21T01:19:59.577698+0000","last_peered":"2024-05-21T01:19:59.577698+0000","last_clean":"2024-05-21T01:19:59.577698+0000","last_became_active":"2024-05-21T01:19:58.598175+0000","last_became_peered":"2024-05-21T01:19:58.598175+0000","last_unstale":"2024-05-21T01:19:59.577698+0000","last_undegraded":"2024-05-21T01:19:59.577698+0000","last_fullsized":"2024-05-21T01:19:59.577698+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:45:17.138090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.574222+0000","last_change":"2024-05-21T01:19:54.551092+0000","last_active":"2024-05-21T01:19:59.574222+0000","last_peered":"2024-05-21T01:19:59.574222+0000","last_clean":"2024-05-21T01:19:59.574222+0000","last_became_active":"2024-05-21T01:19:54.550338+0000","last_became_peered":"2024-05-21T01:19:54.550338+0000","last_unstale":"2024-05-21T01:19:59.574222+0000","last_undegraded":"2024-05-21T01:19:59.574222+0000","last_fullsized":"2024-05-21T01:19:59.574222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:29:13.540719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"25'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:30.690226+0000","last_change":"2024-05-21T01:19:53.554835+0000","last_active":"2024-05-21T01:20:30.690226+0000","last_peered":"2024-05-21T01:20:30.690226+0000","last_clean":"2024-05-21T01:20:30.690226+0000","last_became_active":"2024-05-21T01:19:53.554598+0000","last_became_peered":"2024-05-21T01:19:53.554598+0000","last_unstale":"2024-05-21T01:20:30.690226+0000","last_undegraded":"2024-05-21T01:20:30.690226+0000","last_fullsized":"2024-05-21T01:20:30.690226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:28:43.940978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.211238+0000","last_change":"2024-05-21T01:19:58.629747+0000","last_active":"2024-05-21T01:20:00.211238+0000","last_peered":"2024-05-21T01:20:00.211238+0000","last_clean":"2024-05-21T01:20:00.211238+0000","last_became_active":"2024-05-21T01:19:58.622106+0000","last_became_peered":"2024-05-21T01:19:58.622106+0000","last_unstale":"2024-05-21T01:20:00.211238+0000","last_undegraded":"2024-05-21T01:20:00.211238+0000","last_fullsized":"2024-05-21T01:20:00.211238+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:22:07.047914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.571255+0000","last_change":"2024-05-21T01:19:54.554303+0000","last_active":"2024-05-21T01:19:59.571255+0000","last_peered":"2024-05-21T01:19:59.571255+0000","last_clean":"2024-05-21T01:19:59.571255+0000","last_became_active":"2024-05-21T01:19:54.552126+0000","last_became_peered":"2024-05-21T01:19:54.552126+0000","last_unstale":"2024-05-21T01:19:59.571255+0000","last_undegraded":"2024-05-21T01:19:59.571255+0000","last_fullsized":"2024-05-21T01:19:59.571255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:59:46.383359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"25'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:24.666931+0000","last_change":"2024-05-21T01:19:53.536580+0000","last_active":"2024-05-21T01:20:24.666931+0000","last_peered":"2024-05-21T01:20:24.666931+0000","last_clean":"2024-05-21T01:20:24.666931+0000","last_became_active":"2024-05-21T01:19:53.535105+0000","last_became_peered":"2024-05-21T01:19:53.535105+0000","last_unstale":"2024-05-21T01:20:24.666931+0000","last_undegraded":"2024-05-21T01:20:24.666931+0000","last_fullsized":"2024-05-21T01:20:24.666931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:58:05.019025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":118,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207611+0000","last_change":"2024-05-21T01:19:49.490062+0000","last_active":"2024-05-21T01:20:00.207611+0000","last_peered":"2024-05-21T01:20:00.207611+0000","last_clean":"2024-05-21T01:20:00.207611+0000","last_became_active":"2024-05-21T01:19:49.488796+0000","last_became_peered":"2024-05-21T01:19:49.488796+0000","last_unstale":"2024-05-21T01:20:00.207611+0000","last_undegraded":"2024-05-21T01:20:00.207611+0000","last_fullsized":"2024-05-21T01:20:00.207611+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:47.457865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:47.457865+0000","last_clean_scrub_stamp":"2024-05-21T01:19:47.457865+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T09:37:06.199150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.568012+0000","last_change":"2024-05-21T01:19:58.590851+0000","last_active":"2024-05-21T01:19:59.568012+0000","last_peered":"2024-05-21T01:19:59.568012+0000","last_clean":"2024-05-21T01:19:59.568012+0000","last_became_active":"2024-05-21T01:19:58.589288+0000","last_became_peered":"2024-05-21T01:19:58.589288+0000","last_unstale":"2024-05-21T01:19:59.568012+0000","last_undegraded":"2024-05-21T01:19:59.568012+0000","last_fullsized":"2024-05-21T01:19:59.568012+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:36:46.992834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.567741+0000","last_change":"2024-05-21T01:19:54.543894+0000","last_active":"2024-05-21T01:19:59.567741+0000","last_peered":"2024-05-21T01:19:59.567741+0000","last_clean":"2024-05-21T01:19:59.567741+0000","last_became_active":"2024-05-21T01:19:54.543586+0000","last_became_peered":"2024-05-21T01:19:54.543586+0000","last_unstale":"2024-05-21T01:19:59.567741+0000","last_undegraded":"2024-05-21T01:19:59.567741+0000","last_fullsized":"2024-05-21T01:19:59.567741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:33:02.756634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"25'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:30.693726+0000","last_change":"2024-05-21T01:19:53.532115+0000","last_active":"2024-05-21T01:20:30.693726+0000","last_peered":"2024-05-21T01:20:30.693726+0000","last_clean":"2024-05-21T01:20:30.693726+0000","last_became_active":"2024-05-21T01:19:53.529879+0000","last_became_peered":"2024-05-21T01:19:53.529879+0000","last_unstale":"2024-05-21T01:20:30.693726+0000","last_undegraded":"2024-05-21T01:20:30.693726+0000","last_fullsized":"2024-05-21T01:20:30.693726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:42:07.436243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.206924+0000","last_change":"2024-05-21T01:19:58.604417+0000","last_active":"2024-05-21T01:20:00.206924+0000","last_peered":"2024-05-21T01:20:00.206924+0000","last_clean":"2024-05-21T01:20:00.206924+0000","last_became_active":"2024-05-21T01:19:58.603929+0000","last_became_peered":"2024-05-21T01:19:58.603929+0000","last_unstale":"2024-05-21T01:20:00.206924+0000","last_undegraded":"2024-05-21T01:20:00.206924+0000","last_fullsized":"2024-05-21T01:20:00.206924+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:15:59.031738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207029+0000","last_change":"2024-05-21T01:19:54.542096+0000","last_active":"2024-05-21T01:20:00.207029+0000","last_peered":"2024-05-21T01:20:00.207029+0000","last_clean":"2024-05-21T01:20:00.207029+0000","last_became_active":"2024-05-21T01:19:54.541837+0000","last_became_peered":"2024-05-21T01:19:54.541837+0000","last_unstale":"2024-05-21T01:20:00.207029+0000","last_undegraded":"2024-05-21T01:20:00.207029+0000","last_fullsized":"2024-05-21T01:20:00.207029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:55:30.807311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.211049+0000","last_change":"2024-05-21T01:19:53.551697+0000","last_active":"2024-05-21T01:20:00.211049+0000","last_peered":"2024-05-21T01:20:00.211049+0000","last_clean":"2024-05-21T01:20:00.211049+0000","last_became_active":"2024-05-21T01:19:53.550893+0000","last_became_peered":"2024-05-21T01:19:53.550893+0000","last_unstale":"2024-05-21T01:20:00.211049+0000","last_undegraded":"2024-05-21T01:20:00.211049+0000","last_fullsized":"2024-05-21T01:20:00.211049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:42:20.295229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.210457+0000","last_change":"2024-05-21T01:19:58.628526+0000","last_active":"2024-05-21T01:20:00.210457+0000","last_peered":"2024-05-21T01:20:00.210457+0000","last_clean":"2024-05-21T01:20:00.210457+0000","last_became_active":"2024-05-21T01:19:58.620667+0000","last_became_peered":"2024-05-21T01:19:58.620667+0000","last_unstale":"2024-05-21T01:20:00.210457+0000","last_undegraded":"2024-05-21T01:20:00.210457+0000","last_fullsized":"2024-05-21T01:20:00.210457+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:46:22.396063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.208496+0000","last_change":"2024-05-21T01:19:54.532551+0000","last_active":"2024-05-21T01:20:00.208496+0000","last_peered":"2024-05-21T01:20:00.208496+0000","last_clean":"2024-05-21T01:20:00.208496+0000","last_became_active":"2024-05-21T01:19:54.532251+0000","last_became_peered":"2024-05-21T01:19:54.532251+0000","last_unstale":"2024-05-21T01:20:00.208496+0000","last_undegraded":"2024-05-21T01:20:00.208496+0000","last_fullsized":"2024-05-21T01:20:00.208496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:00:30.042781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.572555+0000","last_change":"2024-05-21T01:19:53.554659+0000","last_active":"2024-05-21T01:19:59.572555+0000","last_peered":"2024-05-21T01:19:59.572555+0000","last_clean":"2024-05-21T01:19:59.572555+0000","last_became_active":"2024-05-21T01:19:53.553953+0000","last_became_peered":"2024-05-21T01:19:53.553953+0000","last_unstale":"2024-05-21T01:19:59.572555+0000","last_undegraded":"2024-05-21T01:19:59.572555+0000","last_fullsized":"2024-05-21T01:19:59.572555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:31:13.091061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.566596+0000","last_change":"2024-05-21T01:19:58.593243+0000","last_active":"2024-05-21T01:19:59.566596+0000","last_peered":"2024-05-21T01:19:59.566596+0000","last_clean":"2024-05-21T01:19:59.566596+0000","last_became_active":"2024-05-21T01:19:58.592758+0000","last_became_peered":"2024-05-21T01:19:58.592758+0000","last_unstale":"2024-05-21T01:19:59.566596+0000","last_undegraded":"2024-05-21T01:19:59.566596+0000","last_fullsized":"2024-05-21T01:19:59.566596+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:46:17.877736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207962+0000","last_change":"2024-05-21T01:19:54.538391+0000","last_active":"2024-05-21T01:20:00.207962+0000","last_peered":"2024-05-21T01:20:00.207962+0000","last_clean":"2024-05-21T01:20:00.207962+0000","last_became_active":"2024-05-21T01:19:54.538106+0000","last_became_peered":"2024-05-21T01:19:54.538106+0000","last_unstale":"2024-05-21T01:20:00.207962+0000","last_undegraded":"2024-05-21T01:20:00.207962+0000","last_fullsized":"2024-05-21T01:20:00.207962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:36:07.297496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.208540+0000","last_change":"2024-05-21T01:19:53.551917+0000","last_active":"2024-05-21T01:20:00.208540+0000","last_peered":"2024-05-21T01:20:00.208540+0000","last_clean":"2024-05-21T01:20:00.208540+0000","last_became_active":"2024-05-21T01:19:53.551608+0000","last_became_peered":"2024-05-21T01:19:53.551608+0000","last_unstale":"2024-05-21T01:20:00.208540+0000","last_undegraded":"2024-05-21T01:20:00.208540+0000","last_fullsized":"2024-05-21T01:20:00.208540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:20:54.093966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.208119+0000","last_change":"2024-05-21T01:19:58.613367+0000","last_active":"2024-05-21T01:20:00.208119+0000","last_peered":"2024-05-21T01:20:00.208119+0000","last_clean":"2024-05-21T01:20:00.208119+0000","last_became_active":"2024-05-21T01:19:58.612950+0000","last_became_peered":"2024-05-21T01:19:58.612950+0000","last_unstale":"2024-05-21T01:20:00.208119+0000","last_undegraded":"2024-05-21T01:20:00.208119+0000","last_fullsized":"2024-05-21T01:20:00.208119+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:32:12.365734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.566761+0000","last_change":"2024-05-21T01:19:54.548979+0000","last_active":"2024-05-21T01:19:59.566761+0000","last_peered":"2024-05-21T01:19:59.566761+0000","last_clean":"2024-05-21T01:19:59.566761+0000","last_became_active":"2024-05-21T01:19:54.548704+0000","last_became_peered":"2024-05-21T01:19:54.548704+0000","last_unstale":"2024-05-21T01:19:59.566761+0000","last_undegraded":"2024-05-21T01:19:59.566761+0000","last_fullsized":"2024-05-21T01:19:59.566761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:57:09.076705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"25'15","reported_seq":37,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:30.697911+0000","last_change":"2024-05-21T01:19:53.542425+0000","last_active":"2024-05-21T01:20:30.697911+0000","last_peered":"2024-05-21T01:20:30.697911+0000","last_clean":"2024-05-21T01:20:30.697911+0000","last_became_active":"2024-05-21T01:19:53.541577+0000","last_became_peered":"2024-05-21T01:19:53.541577+0000","last_unstale":"2024-05-21T01:20:30.697911+0000","last_undegraded":"2024-05-21T01:20:30.697911+0000","last_fullsized":"2024-05-21T01:20:30.697911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:47:54.892789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.211663+0000","last_change":"2024-05-21T01:19:58.630293+0000","last_active":"2024-05-21T01:20:00.211663+0000","last_peered":"2024-05-21T01:20:00.211663+0000","last_clean":"2024-05-21T01:20:00.211663+0000","last_became_active":"2024-05-21T01:19:58.629119+0000","last_became_peered":"2024-05-21T01:19:58.629119+0000","last_unstale":"2024-05-21T01:20:00.211663+0000","last_undegraded":"2024-05-21T01:20:00.211663+0000","last_fullsized":"2024-05-21T01:20:00.211663+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:10:45.318517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207523+0000","last_change":"2024-05-21T01:19:54.575541+0000","last_active":"2024-05-21T01:20:00.207523+0000","last_peered":"2024-05-21T01:20:00.207523+0000","last_clean":"2024-05-21T01:20:00.207523+0000","last_became_active":"2024-05-21T01:19:54.575314+0000","last_became_peered":"2024-05-21T01:19:54.575314+0000","last_unstale":"2024-05-21T01:20:00.207523+0000","last_undegraded":"2024-05-21T01:20:00.207523+0000","last_fullsized":"2024-05-21T01:20:00.207523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:02:36.840590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"25'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:30.692210+0000","last_change":"2024-05-21T01:19:53.523758+0000","last_active":"2024-05-21T01:20:30.692210+0000","last_peered":"2024-05-21T01:20:30.692210+0000","last_clean":"2024-05-21T01:20:30.692210+0000","last_became_active":"2024-05-21T01:19:53.523273+0000","last_became_peered":"2024-05-21T01:19:53.523273+0000","last_unstale":"2024-05-21T01:20:30.692210+0000","last_undegraded":"2024-05-21T01:20:30.692210+0000","last_fullsized":"2024-05-21T01:20:30.692210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:05:47.275193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.211601+0000","last_change":"2024-05-21T01:19:58.621996+0000","last_active":"2024-05-21T01:20:00.211601+0000","last_peered":"2024-05-21T01:20:00.211601+0000","last_clean":"2024-05-21T01:20:00.211601+0000","last_became_active":"2024-05-21T01:19:58.620552+0000","last_became_peered":"2024-05-21T01:19:58.620552+0000","last_unstale":"2024-05-21T01:20:00.211601+0000","last_undegraded":"2024-05-21T01:20:00.211601+0000","last_fullsized":"2024-05-21T01:20:00.211601+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:58:32.635003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.567139+0000","last_change":"2024-05-21T01:19:54.557379+0000","last_active":"2024-05-21T01:19:59.567139+0000","last_peered":"2024-05-21T01:19:59.567139+0000","last_clean":"2024-05-21T01:19:59.567139+0000","last_became_active":"2024-05-21T01:19:54.550335+0000","last_became_peered":"2024-05-21T01:19:54.550335+0000","last_unstale":"2024-05-21T01:19:59.567139+0000","last_undegraded":"2024-05-21T01:19:59.567139+0000","last_fullsized":"2024-05-21T01:19:59.567139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:24:52.297888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"25'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:24.658932+0000","last_change":"2024-05-21T01:19:53.534431+0000","last_active":"2024-05-21T01:20:24.658932+0000","last_peered":"2024-05-21T01:20:24.658932+0000","last_clean":"2024-05-21T01:20:24.658932+0000","last_became_active":"2024-05-21T01:19:53.534174+0000","last_became_peered":"2024-05-21T01:19:53.534174+0000","last_unstale":"2024-05-21T01:20:24.658932+0000","last_undegraded":"2024-05-21T01:20:24.658932+0000","last_fullsized":"2024-05-21T01:20:24.658932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:42:04.743914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.576325+0000","last_change":"2024-05-21T01:19:58.609289+0000","last_active":"2024-05-21T01:19:59.576325+0000","last_peered":"2024-05-21T01:19:59.576325+0000","last_clean":"2024-05-21T01:19:59.576325+0000","last_became_active":"2024-05-21T01:19:58.608371+0000","last_became_peered":"2024-05-21T01:19:58.608371+0000","last_unstale":"2024-05-21T01:19:59.576325+0000","last_undegraded":"2024-05-21T01:19:59.576325+0000","last_fullsized":"2024-05-21T01:19:59.576325+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:27:36.997803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.575122+0000","last_change":"2024-05-21T01:19:54.551617+0000","last_active":"2024-05-21T01:19:59.575122+0000","last_peered":"2024-05-21T01:19:59.575122+0000","last_clean":"2024-05-21T01:19:59.575122+0000","last_became_active":"2024-05-21T01:19:54.550865+0000","last_became_peered":"2024-05-21T01:19:54.550865+0000","last_unstale":"2024-05-21T01:19:59.575122+0000","last_undegraded":"2024-05-21T01:19:59.575122+0000","last_fullsized":"2024-05-21T01:19:59.575122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:32:44.168265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"25'6","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:30.693468+0000","last_change":"2024-05-21T01:19:53.535936+0000","last_active":"2024-05-21T01:20:30.693468+0000","last_peered":"2024-05-21T01:20:30.693468+0000","last_clean":"2024-05-21T01:20:30.693468+0000","last_became_active":"2024-05-21T01:19:53.535143+0000","last_became_peered":"2024-05-21T01:19:53.535143+0000","last_unstale":"2024-05-21T01:20:30.693468+0000","last_undegraded":"2024-05-21T01:20:30.693468+0000","last_fullsized":"2024-05-21T01:20:30.693468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:50:51.433726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.567570+0000","last_change":"2024-05-21T01:19:58.622615+0000","last_active":"2024-05-21T01:19:59.567570+0000","last_peered":"2024-05-21T01:19:59.567570+0000","last_clean":"2024-05-21T01:19:59.567570+0000","last_became_active":"2024-05-21T01:19:58.622250+0000","last_became_peered":"2024-05-21T01:19:58.622250+0000","last_unstale":"2024-05-21T01:19:59.567570+0000","last_undegraded":"2024-05-21T01:19:59.567570+0000","last_fullsized":"2024-05-21T01:19:59.567570+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:05:22.913945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207577+0000","last_change":"2024-05-21T01:19:54.558348+0000","last_active":"2024-05-21T01:20:00.207577+0000","last_peered":"2024-05-21T01:20:00.207577+0000","last_clean":"2024-05-21T01:20:00.207577+0000","last_became_active":"2024-05-21T01:19:54.558095+0000","last_became_peered":"2024-05-21T01:19:54.558095+0000","last_unstale":"2024-05-21T01:20:00.207577+0000","last_undegraded":"2024-05-21T01:20:00.207577+0000","last_fullsized":"2024-05-21T01:20:00.207577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:43:48.625583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"25'11","reported_seq":33,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:24.664060+0000","last_change":"2024-05-21T01:19:53.534947+0000","last_active":"2024-05-21T01:20:24.664060+0000","last_peered":"2024-05-21T01:20:24.664060+0000","last_clean":"2024-05-21T01:20:24.664060+0000","last_became_active":"2024-05-21T01:19:53.534616+0000","last_became_peered":"2024-05-21T01:19:53.534616+0000","last_unstale":"2024-05-21T01:20:24.664060+0000","last_undegraded":"2024-05-21T01:20:24.664060+0000","last_fullsized":"2024-05-21T01:20:24.664060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:01:25.372035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.571116+0000","last_change":"2024-05-21T01:19:58.617970+0000","last_active":"2024-05-21T01:19:59.571116+0000","last_peered":"2024-05-21T01:19:59.571116+0000","last_clean":"2024-05-21T01:19:59.571116+0000","last_became_active":"2024-05-21T01:19:58.617061+0000","last_became_peered":"2024-05-21T01:19:58.617061+0000","last_unstale":"2024-05-21T01:19:59.571116+0000","last_undegraded":"2024-05-21T01:19:59.571116+0000","last_fullsized":"2024-05-21T01:19:59.571116+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:48:50.703577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.567205+0000","last_change":"2024-05-21T01:19:54.557175+0000","last_active":"2024-05-21T01:19:59.567205+0000","last_peered":"2024-05-21T01:19:59.567205+0000","last_clean":"2024-05-21T01:19:59.567205+0000","last_became_active":"2024-05-21T01:19:54.556933+0000","last_became_peered":"2024-05-21T01:19:54.556933+0000","last_unstale":"2024-05-21T01:19:59.567205+0000","last_undegraded":"2024-05-21T01:19:59.567205+0000","last_fullsized":"2024-05-21T01:19:59.567205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:15:44.089544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"25'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.208892+0000","last_change":"2024-05-21T01:19:53.536780+0000","last_active":"2024-05-21T01:20:00.208892+0000","last_peered":"2024-05-21T01:20:00.208892+0000","last_clean":"2024-05-21T01:20:00.208892+0000","last_became_active":"2024-05-21T01:19:53.535768+0000","last_became_peered":"2024-05-21T01:19:53.535768+0000","last_unstale":"2024-05-21T01:20:00.208892+0000","last_undegraded":"2024-05-21T01:20:00.208892+0000","last_fullsized":"2024-05-21T01:20:00.208892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:04:14.732801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207120+0000","last_change":"2024-05-21T01:19:58.606532+0000","last_active":"2024-05-21T01:20:00.207120+0000","last_peered":"2024-05-21T01:20:00.207120+0000","last_clean":"2024-05-21T01:20:00.207120+0000","last_became_active":"2024-05-21T01:19:58.606180+0000","last_became_peered":"2024-05-21T01:19:58.606180+0000","last_unstale":"2024-05-21T01:20:00.207120+0000","last_undegraded":"2024-05-21T01:20:00.207120+0000","last_fullsized":"2024-05-21T01:20:00.207120+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:25:31.161427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.211807+0000","last_change":"2024-05-21T01:19:54.571280+0000","last_active":"2024-05-21T01:20:00.211807+0000","last_peered":"2024-05-21T01:20:00.211807+0000","last_clean":"2024-05-21T01:20:00.211807+0000","last_became_active":"2024-05-21T01:19:54.568778+0000","last_became_peered":"2024-05-21T01:19:54.568778+0000","last_unstale":"2024-05-21T01:20:00.211807+0000","last_undegraded":"2024-05-21T01:20:00.211807+0000","last_fullsized":"2024-05-21T01:20:00.211807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:43:16.583632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"25'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:24.660610+0000","last_change":"2024-05-21T01:19:53.530770+0000","last_active":"2024-05-21T01:20:24.660610+0000","last_peered":"2024-05-21T01:20:24.660610+0000","last_clean":"2024-05-21T01:20:24.660610+0000","last_became_active":"2024-05-21T01:19:53.526431+0000","last_became_peered":"2024-05-21T01:19:53.526431+0000","last_unstale":"2024-05-21T01:20:24.660610+0000","last_undegraded":"2024-05-21T01:20:24.660610+0000","last_fullsized":"2024-05-21T01:20:24.660610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:08:59.892029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.208009+0000","last_change":"2024-05-21T01:19:58.611576+0000","last_active":"2024-05-21T01:20:00.208009+0000","last_peered":"2024-05-21T01:20:00.208009+0000","last_clean":"2024-05-21T01:20:00.208009+0000","last_became_active":"2024-05-21T01:19:58.610838+0000","last_became_peered":"2024-05-21T01:19:58.610838+0000","last_unstale":"2024-05-21T01:20:00.208009+0000","last_undegraded":"2024-05-21T01:20:00.208009+0000","last_fullsized":"2024-05-21T01:20:00.208009+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:07:31.736640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207957+0000","last_change":"2024-05-21T01:19:54.552709+0000","last_active":"2024-05-21T01:20:00.207957+0000","last_peered":"2024-05-21T01:20:00.207957+0000","last_clean":"2024-05-21T01:20:00.207957+0000","last_became_active":"2024-05-21T01:19:54.547898+0000","last_became_peered":"2024-05-21T01:19:54.547898+0000","last_unstale":"2024-05-21T01:20:00.207957+0000","last_undegraded":"2024-05-21T01:20:00.207957+0000","last_fullsized":"2024-05-21T01:20:00.207957+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:20:17.933506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"25'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:24.659103+0000","last_change":"2024-05-21T01:19:53.534507+0000","last_active":"2024-05-21T01:20:24.659103+0000","last_peered":"2024-05-21T01:20:24.659103+0000","last_clean":"2024-05-21T01:20:24.659103+0000","last_became_active":"2024-05-21T01:19:53.534036+0000","last_became_peered":"2024-05-21T01:19:53.534036+0000","last_unstale":"2024-05-21T01:20:24.659103+0000","last_undegraded":"2024-05-21T01:20:24.659103+0000","last_fullsized":"2024-05-21T01:20:24.659103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:01:08.218098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.572286+0000","last_change":"2024-05-21T01:19:58.608135+0000","last_active":"2024-05-21T01:19:59.572286+0000","last_peered":"2024-05-21T01:19:59.572286+0000","last_clean":"2024-05-21T01:19:59.572286+0000","last_became_active":"2024-05-21T01:19:58.607242+0000","last_became_peered":"2024-05-21T01:19:58.607242+0000","last_unstale":"2024-05-21T01:19:59.572286+0000","last_undegraded":"2024-05-21T01:19:59.572286+0000","last_fullsized":"2024-05-21T01:19:59.572286+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:05:26.197876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.572239+0000","last_change":"2024-05-21T01:19:58.624883+0000","last_active":"2024-05-21T01:19:59.572239+0000","last_peered":"2024-05-21T01:19:59.572239+0000","last_clean":"2024-05-21T01:19:59.572239+0000","last_became_active":"2024-05-21T01:19:58.623991+0000","last_became_peered":"2024-05-21T01:19:58.623991+0000","last_unstale":"2024-05-21T01:19:59.572239+0000","last_undegraded":"2024-05-21T01:19:59.572239+0000","last_fullsized":"2024-05-21T01:19:59.572239+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:29:26.251376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.572416+0000","last_change":"2024-05-21T01:19:54.549215+0000","last_active":"2024-05-21T01:19:59.572416+0000","last_peered":"2024-05-21T01:19:59.572416+0000","last_clean":"2024-05-21T01:19:59.572416+0000","last_became_active":"2024-05-21T01:19:54.548426+0000","last_became_peered":"2024-05-21T01:19:54.548426+0000","last_unstale":"2024-05-21T01:19:59.572416+0000","last_undegraded":"2024-05-21T01:19:59.572416+0000","last_fullsized":"2024-05-21T01:19:59.572416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:10:10.800391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"25'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.566886+0000","last_change":"2024-05-21T01:19:53.526106+0000","last_active":"2024-05-21T01:19:59.566886+0000","last_peered":"2024-05-21T01:19:59.566886+0000","last_clean":"2024-05-21T01:19:59.566886+0000","last_became_active":"2024-05-21T01:19:53.525786+0000","last_became_peered":"2024-05-21T01:19:53.525786+0000","last_unstale":"2024-05-21T01:19:59.566886+0000","last_undegraded":"2024-05-21T01:19:59.566886+0000","last_fullsized":"2024-05-21T01:19:59.566886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:01:05.180803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.567758+0000","last_change":"2024-05-21T01:19:58.615481+0000","last_active":"2024-05-21T01:19:59.567758+0000","last_peered":"2024-05-21T01:19:59.567758+0000","last_clean":"2024-05-21T01:19:59.567758+0000","last_became_active":"2024-05-21T01:19:58.614879+0000","last_became_peered":"2024-05-21T01:19:58.614879+0000","last_unstale":"2024-05-21T01:19:59.567758+0000","last_undegraded":"2024-05-21T01:19:59.567758+0000","last_fullsized":"2024-05-21T01:19:59.567758+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:45:57.208342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.209731+0000","last_change":"2024-05-21T01:19:54.570650+0000","last_active":"2024-05-21T01:20:00.209731+0000","last_peered":"2024-05-21T01:20:00.209731+0000","last_clean":"2024-05-21T01:20:00.209731+0000","last_became_active":"2024-05-21T01:19:54.570034+0000","last_became_peered":"2024-05-21T01:19:54.570034+0000","last_unstale":"2024-05-21T01:20:00.209731+0000","last_undegraded":"2024-05-21T01:20:00.209731+0000","last_fullsized":"2024-05-21T01:20:00.209731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:01:05.887729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"25'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:30.693111+0000","last_change":"2024-05-21T01:19:53.532017+0000","last_active":"2024-05-21T01:20:30.693111+0000","last_peered":"2024-05-21T01:20:30.693111+0000","last_clean":"2024-05-21T01:20:30.693111+0000","last_became_active":"2024-05-21T01:19:53.529457+0000","last_became_peered":"2024-05-21T01:19:53.529457+0000","last_unstale":"2024-05-21T01:20:30.693111+0000","last_undegraded":"2024-05-21T01:20:30.693111+0000","last_fullsized":"2024-05-21T01:20:30.693111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:58:03.979929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"25'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:30.690025+0000","last_change":"2024-05-21T01:19:53.525620+0000","last_active":"2024-05-21T01:20:30.690025+0000","last_peered":"2024-05-21T01:20:30.690025+0000","last_clean":"2024-05-21T01:20:30.690025+0000","last_became_active":"2024-05-21T01:19:53.525315+0000","last_became_peered":"2024-05-21T01:19:53.525315+0000","last_unstale":"2024-05-21T01:20:30.690025+0000","last_undegraded":"2024-05-21T01:20:30.690025+0000","last_fullsized":"2024-05-21T01:20:30.690025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:30:38.075463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.571359+0000","last_change":"2024-05-21T01:19:54.555344+0000","last_active":"2024-05-21T01:19:59.571359+0000","last_peered":"2024-05-21T01:19:59.571359+0000","last_clean":"2024-05-21T01:19:59.571359+0000","last_became_active":"2024-05-21T01:19:54.552817+0000","last_became_peered":"2024-05-21T01:19:54.552817+0000","last_unstale":"2024-05-21T01:19:59.571359+0000","last_undegraded":"2024-05-21T01:19:59.571359+0000","last_fullsized":"2024-05-21T01:19:59.571359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:10:03.810064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.572198+0000","last_change":"2024-05-21T01:19:58.619520+0000","last_active":"2024-05-21T01:19:59.572198+0000","last_peered":"2024-05-21T01:19:59.572198+0000","last_clean":"2024-05-21T01:19:59.572198+0000","last_became_active":"2024-05-21T01:19:58.617165+0000","last_became_peered":"2024-05-21T01:19:58.617165+0000","last_unstale":"2024-05-21T01:19:59.572198+0000","last_undegraded":"2024-05-21T01:19:59.572198+0000","last_fullsized":"2024-05-21T01:19:59.572198+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T13:07:51.530746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"25'5","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:24.652930+0000","last_change":"2024-05-21T01:19:53.551547+0000","last_active":"2024-05-21T01:20:24.652930+0000","last_peered":"2024-05-21T01:20:24.652930+0000","last_clean":"2024-05-21T01:20:24.652930+0000","last_became_active":"2024-05-21T01:19:53.550931+0000","last_became_peered":"2024-05-21T01:19:53.550931+0000","last_unstale":"2024-05-21T01:20:24.652930+0000","last_undegraded":"2024-05-21T01:20:24.652930+0000","last_fullsized":"2024-05-21T01:20:24.652930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:13:47.329230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.208939+0000","last_change":"2024-05-21T01:19:54.574552+0000","last_active":"2024-05-21T01:20:00.208939+0000","last_peered":"2024-05-21T01:20:00.208939+0000","last_clean":"2024-05-21T01:20:00.208939+0000","last_became_active":"2024-05-21T01:19:54.574246+0000","last_became_peered":"2024-05-21T01:19:54.574246+0000","last_unstale":"2024-05-21T01:20:00.208939+0000","last_undegraded":"2024-05-21T01:20:00.208939+0000","last_fullsized":"2024-05-21T01:20:00.208939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:23:33.685798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.208672+0000","last_change":"2024-05-21T01:19:58.624400+0000","last_active":"2024-05-21T01:20:00.208672+0000","last_peered":"2024-05-21T01:20:00.208672+0000","last_clean":"2024-05-21T01:20:00.208672+0000","last_became_active":"2024-05-21T01:19:58.623388+0000","last_became_peered":"2024-05-21T01:19:58.623388+0000","last_unstale":"2024-05-21T01:20:00.208672+0000","last_undegraded":"2024-05-21T01:20:00.208672+0000","last_fullsized":"2024-05-21T01:20:00.208672+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:59:30.019393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.206641+0000","last_change":"2024-05-21T01:19:54.553262+0000","last_active":"2024-05-21T01:20:00.206641+0000","last_peered":"2024-05-21T01:20:00.206641+0000","last_clean":"2024-05-21T01:20:00.206641+0000","last_became_active":"2024-05-21T01:19:54.553060+0000","last_became_peered":"2024-05-21T01:19:54.553060+0000","last_unstale":"2024-05-21T01:20:00.206641+0000","last_undegraded":"2024-05-21T01:20:00.206641+0000","last_fullsized":"2024-05-21T01:20:00.206641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:18:14.077480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207978+0000","last_change":"2024-05-21T01:19:54.566851+0000","last_active":"2024-05-21T01:20:00.207978+0000","last_peered":"2024-05-21T01:20:00.207978+0000","last_clean":"2024-05-21T01:20:00.207978+0000","last_became_active":"2024-05-21T01:19:54.565573+0000","last_became_peered":"2024-05-21T01:19:54.565573+0000","last_unstale":"2024-05-21T01:20:00.207978+0000","last_undegraded":"2024-05-21T01:20:00.207978+0000","last_fullsized":"2024-05-21T01:20:00.207978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:51:30.883954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.566981+0000","last_change":"2024-05-21T01:19:54.566934+0000","last_active":"2024-05-21T01:19:59.566981+0000","last_peered":"2024-05-21T01:19:59.566981+0000","last_clean":"2024-05-21T01:19:59.566981+0000","last_became_active":"2024-05-21T01:19:54.566503+0000","last_became_peered":"2024-05-21T01:19:54.566503+0000","last_unstale":"2024-05-21T01:19:59.566981+0000","last_undegraded":"2024-05-21T01:19:59.566981+0000","last_fullsized":"2024-05-21T01:19:59.566981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:14:54.262165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.210361+0000","last_change":"2024-05-21T01:19:54.573091+0000","last_active":"2024-05-21T01:20:00.210361+0000","last_peered":"2024-05-21T01:20:00.210361+0000","last_clean":"2024-05-21T01:20:00.210361+0000","last_became_active":"2024-05-21T01:19:54.572366+0000","last_became_peered":"2024-05-21T01:19:54.572366+0000","last_unstale":"2024-05-21T01:20:00.210361+0000","last_undegraded":"2024-05-21T01:20:00.210361+0000","last_fullsized":"2024-05-21T01:20:00.210361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:10:09.353807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.576980+0000","last_change":"2024-05-21T01:19:54.563339+0000","last_active":"2024-05-21T01:19:59.576980+0000","last_peered":"2024-05-21T01:19:59.576980+0000","last_clean":"2024-05-21T01:19:59.576980+0000","last_became_active":"2024-05-21T01:19:54.557934+0000","last_became_peered":"2024-05-21T01:19:54.557934+0000","last_unstale":"2024-05-21T01:19:59.576980+0000","last_undegraded":"2024-05-21T01:19:59.576980+0000","last_fullsized":"2024-05-21T01:19:59.576980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:46:21.598689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.577198+0000","last_change":"2024-05-21T01:19:54.553551+0000","last_active":"2024-05-21T01:19:59.577198+0000","last_peered":"2024-05-21T01:19:59.577198+0000","last_clean":"2024-05-21T01:19:59.577198+0000","last_became_active":"2024-05-21T01:19:54.552812+0000","last_became_peered":"2024-05-21T01:19:54.552812+0000","last_unstale":"2024-05-21T01:19:59.577198+0000","last_undegraded":"2024-05-21T01:19:59.577198+0000","last_fullsized":"2024-05-21T01:19:59.577198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:27:41.166606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207853+0000","last_change":"2024-05-21T01:19:54.548604+0000","last_active":"2024-05-21T01:20:00.207853+0000","last_peered":"2024-05-21T01:20:00.207853+0000","last_clean":"2024-05-21T01:20:00.207853+0000","last_became_active":"2024-05-21T01:19:54.548263+0000","last_became_peered":"2024-05-21T01:19:54.548263+0000","last_unstale":"2024-05-21T01:20:00.207853+0000","last_undegraded":"2024-05-21T01:20:00.207853+0000","last_fullsized":"2024-05-21T01:20:00.207853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:33:55.302088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.211381+0000","last_change":"2024-05-21T01:19:54.573995+0000","last_active":"2024-05-21T01:20:00.211381+0000","last_peered":"2024-05-21T01:20:00.211381+0000","last_clean":"2024-05-21T01:20:00.211381+0000","last_became_active":"2024-05-21T01:19:54.570373+0000","last_became_peered":"2024-05-21T01:19:54.570373+0000","last_unstale":"2024-05-21T01:20:00.211381+0000","last_undegraded":"2024-05-21T01:20:00.211381+0000","last_fullsized":"2024-05-21T01:20:00.211381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:44:23.194713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.566746+0000","last_change":"2024-05-21T01:19:54.575196+0000","last_active":"2024-05-21T01:19:59.566746+0000","last_peered":"2024-05-21T01:19:59.566746+0000","last_clean":"2024-05-21T01:19:59.566746+0000","last_became_active":"2024-05-21T01:19:54.574945+0000","last_became_peered":"2024-05-21T01:19:54.574945+0000","last_unstale":"2024-05-21T01:19:59.566746+0000","last_undegraded":"2024-05-21T01:19:59.566746+0000","last_fullsized":"2024-05-21T01:19:59.566746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:52:56.244771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.209915+0000","last_change":"2024-05-21T01:19:54.566719+0000","last_active":"2024-05-21T01:20:00.209915+0000","last_peered":"2024-05-21T01:20:00.209915+0000","last_clean":"2024-05-21T01:20:00.209915+0000","last_became_active":"2024-05-21T01:19:54.565922+0000","last_became_peered":"2024-05-21T01:19:54.565922+0000","last_unstale":"2024-05-21T01:20:00.209915+0000","last_undegraded":"2024-05-21T01:20:00.209915+0000","last_fullsized":"2024-05-21T01:20:00.209915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:39:19.454688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.208888+0000","last_change":"2024-05-21T01:19:54.536815+0000","last_active":"2024-05-21T01:20:00.208888+0000","last_peered":"2024-05-21T01:20:00.208888+0000","last_clean":"2024-05-21T01:20:00.208888+0000","last_became_active":"2024-05-21T01:19:54.535957+0000","last_became_peered":"2024-05-21T01:19:54.535957+0000","last_unstale":"2024-05-21T01:20:00.208888+0000","last_undegraded":"2024-05-21T01:20:00.208888+0000","last_fullsized":"2024-05-21T01:20:00.208888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:24:53.906256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.571247+0000","last_change":"2024-05-21T01:19:54.552466+0000","last_active":"2024-05-21T01:19:59.571247+0000","last_peered":"2024-05-21T01:19:59.571247+0000","last_clean":"2024-05-21T01:19:59.571247+0000","last_became_active":"2024-05-21T01:19:54.551790+0000","last_became_peered":"2024-05-21T01:19:54.551790+0000","last_unstale":"2024-05-21T01:19:59.571247+0000","last_undegraded":"2024-05-21T01:19:59.571247+0000","last_fullsized":"2024-05-21T01:19:59.571247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:24:34.737707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.206948+0000","last_change":"2024-05-21T01:19:54.535314+0000","last_active":"2024-05-21T01:20:00.206948+0000","last_peered":"2024-05-21T01:20:00.206948+0000","last_clean":"2024-05-21T01:20:00.206948+0000","last_became_active":"2024-05-21T01:19:54.534793+0000","last_became_peered":"2024-05-21T01:19:54.534793+0000","last_unstale":"2024-05-21T01:20:00.206948+0000","last_undegraded":"2024-05-21T01:20:00.206948+0000","last_fullsized":"2024-05-21T01:20:00.206948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:52:35.492250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.568120+0000","last_change":"2024-05-21T01:19:54.556323+0000","last_active":"2024-05-21T01:19:59.568120+0000","last_peered":"2024-05-21T01:19:59.568120+0000","last_clean":"2024-05-21T01:19:59.568120+0000","last_became_active":"2024-05-21T01:19:54.556043+0000","last_became_peered":"2024-05-21T01:19:54.556043+0000","last_unstale":"2024-05-21T01:19:59.568120+0000","last_undegraded":"2024-05-21T01:19:59.568120+0000","last_fullsized":"2024-05-21T01:19:59.568120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:34:02.068527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.209056+0000","last_change":"2024-05-21T01:19:54.567457+0000","last_active":"2024-05-21T01:20:00.209056+0000","last_peered":"2024-05-21T01:20:00.209056+0000","last_clean":"2024-05-21T01:20:00.209056+0000","last_became_active":"2024-05-21T01:19:54.565326+0000","last_became_peered":"2024-05-21T01:19:54.565326+0000","last_unstale":"2024-05-21T01:20:00.209056+0000","last_undegraded":"2024-05-21T01:20:00.209056+0000","last_fullsized":"2024-05-21T01:20:00.209056+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:11:05.775389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.568111+0000","last_change":"2024-05-21T01:19:54.562078+0000","last_active":"2024-05-21T01:19:59.568111+0000","last_peered":"2024-05-21T01:19:59.568111+0000","last_clean":"2024-05-21T01:19:59.568111+0000","last_became_active":"2024-05-21T01:19:54.558286+0000","last_became_peered":"2024-05-21T01:19:54.558286+0000","last_unstale":"2024-05-21T01:19:59.568111+0000","last_undegraded":"2024-05-21T01:19:59.568111+0000","last_fullsized":"2024-05-21T01:19:59.568111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T09:09:58.360014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.566714+0000","last_change":"2024-05-21T01:19:54.548274+0000","last_active":"2024-05-21T01:19:59.566714+0000","last_peered":"2024-05-21T01:19:59.566714+0000","last_clean":"2024-05-21T01:19:59.566714+0000","last_became_active":"2024-05-21T01:19:54.548079+0000","last_became_peered":"2024-05-21T01:19:54.548079+0000","last_unstale":"2024-05-21T01:19:59.566714+0000","last_undegraded":"2024-05-21T01:19:59.566714+0000","last_fullsized":"2024-05-21T01:19:59.566714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:49:03.296571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.209656+0000","last_change":"2024-05-21T01:19:54.568211+0000","last_active":"2024-05-21T01:20:00.209656+0000","last_peered":"2024-05-21T01:20:00.209656+0000","last_clean":"2024-05-21T01:20:00.209656+0000","last_became_active":"2024-05-21T01:19:54.567512+0000","last_became_peered":"2024-05-21T01:19:54.567512+0000","last_unstale":"2024-05-21T01:20:00.209656+0000","last_undegraded":"2024-05-21T01:20:00.209656+0000","last_fullsized":"2024-05-21T01:20:00.209656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:32:18.004763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.575120+0000","last_change":"2024-05-21T01:19:54.556683+0000","last_active":"2024-05-21T01:19:59.575120+0000","last_peered":"2024-05-21T01:19:59.575120+0000","last_clean":"2024-05-21T01:19:59.575120+0000","last_became_active":"2024-05-21T01:19:54.555947+0000","last_became_peered":"2024-05-21T01:19:54.555947+0000","last_unstale":"2024-05-21T01:19:59.575120+0000","last_undegraded":"2024-05-21T01:19:59.575120+0000","last_fullsized":"2024-05-21T01:19:59.575120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:59:04.593946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.575926+0000","last_change":"2024-05-21T01:19:54.560218+0000","last_active":"2024-05-21T01:19:59.575926+0000","last_peered":"2024-05-21T01:19:59.575926+0000","last_clean":"2024-05-21T01:19:59.575926+0000","last_became_active":"2024-05-21T01:19:54.557787+0000","last_became_peered":"2024-05-21T01:19:54.557787+0000","last_unstale":"2024-05-21T01:19:59.575926+0000","last_undegraded":"2024-05-21T01:19:59.575926+0000","last_fullsized":"2024-05-21T01:19:59.575926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:05:48.282563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.206865+0000","last_change":"2024-05-21T01:19:54.535096+0000","last_active":"2024-05-21T01:20:00.206865+0000","last_peered":"2024-05-21T01:20:00.206865+0000","last_clean":"2024-05-21T01:20:00.206865+0000","last_became_active":"2024-05-21T01:19:54.534472+0000","last_became_peered":"2024-05-21T01:19:54.534472+0000","last_unstale":"2024-05-21T01:20:00.206865+0000","last_undegraded":"2024-05-21T01:20:00.206865+0000","last_fullsized":"2024-05-21T01:20:00.206865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:05:40.018457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207495+0000","last_change":"2024-05-21T01:19:54.546352+0000","last_active":"2024-05-21T01:20:00.207495+0000","last_peered":"2024-05-21T01:20:00.207495+0000","last_clean":"2024-05-21T01:20:00.207495+0000","last_became_active":"2024-05-21T01:19:54.546055+0000","last_became_peered":"2024-05-21T01:19:54.546055+0000","last_unstale":"2024-05-21T01:20:00.207495+0000","last_undegraded":"2024-05-21T01:20:00.207495+0000","last_fullsized":"2024-05-21T01:20:00.207495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:14:56.268312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.208385+0000","last_change":"2024-05-21T01:19:54.539886+0000","last_active":"2024-05-21T01:20:00.208385+0000","last_peered":"2024-05-21T01:20:00.208385+0000","last_clean":"2024-05-21T01:20:00.208385+0000","last_became_active":"2024-05-21T01:19:54.539599+0000","last_became_peered":"2024-05-21T01:19:54.539599+0000","last_unstale":"2024-05-21T01:20:00.208385+0000","last_undegraded":"2024-05-21T01:20:00.208385+0000","last_fullsized":"2024-05-21T01:20:00.208385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:08:51.107275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.209668+0000","last_change":"2024-05-21T01:19:54.548954+0000","last_active":"2024-05-21T01:20:00.209668+0000","last_peered":"2024-05-21T01:20:00.209668+0000","last_clean":"2024-05-21T01:20:00.209668+0000","last_became_active":"2024-05-21T01:19:54.547528+0000","last_became_peered":"2024-05-21T01:19:54.547528+0000","last_unstale":"2024-05-21T01:20:00.209668+0000","last_undegraded":"2024-05-21T01:20:00.209668+0000","last_fullsized":"2024-05-21T01:20:00.209668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:47:24.598610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.209472+0000","last_change":"2024-05-21T01:19:54.575256+0000","last_active":"2024-05-21T01:20:00.209472+0000","last_peered":"2024-05-21T01:20:00.209472+0000","last_clean":"2024-05-21T01:20:00.209472+0000","last_became_active":"2024-05-21T01:19:54.570119+0000","last_became_peered":"2024-05-21T01:19:54.570119+0000","last_unstale":"2024-05-21T01:20:00.209472+0000","last_undegraded":"2024-05-21T01:20:00.209472+0000","last_fullsized":"2024-05-21T01:20:00.209472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:10:02.800110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.206200+0000","last_change":"2024-05-21T01:19:54.550134+0000","last_active":"2024-05-21T01:20:00.206200+0000","last_peered":"2024-05-21T01:20:00.206200+0000","last_clean":"2024-05-21T01:20:00.206200+0000","last_became_active":"2024-05-21T01:19:54.549617+0000","last_became_peered":"2024-05-21T01:19:54.549617+0000","last_unstale":"2024-05-21T01:20:00.206200+0000","last_undegraded":"2024-05-21T01:20:00.206200+0000","last_fullsized":"2024-05-21T01:20:00.206200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:34:59.845458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207085+0000","last_change":"2024-05-21T01:19:54.555653+0000","last_active":"2024-05-21T01:20:00.207085+0000","last_peered":"2024-05-21T01:20:00.207085+0000","last_clean":"2024-05-21T01:20:00.207085+0000","last_became_active":"2024-05-21T01:19:54.555274+0000","last_became_peered":"2024-05-21T01:19:54.555274+0000","last_unstale":"2024-05-21T01:20:00.207085+0000","last_undegraded":"2024-05-21T01:20:00.207085+0000","last_fullsized":"2024-05-21T01:20:00.207085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:43:43.237853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207101+0000","last_change":"2024-05-21T01:19:54.568866+0000","last_active":"2024-05-21T01:20:00.207101+0000","last_peered":"2024-05-21T01:20:00.207101+0000","last_clean":"2024-05-21T01:20:00.207101+0000","last_became_active":"2024-05-21T01:19:54.568605+0000","last_became_peered":"2024-05-21T01:19:54.568605+0000","last_unstale":"2024-05-21T01:20:00.207101+0000","last_undegraded":"2024-05-21T01:20:00.207101+0000","last_fullsized":"2024-05-21T01:20:00.207101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:21:20.820620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207281+0000","last_change":"2024-05-21T01:19:54.557468+0000","last_active":"2024-05-21T01:20:00.207281+0000","last_peered":"2024-05-21T01:20:00.207281+0000","last_clean":"2024-05-21T01:20:00.207281+0000","last_became_active":"2024-05-21T01:19:54.554976+0000","last_became_peered":"2024-05-21T01:19:54.554976+0000","last_unstale":"2024-05-21T01:20:00.207281+0000","last_undegraded":"2024-05-21T01:20:00.207281+0000","last_fullsized":"2024-05-21T01:20:00.207281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:25:08.737348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.210942+0000","last_change":"2024-05-21T01:19:54.566991+0000","last_active":"2024-05-21T01:20:00.210942+0000","last_peered":"2024-05-21T01:20:00.210942+0000","last_clean":"2024-05-21T01:20:00.210942+0000","last_became_active":"2024-05-21T01:19:54.566349+0000","last_became_peered":"2024-05-21T01:19:54.566349+0000","last_unstale":"2024-05-21T01:20:00.210942+0000","last_undegraded":"2024-05-21T01:20:00.210942+0000","last_fullsized":"2024-05-21T01:20:00.210942+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:25:43.468081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.211304+0000","last_change":"2024-05-21T01:19:54.576100+0000","last_active":"2024-05-21T01:20:00.211304+0000","last_peered":"2024-05-21T01:20:00.211304+0000","last_clean":"2024-05-21T01:20:00.211304+0000","last_became_active":"2024-05-21T01:19:54.574914+0000","last_became_peered":"2024-05-21T01:19:54.574914+0000","last_unstale":"2024-05-21T01:20:00.211304+0000","last_undegraded":"2024-05-21T01:20:00.211304+0000","last_fullsized":"2024-05-21T01:20:00.211304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:29:30.730283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.208436+0000","last_change":"2024-05-21T01:19:54.546570+0000","last_active":"2024-05-21T01:20:00.208436+0000","last_peered":"2024-05-21T01:20:00.208436+0000","last_clean":"2024-05-21T01:20:00.208436+0000","last_became_active":"2024-05-21T01:19:54.546284+0000","last_became_peered":"2024-05-21T01:19:54.546284+0000","last_unstale":"2024-05-21T01:20:00.208436+0000","last_undegraded":"2024-05-21T01:20:00.208436+0000","last_fullsized":"2024-05-21T01:20:00.208436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:36:30.219522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":7452,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":14904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66932,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509454,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":104037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509453,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":106687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509452,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":331776,"data_stored":693339,"data_compressed":33466,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509452,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":104127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542157,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":270336,"data_stored":104015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542156,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":344064,"data_stored":693983,"data_compressed":33466,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574861,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":103719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574861,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":108221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33466,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33466,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":5410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-21T01:20:40.342 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-21T01:20:40.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.513+0000 7fb9ffc00640 1 Processor -- start 2024-05-21T01:20:40.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.513+0000 7fb9ffc00640 1 -- start start 2024-05-21T01:20:40.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.517+0000 7fb9ffc00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fb9f806f5d0 0x7fb9f80c47f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:40.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.517+0000 7fb9ffc00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb9f806f9b0 0x7fb9f80c94f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:40.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.517+0000 7fb9ffc00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9f80c4d30 con 0x7fb9f80c69c0 2024-05-21T01:20:40.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.517+0000 7fb9ffc00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fb9f80c52a0 con 0x7fb9f806f5d0 2024-05-21T01:20:40.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.517+0000 7fb9ffc00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fb9f80c4fc0 con 0x7fb9f806f9b0 2024-05-21T01:20:40.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.517+0000 7fb9fd200640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fb9f806f5d0 0x7fb9f80c47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:40.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.517+0000 7fb9f7e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb9f806f9b0 0x7fb9f80c94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:40.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.517+0000 7fb9fdc00640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fb9f80c69c0 0x7fb9f80c6df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.63:48902/0 (socket says 172.21.15.63:48902) 2024-05-21T01:20:40.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.517+0000 7fb9fdc00640 1 -- 172.21.15.63:0/631517169 learned_addr learned my addr 172.21.15.63:0/631517169 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-05-21T01:20:40.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.517+0000 7fb9f7400640 1 -- 172.21.15.63:0/631517169 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3992261391 0 0) 0x7fb9f80c4d30 con 0x7fb9f80c69c0 2024-05-21T01:20:40.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.517+0000 7fb9f7400640 1 -- 172.21.15.63:0/631517169 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb9e0003530 con 0x7fb9f80c69c0 2024-05-21T01:20:40.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.517+0000 7fb9f7e00640 1 -- 172.21.15.63:0/631517169 >> v2:172.21.15.131:3300/0 conn(0x7fb9f806f5d0 msgr2=0x7fb9f80c47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:40.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.517+0000 7fb9f7e00640 1 --2- 172.21.15.63:0/631517169 >> v2:172.21.15.131:3300/0 conn(0x7fb9f806f5d0 0x7fb9f80c47f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:40.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.517+0000 7fb9f7e00640 1 -- 172.21.15.63:0/631517169 >> v1:172.21.15.131:6789/0 conn(0x7fb9f80c69c0 legacy=0x7fb9f80c6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:40.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.517+0000 7fb9f7e00640 1 -- 172.21.15.63:0/631517169 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9f80ca240 con 0x7fb9f806f9b0 2024-05-21T01:20:40.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.521+0000 7fb9f7e00640 1 --2- 172.21.15.63:0/631517169 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb9f806f9b0 0x7fb9f80c94f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb9e40097c0 tx=0x7fb9e401c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b534b0e857d81f7 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:40.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.521+0000 7fb9f7400640 1 -- 172.21.15.63:0/631517169 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9e40a7070 con 0x7fb9f806f9b0 2024-05-21T01:20:40.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.521+0000 7fb9f7400640 1 -- 172.21.15.63:0/631517169 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9e40b0070 con 0x7fb9f806f9b0 2024-05-21T01:20:40.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.521+0000 7fb9f7400640 1 -- 172.21.15.63:0/631517169 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9e40ab890 con 0x7fb9f806f9b0 2024-05-21T01:20:40.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.521+0000 7fb9ffc00640 1 -- 172.21.15.63:0/631517169 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb9f806f9b0 msgr2=0x7fb9f80c94f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:40.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.521+0000 7fb9ffc00640 1 --2- 172.21.15.63:0/631517169 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb9f806f9b0 0x7fb9f80c94f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb9e40097c0 tx=0x7fb9e401c470 comp rx=0 tx=0).stop 2024-05-21T01:20:40.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.521+0000 7fb9ffc00640 1 -- 172.21.15.63:0/631517169 shutdown_connections 2024-05-21T01:20:40.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.521+0000 7fb9ffc00640 1 --2- 172.21.15.63:0/631517169 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb9f806f9b0 0x7fb9f80c94f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:40.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.521+0000 7fb9ffc00640 1 --2- 172.21.15.63:0/631517169 >> v2:172.21.15.131:3300/0 conn(0x7fb9f806f5d0 0x7fb9f80c47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:40.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.521+0000 7fb9ffc00640 1 -- 172.21.15.63:0/631517169 >> 172.21.15.63:0/631517169 conn(0x7fb9f8068460 msgr2=0x7fb9f8068870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:40.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.521+0000 7fb9ffc00640 1 -- 172.21.15.63:0/631517169 shutdown_connections 2024-05-21T01:20:40.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.521+0000 7fb9ffc00640 1 -- 172.21.15.63:0/631517169 wait complete. 2024-05-21T01:20:40.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.525+0000 7fb9ffc00640 1 Processor -- start 2024-05-21T01:20:40.528 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.525+0000 7fb9ffc00640 1 -- start start 2024-05-21T01:20:40.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.525+0000 7fb9ffc00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb9f806f5d0 0x7fb9f80cb230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:40.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.525+0000 7fb9ffc00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb9f806f9b0 0x7fb9f80cd230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:40.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.525+0000 7fb9ffc00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9f80c69c0 0x7fb9f813dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:40.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.525+0000 7fb9ffc00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fb9f80c9bb0 con 0x7fb9f806f9b0 2024-05-21T01:20:40.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.525+0000 7fb9ffc00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fb9f80c9a30 con 0x7fb9f80c69c0 2024-05-21T01:20:40.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.525+0000 7fb9ffc00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fb9f81541d0 con 0x7fb9f806f5d0 2024-05-21T01:20:40.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.525+0000 7fb9f7e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb9f806f9b0 0x7fb9f80cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:40.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.525+0000 7fb9f7e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb9f806f9b0 0x7fb9f80cd230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38244/0 (socket says 172.21.15.63:38244) 2024-05-21T01:20:40.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.525+0000 7fb9f7e00640 1 -- 172.21.15.63:0/2953790192 learned_addr learned my addr 172.21.15.63:0/2953790192 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:40.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.525+0000 7fb9fd200640 1 --2- 172.21.15.63:0/2953790192 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb9f806f5d0 0x7fb9f80cb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:40.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.525+0000 7fb9fdc00640 1 --2- 172.21.15.63:0/2953790192 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9f80c69c0 0x7fb9f813dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:40.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.525+0000 7fb9f7e00640 1 -- 172.21.15.63:0/2953790192 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb9f806f5d0 msgr2=0x7fb9f80cb230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:40.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.525+0000 7fb9f7e00640 1 --2- 172.21.15.63:0/2953790192 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb9f806f5d0 0x7fb9f80cb230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:40.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.525+0000 7fb9f7e00640 1 -- 172.21.15.63:0/2953790192 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9f80c69c0 msgr2=0x7fb9f813dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:40.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.525+0000 7fb9f7e00640 1 --2- 172.21.15.63:0/2953790192 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9f80c69c0 0x7fb9f813dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:40.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.525+0000 7fb9f7e00640 1 -- 172.21.15.63:0/2953790192 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9f80cb870 con 0x7fb9f806f9b0 2024-05-21T01:20:40.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.525+0000 7fb9fdc00640 1 --2- 172.21.15.63:0/2953790192 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9f80c69c0 0x7fb9f813dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T01:20:40.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.525+0000 7fb9f7e00640 1 --2- 172.21.15.63:0/2953790192 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb9f806f9b0 0x7fb9f80cd230 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb9e401a0a0 tx=0x7fb9e401acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:40.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.525+0000 7fb9f4c00640 1 -- 172.21.15.63:0/2953790192 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9e40bf610 con 0x7fb9f806f9b0 2024-05-21T01:20:40.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.525+0000 7fb9f4c00640 1 -- 172.21.15.63:0/2953790192 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9e40abe50 con 0x7fb9f806f9b0 2024-05-21T01:20:40.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.525+0000 7fb9ffc00640 1 -- 172.21.15.63:0/2953790192 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9f8155180 con 0x7fb9f806f9b0 2024-05-21T01:20:40.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.525+0000 7fb9f4c00640 1 -- 172.21.15.63:0/2953790192 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9e40bfa10 con 0x7fb9f806f9b0 2024-05-21T01:20:40.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.525+0000 7fb9ffc00640 1 -- 172.21.15.63:0/2953790192 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9f8155740 con 0x7fb9f806f9b0 2024-05-21T01:20:40.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.525+0000 7fb9ffc00640 1 -- 172.21.15.63:0/2953790192 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9f80507f0 con 0x7fb9f806f9b0 2024-05-21T01:20:40.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.529+0000 7fb9f4c00640 1 -- 172.21.15.63:0/2953790192 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7fb9e40bd020 con 0x7fb9f806f9b0 2024-05-21T01:20:40.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.529+0000 7fb9f4c00640 1 --2- 172.21.15.63:0/2953790192 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fb9d806f400 0x7fb9d80718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:40.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.529+0000 7fb9f4c00640 1 -- 172.21.15.63:0/2953790192 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb9e4129b50 con 0x7fb9f806f9b0 2024-05-21T01:20:40.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.529+0000 7fb9fd200640 1 --2- 172.21.15.63:0/2953790192 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fb9d806f400 0x7fb9d80718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:40.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.529+0000 7fb9fd200640 1 --2- 172.21.15.63:0/2953790192 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fb9d806f400 0x7fb9d80718c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec009b60 tx=0x7fb9ec009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:40.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.533+0000 7fb9f4c00640 1 -- 172.21.15.63:0/2953790192 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fb9e4016090 con 0x7fb9f806f9b0 2024-05-21T01:20:40.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.697+0000 7fb9ffc00640 1 -- 172.21.15.63:0/2953790192 --> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb9f8068b20 con 0x7fb9d806f400 2024-05-21T01:20:40.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.721+0000 7fb9f4c00640 1 -- 172.21.15.63:0/2953790192 <== mgr.4103 v2:172.21.15.131:6832/921953667 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332688 (secure 0 0 0) 0x7fb9f8068b20 con 0x7fb9d806f400 2024-05-21T01:20:40.727 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-05-21T01:20:40.729 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-05-21T01:20:40.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.725+0000 7fb9ffc00640 1 -- 172.21.15.63:0/2953790192 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fb9d806f400 msgr2=0x7fb9d80718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:40.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.725+0000 7fb9ffc00640 1 --2- 172.21.15.63:0/2953790192 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fb9d806f400 0x7fb9d80718c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec009b60 tx=0x7fb9ec009190 comp rx=0 tx=0).stop 2024-05-21T01:20:40.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.725+0000 7fb9ffc00640 1 -- 172.21.15.63:0/2953790192 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb9f806f9b0 msgr2=0x7fb9f80cd230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:40.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.725+0000 7fb9ffc00640 1 --2- 172.21.15.63:0/2953790192 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb9f806f9b0 0x7fb9f80cd230 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb9e401a0a0 tx=0x7fb9e401acb0 comp rx=0 tx=0).stop 2024-05-21T01:20:40.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.725+0000 7fb9ffc00640 1 -- 172.21.15.63:0/2953790192 shutdown_connections 2024-05-21T01:20:40.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.725+0000 7fb9ffc00640 1 --2- 172.21.15.63:0/2953790192 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fb9d806f400 0x7fb9d80718c0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:40.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.725+0000 7fb9ffc00640 1 --2- 172.21.15.63:0/2953790192 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9f80c69c0 0x7fb9f813dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:40.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.725+0000 7fb9ffc00640 1 --2- 172.21.15.63:0/2953790192 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb9f806f9b0 0x7fb9f80cd230 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:40.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.725+0000 7fb9ffc00640 1 --2- 172.21.15.63:0/2953790192 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb9f806f5d0 0x7fb9f80cb230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:40.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.725+0000 7fb9ffc00640 1 -- 172.21.15.63:0/2953790192 >> 172.21.15.63:0/2953790192 conn(0x7fb9f8068460 msgr2=0x7fb9f80c8340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:40.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.725+0000 7fb9ffc00640 1 -- 172.21.15.63:0/2953790192 shutdown_connections 2024-05-21T01:20:40.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.725+0000 7fb9ffc00640 1 -- 172.21.15.63:0/2953790192 wait complete. 2024-05-21T01:20:40.748 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":45,"stamp":"2024-05-21T01:20:40.449861+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597820,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":229,"num_write_kb":1670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":184,"ondisk_log_size":184,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218432,"kb_used_data":2304,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756288,"statfs":{"total":773094113280,"available":772870438912,"internally_reserved":0,"allocated":2359296,"data_stored":2018128,"data_compressed":66932,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1496,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005072"},"pg_stats":[{"pgid":"2.1f","version":"25'9","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:30.697944+0000","last_change":"2024-05-21T01:19:53.545236+0000","last_active":"2024-05-21T01:20:30.697944+0000","last_peered":"2024-05-21T01:20:30.697944+0000","last_clean":"2024-05-21T01:20:30.697944+0000","last_became_active":"2024-05-21T01:19:53.544469+0000","last_became_peered":"2024-05-21T01:19:53.544469+0000","last_unstale":"2024-05-21T01:20:30.697944+0000","last_undegraded":"2024-05-21T01:20:30.697944+0000","last_fullsized":"2024-05-21T01:20:30.697944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:33:09.421287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.211552+0000","last_change":"2024-05-21T01:19:54.568235+0000","last_active":"2024-05-21T01:20:00.211552+0000","last_peered":"2024-05-21T01:20:00.211552+0000","last_clean":"2024-05-21T01:20:00.211552+0000","last_became_active":"2024-05-21T01:19:54.567245+0000","last_became_peered":"2024-05-21T01:19:54.567245+0000","last_unstale":"2024-05-21T01:20:00.211552+0000","last_undegraded":"2024-05-21T01:20:00.211552+0000","last_fullsized":"2024-05-21T01:20:00.211552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:39:51.222819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207912+0000","last_change":"2024-05-21T01:19:58.618772+0000","last_active":"2024-05-21T01:20:00.207912+0000","last_peered":"2024-05-21T01:20:00.207912+0000","last_clean":"2024-05-21T01:20:00.207912+0000","last_became_active":"2024-05-21T01:19:58.617757+0000","last_became_peered":"2024-05-21T01:19:58.617757+0000","last_unstale":"2024-05-21T01:20:00.207912+0000","last_undegraded":"2024-05-21T01:20:00.207912+0000","last_fullsized":"2024-05-21T01:20:00.207912+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T13:07:31.666521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"25'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.211964+0000","last_change":"2024-05-21T01:19:53.551775+0000","last_active":"2024-05-21T01:20:00.211964+0000","last_peered":"2024-05-21T01:20:00.211964+0000","last_clean":"2024-05-21T01:20:00.211964+0000","last_became_active":"2024-05-21T01:19:53.551049+0000","last_became_peered":"2024-05-21T01:19:53.551049+0000","last_unstale":"2024-05-21T01:20:00.211964+0000","last_undegraded":"2024-05-21T01:20:00.211964+0000","last_fullsized":"2024-05-21T01:20:00.211964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:49:02.289202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.211755+0000","last_change":"2024-05-21T01:19:54.573420+0000","last_active":"2024-05-21T01:20:00.211755+0000","last_peered":"2024-05-21T01:20:00.211755+0000","last_clean":"2024-05-21T01:20:00.211755+0000","last_became_active":"2024-05-21T01:19:54.569573+0000","last_became_peered":"2024-05-21T01:19:54.569573+0000","last_unstale":"2024-05-21T01:20:00.211755+0000","last_undegraded":"2024-05-21T01:20:00.211755+0000","last_fullsized":"2024-05-21T01:20:00.211755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:00:12.257816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.206470+0000","last_change":"2024-05-21T01:19:58.604490+0000","last_active":"2024-05-21T01:20:00.206470+0000","last_peered":"2024-05-21T01:20:00.206470+0000","last_clean":"2024-05-21T01:20:00.206470+0000","last_became_active":"2024-05-21T01:19:58.604108+0000","last_became_peered":"2024-05-21T01:19:58.604108+0000","last_unstale":"2024-05-21T01:20:00.206470+0000","last_undegraded":"2024-05-21T01:20:00.206470+0000","last_fullsized":"2024-05-21T01:20:00.206470+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:11:10.963073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"25'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:30.691629+0000","last_change":"2024-05-21T01:19:53.525403+0000","last_active":"2024-05-21T01:20:30.691629+0000","last_peered":"2024-05-21T01:20:30.691629+0000","last_clean":"2024-05-21T01:20:30.691629+0000","last_became_active":"2024-05-21T01:19:53.521265+0000","last_became_peered":"2024-05-21T01:19:53.521265+0000","last_unstale":"2024-05-21T01:20:30.691629+0000","last_undegraded":"2024-05-21T01:20:30.691629+0000","last_fullsized":"2024-05-21T01:20:30.691629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:52:16.488269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.209201+0000","last_change":"2024-05-21T01:19:54.536436+0000","last_active":"2024-05-21T01:20:00.209201+0000","last_peered":"2024-05-21T01:20:00.209201+0000","last_clean":"2024-05-21T01:20:00.209201+0000","last_became_active":"2024-05-21T01:19:54.536061+0000","last_became_peered":"2024-05-21T01:19:54.536061+0000","last_unstale":"2024-05-21T01:20:00.209201+0000","last_undegraded":"2024-05-21T01:20:00.209201+0000","last_fullsized":"2024-05-21T01:20:00.209201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:48:23.811712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.206960+0000","last_change":"2024-05-21T01:19:58.623087+0000","last_active":"2024-05-21T01:20:00.206960+0000","last_peered":"2024-05-21T01:20:00.206960+0000","last_clean":"2024-05-21T01:20:00.206960+0000","last_became_active":"2024-05-21T01:19:58.622672+0000","last_became_peered":"2024-05-21T01:19:58.622672+0000","last_unstale":"2024-05-21T01:20:00.206960+0000","last_undegraded":"2024-05-21T01:20:00.206960+0000","last_fullsized":"2024-05-21T01:20:00.206960+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:45:49.241750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207109+0000","last_change":"2024-05-21T01:19:53.522497+0000","last_active":"2024-05-21T01:20:00.207109+0000","last_peered":"2024-05-21T01:20:00.207109+0000","last_clean":"2024-05-21T01:20:00.207109+0000","last_became_active":"2024-05-21T01:19:53.521684+0000","last_became_peered":"2024-05-21T01:19:53.521684+0000","last_unstale":"2024-05-21T01:20:00.207109+0000","last_undegraded":"2024-05-21T01:20:00.207109+0000","last_fullsized":"2024-05-21T01:20:00.207109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:18:17.808255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.567660+0000","last_change":"2024-05-21T01:19:54.549512+0000","last_active":"2024-05-21T01:19:59.567660+0000","last_peered":"2024-05-21T01:19:59.567660+0000","last_clean":"2024-05-21T01:19:59.567660+0000","last_became_active":"2024-05-21T01:19:54.549291+0000","last_became_peered":"2024-05-21T01:19:54.549291+0000","last_unstale":"2024-05-21T01:19:59.567660+0000","last_undegraded":"2024-05-21T01:19:59.567660+0000","last_fullsized":"2024-05-21T01:19:59.567660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:48:34.571236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.206754+0000","last_change":"2024-05-21T01:19:58.614748+0000","last_active":"2024-05-21T01:20:00.206754+0000","last_peered":"2024-05-21T01:20:00.206754+0000","last_clean":"2024-05-21T01:20:00.206754+0000","last_became_active":"2024-05-21T01:19:58.614313+0000","last_became_peered":"2024-05-21T01:19:58.614313+0000","last_unstale":"2024-05-21T01:20:00.206754+0000","last_undegraded":"2024-05-21T01:20:00.206754+0000","last_fullsized":"2024-05-21T01:20:00.206754+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:45:34.204591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.567029+0000","last_change":"2024-05-21T01:19:54.545467+0000","last_active":"2024-05-21T01:19:59.567029+0000","last_peered":"2024-05-21T01:19:59.567029+0000","last_clean":"2024-05-21T01:19:59.567029+0000","last_became_active":"2024-05-21T01:19:54.545181+0000","last_became_peered":"2024-05-21T01:19:54.545181+0000","last_unstale":"2024-05-21T01:19:59.567029+0000","last_undegraded":"2024-05-21T01:19:59.567029+0000","last_fullsized":"2024-05-21T01:19:59.567029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:43:15.387067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"25'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:24.666732+0000","last_change":"2024-05-21T01:19:53.536139+0000","last_active":"2024-05-21T01:20:24.666732+0000","last_peered":"2024-05-21T01:20:24.666732+0000","last_clean":"2024-05-21T01:20:24.666732+0000","last_became_active":"2024-05-21T01:19:53.535899+0000","last_became_peered":"2024-05-21T01:19:53.535899+0000","last_unstale":"2024-05-21T01:20:24.666732+0000","last_undegraded":"2024-05-21T01:20:24.666732+0000","last_fullsized":"2024-05-21T01:20:24.666732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:40:12.033744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.567390+0000","last_change":"2024-05-21T01:19:58.621487+0000","last_active":"2024-05-21T01:19:59.567390+0000","last_peered":"2024-05-21T01:19:59.567390+0000","last_clean":"2024-05-21T01:19:59.567390+0000","last_became_active":"2024-05-21T01:19:58.621083+0000","last_became_peered":"2024-05-21T01:19:58.621083+0000","last_unstale":"2024-05-21T01:19:59.567390+0000","last_undegraded":"2024-05-21T01:19:59.567390+0000","last_fullsized":"2024-05-21T01:19:59.567390+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:18:44.587274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.208662+0000","last_change":"2024-05-21T01:19:54.572420+0000","last_active":"2024-05-21T01:20:00.208662+0000","last_peered":"2024-05-21T01:20:00.208662+0000","last_clean":"2024-05-21T01:20:00.208662+0000","last_became_active":"2024-05-21T01:19:54.571863+0000","last_became_peered":"2024-05-21T01:19:54.571863+0000","last_unstale":"2024-05-21T01:20:00.208662+0000","last_undegraded":"2024-05-21T01:20:00.208662+0000","last_fullsized":"2024-05-21T01:20:00.208662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:13:52.491903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"25'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.575460+0000","last_change":"2024-05-21T01:19:53.553351+0000","last_active":"2024-05-21T01:19:59.575460+0000","last_peered":"2024-05-21T01:19:59.575460+0000","last_clean":"2024-05-21T01:19:59.575460+0000","last_became_active":"2024-05-21T01:19:53.552694+0000","last_became_peered":"2024-05-21T01:19:53.552694+0000","last_unstale":"2024-05-21T01:19:59.575460+0000","last_undegraded":"2024-05-21T01:19:59.575460+0000","last_fullsized":"2024-05-21T01:19:59.575460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:46:55.273278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.206544+0000","last_change":"2024-05-21T01:19:58.594904+0000","last_active":"2024-05-21T01:20:00.206544+0000","last_peered":"2024-05-21T01:20:00.206544+0000","last_clean":"2024-05-21T01:20:00.206544+0000","last_became_active":"2024-05-21T01:19:58.594450+0000","last_became_peered":"2024-05-21T01:19:58.594450+0000","last_unstale":"2024-05-21T01:20:00.206544+0000","last_undegraded":"2024-05-21T01:20:00.206544+0000","last_fullsized":"2024-05-21T01:20:00.206544+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:37:30.286986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.571649+0000","last_change":"2024-05-21T01:19:54.554750+0000","last_active":"2024-05-21T01:19:59.571649+0000","last_peered":"2024-05-21T01:19:59.571649+0000","last_clean":"2024-05-21T01:19:59.571649+0000","last_became_active":"2024-05-21T01:19:54.551583+0000","last_became_peered":"2024-05-21T01:19:54.551583+0000","last_unstale":"2024-05-21T01:19:59.571649+0000","last_undegraded":"2024-05-21T01:19:59.571649+0000","last_fullsized":"2024-05-21T01:19:59.571649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:37:19.564099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"25'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:24.662369+0000","last_change":"2024-05-21T01:19:53.523277+0000","last_active":"2024-05-21T01:20:24.662369+0000","last_peered":"2024-05-21T01:20:24.662369+0000","last_clean":"2024-05-21T01:20:24.662369+0000","last_became_active":"2024-05-21T01:19:53.522525+0000","last_became_peered":"2024-05-21T01:19:53.522525+0000","last_unstale":"2024-05-21T01:20:24.662369+0000","last_undegraded":"2024-05-21T01:20:24.662369+0000","last_fullsized":"2024-05-21T01:20:24.662369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:23:59.949781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.209007+0000","last_change":"2024-05-21T01:19:58.615575+0000","last_active":"2024-05-21T01:20:00.209007+0000","last_peered":"2024-05-21T01:20:00.209007+0000","last_clean":"2024-05-21T01:20:00.209007+0000","last_became_active":"2024-05-21T01:19:58.614401+0000","last_became_peered":"2024-05-21T01:19:58.614401+0000","last_unstale":"2024-05-21T01:20:00.209007+0000","last_undegraded":"2024-05-21T01:20:00.209007+0000","last_fullsized":"2024-05-21T01:20:00.209007+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:51:09.839503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.566770+0000","last_change":"2024-05-21T01:19:54.555489+0000","last_active":"2024-05-21T01:19:59.566770+0000","last_peered":"2024-05-21T01:19:59.566770+0000","last_clean":"2024-05-21T01:19:59.566770+0000","last_became_active":"2024-05-21T01:19:54.555227+0000","last_became_peered":"2024-05-21T01:19:54.555227+0000","last_unstale":"2024-05-21T01:19:59.566770+0000","last_undegraded":"2024-05-21T01:19:59.566770+0000","last_fullsized":"2024-05-21T01:19:59.566770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:00:22.873520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"25'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:24.663101+0000","last_change":"2024-05-21T01:19:53.520840+0000","last_active":"2024-05-21T01:20:24.663101+0000","last_peered":"2024-05-21T01:20:24.663101+0000","last_clean":"2024-05-21T01:20:24.663101+0000","last_became_active":"2024-05-21T01:19:53.520540+0000","last_became_peered":"2024-05-21T01:19:53.520540+0000","last_unstale":"2024-05-21T01:20:24.663101+0000","last_undegraded":"2024-05-21T01:20:24.663101+0000","last_fullsized":"2024-05-21T01:20:24.663101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:08:36.426465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207823+0000","last_change":"2024-05-21T01:19:58.604357+0000","last_active":"2024-05-21T01:20:00.207823+0000","last_peered":"2024-05-21T01:20:00.207823+0000","last_clean":"2024-05-21T01:20:00.207823+0000","last_became_active":"2024-05-21T01:19:58.603922+0000","last_became_peered":"2024-05-21T01:19:58.603922+0000","last_unstale":"2024-05-21T01:20:00.207823+0000","last_undegraded":"2024-05-21T01:20:00.207823+0000","last_fullsized":"2024-05-21T01:20:00.207823+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:55:18.226031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.572430+0000","last_change":"2024-05-21T01:19:54.569315+0000","last_active":"2024-05-21T01:19:59.572430+0000","last_peered":"2024-05-21T01:19:59.572430+0000","last_clean":"2024-05-21T01:19:59.572430+0000","last_became_active":"2024-05-21T01:19:54.568232+0000","last_became_peered":"2024-05-21T01:19:54.568232+0000","last_unstale":"2024-05-21T01:19:59.572430+0000","last_undegraded":"2024-05-21T01:19:59.572430+0000","last_fullsized":"2024-05-21T01:19:59.572430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:19:01.819418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"25'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:24.660940+0000","last_change":"2024-05-21T01:19:53.525301+0000","last_active":"2024-05-21T01:20:24.660940+0000","last_peered":"2024-05-21T01:20:24.660940+0000","last_clean":"2024-05-21T01:20:24.660940+0000","last_became_active":"2024-05-21T01:19:53.525010+0000","last_became_peered":"2024-05-21T01:19:53.525010+0000","last_unstale":"2024-05-21T01:20:24.660940+0000","last_undegraded":"2024-05-21T01:20:24.660940+0000","last_fullsized":"2024-05-21T01:20:24.660940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:53:11.316975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.206622+0000","last_change":"2024-05-21T01:19:58.590354+0000","last_active":"2024-05-21T01:20:00.206622+0000","last_peered":"2024-05-21T01:20:00.206622+0000","last_clean":"2024-05-21T01:20:00.206622+0000","last_became_active":"2024-05-21T01:19:58.589985+0000","last_became_peered":"2024-05-21T01:19:58.589985+0000","last_unstale":"2024-05-21T01:20:00.206622+0000","last_undegraded":"2024-05-21T01:20:00.206622+0000","last_fullsized":"2024-05-21T01:20:00.206622+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:08:09.222858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.573671+0000","last_change":"2024-05-21T01:19:54.555318+0000","last_active":"2024-05-21T01:19:59.573671+0000","last_peered":"2024-05-21T01:19:59.573671+0000","last_clean":"2024-05-21T01:19:59.573671+0000","last_became_active":"2024-05-21T01:19:54.552947+0000","last_became_peered":"2024-05-21T01:19:54.552947+0000","last_unstale":"2024-05-21T01:19:59.573671+0000","last_undegraded":"2024-05-21T01:19:59.573671+0000","last_fullsized":"2024-05-21T01:19:59.573671+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:29:24.153986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"25'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:30.692794+0000","last_change":"2024-05-21T01:19:53.525004+0000","last_active":"2024-05-21T01:20:30.692794+0000","last_peered":"2024-05-21T01:20:30.692794+0000","last_clean":"2024-05-21T01:20:30.692794+0000","last_became_active":"2024-05-21T01:19:53.521014+0000","last_became_peered":"2024-05-21T01:19:53.521014+0000","last_unstale":"2024-05-21T01:20:30.692794+0000","last_undegraded":"2024-05-21T01:20:30.692794+0000","last_fullsized":"2024-05-21T01:20:30.692794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:02:46.668320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.571502+0000","last_change":"2024-05-21T01:19:58.599880+0000","last_active":"2024-05-21T01:19:59.571502+0000","last_peered":"2024-05-21T01:19:59.571502+0000","last_clean":"2024-05-21T01:19:59.571502+0000","last_became_active":"2024-05-21T01:19:58.598712+0000","last_became_peered":"2024-05-21T01:19:58.598712+0000","last_unstale":"2024-05-21T01:19:59.571502+0000","last_undegraded":"2024-05-21T01:19:59.571502+0000","last_fullsized":"2024-05-21T01:19:59.571502+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:43:05.995986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.577134+0000","last_change":"2024-05-21T01:19:54.576044+0000","last_active":"2024-05-21T01:19:59.577134+0000","last_peered":"2024-05-21T01:19:59.577134+0000","last_clean":"2024-05-21T01:19:59.577134+0000","last_became_active":"2024-05-21T01:19:54.575543+0000","last_became_peered":"2024-05-21T01:19:54.575543+0000","last_unstale":"2024-05-21T01:19:59.577134+0000","last_undegraded":"2024-05-21T01:19:59.577134+0000","last_fullsized":"2024-05-21T01:19:59.577134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T09:33:07.188470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"25'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.568216+0000","last_change":"2024-05-21T01:19:53.543705+0000","last_active":"2024-05-21T01:19:59.568216+0000","last_peered":"2024-05-21T01:19:59.568216+0000","last_clean":"2024-05-21T01:19:59.568216+0000","last_became_active":"2024-05-21T01:19:53.543450+0000","last_became_peered":"2024-05-21T01:19:53.543450+0000","last_unstale":"2024-05-21T01:19:59.568216+0000","last_undegraded":"2024-05-21T01:19:59.568216+0000","last_fullsized":"2024-05-21T01:19:59.568216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:05:49.465156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.575415+0000","last_change":"2024-05-21T01:19:58.612049+0000","last_active":"2024-05-21T01:19:59.575415+0000","last_peered":"2024-05-21T01:19:59.575415+0000","last_clean":"2024-05-21T01:19:59.575415+0000","last_became_active":"2024-05-21T01:19:58.610837+0000","last_became_peered":"2024-05-21T01:19:58.610837+0000","last_unstale":"2024-05-21T01:19:59.575415+0000","last_undegraded":"2024-05-21T01:19:59.575415+0000","last_fullsized":"2024-05-21T01:19:59.575415+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:24:14.332056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207496+0000","last_change":"2024-05-21T01:19:54.553083+0000","last_active":"2024-05-21T01:20:00.207496+0000","last_peered":"2024-05-21T01:20:00.207496+0000","last_clean":"2024-05-21T01:20:00.207496+0000","last_became_active":"2024-05-21T01:19:54.552812+0000","last_became_peered":"2024-05-21T01:19:54.552812+0000","last_unstale":"2024-05-21T01:20:00.207496+0000","last_undegraded":"2024-05-21T01:20:00.207496+0000","last_fullsized":"2024-05-21T01:20:00.207496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:37:25.835345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.210838+0000","last_change":"2024-05-21T01:19:53.551697+0000","last_active":"2024-05-21T01:20:00.210838+0000","last_peered":"2024-05-21T01:20:00.210838+0000","last_clean":"2024-05-21T01:20:00.210838+0000","last_became_active":"2024-05-21T01:19:53.550921+0000","last_became_peered":"2024-05-21T01:19:53.550921+0000","last_unstale":"2024-05-21T01:20:00.210838+0000","last_undegraded":"2024-05-21T01:20:00.210838+0000","last_fullsized":"2024-05-21T01:20:00.210838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T09:31:31.996638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.571559+0000","last_change":"2024-05-21T01:19:58.626472+0000","last_active":"2024-05-21T01:19:59.571559+0000","last_peered":"2024-05-21T01:19:59.571559+0000","last_clean":"2024-05-21T01:19:59.571559+0000","last_became_active":"2024-05-21T01:19:58.625720+0000","last_became_peered":"2024-05-21T01:19:58.625720+0000","last_unstale":"2024-05-21T01:19:59.571559+0000","last_undegraded":"2024-05-21T01:19:59.571559+0000","last_fullsized":"2024-05-21T01:19:59.571559+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:16:03.911585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207190+0000","last_change":"2024-05-21T01:19:54.547947+0000","last_active":"2024-05-21T01:20:00.207190+0000","last_peered":"2024-05-21T01:20:00.207190+0000","last_clean":"2024-05-21T01:20:00.207190+0000","last_became_active":"2024-05-21T01:19:54.547689+0000","last_became_peered":"2024-05-21T01:19:54.547689+0000","last_unstale":"2024-05-21T01:20:00.207190+0000","last_undegraded":"2024-05-21T01:20:00.207190+0000","last_fullsized":"2024-05-21T01:20:00.207190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:40:55.985899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"25'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.567398+0000","last_change":"2024-05-21T01:19:53.540973+0000","last_active":"2024-05-21T01:19:59.567398+0000","last_peered":"2024-05-21T01:19:59.567398+0000","last_clean":"2024-05-21T01:19:59.567398+0000","last_became_active":"2024-05-21T01:19:53.540670+0000","last_became_peered":"2024-05-21T01:19:53.540670+0000","last_unstale":"2024-05-21T01:19:59.567398+0000","last_undegraded":"2024-05-21T01:19:59.567398+0000","last_fullsized":"2024-05-21T01:19:59.567398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:08:21.802284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.576864+0000","last_change":"2024-05-21T01:19:58.611280+0000","last_active":"2024-05-21T01:19:59.576864+0000","last_peered":"2024-05-21T01:19:59.576864+0000","last_clean":"2024-05-21T01:19:59.576864+0000","last_became_active":"2024-05-21T01:19:58.610511+0000","last_became_peered":"2024-05-21T01:19:58.610511+0000","last_unstale":"2024-05-21T01:19:59.576864+0000","last_undegraded":"2024-05-21T01:19:59.576864+0000","last_fullsized":"2024-05-21T01:19:59.576864+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:49:19.660422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.209521+0000","last_change":"2024-05-21T01:19:54.572546+0000","last_active":"2024-05-21T01:20:00.209521+0000","last_peered":"2024-05-21T01:20:00.209521+0000","last_clean":"2024-05-21T01:20:00.209521+0000","last_became_active":"2024-05-21T01:19:54.572022+0000","last_became_peered":"2024-05-21T01:19:54.572022+0000","last_unstale":"2024-05-21T01:20:00.209521+0000","last_undegraded":"2024-05-21T01:20:00.209521+0000","last_fullsized":"2024-05-21T01:20:00.209521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:50:08.351383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"25'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:30.697731+0000","last_change":"2024-05-21T01:19:53.556786+0000","last_active":"2024-05-21T01:20:30.697731+0000","last_peered":"2024-05-21T01:20:30.697731+0000","last_clean":"2024-05-21T01:20:30.697731+0000","last_became_active":"2024-05-21T01:19:53.556143+0000","last_became_peered":"2024-05-21T01:19:53.556143+0000","last_unstale":"2024-05-21T01:20:30.697731+0000","last_undegraded":"2024-05-21T01:20:30.697731+0000","last_fullsized":"2024-05-21T01:20:30.697731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:02:17.391701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.577698+0000","last_change":"2024-05-21T01:19:58.599203+0000","last_active":"2024-05-21T01:19:59.577698+0000","last_peered":"2024-05-21T01:19:59.577698+0000","last_clean":"2024-05-21T01:19:59.577698+0000","last_became_active":"2024-05-21T01:19:58.598175+0000","last_became_peered":"2024-05-21T01:19:58.598175+0000","last_unstale":"2024-05-21T01:19:59.577698+0000","last_undegraded":"2024-05-21T01:19:59.577698+0000","last_fullsized":"2024-05-21T01:19:59.577698+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:45:17.138090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.574222+0000","last_change":"2024-05-21T01:19:54.551092+0000","last_active":"2024-05-21T01:19:59.574222+0000","last_peered":"2024-05-21T01:19:59.574222+0000","last_clean":"2024-05-21T01:19:59.574222+0000","last_became_active":"2024-05-21T01:19:54.550338+0000","last_became_peered":"2024-05-21T01:19:54.550338+0000","last_unstale":"2024-05-21T01:19:59.574222+0000","last_undegraded":"2024-05-21T01:19:59.574222+0000","last_fullsized":"2024-05-21T01:19:59.574222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:29:13.540719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"25'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:30.690226+0000","last_change":"2024-05-21T01:19:53.554835+0000","last_active":"2024-05-21T01:20:30.690226+0000","last_peered":"2024-05-21T01:20:30.690226+0000","last_clean":"2024-05-21T01:20:30.690226+0000","last_became_active":"2024-05-21T01:19:53.554598+0000","last_became_peered":"2024-05-21T01:19:53.554598+0000","last_unstale":"2024-05-21T01:20:30.690226+0000","last_undegraded":"2024-05-21T01:20:30.690226+0000","last_fullsized":"2024-05-21T01:20:30.690226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:28:43.940978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.211238+0000","last_change":"2024-05-21T01:19:58.629747+0000","last_active":"2024-05-21T01:20:00.211238+0000","last_peered":"2024-05-21T01:20:00.211238+0000","last_clean":"2024-05-21T01:20:00.211238+0000","last_became_active":"2024-05-21T01:19:58.622106+0000","last_became_peered":"2024-05-21T01:19:58.622106+0000","last_unstale":"2024-05-21T01:20:00.211238+0000","last_undegraded":"2024-05-21T01:20:00.211238+0000","last_fullsized":"2024-05-21T01:20:00.211238+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:22:07.047914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.571255+0000","last_change":"2024-05-21T01:19:54.554303+0000","last_active":"2024-05-21T01:19:59.571255+0000","last_peered":"2024-05-21T01:19:59.571255+0000","last_clean":"2024-05-21T01:19:59.571255+0000","last_became_active":"2024-05-21T01:19:54.552126+0000","last_became_peered":"2024-05-21T01:19:54.552126+0000","last_unstale":"2024-05-21T01:19:59.571255+0000","last_undegraded":"2024-05-21T01:19:59.571255+0000","last_fullsized":"2024-05-21T01:19:59.571255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:59:46.383359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"25'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:24.666931+0000","last_change":"2024-05-21T01:19:53.536580+0000","last_active":"2024-05-21T01:20:24.666931+0000","last_peered":"2024-05-21T01:20:24.666931+0000","last_clean":"2024-05-21T01:20:24.666931+0000","last_became_active":"2024-05-21T01:19:53.535105+0000","last_became_peered":"2024-05-21T01:19:53.535105+0000","last_unstale":"2024-05-21T01:20:24.666931+0000","last_undegraded":"2024-05-21T01:20:24.666931+0000","last_fullsized":"2024-05-21T01:20:24.666931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:58:05.019025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":118,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207611+0000","last_change":"2024-05-21T01:19:49.490062+0000","last_active":"2024-05-21T01:20:00.207611+0000","last_peered":"2024-05-21T01:20:00.207611+0000","last_clean":"2024-05-21T01:20:00.207611+0000","last_became_active":"2024-05-21T01:19:49.488796+0000","last_became_peered":"2024-05-21T01:19:49.488796+0000","last_unstale":"2024-05-21T01:20:00.207611+0000","last_undegraded":"2024-05-21T01:20:00.207611+0000","last_fullsized":"2024-05-21T01:20:00.207611+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:47.457865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:47.457865+0000","last_clean_scrub_stamp":"2024-05-21T01:19:47.457865+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T09:37:06.199150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.568012+0000","last_change":"2024-05-21T01:19:58.590851+0000","last_active":"2024-05-21T01:19:59.568012+0000","last_peered":"2024-05-21T01:19:59.568012+0000","last_clean":"2024-05-21T01:19:59.568012+0000","last_became_active":"2024-05-21T01:19:58.589288+0000","last_became_peered":"2024-05-21T01:19:58.589288+0000","last_unstale":"2024-05-21T01:19:59.568012+0000","last_undegraded":"2024-05-21T01:19:59.568012+0000","last_fullsized":"2024-05-21T01:19:59.568012+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:36:46.992834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.567741+0000","last_change":"2024-05-21T01:19:54.543894+0000","last_active":"2024-05-21T01:19:59.567741+0000","last_peered":"2024-05-21T01:19:59.567741+0000","last_clean":"2024-05-21T01:19:59.567741+0000","last_became_active":"2024-05-21T01:19:54.543586+0000","last_became_peered":"2024-05-21T01:19:54.543586+0000","last_unstale":"2024-05-21T01:19:59.567741+0000","last_undegraded":"2024-05-21T01:19:59.567741+0000","last_fullsized":"2024-05-21T01:19:59.567741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:33:02.756634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"25'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:30.693726+0000","last_change":"2024-05-21T01:19:53.532115+0000","last_active":"2024-05-21T01:20:30.693726+0000","last_peered":"2024-05-21T01:20:30.693726+0000","last_clean":"2024-05-21T01:20:30.693726+0000","last_became_active":"2024-05-21T01:19:53.529879+0000","last_became_peered":"2024-05-21T01:19:53.529879+0000","last_unstale":"2024-05-21T01:20:30.693726+0000","last_undegraded":"2024-05-21T01:20:30.693726+0000","last_fullsized":"2024-05-21T01:20:30.693726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:42:07.436243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.206924+0000","last_change":"2024-05-21T01:19:58.604417+0000","last_active":"2024-05-21T01:20:00.206924+0000","last_peered":"2024-05-21T01:20:00.206924+0000","last_clean":"2024-05-21T01:20:00.206924+0000","last_became_active":"2024-05-21T01:19:58.603929+0000","last_became_peered":"2024-05-21T01:19:58.603929+0000","last_unstale":"2024-05-21T01:20:00.206924+0000","last_undegraded":"2024-05-21T01:20:00.206924+0000","last_fullsized":"2024-05-21T01:20:00.206924+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:15:59.031738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207029+0000","last_change":"2024-05-21T01:19:54.542096+0000","last_active":"2024-05-21T01:20:00.207029+0000","last_peered":"2024-05-21T01:20:00.207029+0000","last_clean":"2024-05-21T01:20:00.207029+0000","last_became_active":"2024-05-21T01:19:54.541837+0000","last_became_peered":"2024-05-21T01:19:54.541837+0000","last_unstale":"2024-05-21T01:20:00.207029+0000","last_undegraded":"2024-05-21T01:20:00.207029+0000","last_fullsized":"2024-05-21T01:20:00.207029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:55:30.807311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.211049+0000","last_change":"2024-05-21T01:19:53.551697+0000","last_active":"2024-05-21T01:20:00.211049+0000","last_peered":"2024-05-21T01:20:00.211049+0000","last_clean":"2024-05-21T01:20:00.211049+0000","last_became_active":"2024-05-21T01:19:53.550893+0000","last_became_peered":"2024-05-21T01:19:53.550893+0000","last_unstale":"2024-05-21T01:20:00.211049+0000","last_undegraded":"2024-05-21T01:20:00.211049+0000","last_fullsized":"2024-05-21T01:20:00.211049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:42:20.295229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.210457+0000","last_change":"2024-05-21T01:19:58.628526+0000","last_active":"2024-05-21T01:20:00.210457+0000","last_peered":"2024-05-21T01:20:00.210457+0000","last_clean":"2024-05-21T01:20:00.210457+0000","last_became_active":"2024-05-21T01:19:58.620667+0000","last_became_peered":"2024-05-21T01:19:58.620667+0000","last_unstale":"2024-05-21T01:20:00.210457+0000","last_undegraded":"2024-05-21T01:20:00.210457+0000","last_fullsized":"2024-05-21T01:20:00.210457+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:46:22.396063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.208496+0000","last_change":"2024-05-21T01:19:54.532551+0000","last_active":"2024-05-21T01:20:00.208496+0000","last_peered":"2024-05-21T01:20:00.208496+0000","last_clean":"2024-05-21T01:20:00.208496+0000","last_became_active":"2024-05-21T01:19:54.532251+0000","last_became_peered":"2024-05-21T01:19:54.532251+0000","last_unstale":"2024-05-21T01:20:00.208496+0000","last_undegraded":"2024-05-21T01:20:00.208496+0000","last_fullsized":"2024-05-21T01:20:00.208496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:00:30.042781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.572555+0000","last_change":"2024-05-21T01:19:53.554659+0000","last_active":"2024-05-21T01:19:59.572555+0000","last_peered":"2024-05-21T01:19:59.572555+0000","last_clean":"2024-05-21T01:19:59.572555+0000","last_became_active":"2024-05-21T01:19:53.553953+0000","last_became_peered":"2024-05-21T01:19:53.553953+0000","last_unstale":"2024-05-21T01:19:59.572555+0000","last_undegraded":"2024-05-21T01:19:59.572555+0000","last_fullsized":"2024-05-21T01:19:59.572555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:31:13.091061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.566596+0000","last_change":"2024-05-21T01:19:58.593243+0000","last_active":"2024-05-21T01:19:59.566596+0000","last_peered":"2024-05-21T01:19:59.566596+0000","last_clean":"2024-05-21T01:19:59.566596+0000","last_became_active":"2024-05-21T01:19:58.592758+0000","last_became_peered":"2024-05-21T01:19:58.592758+0000","last_unstale":"2024-05-21T01:19:59.566596+0000","last_undegraded":"2024-05-21T01:19:59.566596+0000","last_fullsized":"2024-05-21T01:19:59.566596+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:46:17.877736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207962+0000","last_change":"2024-05-21T01:19:54.538391+0000","last_active":"2024-05-21T01:20:00.207962+0000","last_peered":"2024-05-21T01:20:00.207962+0000","last_clean":"2024-05-21T01:20:00.207962+0000","last_became_active":"2024-05-21T01:19:54.538106+0000","last_became_peered":"2024-05-21T01:19:54.538106+0000","last_unstale":"2024-05-21T01:20:00.207962+0000","last_undegraded":"2024-05-21T01:20:00.207962+0000","last_fullsized":"2024-05-21T01:20:00.207962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:36:07.297496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"25'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.208593+0000","last_change":"2024-05-21T01:19:53.551917+0000","last_active":"2024-05-21T01:20:00.208593+0000","last_peered":"2024-05-21T01:20:00.208593+0000","last_clean":"2024-05-21T01:20:00.208593+0000","last_became_active":"2024-05-21T01:19:53.551608+0000","last_became_peered":"2024-05-21T01:19:53.551608+0000","last_unstale":"2024-05-21T01:20:00.208593+0000","last_undegraded":"2024-05-21T01:20:00.208593+0000","last_fullsized":"2024-05-21T01:20:00.208593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:20:54.093966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.208119+0000","last_change":"2024-05-21T01:19:58.613367+0000","last_active":"2024-05-21T01:20:00.208119+0000","last_peered":"2024-05-21T01:20:00.208119+0000","last_clean":"2024-05-21T01:20:00.208119+0000","last_became_active":"2024-05-21T01:19:58.612950+0000","last_became_peered":"2024-05-21T01:19:58.612950+0000","last_unstale":"2024-05-21T01:20:00.208119+0000","last_undegraded":"2024-05-21T01:20:00.208119+0000","last_fullsized":"2024-05-21T01:20:00.208119+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:32:12.365734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.566761+0000","last_change":"2024-05-21T01:19:54.548979+0000","last_active":"2024-05-21T01:19:59.566761+0000","last_peered":"2024-05-21T01:19:59.566761+0000","last_clean":"2024-05-21T01:19:59.566761+0000","last_became_active":"2024-05-21T01:19:54.548704+0000","last_became_peered":"2024-05-21T01:19:54.548704+0000","last_unstale":"2024-05-21T01:19:59.566761+0000","last_undegraded":"2024-05-21T01:19:59.566761+0000","last_fullsized":"2024-05-21T01:19:59.566761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:57:09.076705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"25'15","reported_seq":37,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:30.697911+0000","last_change":"2024-05-21T01:19:53.542425+0000","last_active":"2024-05-21T01:20:30.697911+0000","last_peered":"2024-05-21T01:20:30.697911+0000","last_clean":"2024-05-21T01:20:30.697911+0000","last_became_active":"2024-05-21T01:19:53.541577+0000","last_became_peered":"2024-05-21T01:19:53.541577+0000","last_unstale":"2024-05-21T01:20:30.697911+0000","last_undegraded":"2024-05-21T01:20:30.697911+0000","last_fullsized":"2024-05-21T01:20:30.697911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:47:54.892789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.211663+0000","last_change":"2024-05-21T01:19:58.630293+0000","last_active":"2024-05-21T01:20:00.211663+0000","last_peered":"2024-05-21T01:20:00.211663+0000","last_clean":"2024-05-21T01:20:00.211663+0000","last_became_active":"2024-05-21T01:19:58.629119+0000","last_became_peered":"2024-05-21T01:19:58.629119+0000","last_unstale":"2024-05-21T01:20:00.211663+0000","last_undegraded":"2024-05-21T01:20:00.211663+0000","last_fullsized":"2024-05-21T01:20:00.211663+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:10:45.318517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207523+0000","last_change":"2024-05-21T01:19:54.575541+0000","last_active":"2024-05-21T01:20:00.207523+0000","last_peered":"2024-05-21T01:20:00.207523+0000","last_clean":"2024-05-21T01:20:00.207523+0000","last_became_active":"2024-05-21T01:19:54.575314+0000","last_became_peered":"2024-05-21T01:19:54.575314+0000","last_unstale":"2024-05-21T01:20:00.207523+0000","last_undegraded":"2024-05-21T01:20:00.207523+0000","last_fullsized":"2024-05-21T01:20:00.207523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:02:36.840590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"25'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:30.692210+0000","last_change":"2024-05-21T01:19:53.523758+0000","last_active":"2024-05-21T01:20:30.692210+0000","last_peered":"2024-05-21T01:20:30.692210+0000","last_clean":"2024-05-21T01:20:30.692210+0000","last_became_active":"2024-05-21T01:19:53.523273+0000","last_became_peered":"2024-05-21T01:19:53.523273+0000","last_unstale":"2024-05-21T01:20:30.692210+0000","last_undegraded":"2024-05-21T01:20:30.692210+0000","last_fullsized":"2024-05-21T01:20:30.692210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:05:47.275193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.211601+0000","last_change":"2024-05-21T01:19:58.621996+0000","last_active":"2024-05-21T01:20:00.211601+0000","last_peered":"2024-05-21T01:20:00.211601+0000","last_clean":"2024-05-21T01:20:00.211601+0000","last_became_active":"2024-05-21T01:19:58.620552+0000","last_became_peered":"2024-05-21T01:19:58.620552+0000","last_unstale":"2024-05-21T01:20:00.211601+0000","last_undegraded":"2024-05-21T01:20:00.211601+0000","last_fullsized":"2024-05-21T01:20:00.211601+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:58:32.635003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.567139+0000","last_change":"2024-05-21T01:19:54.557379+0000","last_active":"2024-05-21T01:19:59.567139+0000","last_peered":"2024-05-21T01:19:59.567139+0000","last_clean":"2024-05-21T01:19:59.567139+0000","last_became_active":"2024-05-21T01:19:54.550335+0000","last_became_peered":"2024-05-21T01:19:54.550335+0000","last_unstale":"2024-05-21T01:19:59.567139+0000","last_undegraded":"2024-05-21T01:19:59.567139+0000","last_fullsized":"2024-05-21T01:19:59.567139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:24:52.297888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"25'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:24.658932+0000","last_change":"2024-05-21T01:19:53.534431+0000","last_active":"2024-05-21T01:20:24.658932+0000","last_peered":"2024-05-21T01:20:24.658932+0000","last_clean":"2024-05-21T01:20:24.658932+0000","last_became_active":"2024-05-21T01:19:53.534174+0000","last_became_peered":"2024-05-21T01:19:53.534174+0000","last_unstale":"2024-05-21T01:20:24.658932+0000","last_undegraded":"2024-05-21T01:20:24.658932+0000","last_fullsized":"2024-05-21T01:20:24.658932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:42:04.743914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.576325+0000","last_change":"2024-05-21T01:19:58.609289+0000","last_active":"2024-05-21T01:19:59.576325+0000","last_peered":"2024-05-21T01:19:59.576325+0000","last_clean":"2024-05-21T01:19:59.576325+0000","last_became_active":"2024-05-21T01:19:58.608371+0000","last_became_peered":"2024-05-21T01:19:58.608371+0000","last_unstale":"2024-05-21T01:19:59.576325+0000","last_undegraded":"2024-05-21T01:19:59.576325+0000","last_fullsized":"2024-05-21T01:19:59.576325+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:27:36.997803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.575122+0000","last_change":"2024-05-21T01:19:54.551617+0000","last_active":"2024-05-21T01:19:59.575122+0000","last_peered":"2024-05-21T01:19:59.575122+0000","last_clean":"2024-05-21T01:19:59.575122+0000","last_became_active":"2024-05-21T01:19:54.550865+0000","last_became_peered":"2024-05-21T01:19:54.550865+0000","last_unstale":"2024-05-21T01:19:59.575122+0000","last_undegraded":"2024-05-21T01:19:59.575122+0000","last_fullsized":"2024-05-21T01:19:59.575122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:32:44.168265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"25'6","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:30.693468+0000","last_change":"2024-05-21T01:19:53.535936+0000","last_active":"2024-05-21T01:20:30.693468+0000","last_peered":"2024-05-21T01:20:30.693468+0000","last_clean":"2024-05-21T01:20:30.693468+0000","last_became_active":"2024-05-21T01:19:53.535143+0000","last_became_peered":"2024-05-21T01:19:53.535143+0000","last_unstale":"2024-05-21T01:20:30.693468+0000","last_undegraded":"2024-05-21T01:20:30.693468+0000","last_fullsized":"2024-05-21T01:20:30.693468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:50:51.433726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.567570+0000","last_change":"2024-05-21T01:19:58.622615+0000","last_active":"2024-05-21T01:19:59.567570+0000","last_peered":"2024-05-21T01:19:59.567570+0000","last_clean":"2024-05-21T01:19:59.567570+0000","last_became_active":"2024-05-21T01:19:58.622250+0000","last_became_peered":"2024-05-21T01:19:58.622250+0000","last_unstale":"2024-05-21T01:19:59.567570+0000","last_undegraded":"2024-05-21T01:19:59.567570+0000","last_fullsized":"2024-05-21T01:19:59.567570+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:05:22.913945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207577+0000","last_change":"2024-05-21T01:19:54.558348+0000","last_active":"2024-05-21T01:20:00.207577+0000","last_peered":"2024-05-21T01:20:00.207577+0000","last_clean":"2024-05-21T01:20:00.207577+0000","last_became_active":"2024-05-21T01:19:54.558095+0000","last_became_peered":"2024-05-21T01:19:54.558095+0000","last_unstale":"2024-05-21T01:20:00.207577+0000","last_undegraded":"2024-05-21T01:20:00.207577+0000","last_fullsized":"2024-05-21T01:20:00.207577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:43:48.625583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"25'11","reported_seq":33,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:24.664060+0000","last_change":"2024-05-21T01:19:53.534947+0000","last_active":"2024-05-21T01:20:24.664060+0000","last_peered":"2024-05-21T01:20:24.664060+0000","last_clean":"2024-05-21T01:20:24.664060+0000","last_became_active":"2024-05-21T01:19:53.534616+0000","last_became_peered":"2024-05-21T01:19:53.534616+0000","last_unstale":"2024-05-21T01:20:24.664060+0000","last_undegraded":"2024-05-21T01:20:24.664060+0000","last_fullsized":"2024-05-21T01:20:24.664060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:01:25.372035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.571116+0000","last_change":"2024-05-21T01:19:58.617970+0000","last_active":"2024-05-21T01:19:59.571116+0000","last_peered":"2024-05-21T01:19:59.571116+0000","last_clean":"2024-05-21T01:19:59.571116+0000","last_became_active":"2024-05-21T01:19:58.617061+0000","last_became_peered":"2024-05-21T01:19:58.617061+0000","last_unstale":"2024-05-21T01:19:59.571116+0000","last_undegraded":"2024-05-21T01:19:59.571116+0000","last_fullsized":"2024-05-21T01:19:59.571116+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:48:50.703577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.567205+0000","last_change":"2024-05-21T01:19:54.557175+0000","last_active":"2024-05-21T01:19:59.567205+0000","last_peered":"2024-05-21T01:19:59.567205+0000","last_clean":"2024-05-21T01:19:59.567205+0000","last_became_active":"2024-05-21T01:19:54.556933+0000","last_became_peered":"2024-05-21T01:19:54.556933+0000","last_unstale":"2024-05-21T01:19:59.567205+0000","last_undegraded":"2024-05-21T01:19:59.567205+0000","last_fullsized":"2024-05-21T01:19:59.567205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:15:44.089544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"25'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.208892+0000","last_change":"2024-05-21T01:19:53.536780+0000","last_active":"2024-05-21T01:20:00.208892+0000","last_peered":"2024-05-21T01:20:00.208892+0000","last_clean":"2024-05-21T01:20:00.208892+0000","last_became_active":"2024-05-21T01:19:53.535768+0000","last_became_peered":"2024-05-21T01:19:53.535768+0000","last_unstale":"2024-05-21T01:20:00.208892+0000","last_undegraded":"2024-05-21T01:20:00.208892+0000","last_fullsized":"2024-05-21T01:20:00.208892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:04:14.732801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207120+0000","last_change":"2024-05-21T01:19:58.606532+0000","last_active":"2024-05-21T01:20:00.207120+0000","last_peered":"2024-05-21T01:20:00.207120+0000","last_clean":"2024-05-21T01:20:00.207120+0000","last_became_active":"2024-05-21T01:19:58.606180+0000","last_became_peered":"2024-05-21T01:19:58.606180+0000","last_unstale":"2024-05-21T01:20:00.207120+0000","last_undegraded":"2024-05-21T01:20:00.207120+0000","last_fullsized":"2024-05-21T01:20:00.207120+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:25:31.161427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.211807+0000","last_change":"2024-05-21T01:19:54.571280+0000","last_active":"2024-05-21T01:20:00.211807+0000","last_peered":"2024-05-21T01:20:00.211807+0000","last_clean":"2024-05-21T01:20:00.211807+0000","last_became_active":"2024-05-21T01:19:54.568778+0000","last_became_peered":"2024-05-21T01:19:54.568778+0000","last_unstale":"2024-05-21T01:20:00.211807+0000","last_undegraded":"2024-05-21T01:20:00.211807+0000","last_fullsized":"2024-05-21T01:20:00.211807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:43:16.583632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"25'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:24.660610+0000","last_change":"2024-05-21T01:19:53.530770+0000","last_active":"2024-05-21T01:20:24.660610+0000","last_peered":"2024-05-21T01:20:24.660610+0000","last_clean":"2024-05-21T01:20:24.660610+0000","last_became_active":"2024-05-21T01:19:53.526431+0000","last_became_peered":"2024-05-21T01:19:53.526431+0000","last_unstale":"2024-05-21T01:20:24.660610+0000","last_undegraded":"2024-05-21T01:20:24.660610+0000","last_fullsized":"2024-05-21T01:20:24.660610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:08:59.892029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.208009+0000","last_change":"2024-05-21T01:19:58.611576+0000","last_active":"2024-05-21T01:20:00.208009+0000","last_peered":"2024-05-21T01:20:00.208009+0000","last_clean":"2024-05-21T01:20:00.208009+0000","last_became_active":"2024-05-21T01:19:58.610838+0000","last_became_peered":"2024-05-21T01:19:58.610838+0000","last_unstale":"2024-05-21T01:20:00.208009+0000","last_undegraded":"2024-05-21T01:20:00.208009+0000","last_fullsized":"2024-05-21T01:20:00.208009+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:07:31.736640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207957+0000","last_change":"2024-05-21T01:19:54.552709+0000","last_active":"2024-05-21T01:20:00.207957+0000","last_peered":"2024-05-21T01:20:00.207957+0000","last_clean":"2024-05-21T01:20:00.207957+0000","last_became_active":"2024-05-21T01:19:54.547898+0000","last_became_peered":"2024-05-21T01:19:54.547898+0000","last_unstale":"2024-05-21T01:20:00.207957+0000","last_undegraded":"2024-05-21T01:20:00.207957+0000","last_fullsized":"2024-05-21T01:20:00.207957+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:20:17.933506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"25'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:24.659103+0000","last_change":"2024-05-21T01:19:53.534507+0000","last_active":"2024-05-21T01:20:24.659103+0000","last_peered":"2024-05-21T01:20:24.659103+0000","last_clean":"2024-05-21T01:20:24.659103+0000","last_became_active":"2024-05-21T01:19:53.534036+0000","last_became_peered":"2024-05-21T01:19:53.534036+0000","last_unstale":"2024-05-21T01:20:24.659103+0000","last_undegraded":"2024-05-21T01:20:24.659103+0000","last_fullsized":"2024-05-21T01:20:24.659103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:01:08.218098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.572286+0000","last_change":"2024-05-21T01:19:58.608135+0000","last_active":"2024-05-21T01:19:59.572286+0000","last_peered":"2024-05-21T01:19:59.572286+0000","last_clean":"2024-05-21T01:19:59.572286+0000","last_became_active":"2024-05-21T01:19:58.607242+0000","last_became_peered":"2024-05-21T01:19:58.607242+0000","last_unstale":"2024-05-21T01:19:59.572286+0000","last_undegraded":"2024-05-21T01:19:59.572286+0000","last_fullsized":"2024-05-21T01:19:59.572286+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:05:26.197876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.572239+0000","last_change":"2024-05-21T01:19:58.624883+0000","last_active":"2024-05-21T01:19:59.572239+0000","last_peered":"2024-05-21T01:19:59.572239+0000","last_clean":"2024-05-21T01:19:59.572239+0000","last_became_active":"2024-05-21T01:19:58.623991+0000","last_became_peered":"2024-05-21T01:19:58.623991+0000","last_unstale":"2024-05-21T01:19:59.572239+0000","last_undegraded":"2024-05-21T01:19:59.572239+0000","last_fullsized":"2024-05-21T01:19:59.572239+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:29:26.251376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.572416+0000","last_change":"2024-05-21T01:19:54.549215+0000","last_active":"2024-05-21T01:19:59.572416+0000","last_peered":"2024-05-21T01:19:59.572416+0000","last_clean":"2024-05-21T01:19:59.572416+0000","last_became_active":"2024-05-21T01:19:54.548426+0000","last_became_peered":"2024-05-21T01:19:54.548426+0000","last_unstale":"2024-05-21T01:19:59.572416+0000","last_undegraded":"2024-05-21T01:19:59.572416+0000","last_fullsized":"2024-05-21T01:19:59.572416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:10:10.800391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"25'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.566886+0000","last_change":"2024-05-21T01:19:53.526106+0000","last_active":"2024-05-21T01:19:59.566886+0000","last_peered":"2024-05-21T01:19:59.566886+0000","last_clean":"2024-05-21T01:19:59.566886+0000","last_became_active":"2024-05-21T01:19:53.525786+0000","last_became_peered":"2024-05-21T01:19:53.525786+0000","last_unstale":"2024-05-21T01:19:59.566886+0000","last_undegraded":"2024-05-21T01:19:59.566886+0000","last_fullsized":"2024-05-21T01:19:59.566886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:01:05.180803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.567758+0000","last_change":"2024-05-21T01:19:58.615481+0000","last_active":"2024-05-21T01:19:59.567758+0000","last_peered":"2024-05-21T01:19:59.567758+0000","last_clean":"2024-05-21T01:19:59.567758+0000","last_became_active":"2024-05-21T01:19:58.614879+0000","last_became_peered":"2024-05-21T01:19:58.614879+0000","last_unstale":"2024-05-21T01:19:59.567758+0000","last_undegraded":"2024-05-21T01:19:59.567758+0000","last_fullsized":"2024-05-21T01:19:59.567758+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:45:57.208342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.209731+0000","last_change":"2024-05-21T01:19:54.570650+0000","last_active":"2024-05-21T01:20:00.209731+0000","last_peered":"2024-05-21T01:20:00.209731+0000","last_clean":"2024-05-21T01:20:00.209731+0000","last_became_active":"2024-05-21T01:19:54.570034+0000","last_became_peered":"2024-05-21T01:19:54.570034+0000","last_unstale":"2024-05-21T01:20:00.209731+0000","last_undegraded":"2024-05-21T01:20:00.209731+0000","last_fullsized":"2024-05-21T01:20:00.209731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:01:05.887729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"25'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:30.693111+0000","last_change":"2024-05-21T01:19:53.532017+0000","last_active":"2024-05-21T01:20:30.693111+0000","last_peered":"2024-05-21T01:20:30.693111+0000","last_clean":"2024-05-21T01:20:30.693111+0000","last_became_active":"2024-05-21T01:19:53.529457+0000","last_became_peered":"2024-05-21T01:19:53.529457+0000","last_unstale":"2024-05-21T01:20:30.693111+0000","last_undegraded":"2024-05-21T01:20:30.693111+0000","last_fullsized":"2024-05-21T01:20:30.693111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:58:03.979929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"25'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:30.690025+0000","last_change":"2024-05-21T01:19:53.525620+0000","last_active":"2024-05-21T01:20:30.690025+0000","last_peered":"2024-05-21T01:20:30.690025+0000","last_clean":"2024-05-21T01:20:30.690025+0000","last_became_active":"2024-05-21T01:19:53.525315+0000","last_became_peered":"2024-05-21T01:19:53.525315+0000","last_unstale":"2024-05-21T01:20:30.690025+0000","last_undegraded":"2024-05-21T01:20:30.690025+0000","last_fullsized":"2024-05-21T01:20:30.690025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:30:38.075463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.571359+0000","last_change":"2024-05-21T01:19:54.555344+0000","last_active":"2024-05-21T01:19:59.571359+0000","last_peered":"2024-05-21T01:19:59.571359+0000","last_clean":"2024-05-21T01:19:59.571359+0000","last_became_active":"2024-05-21T01:19:54.552817+0000","last_became_peered":"2024-05-21T01:19:54.552817+0000","last_unstale":"2024-05-21T01:19:59.571359+0000","last_undegraded":"2024-05-21T01:19:59.571359+0000","last_fullsized":"2024-05-21T01:19:59.571359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:10:03.810064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.572198+0000","last_change":"2024-05-21T01:19:58.619520+0000","last_active":"2024-05-21T01:19:59.572198+0000","last_peered":"2024-05-21T01:19:59.572198+0000","last_clean":"2024-05-21T01:19:59.572198+0000","last_became_active":"2024-05-21T01:19:58.617165+0000","last_became_peered":"2024-05-21T01:19:58.617165+0000","last_unstale":"2024-05-21T01:19:59.572198+0000","last_undegraded":"2024-05-21T01:19:59.572198+0000","last_fullsized":"2024-05-21T01:19:59.572198+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T13:07:51.530746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"25'5","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:24.652930+0000","last_change":"2024-05-21T01:19:53.551547+0000","last_active":"2024-05-21T01:20:24.652930+0000","last_peered":"2024-05-21T01:20:24.652930+0000","last_clean":"2024-05-21T01:20:24.652930+0000","last_became_active":"2024-05-21T01:19:53.550931+0000","last_became_peered":"2024-05-21T01:19:53.550931+0000","last_unstale":"2024-05-21T01:20:24.652930+0000","last_undegraded":"2024-05-21T01:20:24.652930+0000","last_fullsized":"2024-05-21T01:20:24.652930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:13:47.329230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.208939+0000","last_change":"2024-05-21T01:19:54.574552+0000","last_active":"2024-05-21T01:20:00.208939+0000","last_peered":"2024-05-21T01:20:00.208939+0000","last_clean":"2024-05-21T01:20:00.208939+0000","last_became_active":"2024-05-21T01:19:54.574246+0000","last_became_peered":"2024-05-21T01:19:54.574246+0000","last_unstale":"2024-05-21T01:20:00.208939+0000","last_undegraded":"2024-05-21T01:20:00.208939+0000","last_fullsized":"2024-05-21T01:20:00.208939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:23:33.685798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.208672+0000","last_change":"2024-05-21T01:19:58.624400+0000","last_active":"2024-05-21T01:20:00.208672+0000","last_peered":"2024-05-21T01:20:00.208672+0000","last_clean":"2024-05-21T01:20:00.208672+0000","last_became_active":"2024-05-21T01:19:58.623388+0000","last_became_peered":"2024-05-21T01:19:58.623388+0000","last_unstale":"2024-05-21T01:20:00.208672+0000","last_undegraded":"2024-05-21T01:20:00.208672+0000","last_fullsized":"2024-05-21T01:20:00.208672+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:59:30.019393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.206641+0000","last_change":"2024-05-21T01:19:54.553262+0000","last_active":"2024-05-21T01:20:00.206641+0000","last_peered":"2024-05-21T01:20:00.206641+0000","last_clean":"2024-05-21T01:20:00.206641+0000","last_became_active":"2024-05-21T01:19:54.553060+0000","last_became_peered":"2024-05-21T01:19:54.553060+0000","last_unstale":"2024-05-21T01:20:00.206641+0000","last_undegraded":"2024-05-21T01:20:00.206641+0000","last_fullsized":"2024-05-21T01:20:00.206641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:18:14.077480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207978+0000","last_change":"2024-05-21T01:19:54.566851+0000","last_active":"2024-05-21T01:20:00.207978+0000","last_peered":"2024-05-21T01:20:00.207978+0000","last_clean":"2024-05-21T01:20:00.207978+0000","last_became_active":"2024-05-21T01:19:54.565573+0000","last_became_peered":"2024-05-21T01:19:54.565573+0000","last_unstale":"2024-05-21T01:20:00.207978+0000","last_undegraded":"2024-05-21T01:20:00.207978+0000","last_fullsized":"2024-05-21T01:20:00.207978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:51:30.883954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.566981+0000","last_change":"2024-05-21T01:19:54.566934+0000","last_active":"2024-05-21T01:19:59.566981+0000","last_peered":"2024-05-21T01:19:59.566981+0000","last_clean":"2024-05-21T01:19:59.566981+0000","last_became_active":"2024-05-21T01:19:54.566503+0000","last_became_peered":"2024-05-21T01:19:54.566503+0000","last_unstale":"2024-05-21T01:19:59.566981+0000","last_undegraded":"2024-05-21T01:19:59.566981+0000","last_fullsized":"2024-05-21T01:19:59.566981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:14:54.262165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.210361+0000","last_change":"2024-05-21T01:19:54.573091+0000","last_active":"2024-05-21T01:20:00.210361+0000","last_peered":"2024-05-21T01:20:00.210361+0000","last_clean":"2024-05-21T01:20:00.210361+0000","last_became_active":"2024-05-21T01:19:54.572366+0000","last_became_peered":"2024-05-21T01:19:54.572366+0000","last_unstale":"2024-05-21T01:20:00.210361+0000","last_undegraded":"2024-05-21T01:20:00.210361+0000","last_fullsized":"2024-05-21T01:20:00.210361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:10:09.353807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.576980+0000","last_change":"2024-05-21T01:19:54.563339+0000","last_active":"2024-05-21T01:19:59.576980+0000","last_peered":"2024-05-21T01:19:59.576980+0000","last_clean":"2024-05-21T01:19:59.576980+0000","last_became_active":"2024-05-21T01:19:54.557934+0000","last_became_peered":"2024-05-21T01:19:54.557934+0000","last_unstale":"2024-05-21T01:19:59.576980+0000","last_undegraded":"2024-05-21T01:19:59.576980+0000","last_fullsized":"2024-05-21T01:19:59.576980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:46:21.598689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.577198+0000","last_change":"2024-05-21T01:19:54.553551+0000","last_active":"2024-05-21T01:19:59.577198+0000","last_peered":"2024-05-21T01:19:59.577198+0000","last_clean":"2024-05-21T01:19:59.577198+0000","last_became_active":"2024-05-21T01:19:54.552812+0000","last_became_peered":"2024-05-21T01:19:54.552812+0000","last_unstale":"2024-05-21T01:19:59.577198+0000","last_undegraded":"2024-05-21T01:19:59.577198+0000","last_fullsized":"2024-05-21T01:19:59.577198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:27:41.166606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207853+0000","last_change":"2024-05-21T01:19:54.548604+0000","last_active":"2024-05-21T01:20:00.207853+0000","last_peered":"2024-05-21T01:20:00.207853+0000","last_clean":"2024-05-21T01:20:00.207853+0000","last_became_active":"2024-05-21T01:19:54.548263+0000","last_became_peered":"2024-05-21T01:19:54.548263+0000","last_unstale":"2024-05-21T01:20:00.207853+0000","last_undegraded":"2024-05-21T01:20:00.207853+0000","last_fullsized":"2024-05-21T01:20:00.207853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:33:55.302088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.211381+0000","last_change":"2024-05-21T01:19:54.573995+0000","last_active":"2024-05-21T01:20:00.211381+0000","last_peered":"2024-05-21T01:20:00.211381+0000","last_clean":"2024-05-21T01:20:00.211381+0000","last_became_active":"2024-05-21T01:19:54.570373+0000","last_became_peered":"2024-05-21T01:19:54.570373+0000","last_unstale":"2024-05-21T01:20:00.211381+0000","last_undegraded":"2024-05-21T01:20:00.211381+0000","last_fullsized":"2024-05-21T01:20:00.211381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:44:23.194713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.566746+0000","last_change":"2024-05-21T01:19:54.575196+0000","last_active":"2024-05-21T01:19:59.566746+0000","last_peered":"2024-05-21T01:19:59.566746+0000","last_clean":"2024-05-21T01:19:59.566746+0000","last_became_active":"2024-05-21T01:19:54.574945+0000","last_became_peered":"2024-05-21T01:19:54.574945+0000","last_unstale":"2024-05-21T01:19:59.566746+0000","last_undegraded":"2024-05-21T01:19:59.566746+0000","last_fullsized":"2024-05-21T01:19:59.566746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:52:56.244771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.209915+0000","last_change":"2024-05-21T01:19:54.566719+0000","last_active":"2024-05-21T01:20:00.209915+0000","last_peered":"2024-05-21T01:20:00.209915+0000","last_clean":"2024-05-21T01:20:00.209915+0000","last_became_active":"2024-05-21T01:19:54.565922+0000","last_became_peered":"2024-05-21T01:19:54.565922+0000","last_unstale":"2024-05-21T01:20:00.209915+0000","last_undegraded":"2024-05-21T01:20:00.209915+0000","last_fullsized":"2024-05-21T01:20:00.209915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:39:19.454688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.208888+0000","last_change":"2024-05-21T01:19:54.536815+0000","last_active":"2024-05-21T01:20:00.208888+0000","last_peered":"2024-05-21T01:20:00.208888+0000","last_clean":"2024-05-21T01:20:00.208888+0000","last_became_active":"2024-05-21T01:19:54.535957+0000","last_became_peered":"2024-05-21T01:19:54.535957+0000","last_unstale":"2024-05-21T01:20:00.208888+0000","last_undegraded":"2024-05-21T01:20:00.208888+0000","last_fullsized":"2024-05-21T01:20:00.208888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:24:53.906256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.571247+0000","last_change":"2024-05-21T01:19:54.552466+0000","last_active":"2024-05-21T01:19:59.571247+0000","last_peered":"2024-05-21T01:19:59.571247+0000","last_clean":"2024-05-21T01:19:59.571247+0000","last_became_active":"2024-05-21T01:19:54.551790+0000","last_became_peered":"2024-05-21T01:19:54.551790+0000","last_unstale":"2024-05-21T01:19:59.571247+0000","last_undegraded":"2024-05-21T01:19:59.571247+0000","last_fullsized":"2024-05-21T01:19:59.571247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:24:34.737707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.206948+0000","last_change":"2024-05-21T01:19:54.535314+0000","last_active":"2024-05-21T01:20:00.206948+0000","last_peered":"2024-05-21T01:20:00.206948+0000","last_clean":"2024-05-21T01:20:00.206948+0000","last_became_active":"2024-05-21T01:19:54.534793+0000","last_became_peered":"2024-05-21T01:19:54.534793+0000","last_unstale":"2024-05-21T01:20:00.206948+0000","last_undegraded":"2024-05-21T01:20:00.206948+0000","last_fullsized":"2024-05-21T01:20:00.206948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:52:35.492250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.568120+0000","last_change":"2024-05-21T01:19:54.556323+0000","last_active":"2024-05-21T01:19:59.568120+0000","last_peered":"2024-05-21T01:19:59.568120+0000","last_clean":"2024-05-21T01:19:59.568120+0000","last_became_active":"2024-05-21T01:19:54.556043+0000","last_became_peered":"2024-05-21T01:19:54.556043+0000","last_unstale":"2024-05-21T01:19:59.568120+0000","last_undegraded":"2024-05-21T01:19:59.568120+0000","last_fullsized":"2024-05-21T01:19:59.568120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:34:02.068527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.209056+0000","last_change":"2024-05-21T01:19:54.567457+0000","last_active":"2024-05-21T01:20:00.209056+0000","last_peered":"2024-05-21T01:20:00.209056+0000","last_clean":"2024-05-21T01:20:00.209056+0000","last_became_active":"2024-05-21T01:19:54.565326+0000","last_became_peered":"2024-05-21T01:19:54.565326+0000","last_unstale":"2024-05-21T01:20:00.209056+0000","last_undegraded":"2024-05-21T01:20:00.209056+0000","last_fullsized":"2024-05-21T01:20:00.209056+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:11:05.775389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.568111+0000","last_change":"2024-05-21T01:19:54.562078+0000","last_active":"2024-05-21T01:19:59.568111+0000","last_peered":"2024-05-21T01:19:59.568111+0000","last_clean":"2024-05-21T01:19:59.568111+0000","last_became_active":"2024-05-21T01:19:54.558286+0000","last_became_peered":"2024-05-21T01:19:54.558286+0000","last_unstale":"2024-05-21T01:19:59.568111+0000","last_undegraded":"2024-05-21T01:19:59.568111+0000","last_fullsized":"2024-05-21T01:19:59.568111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T09:09:58.360014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.566714+0000","last_change":"2024-05-21T01:19:54.548274+0000","last_active":"2024-05-21T01:19:59.566714+0000","last_peered":"2024-05-21T01:19:59.566714+0000","last_clean":"2024-05-21T01:19:59.566714+0000","last_became_active":"2024-05-21T01:19:54.548079+0000","last_became_peered":"2024-05-21T01:19:54.548079+0000","last_unstale":"2024-05-21T01:19:59.566714+0000","last_undegraded":"2024-05-21T01:19:59.566714+0000","last_fullsized":"2024-05-21T01:19:59.566714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:49:03.296571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.209656+0000","last_change":"2024-05-21T01:19:54.568211+0000","last_active":"2024-05-21T01:20:00.209656+0000","last_peered":"2024-05-21T01:20:00.209656+0000","last_clean":"2024-05-21T01:20:00.209656+0000","last_became_active":"2024-05-21T01:19:54.567512+0000","last_became_peered":"2024-05-21T01:19:54.567512+0000","last_unstale":"2024-05-21T01:20:00.209656+0000","last_undegraded":"2024-05-21T01:20:00.209656+0000","last_fullsized":"2024-05-21T01:20:00.209656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:32:18.004763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.575120+0000","last_change":"2024-05-21T01:19:54.556683+0000","last_active":"2024-05-21T01:19:59.575120+0000","last_peered":"2024-05-21T01:19:59.575120+0000","last_clean":"2024-05-21T01:19:59.575120+0000","last_became_active":"2024-05-21T01:19:54.555947+0000","last_became_peered":"2024-05-21T01:19:54.555947+0000","last_unstale":"2024-05-21T01:19:59.575120+0000","last_undegraded":"2024-05-21T01:19:59.575120+0000","last_fullsized":"2024-05-21T01:19:59.575120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:59:04.593946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.575926+0000","last_change":"2024-05-21T01:19:54.560218+0000","last_active":"2024-05-21T01:19:59.575926+0000","last_peered":"2024-05-21T01:19:59.575926+0000","last_clean":"2024-05-21T01:19:59.575926+0000","last_became_active":"2024-05-21T01:19:54.557787+0000","last_became_peered":"2024-05-21T01:19:54.557787+0000","last_unstale":"2024-05-21T01:19:59.575926+0000","last_undegraded":"2024-05-21T01:19:59.575926+0000","last_fullsized":"2024-05-21T01:19:59.575926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:05:48.282563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.206865+0000","last_change":"2024-05-21T01:19:54.535096+0000","last_active":"2024-05-21T01:20:00.206865+0000","last_peered":"2024-05-21T01:20:00.206865+0000","last_clean":"2024-05-21T01:20:00.206865+0000","last_became_active":"2024-05-21T01:19:54.534472+0000","last_became_peered":"2024-05-21T01:19:54.534472+0000","last_unstale":"2024-05-21T01:20:00.206865+0000","last_undegraded":"2024-05-21T01:20:00.206865+0000","last_fullsized":"2024-05-21T01:20:00.206865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:05:40.018457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207495+0000","last_change":"2024-05-21T01:19:54.546352+0000","last_active":"2024-05-21T01:20:00.207495+0000","last_peered":"2024-05-21T01:20:00.207495+0000","last_clean":"2024-05-21T01:20:00.207495+0000","last_became_active":"2024-05-21T01:19:54.546055+0000","last_became_peered":"2024-05-21T01:19:54.546055+0000","last_unstale":"2024-05-21T01:20:00.207495+0000","last_undegraded":"2024-05-21T01:20:00.207495+0000","last_fullsized":"2024-05-21T01:20:00.207495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:14:56.268312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.208385+0000","last_change":"2024-05-21T01:19:54.539886+0000","last_active":"2024-05-21T01:20:00.208385+0000","last_peered":"2024-05-21T01:20:00.208385+0000","last_clean":"2024-05-21T01:20:00.208385+0000","last_became_active":"2024-05-21T01:19:54.539599+0000","last_became_peered":"2024-05-21T01:19:54.539599+0000","last_unstale":"2024-05-21T01:20:00.208385+0000","last_undegraded":"2024-05-21T01:20:00.208385+0000","last_fullsized":"2024-05-21T01:20:00.208385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:08:51.107275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.209668+0000","last_change":"2024-05-21T01:19:54.548954+0000","last_active":"2024-05-21T01:20:00.209668+0000","last_peered":"2024-05-21T01:20:00.209668+0000","last_clean":"2024-05-21T01:20:00.209668+0000","last_became_active":"2024-05-21T01:19:54.547528+0000","last_became_peered":"2024-05-21T01:19:54.547528+0000","last_unstale":"2024-05-21T01:20:00.209668+0000","last_undegraded":"2024-05-21T01:20:00.209668+0000","last_fullsized":"2024-05-21T01:20:00.209668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:47:24.598610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.209472+0000","last_change":"2024-05-21T01:19:54.575256+0000","last_active":"2024-05-21T01:20:00.209472+0000","last_peered":"2024-05-21T01:20:00.209472+0000","last_clean":"2024-05-21T01:20:00.209472+0000","last_became_active":"2024-05-21T01:19:54.570119+0000","last_became_peered":"2024-05-21T01:19:54.570119+0000","last_unstale":"2024-05-21T01:20:00.209472+0000","last_undegraded":"2024-05-21T01:20:00.209472+0000","last_fullsized":"2024-05-21T01:20:00.209472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:10:02.800110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.206200+0000","last_change":"2024-05-21T01:19:54.550134+0000","last_active":"2024-05-21T01:20:00.206200+0000","last_peered":"2024-05-21T01:20:00.206200+0000","last_clean":"2024-05-21T01:20:00.206200+0000","last_became_active":"2024-05-21T01:19:54.549617+0000","last_became_peered":"2024-05-21T01:19:54.549617+0000","last_unstale":"2024-05-21T01:20:00.206200+0000","last_undegraded":"2024-05-21T01:20:00.206200+0000","last_fullsized":"2024-05-21T01:20:00.206200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:34:59.845458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207085+0000","last_change":"2024-05-21T01:19:54.555653+0000","last_active":"2024-05-21T01:20:00.207085+0000","last_peered":"2024-05-21T01:20:00.207085+0000","last_clean":"2024-05-21T01:20:00.207085+0000","last_became_active":"2024-05-21T01:19:54.555274+0000","last_became_peered":"2024-05-21T01:19:54.555274+0000","last_unstale":"2024-05-21T01:20:00.207085+0000","last_undegraded":"2024-05-21T01:20:00.207085+0000","last_fullsized":"2024-05-21T01:20:00.207085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:43:43.237853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207101+0000","last_change":"2024-05-21T01:19:54.568866+0000","last_active":"2024-05-21T01:20:00.207101+0000","last_peered":"2024-05-21T01:20:00.207101+0000","last_clean":"2024-05-21T01:20:00.207101+0000","last_became_active":"2024-05-21T01:19:54.568605+0000","last_became_peered":"2024-05-21T01:19:54.568605+0000","last_unstale":"2024-05-21T01:20:00.207101+0000","last_undegraded":"2024-05-21T01:20:00.207101+0000","last_fullsized":"2024-05-21T01:20:00.207101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:21:20.820620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207281+0000","last_change":"2024-05-21T01:19:54.557468+0000","last_active":"2024-05-21T01:20:00.207281+0000","last_peered":"2024-05-21T01:20:00.207281+0000","last_clean":"2024-05-21T01:20:00.207281+0000","last_became_active":"2024-05-21T01:19:54.554976+0000","last_became_peered":"2024-05-21T01:19:54.554976+0000","last_unstale":"2024-05-21T01:20:00.207281+0000","last_undegraded":"2024-05-21T01:20:00.207281+0000","last_fullsized":"2024-05-21T01:20:00.207281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:25:08.737348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.210942+0000","last_change":"2024-05-21T01:19:54.566991+0000","last_active":"2024-05-21T01:20:00.210942+0000","last_peered":"2024-05-21T01:20:00.210942+0000","last_clean":"2024-05-21T01:20:00.210942+0000","last_became_active":"2024-05-21T01:19:54.566349+0000","last_became_peered":"2024-05-21T01:19:54.566349+0000","last_unstale":"2024-05-21T01:20:00.210942+0000","last_undegraded":"2024-05-21T01:20:00.210942+0000","last_fullsized":"2024-05-21T01:20:00.210942+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:25:43.468081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.211304+0000","last_change":"2024-05-21T01:19:54.576100+0000","last_active":"2024-05-21T01:20:00.211304+0000","last_peered":"2024-05-21T01:20:00.211304+0000","last_clean":"2024-05-21T01:20:00.211304+0000","last_became_active":"2024-05-21T01:19:54.574914+0000","last_became_peered":"2024-05-21T01:19:54.574914+0000","last_unstale":"2024-05-21T01:20:00.211304+0000","last_undegraded":"2024-05-21T01:20:00.211304+0000","last_fullsized":"2024-05-21T01:20:00.211304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:29:30.730283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.208436+0000","last_change":"2024-05-21T01:19:54.546570+0000","last_active":"2024-05-21T01:20:00.208436+0000","last_peered":"2024-05-21T01:20:00.208436+0000","last_clean":"2024-05-21T01:20:00.208436+0000","last_became_active":"2024-05-21T01:19:54.546284+0000","last_became_peered":"2024-05-21T01:19:54.546284+0000","last_unstale":"2024-05-21T01:20:00.208436+0000","last_undegraded":"2024-05-21T01:20:00.208436+0000","last_fullsized":"2024-05-21T01:20:00.208436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:36:30.219522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":7452,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":14904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66932,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509455,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":104037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509454,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":106687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509453,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":331776,"data_stored":693339,"data_compressed":33466,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509453,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":104127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542158,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":270336,"data_stored":104015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542157,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":344064,"data_stored":693983,"data_compressed":33466,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574861,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":103719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574861,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":108221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33466,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33466,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":5410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-21T01:20:40.753 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-21T01:20:40.753 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-21T01:20:40.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.929+0000 7f9c5f600640 1 Processor -- start 2024-05-21T01:20:40.936 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.929+0000 7f9c5f600640 1 -- start start 2024-05-21T01:20:40.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.933+0000 7f9c5f600640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9c58156150 0x7f9c5815bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:40.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.933+0000 7f9c5f600640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9c5806d5b0 0x7f9c5806da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:40.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.933+0000 7f9c5f600640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c5806f510 con 0x7f9c58073480 2024-05-21T01:20:40.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.933+0000 7f9c5f600640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f9c58070a20 con 0x7f9c58156150 2024-05-21T01:20:40.938 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.933+0000 7f9c5f600640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f9c58073ac0 con 0x7f9c5806d5b0 2024-05-21T01:20:40.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.933+0000 7f9c5cc00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9c58156150 0x7f9c5815bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:40.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.933+0000 7f9c5cc00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9c58156150 0x7f9c5815bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38260/0 (socket says 172.21.15.63:38260) 2024-05-21T01:20:40.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.933+0000 7f9c4fe00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f9c58073480 0x7f9c58071190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:38942/0 (socket says 172.21.15.63:38942) 2024-05-21T01:20:40.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.933+0000 7f9c5cc00640 1 -- 172.21.15.63:0/2473561845 learned_addr learned my addr 172.21.15.63:0/2473561845 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:40.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.933+0000 7f9c5d600640 1 --2- 172.21.15.63:0/2473561845 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9c5806d5b0 0x7f9c5806da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:40.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.933+0000 7f9c5cc00640 1 -- 172.21.15.63:0/2473561845 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9c5806d5b0 msgr2=0x7f9c5806da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:40.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.933+0000 7f9c5cc00640 1 --2- 172.21.15.63:0/2473561845 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9c5806d5b0 0x7f9c5806da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:40.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.933+0000 7f9c5cc00640 1 -- 172.21.15.63:0/2473561845 >> v1:172.21.15.63:6789/0 conn(0x7f9c58073480 legacy=0x7f9c58071190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:40.939 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.933+0000 7f9c5cc00640 1 -- 172.21.15.63:0/2473561845 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c58073da0 con 0x7f9c58156150 2024-05-21T01:20:40.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.937+0000 7f9c5cc00640 1 --2- 172.21.15.63:0/2473561845 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c58156150 0x7f9c5815bd30 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f9c58070ba0 tx=0x7f9c4801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24fe309bc45a48b1 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:40.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.937+0000 7f9c57e00640 1 -- 172.21.15.63:0/2473561845 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c480b0070 con 0x7f9c58156150 2024-05-21T01:20:40.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.937+0000 7f9c57e00640 1 -- 172.21.15.63:0/2473561845 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c480ab600 con 0x7f9c58156150 2024-05-21T01:20:40.941 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.937+0000 7f9c57e00640 1 -- 172.21.15.63:0/2473561845 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c480ab9d0 con 0x7f9c58156150 2024-05-21T01:20:40.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.937+0000 7f9c5f600640 1 -- 172.21.15.63:0/2473561845 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c58156150 msgr2=0x7f9c5815bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:40.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.937+0000 7f9c5f600640 1 --2- 172.21.15.63:0/2473561845 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c58156150 0x7f9c5815bd30 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f9c58070ba0 tx=0x7f9c4801c4b0 comp rx=0 tx=0).stop 2024-05-21T01:20:40.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.937+0000 7f9c5f600640 1 -- 172.21.15.63:0/2473561845 shutdown_connections 2024-05-21T01:20:40.942 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.937+0000 7f9c5f600640 1 --2- 172.21.15.63:0/2473561845 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9c5806d5b0 0x7f9c5806da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:40.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.937+0000 7f9c5f600640 1 --2- 172.21.15.63:0/2473561845 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c58156150 0x7f9c5815bd30 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:40.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.937+0000 7f9c5f600640 1 -- 172.21.15.63:0/2473561845 >> 172.21.15.63:0/2473561845 conn(0x7f9c580cbf10 msgr2=0x7f9c580cc320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:40.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.937+0000 7f9c5f600640 1 -- 172.21.15.63:0/2473561845 shutdown_connections 2024-05-21T01:20:40.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.937+0000 7f9c5f600640 1 -- 172.21.15.63:0/2473561845 wait complete. 2024-05-21T01:20:40.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.937+0000 7f9c5f600640 1 Processor -- start 2024-05-21T01:20:40.943 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.937+0000 7f9c5f600640 1 -- start start 2024-05-21T01:20:40.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.941+0000 7f9c5f600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c5806d5b0 0x7f9c58147780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:40.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.941+0000 7f9c5f600640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9c58073480 0x7f9c581f83b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:40.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.941+0000 7f9c5f600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9c58156150 0x7f9c580cf590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:40.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.941+0000 7f9c5f600640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f9c58071a20 con 0x7f9c5806d5b0 2024-05-21T01:20:40.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.941+0000 7f9c5f600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f9c580718a0 con 0x7f9c58156150 2024-05-21T01:20:40.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.941+0000 7f9c5f600640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f9c58168ed0 con 0x7f9c58073480 2024-05-21T01:20:40.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.941+0000 7f9c5cc00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c5806d5b0 0x7f9c58147780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:40.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.941+0000 7f9c5cc00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c5806d5b0 0x7f9c58147780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38266/0 (socket says 172.21.15.63:38266) 2024-05-21T01:20:40.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.941+0000 7f9c5cc00640 1 -- 172.21.15.63:0/3326253091 learned_addr learned my addr 172.21.15.63:0/3326253091 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:40.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.941+0000 7f9c5d600640 1 --2- 172.21.15.63:0/3326253091 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9c58156150 0x7f9c580cf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:40.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.941+0000 7f9c4fe00640 1 --2- 172.21.15.63:0/3326253091 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9c58073480 0x7f9c581f83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:40.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.941+0000 7f9c5cc00640 1 -- 172.21.15.63:0/3326253091 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9c58073480 msgr2=0x7f9c581f83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:40.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.941+0000 7f9c5cc00640 1 --2- 172.21.15.63:0/3326253091 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9c58073480 0x7f9c581f83b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:40.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.941+0000 7f9c5cc00640 1 -- 172.21.15.63:0/3326253091 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9c58156150 msgr2=0x7f9c580cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:40.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.941+0000 7f9c5cc00640 1 --2- 172.21.15.63:0/3326253091 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9c58156150 0x7f9c580cf590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:40.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.941+0000 7f9c5cc00640 1 -- 172.21.15.63:0/3326253091 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c58156df0 con 0x7f9c5806d5b0 2024-05-21T01:20:40.946 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.941+0000 7f9c5cc00640 1 --2- 172.21.15.63:0/3326253091 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c5806d5b0 0x7f9c58147780 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9c480ae040 tx=0x7f9c4801acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:40.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.941+0000 7f9c55600640 1 -- 172.21.15.63:0/3326253091 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c480b0040 con 0x7f9c5806d5b0 2024-05-21T01:20:40.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.941+0000 7f9c55600640 1 -- 172.21.15.63:0/3326253091 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c480bc070 con 0x7f9c5806d5b0 2024-05-21T01:20:40.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.941+0000 7f9c55600640 1 -- 172.21.15.63:0/3326253091 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c480b6880 con 0x7f9c5806d5b0 2024-05-21T01:20:40.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.941+0000 7f9c5f600640 1 -- 172.21.15.63:0/3326253091 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c58156b10 con 0x7f9c5806d5b0 2024-05-21T01:20:40.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.941+0000 7f9c5f600640 1 -- 172.21.15.63:0/3326253091 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c581f5230 con 0x7f9c5806d5b0 2024-05-21T01:20:40.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.941+0000 7f9c5f600640 1 -- 172.21.15.63:0/3326253091 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c580507f0 con 0x7f9c5806d5b0 2024-05-21T01:20:40.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.941+0000 7f9c55600640 1 -- 172.21.15.63:0/3326253091 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7f9c480ab480 con 0x7f9c5806d5b0 2024-05-21T01:20:40.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.945+0000 7f9c55600640 1 --2- 172.21.15.63:0/3326253091 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f9c3406f400 0x7f9c340718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:40.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.945+0000 7f9c55600640 1 -- 172.21.15.63:0/3326253091 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f9c48129880 con 0x7f9c5806d5b0 2024-05-21T01:20:40.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.945+0000 7f9c4fe00640 1 --2- 172.21.15.63:0/3326253091 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f9c3406f400 0x7f9c340718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:40.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.945+0000 7f9c4fe00640 1 --2- 172.21.15.63:0/3326253091 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f9c3406f400 0x7f9c340718c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9c580d0320 tx=0x7f9c40007c90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:40.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:40.949+0000 7f9c55600640 1 -- 172.21.15.63:0/3326253091 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f9c48016130 con 0x7f9c5806d5b0 2024-05-21T01:20:41.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.109+0000 7f9c5f600640 1 -- 172.21.15.63:0/3326253091 --> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9c580ca260 con 0x7f9c3406f400 2024-05-21T01:20:41.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.133+0000 7f9c55600640 1 -- 172.21.15.63:0/3326253091 <== mgr.4103 v2:172.21.15.131:6832/921953667 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332688 (secure 0 0 0) 0x7f9c580ca260 con 0x7f9c3406f400 2024-05-21T01:20:41.140 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-05-21T01:20:41.142 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-05-21T01:20:41.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.137+0000 7f9c5f600640 1 -- 172.21.15.63:0/3326253091 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f9c3406f400 msgr2=0x7f9c340718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:41.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.137+0000 7f9c5f600640 1 --2- 172.21.15.63:0/3326253091 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f9c3406f400 0x7f9c340718c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9c580d0320 tx=0x7f9c40007c90 comp rx=0 tx=0).stop 2024-05-21T01:20:41.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.137+0000 7f9c5f600640 1 -- 172.21.15.63:0/3326253091 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c5806d5b0 msgr2=0x7f9c58147780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:41.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.137+0000 7f9c5f600640 1 --2- 172.21.15.63:0/3326253091 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c5806d5b0 0x7f9c58147780 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9c480ae040 tx=0x7f9c4801acf0 comp rx=0 tx=0).stop 2024-05-21T01:20:41.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.137+0000 7f9c5f600640 1 -- 172.21.15.63:0/3326253091 shutdown_connections 2024-05-21T01:20:41.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.137+0000 7f9c5f600640 1 --2- 172.21.15.63:0/3326253091 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f9c3406f400 0x7f9c340718c0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:41.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.137+0000 7f9c5f600640 1 --2- 172.21.15.63:0/3326253091 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9c58156150 0x7f9c580cf590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:41.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.137+0000 7f9c5f600640 1 --2- 172.21.15.63:0/3326253091 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9c58073480 0x7f9c581f83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:41.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.137+0000 7f9c5f600640 1 --2- 172.21.15.63:0/3326253091 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c5806d5b0 0x7f9c58147780 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:41.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.137+0000 7f9c5f600640 1 -- 172.21.15.63:0/3326253091 >> 172.21.15.63:0/3326253091 conn(0x7f9c580cbf10 msgr2=0x7f9c580ca850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:41.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.137+0000 7f9c5f600640 1 -- 172.21.15.63:0/3326253091 shutdown_connections 2024-05-21T01:20:41.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.137+0000 7f9c5f600640 1 -- 172.21.15.63:0/3326253091 wait complete. 2024-05-21T01:20:41.161 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":45,"stamp":"2024-05-21T01:20:40.449861+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597820,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":229,"num_write_kb":1670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":184,"ondisk_log_size":184,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218432,"kb_used_data":2304,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756288,"statfs":{"total":773094113280,"available":772870438912,"internally_reserved":0,"allocated":2359296,"data_stored":2018128,"data_compressed":66932,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1496,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005072"},"pg_stats":[{"pgid":"2.1f","version":"25'9","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:30.697944+0000","last_change":"2024-05-21T01:19:53.545236+0000","last_active":"2024-05-21T01:20:30.697944+0000","last_peered":"2024-05-21T01:20:30.697944+0000","last_clean":"2024-05-21T01:20:30.697944+0000","last_became_active":"2024-05-21T01:19:53.544469+0000","last_became_peered":"2024-05-21T01:19:53.544469+0000","last_unstale":"2024-05-21T01:20:30.697944+0000","last_undegraded":"2024-05-21T01:20:30.697944+0000","last_fullsized":"2024-05-21T01:20:30.697944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:33:09.421287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.211552+0000","last_change":"2024-05-21T01:19:54.568235+0000","last_active":"2024-05-21T01:20:00.211552+0000","last_peered":"2024-05-21T01:20:00.211552+0000","last_clean":"2024-05-21T01:20:00.211552+0000","last_became_active":"2024-05-21T01:19:54.567245+0000","last_became_peered":"2024-05-21T01:19:54.567245+0000","last_unstale":"2024-05-21T01:20:00.211552+0000","last_undegraded":"2024-05-21T01:20:00.211552+0000","last_fullsized":"2024-05-21T01:20:00.211552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:39:51.222819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207912+0000","last_change":"2024-05-21T01:19:58.618772+0000","last_active":"2024-05-21T01:20:00.207912+0000","last_peered":"2024-05-21T01:20:00.207912+0000","last_clean":"2024-05-21T01:20:00.207912+0000","last_became_active":"2024-05-21T01:19:58.617757+0000","last_became_peered":"2024-05-21T01:19:58.617757+0000","last_unstale":"2024-05-21T01:20:00.207912+0000","last_undegraded":"2024-05-21T01:20:00.207912+0000","last_fullsized":"2024-05-21T01:20:00.207912+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T13:07:31.666521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"25'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.211964+0000","last_change":"2024-05-21T01:19:53.551775+0000","last_active":"2024-05-21T01:20:00.211964+0000","last_peered":"2024-05-21T01:20:00.211964+0000","last_clean":"2024-05-21T01:20:00.211964+0000","last_became_active":"2024-05-21T01:19:53.551049+0000","last_became_peered":"2024-05-21T01:19:53.551049+0000","last_unstale":"2024-05-21T01:20:00.211964+0000","last_undegraded":"2024-05-21T01:20:00.211964+0000","last_fullsized":"2024-05-21T01:20:00.211964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:49:02.289202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.211755+0000","last_change":"2024-05-21T01:19:54.573420+0000","last_active":"2024-05-21T01:20:00.211755+0000","last_peered":"2024-05-21T01:20:00.211755+0000","last_clean":"2024-05-21T01:20:00.211755+0000","last_became_active":"2024-05-21T01:19:54.569573+0000","last_became_peered":"2024-05-21T01:19:54.569573+0000","last_unstale":"2024-05-21T01:20:00.211755+0000","last_undegraded":"2024-05-21T01:20:00.211755+0000","last_fullsized":"2024-05-21T01:20:00.211755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:00:12.257816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.206470+0000","last_change":"2024-05-21T01:19:58.604490+0000","last_active":"2024-05-21T01:20:00.206470+0000","last_peered":"2024-05-21T01:20:00.206470+0000","last_clean":"2024-05-21T01:20:00.206470+0000","last_became_active":"2024-05-21T01:19:58.604108+0000","last_became_peered":"2024-05-21T01:19:58.604108+0000","last_unstale":"2024-05-21T01:20:00.206470+0000","last_undegraded":"2024-05-21T01:20:00.206470+0000","last_fullsized":"2024-05-21T01:20:00.206470+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:11:10.963073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"25'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:30.691629+0000","last_change":"2024-05-21T01:19:53.525403+0000","last_active":"2024-05-21T01:20:30.691629+0000","last_peered":"2024-05-21T01:20:30.691629+0000","last_clean":"2024-05-21T01:20:30.691629+0000","last_became_active":"2024-05-21T01:19:53.521265+0000","last_became_peered":"2024-05-21T01:19:53.521265+0000","last_unstale":"2024-05-21T01:20:30.691629+0000","last_undegraded":"2024-05-21T01:20:30.691629+0000","last_fullsized":"2024-05-21T01:20:30.691629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:52:16.488269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.209201+0000","last_change":"2024-05-21T01:19:54.536436+0000","last_active":"2024-05-21T01:20:00.209201+0000","last_peered":"2024-05-21T01:20:00.209201+0000","last_clean":"2024-05-21T01:20:00.209201+0000","last_became_active":"2024-05-21T01:19:54.536061+0000","last_became_peered":"2024-05-21T01:19:54.536061+0000","last_unstale":"2024-05-21T01:20:00.209201+0000","last_undegraded":"2024-05-21T01:20:00.209201+0000","last_fullsized":"2024-05-21T01:20:00.209201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:48:23.811712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.206960+0000","last_change":"2024-05-21T01:19:58.623087+0000","last_active":"2024-05-21T01:20:00.206960+0000","last_peered":"2024-05-21T01:20:00.206960+0000","last_clean":"2024-05-21T01:20:00.206960+0000","last_became_active":"2024-05-21T01:19:58.622672+0000","last_became_peered":"2024-05-21T01:19:58.622672+0000","last_unstale":"2024-05-21T01:20:00.206960+0000","last_undegraded":"2024-05-21T01:20:00.206960+0000","last_fullsized":"2024-05-21T01:20:00.206960+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:45:49.241750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207109+0000","last_change":"2024-05-21T01:19:53.522497+0000","last_active":"2024-05-21T01:20:00.207109+0000","last_peered":"2024-05-21T01:20:00.207109+0000","last_clean":"2024-05-21T01:20:00.207109+0000","last_became_active":"2024-05-21T01:19:53.521684+0000","last_became_peered":"2024-05-21T01:19:53.521684+0000","last_unstale":"2024-05-21T01:20:00.207109+0000","last_undegraded":"2024-05-21T01:20:00.207109+0000","last_fullsized":"2024-05-21T01:20:00.207109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:18:17.808255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.567660+0000","last_change":"2024-05-21T01:19:54.549512+0000","last_active":"2024-05-21T01:19:59.567660+0000","last_peered":"2024-05-21T01:19:59.567660+0000","last_clean":"2024-05-21T01:19:59.567660+0000","last_became_active":"2024-05-21T01:19:54.549291+0000","last_became_peered":"2024-05-21T01:19:54.549291+0000","last_unstale":"2024-05-21T01:19:59.567660+0000","last_undegraded":"2024-05-21T01:19:59.567660+0000","last_fullsized":"2024-05-21T01:19:59.567660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:48:34.571236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.206754+0000","last_change":"2024-05-21T01:19:58.614748+0000","last_active":"2024-05-21T01:20:00.206754+0000","last_peered":"2024-05-21T01:20:00.206754+0000","last_clean":"2024-05-21T01:20:00.206754+0000","last_became_active":"2024-05-21T01:19:58.614313+0000","last_became_peered":"2024-05-21T01:19:58.614313+0000","last_unstale":"2024-05-21T01:20:00.206754+0000","last_undegraded":"2024-05-21T01:20:00.206754+0000","last_fullsized":"2024-05-21T01:20:00.206754+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:45:34.204591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.567029+0000","last_change":"2024-05-21T01:19:54.545467+0000","last_active":"2024-05-21T01:19:59.567029+0000","last_peered":"2024-05-21T01:19:59.567029+0000","last_clean":"2024-05-21T01:19:59.567029+0000","last_became_active":"2024-05-21T01:19:54.545181+0000","last_became_peered":"2024-05-21T01:19:54.545181+0000","last_unstale":"2024-05-21T01:19:59.567029+0000","last_undegraded":"2024-05-21T01:19:59.567029+0000","last_fullsized":"2024-05-21T01:19:59.567029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:43:15.387067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"25'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:24.666732+0000","last_change":"2024-05-21T01:19:53.536139+0000","last_active":"2024-05-21T01:20:24.666732+0000","last_peered":"2024-05-21T01:20:24.666732+0000","last_clean":"2024-05-21T01:20:24.666732+0000","last_became_active":"2024-05-21T01:19:53.535899+0000","last_became_peered":"2024-05-21T01:19:53.535899+0000","last_unstale":"2024-05-21T01:20:24.666732+0000","last_undegraded":"2024-05-21T01:20:24.666732+0000","last_fullsized":"2024-05-21T01:20:24.666732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:40:12.033744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.567390+0000","last_change":"2024-05-21T01:19:58.621487+0000","last_active":"2024-05-21T01:19:59.567390+0000","last_peered":"2024-05-21T01:19:59.567390+0000","last_clean":"2024-05-21T01:19:59.567390+0000","last_became_active":"2024-05-21T01:19:58.621083+0000","last_became_peered":"2024-05-21T01:19:58.621083+0000","last_unstale":"2024-05-21T01:19:59.567390+0000","last_undegraded":"2024-05-21T01:19:59.567390+0000","last_fullsized":"2024-05-21T01:19:59.567390+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:18:44.587274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.208662+0000","last_change":"2024-05-21T01:19:54.572420+0000","last_active":"2024-05-21T01:20:00.208662+0000","last_peered":"2024-05-21T01:20:00.208662+0000","last_clean":"2024-05-21T01:20:00.208662+0000","last_became_active":"2024-05-21T01:19:54.571863+0000","last_became_peered":"2024-05-21T01:19:54.571863+0000","last_unstale":"2024-05-21T01:20:00.208662+0000","last_undegraded":"2024-05-21T01:20:00.208662+0000","last_fullsized":"2024-05-21T01:20:00.208662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:13:52.491903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"25'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.575460+0000","last_change":"2024-05-21T01:19:53.553351+0000","last_active":"2024-05-21T01:19:59.575460+0000","last_peered":"2024-05-21T01:19:59.575460+0000","last_clean":"2024-05-21T01:19:59.575460+0000","last_became_active":"2024-05-21T01:19:53.552694+0000","last_became_peered":"2024-05-21T01:19:53.552694+0000","last_unstale":"2024-05-21T01:19:59.575460+0000","last_undegraded":"2024-05-21T01:19:59.575460+0000","last_fullsized":"2024-05-21T01:19:59.575460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:46:55.273278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.206544+0000","last_change":"2024-05-21T01:19:58.594904+0000","last_active":"2024-05-21T01:20:00.206544+0000","last_peered":"2024-05-21T01:20:00.206544+0000","last_clean":"2024-05-21T01:20:00.206544+0000","last_became_active":"2024-05-21T01:19:58.594450+0000","last_became_peered":"2024-05-21T01:19:58.594450+0000","last_unstale":"2024-05-21T01:20:00.206544+0000","last_undegraded":"2024-05-21T01:20:00.206544+0000","last_fullsized":"2024-05-21T01:20:00.206544+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:37:30.286986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.571649+0000","last_change":"2024-05-21T01:19:54.554750+0000","last_active":"2024-05-21T01:19:59.571649+0000","last_peered":"2024-05-21T01:19:59.571649+0000","last_clean":"2024-05-21T01:19:59.571649+0000","last_became_active":"2024-05-21T01:19:54.551583+0000","last_became_peered":"2024-05-21T01:19:54.551583+0000","last_unstale":"2024-05-21T01:19:59.571649+0000","last_undegraded":"2024-05-21T01:19:59.571649+0000","last_fullsized":"2024-05-21T01:19:59.571649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:37:19.564099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"25'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:24.662369+0000","last_change":"2024-05-21T01:19:53.523277+0000","last_active":"2024-05-21T01:20:24.662369+0000","last_peered":"2024-05-21T01:20:24.662369+0000","last_clean":"2024-05-21T01:20:24.662369+0000","last_became_active":"2024-05-21T01:19:53.522525+0000","last_became_peered":"2024-05-21T01:19:53.522525+0000","last_unstale":"2024-05-21T01:20:24.662369+0000","last_undegraded":"2024-05-21T01:20:24.662369+0000","last_fullsized":"2024-05-21T01:20:24.662369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:23:59.949781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.209007+0000","last_change":"2024-05-21T01:19:58.615575+0000","last_active":"2024-05-21T01:20:00.209007+0000","last_peered":"2024-05-21T01:20:00.209007+0000","last_clean":"2024-05-21T01:20:00.209007+0000","last_became_active":"2024-05-21T01:19:58.614401+0000","last_became_peered":"2024-05-21T01:19:58.614401+0000","last_unstale":"2024-05-21T01:20:00.209007+0000","last_undegraded":"2024-05-21T01:20:00.209007+0000","last_fullsized":"2024-05-21T01:20:00.209007+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:51:09.839503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.566770+0000","last_change":"2024-05-21T01:19:54.555489+0000","last_active":"2024-05-21T01:19:59.566770+0000","last_peered":"2024-05-21T01:19:59.566770+0000","last_clean":"2024-05-21T01:19:59.566770+0000","last_became_active":"2024-05-21T01:19:54.555227+0000","last_became_peered":"2024-05-21T01:19:54.555227+0000","last_unstale":"2024-05-21T01:19:59.566770+0000","last_undegraded":"2024-05-21T01:19:59.566770+0000","last_fullsized":"2024-05-21T01:19:59.566770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:00:22.873520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"25'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:24.663101+0000","last_change":"2024-05-21T01:19:53.520840+0000","last_active":"2024-05-21T01:20:24.663101+0000","last_peered":"2024-05-21T01:20:24.663101+0000","last_clean":"2024-05-21T01:20:24.663101+0000","last_became_active":"2024-05-21T01:19:53.520540+0000","last_became_peered":"2024-05-21T01:19:53.520540+0000","last_unstale":"2024-05-21T01:20:24.663101+0000","last_undegraded":"2024-05-21T01:20:24.663101+0000","last_fullsized":"2024-05-21T01:20:24.663101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:08:36.426465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207823+0000","last_change":"2024-05-21T01:19:58.604357+0000","last_active":"2024-05-21T01:20:00.207823+0000","last_peered":"2024-05-21T01:20:00.207823+0000","last_clean":"2024-05-21T01:20:00.207823+0000","last_became_active":"2024-05-21T01:19:58.603922+0000","last_became_peered":"2024-05-21T01:19:58.603922+0000","last_unstale":"2024-05-21T01:20:00.207823+0000","last_undegraded":"2024-05-21T01:20:00.207823+0000","last_fullsized":"2024-05-21T01:20:00.207823+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:55:18.226031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.572430+0000","last_change":"2024-05-21T01:19:54.569315+0000","last_active":"2024-05-21T01:19:59.572430+0000","last_peered":"2024-05-21T01:19:59.572430+0000","last_clean":"2024-05-21T01:19:59.572430+0000","last_became_active":"2024-05-21T01:19:54.568232+0000","last_became_peered":"2024-05-21T01:19:54.568232+0000","last_unstale":"2024-05-21T01:19:59.572430+0000","last_undegraded":"2024-05-21T01:19:59.572430+0000","last_fullsized":"2024-05-21T01:19:59.572430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:19:01.819418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"25'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:24.660940+0000","last_change":"2024-05-21T01:19:53.525301+0000","last_active":"2024-05-21T01:20:24.660940+0000","last_peered":"2024-05-21T01:20:24.660940+0000","last_clean":"2024-05-21T01:20:24.660940+0000","last_became_active":"2024-05-21T01:19:53.525010+0000","last_became_peered":"2024-05-21T01:19:53.525010+0000","last_unstale":"2024-05-21T01:20:24.660940+0000","last_undegraded":"2024-05-21T01:20:24.660940+0000","last_fullsized":"2024-05-21T01:20:24.660940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:53:11.316975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.206622+0000","last_change":"2024-05-21T01:19:58.590354+0000","last_active":"2024-05-21T01:20:00.206622+0000","last_peered":"2024-05-21T01:20:00.206622+0000","last_clean":"2024-05-21T01:20:00.206622+0000","last_became_active":"2024-05-21T01:19:58.589985+0000","last_became_peered":"2024-05-21T01:19:58.589985+0000","last_unstale":"2024-05-21T01:20:00.206622+0000","last_undegraded":"2024-05-21T01:20:00.206622+0000","last_fullsized":"2024-05-21T01:20:00.206622+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:08:09.222858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.573671+0000","last_change":"2024-05-21T01:19:54.555318+0000","last_active":"2024-05-21T01:19:59.573671+0000","last_peered":"2024-05-21T01:19:59.573671+0000","last_clean":"2024-05-21T01:19:59.573671+0000","last_became_active":"2024-05-21T01:19:54.552947+0000","last_became_peered":"2024-05-21T01:19:54.552947+0000","last_unstale":"2024-05-21T01:19:59.573671+0000","last_undegraded":"2024-05-21T01:19:59.573671+0000","last_fullsized":"2024-05-21T01:19:59.573671+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:29:24.153986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"25'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:30.692794+0000","last_change":"2024-05-21T01:19:53.525004+0000","last_active":"2024-05-21T01:20:30.692794+0000","last_peered":"2024-05-21T01:20:30.692794+0000","last_clean":"2024-05-21T01:20:30.692794+0000","last_became_active":"2024-05-21T01:19:53.521014+0000","last_became_peered":"2024-05-21T01:19:53.521014+0000","last_unstale":"2024-05-21T01:20:30.692794+0000","last_undegraded":"2024-05-21T01:20:30.692794+0000","last_fullsized":"2024-05-21T01:20:30.692794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:02:46.668320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.571502+0000","last_change":"2024-05-21T01:19:58.599880+0000","last_active":"2024-05-21T01:19:59.571502+0000","last_peered":"2024-05-21T01:19:59.571502+0000","last_clean":"2024-05-21T01:19:59.571502+0000","last_became_active":"2024-05-21T01:19:58.598712+0000","last_became_peered":"2024-05-21T01:19:58.598712+0000","last_unstale":"2024-05-21T01:19:59.571502+0000","last_undegraded":"2024-05-21T01:19:59.571502+0000","last_fullsized":"2024-05-21T01:19:59.571502+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:43:05.995986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.577134+0000","last_change":"2024-05-21T01:19:54.576044+0000","last_active":"2024-05-21T01:19:59.577134+0000","last_peered":"2024-05-21T01:19:59.577134+0000","last_clean":"2024-05-21T01:19:59.577134+0000","last_became_active":"2024-05-21T01:19:54.575543+0000","last_became_peered":"2024-05-21T01:19:54.575543+0000","last_unstale":"2024-05-21T01:19:59.577134+0000","last_undegraded":"2024-05-21T01:19:59.577134+0000","last_fullsized":"2024-05-21T01:19:59.577134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T09:33:07.188470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"25'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.568216+0000","last_change":"2024-05-21T01:19:53.543705+0000","last_active":"2024-05-21T01:19:59.568216+0000","last_peered":"2024-05-21T01:19:59.568216+0000","last_clean":"2024-05-21T01:19:59.568216+0000","last_became_active":"2024-05-21T01:19:53.543450+0000","last_became_peered":"2024-05-21T01:19:53.543450+0000","last_unstale":"2024-05-21T01:19:59.568216+0000","last_undegraded":"2024-05-21T01:19:59.568216+0000","last_fullsized":"2024-05-21T01:19:59.568216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:05:49.465156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.575415+0000","last_change":"2024-05-21T01:19:58.612049+0000","last_active":"2024-05-21T01:19:59.575415+0000","last_peered":"2024-05-21T01:19:59.575415+0000","last_clean":"2024-05-21T01:19:59.575415+0000","last_became_active":"2024-05-21T01:19:58.610837+0000","last_became_peered":"2024-05-21T01:19:58.610837+0000","last_unstale":"2024-05-21T01:19:59.575415+0000","last_undegraded":"2024-05-21T01:19:59.575415+0000","last_fullsized":"2024-05-21T01:19:59.575415+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:24:14.332056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207496+0000","last_change":"2024-05-21T01:19:54.553083+0000","last_active":"2024-05-21T01:20:00.207496+0000","last_peered":"2024-05-21T01:20:00.207496+0000","last_clean":"2024-05-21T01:20:00.207496+0000","last_became_active":"2024-05-21T01:19:54.552812+0000","last_became_peered":"2024-05-21T01:19:54.552812+0000","last_unstale":"2024-05-21T01:20:00.207496+0000","last_undegraded":"2024-05-21T01:20:00.207496+0000","last_fullsized":"2024-05-21T01:20:00.207496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:37:25.835345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.210838+0000","last_change":"2024-05-21T01:19:53.551697+0000","last_active":"2024-05-21T01:20:00.210838+0000","last_peered":"2024-05-21T01:20:00.210838+0000","last_clean":"2024-05-21T01:20:00.210838+0000","last_became_active":"2024-05-21T01:19:53.550921+0000","last_became_peered":"2024-05-21T01:19:53.550921+0000","last_unstale":"2024-05-21T01:20:00.210838+0000","last_undegraded":"2024-05-21T01:20:00.210838+0000","last_fullsized":"2024-05-21T01:20:00.210838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T09:31:31.996638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.571559+0000","last_change":"2024-05-21T01:19:58.626472+0000","last_active":"2024-05-21T01:19:59.571559+0000","last_peered":"2024-05-21T01:19:59.571559+0000","last_clean":"2024-05-21T01:19:59.571559+0000","last_became_active":"2024-05-21T01:19:58.625720+0000","last_became_peered":"2024-05-21T01:19:58.625720+0000","last_unstale":"2024-05-21T01:19:59.571559+0000","last_undegraded":"2024-05-21T01:19:59.571559+0000","last_fullsized":"2024-05-21T01:19:59.571559+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:16:03.911585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207190+0000","last_change":"2024-05-21T01:19:54.547947+0000","last_active":"2024-05-21T01:20:00.207190+0000","last_peered":"2024-05-21T01:20:00.207190+0000","last_clean":"2024-05-21T01:20:00.207190+0000","last_became_active":"2024-05-21T01:19:54.547689+0000","last_became_peered":"2024-05-21T01:19:54.547689+0000","last_unstale":"2024-05-21T01:20:00.207190+0000","last_undegraded":"2024-05-21T01:20:00.207190+0000","last_fullsized":"2024-05-21T01:20:00.207190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:40:55.985899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"25'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.567398+0000","last_change":"2024-05-21T01:19:53.540973+0000","last_active":"2024-05-21T01:19:59.567398+0000","last_peered":"2024-05-21T01:19:59.567398+0000","last_clean":"2024-05-21T01:19:59.567398+0000","last_became_active":"2024-05-21T01:19:53.540670+0000","last_became_peered":"2024-05-21T01:19:53.540670+0000","last_unstale":"2024-05-21T01:19:59.567398+0000","last_undegraded":"2024-05-21T01:19:59.567398+0000","last_fullsized":"2024-05-21T01:19:59.567398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:08:21.802284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.576864+0000","last_change":"2024-05-21T01:19:58.611280+0000","last_active":"2024-05-21T01:19:59.576864+0000","last_peered":"2024-05-21T01:19:59.576864+0000","last_clean":"2024-05-21T01:19:59.576864+0000","last_became_active":"2024-05-21T01:19:58.610511+0000","last_became_peered":"2024-05-21T01:19:58.610511+0000","last_unstale":"2024-05-21T01:19:59.576864+0000","last_undegraded":"2024-05-21T01:19:59.576864+0000","last_fullsized":"2024-05-21T01:19:59.576864+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:49:19.660422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.209521+0000","last_change":"2024-05-21T01:19:54.572546+0000","last_active":"2024-05-21T01:20:00.209521+0000","last_peered":"2024-05-21T01:20:00.209521+0000","last_clean":"2024-05-21T01:20:00.209521+0000","last_became_active":"2024-05-21T01:19:54.572022+0000","last_became_peered":"2024-05-21T01:19:54.572022+0000","last_unstale":"2024-05-21T01:20:00.209521+0000","last_undegraded":"2024-05-21T01:20:00.209521+0000","last_fullsized":"2024-05-21T01:20:00.209521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:50:08.351383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"25'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:30.697731+0000","last_change":"2024-05-21T01:19:53.556786+0000","last_active":"2024-05-21T01:20:30.697731+0000","last_peered":"2024-05-21T01:20:30.697731+0000","last_clean":"2024-05-21T01:20:30.697731+0000","last_became_active":"2024-05-21T01:19:53.556143+0000","last_became_peered":"2024-05-21T01:19:53.556143+0000","last_unstale":"2024-05-21T01:20:30.697731+0000","last_undegraded":"2024-05-21T01:20:30.697731+0000","last_fullsized":"2024-05-21T01:20:30.697731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:02:17.391701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.577698+0000","last_change":"2024-05-21T01:19:58.599203+0000","last_active":"2024-05-21T01:19:59.577698+0000","last_peered":"2024-05-21T01:19:59.577698+0000","last_clean":"2024-05-21T01:19:59.577698+0000","last_became_active":"2024-05-21T01:19:58.598175+0000","last_became_peered":"2024-05-21T01:19:58.598175+0000","last_unstale":"2024-05-21T01:19:59.577698+0000","last_undegraded":"2024-05-21T01:19:59.577698+0000","last_fullsized":"2024-05-21T01:19:59.577698+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:45:17.138090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.574222+0000","last_change":"2024-05-21T01:19:54.551092+0000","last_active":"2024-05-21T01:19:59.574222+0000","last_peered":"2024-05-21T01:19:59.574222+0000","last_clean":"2024-05-21T01:19:59.574222+0000","last_became_active":"2024-05-21T01:19:54.550338+0000","last_became_peered":"2024-05-21T01:19:54.550338+0000","last_unstale":"2024-05-21T01:19:59.574222+0000","last_undegraded":"2024-05-21T01:19:59.574222+0000","last_fullsized":"2024-05-21T01:19:59.574222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:29:13.540719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"25'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:30.690226+0000","last_change":"2024-05-21T01:19:53.554835+0000","last_active":"2024-05-21T01:20:30.690226+0000","last_peered":"2024-05-21T01:20:30.690226+0000","last_clean":"2024-05-21T01:20:30.690226+0000","last_became_active":"2024-05-21T01:19:53.554598+0000","last_became_peered":"2024-05-21T01:19:53.554598+0000","last_unstale":"2024-05-21T01:20:30.690226+0000","last_undegraded":"2024-05-21T01:20:30.690226+0000","last_fullsized":"2024-05-21T01:20:30.690226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:28:43.940978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.211238+0000","last_change":"2024-05-21T01:19:58.629747+0000","last_active":"2024-05-21T01:20:00.211238+0000","last_peered":"2024-05-21T01:20:00.211238+0000","last_clean":"2024-05-21T01:20:00.211238+0000","last_became_active":"2024-05-21T01:19:58.622106+0000","last_became_peered":"2024-05-21T01:19:58.622106+0000","last_unstale":"2024-05-21T01:20:00.211238+0000","last_undegraded":"2024-05-21T01:20:00.211238+0000","last_fullsized":"2024-05-21T01:20:00.211238+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:22:07.047914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.571255+0000","last_change":"2024-05-21T01:19:54.554303+0000","last_active":"2024-05-21T01:19:59.571255+0000","last_peered":"2024-05-21T01:19:59.571255+0000","last_clean":"2024-05-21T01:19:59.571255+0000","last_became_active":"2024-05-21T01:19:54.552126+0000","last_became_peered":"2024-05-21T01:19:54.552126+0000","last_unstale":"2024-05-21T01:19:59.571255+0000","last_undegraded":"2024-05-21T01:19:59.571255+0000","last_fullsized":"2024-05-21T01:19:59.571255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:59:46.383359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"25'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:24.666931+0000","last_change":"2024-05-21T01:19:53.536580+0000","last_active":"2024-05-21T01:20:24.666931+0000","last_peered":"2024-05-21T01:20:24.666931+0000","last_clean":"2024-05-21T01:20:24.666931+0000","last_became_active":"2024-05-21T01:19:53.535105+0000","last_became_peered":"2024-05-21T01:19:53.535105+0000","last_unstale":"2024-05-21T01:20:24.666931+0000","last_undegraded":"2024-05-21T01:20:24.666931+0000","last_fullsized":"2024-05-21T01:20:24.666931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:58:05.019025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":118,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207611+0000","last_change":"2024-05-21T01:19:49.490062+0000","last_active":"2024-05-21T01:20:00.207611+0000","last_peered":"2024-05-21T01:20:00.207611+0000","last_clean":"2024-05-21T01:20:00.207611+0000","last_became_active":"2024-05-21T01:19:49.488796+0000","last_became_peered":"2024-05-21T01:19:49.488796+0000","last_unstale":"2024-05-21T01:20:00.207611+0000","last_undegraded":"2024-05-21T01:20:00.207611+0000","last_fullsized":"2024-05-21T01:20:00.207611+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:47.457865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:47.457865+0000","last_clean_scrub_stamp":"2024-05-21T01:19:47.457865+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T09:37:06.199150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.568012+0000","last_change":"2024-05-21T01:19:58.590851+0000","last_active":"2024-05-21T01:19:59.568012+0000","last_peered":"2024-05-21T01:19:59.568012+0000","last_clean":"2024-05-21T01:19:59.568012+0000","last_became_active":"2024-05-21T01:19:58.589288+0000","last_became_peered":"2024-05-21T01:19:58.589288+0000","last_unstale":"2024-05-21T01:19:59.568012+0000","last_undegraded":"2024-05-21T01:19:59.568012+0000","last_fullsized":"2024-05-21T01:19:59.568012+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:36:46.992834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.567741+0000","last_change":"2024-05-21T01:19:54.543894+0000","last_active":"2024-05-21T01:19:59.567741+0000","last_peered":"2024-05-21T01:19:59.567741+0000","last_clean":"2024-05-21T01:19:59.567741+0000","last_became_active":"2024-05-21T01:19:54.543586+0000","last_became_peered":"2024-05-21T01:19:54.543586+0000","last_unstale":"2024-05-21T01:19:59.567741+0000","last_undegraded":"2024-05-21T01:19:59.567741+0000","last_fullsized":"2024-05-21T01:19:59.567741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:33:02.756634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"25'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:30.693726+0000","last_change":"2024-05-21T01:19:53.532115+0000","last_active":"2024-05-21T01:20:30.693726+0000","last_peered":"2024-05-21T01:20:30.693726+0000","last_clean":"2024-05-21T01:20:30.693726+0000","last_became_active":"2024-05-21T01:19:53.529879+0000","last_became_peered":"2024-05-21T01:19:53.529879+0000","last_unstale":"2024-05-21T01:20:30.693726+0000","last_undegraded":"2024-05-21T01:20:30.693726+0000","last_fullsized":"2024-05-21T01:20:30.693726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:42:07.436243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.206924+0000","last_change":"2024-05-21T01:19:58.604417+0000","last_active":"2024-05-21T01:20:00.206924+0000","last_peered":"2024-05-21T01:20:00.206924+0000","last_clean":"2024-05-21T01:20:00.206924+0000","last_became_active":"2024-05-21T01:19:58.603929+0000","last_became_peered":"2024-05-21T01:19:58.603929+0000","last_unstale":"2024-05-21T01:20:00.206924+0000","last_undegraded":"2024-05-21T01:20:00.206924+0000","last_fullsized":"2024-05-21T01:20:00.206924+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:15:59.031738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207029+0000","last_change":"2024-05-21T01:19:54.542096+0000","last_active":"2024-05-21T01:20:00.207029+0000","last_peered":"2024-05-21T01:20:00.207029+0000","last_clean":"2024-05-21T01:20:00.207029+0000","last_became_active":"2024-05-21T01:19:54.541837+0000","last_became_peered":"2024-05-21T01:19:54.541837+0000","last_unstale":"2024-05-21T01:20:00.207029+0000","last_undegraded":"2024-05-21T01:20:00.207029+0000","last_fullsized":"2024-05-21T01:20:00.207029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:55:30.807311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.211049+0000","last_change":"2024-05-21T01:19:53.551697+0000","last_active":"2024-05-21T01:20:00.211049+0000","last_peered":"2024-05-21T01:20:00.211049+0000","last_clean":"2024-05-21T01:20:00.211049+0000","last_became_active":"2024-05-21T01:19:53.550893+0000","last_became_peered":"2024-05-21T01:19:53.550893+0000","last_unstale":"2024-05-21T01:20:00.211049+0000","last_undegraded":"2024-05-21T01:20:00.211049+0000","last_fullsized":"2024-05-21T01:20:00.211049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:42:20.295229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.210457+0000","last_change":"2024-05-21T01:19:58.628526+0000","last_active":"2024-05-21T01:20:00.210457+0000","last_peered":"2024-05-21T01:20:00.210457+0000","last_clean":"2024-05-21T01:20:00.210457+0000","last_became_active":"2024-05-21T01:19:58.620667+0000","last_became_peered":"2024-05-21T01:19:58.620667+0000","last_unstale":"2024-05-21T01:20:00.210457+0000","last_undegraded":"2024-05-21T01:20:00.210457+0000","last_fullsized":"2024-05-21T01:20:00.210457+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:46:22.396063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.208496+0000","last_change":"2024-05-21T01:19:54.532551+0000","last_active":"2024-05-21T01:20:00.208496+0000","last_peered":"2024-05-21T01:20:00.208496+0000","last_clean":"2024-05-21T01:20:00.208496+0000","last_became_active":"2024-05-21T01:19:54.532251+0000","last_became_peered":"2024-05-21T01:19:54.532251+0000","last_unstale":"2024-05-21T01:20:00.208496+0000","last_undegraded":"2024-05-21T01:20:00.208496+0000","last_fullsized":"2024-05-21T01:20:00.208496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:00:30.042781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.572555+0000","last_change":"2024-05-21T01:19:53.554659+0000","last_active":"2024-05-21T01:19:59.572555+0000","last_peered":"2024-05-21T01:19:59.572555+0000","last_clean":"2024-05-21T01:19:59.572555+0000","last_became_active":"2024-05-21T01:19:53.553953+0000","last_became_peered":"2024-05-21T01:19:53.553953+0000","last_unstale":"2024-05-21T01:19:59.572555+0000","last_undegraded":"2024-05-21T01:19:59.572555+0000","last_fullsized":"2024-05-21T01:19:59.572555+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:31:13.091061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.566596+0000","last_change":"2024-05-21T01:19:58.593243+0000","last_active":"2024-05-21T01:19:59.566596+0000","last_peered":"2024-05-21T01:19:59.566596+0000","last_clean":"2024-05-21T01:19:59.566596+0000","last_became_active":"2024-05-21T01:19:58.592758+0000","last_became_peered":"2024-05-21T01:19:58.592758+0000","last_unstale":"2024-05-21T01:19:59.566596+0000","last_undegraded":"2024-05-21T01:19:59.566596+0000","last_fullsized":"2024-05-21T01:19:59.566596+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:46:17.877736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207962+0000","last_change":"2024-05-21T01:19:54.538391+0000","last_active":"2024-05-21T01:20:00.207962+0000","last_peered":"2024-05-21T01:20:00.207962+0000","last_clean":"2024-05-21T01:20:00.207962+0000","last_became_active":"2024-05-21T01:19:54.538106+0000","last_became_peered":"2024-05-21T01:19:54.538106+0000","last_unstale":"2024-05-21T01:20:00.207962+0000","last_undegraded":"2024-05-21T01:20:00.207962+0000","last_fullsized":"2024-05-21T01:20:00.207962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:36:07.297496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"25'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.208593+0000","last_change":"2024-05-21T01:19:53.551917+0000","last_active":"2024-05-21T01:20:00.208593+0000","last_peered":"2024-05-21T01:20:00.208593+0000","last_clean":"2024-05-21T01:20:00.208593+0000","last_became_active":"2024-05-21T01:19:53.551608+0000","last_became_peered":"2024-05-21T01:19:53.551608+0000","last_unstale":"2024-05-21T01:20:00.208593+0000","last_undegraded":"2024-05-21T01:20:00.208593+0000","last_fullsized":"2024-05-21T01:20:00.208593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:20:54.093966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.208119+0000","last_change":"2024-05-21T01:19:58.613367+0000","last_active":"2024-05-21T01:20:00.208119+0000","last_peered":"2024-05-21T01:20:00.208119+0000","last_clean":"2024-05-21T01:20:00.208119+0000","last_became_active":"2024-05-21T01:19:58.612950+0000","last_became_peered":"2024-05-21T01:19:58.612950+0000","last_unstale":"2024-05-21T01:20:00.208119+0000","last_undegraded":"2024-05-21T01:20:00.208119+0000","last_fullsized":"2024-05-21T01:20:00.208119+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:32:12.365734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.566761+0000","last_change":"2024-05-21T01:19:54.548979+0000","last_active":"2024-05-21T01:19:59.566761+0000","last_peered":"2024-05-21T01:19:59.566761+0000","last_clean":"2024-05-21T01:19:59.566761+0000","last_became_active":"2024-05-21T01:19:54.548704+0000","last_became_peered":"2024-05-21T01:19:54.548704+0000","last_unstale":"2024-05-21T01:19:59.566761+0000","last_undegraded":"2024-05-21T01:19:59.566761+0000","last_fullsized":"2024-05-21T01:19:59.566761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:57:09.076705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"25'15","reported_seq":37,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:30.697911+0000","last_change":"2024-05-21T01:19:53.542425+0000","last_active":"2024-05-21T01:20:30.697911+0000","last_peered":"2024-05-21T01:20:30.697911+0000","last_clean":"2024-05-21T01:20:30.697911+0000","last_became_active":"2024-05-21T01:19:53.541577+0000","last_became_peered":"2024-05-21T01:19:53.541577+0000","last_unstale":"2024-05-21T01:20:30.697911+0000","last_undegraded":"2024-05-21T01:20:30.697911+0000","last_fullsized":"2024-05-21T01:20:30.697911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:47:54.892789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.211663+0000","last_change":"2024-05-21T01:19:58.630293+0000","last_active":"2024-05-21T01:20:00.211663+0000","last_peered":"2024-05-21T01:20:00.211663+0000","last_clean":"2024-05-21T01:20:00.211663+0000","last_became_active":"2024-05-21T01:19:58.629119+0000","last_became_peered":"2024-05-21T01:19:58.629119+0000","last_unstale":"2024-05-21T01:20:00.211663+0000","last_undegraded":"2024-05-21T01:20:00.211663+0000","last_fullsized":"2024-05-21T01:20:00.211663+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:10:45.318517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207523+0000","last_change":"2024-05-21T01:19:54.575541+0000","last_active":"2024-05-21T01:20:00.207523+0000","last_peered":"2024-05-21T01:20:00.207523+0000","last_clean":"2024-05-21T01:20:00.207523+0000","last_became_active":"2024-05-21T01:19:54.575314+0000","last_became_peered":"2024-05-21T01:19:54.575314+0000","last_unstale":"2024-05-21T01:20:00.207523+0000","last_undegraded":"2024-05-21T01:20:00.207523+0000","last_fullsized":"2024-05-21T01:20:00.207523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:02:36.840590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"25'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:30.692210+0000","last_change":"2024-05-21T01:19:53.523758+0000","last_active":"2024-05-21T01:20:30.692210+0000","last_peered":"2024-05-21T01:20:30.692210+0000","last_clean":"2024-05-21T01:20:30.692210+0000","last_became_active":"2024-05-21T01:19:53.523273+0000","last_became_peered":"2024-05-21T01:19:53.523273+0000","last_unstale":"2024-05-21T01:20:30.692210+0000","last_undegraded":"2024-05-21T01:20:30.692210+0000","last_fullsized":"2024-05-21T01:20:30.692210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:05:47.275193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.211601+0000","last_change":"2024-05-21T01:19:58.621996+0000","last_active":"2024-05-21T01:20:00.211601+0000","last_peered":"2024-05-21T01:20:00.211601+0000","last_clean":"2024-05-21T01:20:00.211601+0000","last_became_active":"2024-05-21T01:19:58.620552+0000","last_became_peered":"2024-05-21T01:19:58.620552+0000","last_unstale":"2024-05-21T01:20:00.211601+0000","last_undegraded":"2024-05-21T01:20:00.211601+0000","last_fullsized":"2024-05-21T01:20:00.211601+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:58:32.635003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.567139+0000","last_change":"2024-05-21T01:19:54.557379+0000","last_active":"2024-05-21T01:19:59.567139+0000","last_peered":"2024-05-21T01:19:59.567139+0000","last_clean":"2024-05-21T01:19:59.567139+0000","last_became_active":"2024-05-21T01:19:54.550335+0000","last_became_peered":"2024-05-21T01:19:54.550335+0000","last_unstale":"2024-05-21T01:19:59.567139+0000","last_undegraded":"2024-05-21T01:19:59.567139+0000","last_fullsized":"2024-05-21T01:19:59.567139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:24:52.297888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"25'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:24.658932+0000","last_change":"2024-05-21T01:19:53.534431+0000","last_active":"2024-05-21T01:20:24.658932+0000","last_peered":"2024-05-21T01:20:24.658932+0000","last_clean":"2024-05-21T01:20:24.658932+0000","last_became_active":"2024-05-21T01:19:53.534174+0000","last_became_peered":"2024-05-21T01:19:53.534174+0000","last_unstale":"2024-05-21T01:20:24.658932+0000","last_undegraded":"2024-05-21T01:20:24.658932+0000","last_fullsized":"2024-05-21T01:20:24.658932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:42:04.743914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.576325+0000","last_change":"2024-05-21T01:19:58.609289+0000","last_active":"2024-05-21T01:19:59.576325+0000","last_peered":"2024-05-21T01:19:59.576325+0000","last_clean":"2024-05-21T01:19:59.576325+0000","last_became_active":"2024-05-21T01:19:58.608371+0000","last_became_peered":"2024-05-21T01:19:58.608371+0000","last_unstale":"2024-05-21T01:19:59.576325+0000","last_undegraded":"2024-05-21T01:19:59.576325+0000","last_fullsized":"2024-05-21T01:19:59.576325+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:27:36.997803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.575122+0000","last_change":"2024-05-21T01:19:54.551617+0000","last_active":"2024-05-21T01:19:59.575122+0000","last_peered":"2024-05-21T01:19:59.575122+0000","last_clean":"2024-05-21T01:19:59.575122+0000","last_became_active":"2024-05-21T01:19:54.550865+0000","last_became_peered":"2024-05-21T01:19:54.550865+0000","last_unstale":"2024-05-21T01:19:59.575122+0000","last_undegraded":"2024-05-21T01:19:59.575122+0000","last_fullsized":"2024-05-21T01:19:59.575122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:32:44.168265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"25'6","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:30.693468+0000","last_change":"2024-05-21T01:19:53.535936+0000","last_active":"2024-05-21T01:20:30.693468+0000","last_peered":"2024-05-21T01:20:30.693468+0000","last_clean":"2024-05-21T01:20:30.693468+0000","last_became_active":"2024-05-21T01:19:53.535143+0000","last_became_peered":"2024-05-21T01:19:53.535143+0000","last_unstale":"2024-05-21T01:20:30.693468+0000","last_undegraded":"2024-05-21T01:20:30.693468+0000","last_fullsized":"2024-05-21T01:20:30.693468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:50:51.433726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.567570+0000","last_change":"2024-05-21T01:19:58.622615+0000","last_active":"2024-05-21T01:19:59.567570+0000","last_peered":"2024-05-21T01:19:59.567570+0000","last_clean":"2024-05-21T01:19:59.567570+0000","last_became_active":"2024-05-21T01:19:58.622250+0000","last_became_peered":"2024-05-21T01:19:58.622250+0000","last_unstale":"2024-05-21T01:19:59.567570+0000","last_undegraded":"2024-05-21T01:19:59.567570+0000","last_fullsized":"2024-05-21T01:19:59.567570+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:05:22.913945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207577+0000","last_change":"2024-05-21T01:19:54.558348+0000","last_active":"2024-05-21T01:20:00.207577+0000","last_peered":"2024-05-21T01:20:00.207577+0000","last_clean":"2024-05-21T01:20:00.207577+0000","last_became_active":"2024-05-21T01:19:54.558095+0000","last_became_peered":"2024-05-21T01:19:54.558095+0000","last_unstale":"2024-05-21T01:20:00.207577+0000","last_undegraded":"2024-05-21T01:20:00.207577+0000","last_fullsized":"2024-05-21T01:20:00.207577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:43:48.625583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"25'11","reported_seq":33,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:24.664060+0000","last_change":"2024-05-21T01:19:53.534947+0000","last_active":"2024-05-21T01:20:24.664060+0000","last_peered":"2024-05-21T01:20:24.664060+0000","last_clean":"2024-05-21T01:20:24.664060+0000","last_became_active":"2024-05-21T01:19:53.534616+0000","last_became_peered":"2024-05-21T01:19:53.534616+0000","last_unstale":"2024-05-21T01:20:24.664060+0000","last_undegraded":"2024-05-21T01:20:24.664060+0000","last_fullsized":"2024-05-21T01:20:24.664060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:01:25.372035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.571116+0000","last_change":"2024-05-21T01:19:58.617970+0000","last_active":"2024-05-21T01:19:59.571116+0000","last_peered":"2024-05-21T01:19:59.571116+0000","last_clean":"2024-05-21T01:19:59.571116+0000","last_became_active":"2024-05-21T01:19:58.617061+0000","last_became_peered":"2024-05-21T01:19:58.617061+0000","last_unstale":"2024-05-21T01:19:59.571116+0000","last_undegraded":"2024-05-21T01:19:59.571116+0000","last_fullsized":"2024-05-21T01:19:59.571116+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:48:50.703577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.567205+0000","last_change":"2024-05-21T01:19:54.557175+0000","last_active":"2024-05-21T01:19:59.567205+0000","last_peered":"2024-05-21T01:19:59.567205+0000","last_clean":"2024-05-21T01:19:59.567205+0000","last_became_active":"2024-05-21T01:19:54.556933+0000","last_became_peered":"2024-05-21T01:19:54.556933+0000","last_unstale":"2024-05-21T01:19:59.567205+0000","last_undegraded":"2024-05-21T01:19:59.567205+0000","last_fullsized":"2024-05-21T01:19:59.567205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:15:44.089544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"25'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.208892+0000","last_change":"2024-05-21T01:19:53.536780+0000","last_active":"2024-05-21T01:20:00.208892+0000","last_peered":"2024-05-21T01:20:00.208892+0000","last_clean":"2024-05-21T01:20:00.208892+0000","last_became_active":"2024-05-21T01:19:53.535768+0000","last_became_peered":"2024-05-21T01:19:53.535768+0000","last_unstale":"2024-05-21T01:20:00.208892+0000","last_undegraded":"2024-05-21T01:20:00.208892+0000","last_fullsized":"2024-05-21T01:20:00.208892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:04:14.732801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207120+0000","last_change":"2024-05-21T01:19:58.606532+0000","last_active":"2024-05-21T01:20:00.207120+0000","last_peered":"2024-05-21T01:20:00.207120+0000","last_clean":"2024-05-21T01:20:00.207120+0000","last_became_active":"2024-05-21T01:19:58.606180+0000","last_became_peered":"2024-05-21T01:19:58.606180+0000","last_unstale":"2024-05-21T01:20:00.207120+0000","last_undegraded":"2024-05-21T01:20:00.207120+0000","last_fullsized":"2024-05-21T01:20:00.207120+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:25:31.161427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.211807+0000","last_change":"2024-05-21T01:19:54.571280+0000","last_active":"2024-05-21T01:20:00.211807+0000","last_peered":"2024-05-21T01:20:00.211807+0000","last_clean":"2024-05-21T01:20:00.211807+0000","last_became_active":"2024-05-21T01:19:54.568778+0000","last_became_peered":"2024-05-21T01:19:54.568778+0000","last_unstale":"2024-05-21T01:20:00.211807+0000","last_undegraded":"2024-05-21T01:20:00.211807+0000","last_fullsized":"2024-05-21T01:20:00.211807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:43:16.583632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"25'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:24.660610+0000","last_change":"2024-05-21T01:19:53.530770+0000","last_active":"2024-05-21T01:20:24.660610+0000","last_peered":"2024-05-21T01:20:24.660610+0000","last_clean":"2024-05-21T01:20:24.660610+0000","last_became_active":"2024-05-21T01:19:53.526431+0000","last_became_peered":"2024-05-21T01:19:53.526431+0000","last_unstale":"2024-05-21T01:20:24.660610+0000","last_undegraded":"2024-05-21T01:20:24.660610+0000","last_fullsized":"2024-05-21T01:20:24.660610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:08:59.892029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.208009+0000","last_change":"2024-05-21T01:19:58.611576+0000","last_active":"2024-05-21T01:20:00.208009+0000","last_peered":"2024-05-21T01:20:00.208009+0000","last_clean":"2024-05-21T01:20:00.208009+0000","last_became_active":"2024-05-21T01:19:58.610838+0000","last_became_peered":"2024-05-21T01:19:58.610838+0000","last_unstale":"2024-05-21T01:20:00.208009+0000","last_undegraded":"2024-05-21T01:20:00.208009+0000","last_fullsized":"2024-05-21T01:20:00.208009+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:07:31.736640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207957+0000","last_change":"2024-05-21T01:19:54.552709+0000","last_active":"2024-05-21T01:20:00.207957+0000","last_peered":"2024-05-21T01:20:00.207957+0000","last_clean":"2024-05-21T01:20:00.207957+0000","last_became_active":"2024-05-21T01:19:54.547898+0000","last_became_peered":"2024-05-21T01:19:54.547898+0000","last_unstale":"2024-05-21T01:20:00.207957+0000","last_undegraded":"2024-05-21T01:20:00.207957+0000","last_fullsized":"2024-05-21T01:20:00.207957+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:20:17.933506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"25'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:24.659103+0000","last_change":"2024-05-21T01:19:53.534507+0000","last_active":"2024-05-21T01:20:24.659103+0000","last_peered":"2024-05-21T01:20:24.659103+0000","last_clean":"2024-05-21T01:20:24.659103+0000","last_became_active":"2024-05-21T01:19:53.534036+0000","last_became_peered":"2024-05-21T01:19:53.534036+0000","last_unstale":"2024-05-21T01:20:24.659103+0000","last_undegraded":"2024-05-21T01:20:24.659103+0000","last_fullsized":"2024-05-21T01:20:24.659103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:01:08.218098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.572286+0000","last_change":"2024-05-21T01:19:58.608135+0000","last_active":"2024-05-21T01:19:59.572286+0000","last_peered":"2024-05-21T01:19:59.572286+0000","last_clean":"2024-05-21T01:19:59.572286+0000","last_became_active":"2024-05-21T01:19:58.607242+0000","last_became_peered":"2024-05-21T01:19:58.607242+0000","last_unstale":"2024-05-21T01:19:59.572286+0000","last_undegraded":"2024-05-21T01:19:59.572286+0000","last_fullsized":"2024-05-21T01:19:59.572286+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:05:26.197876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.572239+0000","last_change":"2024-05-21T01:19:58.624883+0000","last_active":"2024-05-21T01:19:59.572239+0000","last_peered":"2024-05-21T01:19:59.572239+0000","last_clean":"2024-05-21T01:19:59.572239+0000","last_became_active":"2024-05-21T01:19:58.623991+0000","last_became_peered":"2024-05-21T01:19:58.623991+0000","last_unstale":"2024-05-21T01:19:59.572239+0000","last_undegraded":"2024-05-21T01:19:59.572239+0000","last_fullsized":"2024-05-21T01:19:59.572239+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:29:26.251376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.572416+0000","last_change":"2024-05-21T01:19:54.549215+0000","last_active":"2024-05-21T01:19:59.572416+0000","last_peered":"2024-05-21T01:19:59.572416+0000","last_clean":"2024-05-21T01:19:59.572416+0000","last_became_active":"2024-05-21T01:19:54.548426+0000","last_became_peered":"2024-05-21T01:19:54.548426+0000","last_unstale":"2024-05-21T01:19:59.572416+0000","last_undegraded":"2024-05-21T01:19:59.572416+0000","last_fullsized":"2024-05-21T01:19:59.572416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:10:10.800391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"25'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.566886+0000","last_change":"2024-05-21T01:19:53.526106+0000","last_active":"2024-05-21T01:19:59.566886+0000","last_peered":"2024-05-21T01:19:59.566886+0000","last_clean":"2024-05-21T01:19:59.566886+0000","last_became_active":"2024-05-21T01:19:53.525786+0000","last_became_peered":"2024-05-21T01:19:53.525786+0000","last_unstale":"2024-05-21T01:19:59.566886+0000","last_undegraded":"2024-05-21T01:19:59.566886+0000","last_fullsized":"2024-05-21T01:19:59.566886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:01:05.180803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.567758+0000","last_change":"2024-05-21T01:19:58.615481+0000","last_active":"2024-05-21T01:19:59.567758+0000","last_peered":"2024-05-21T01:19:59.567758+0000","last_clean":"2024-05-21T01:19:59.567758+0000","last_became_active":"2024-05-21T01:19:58.614879+0000","last_became_peered":"2024-05-21T01:19:58.614879+0000","last_unstale":"2024-05-21T01:19:59.567758+0000","last_undegraded":"2024-05-21T01:19:59.567758+0000","last_fullsized":"2024-05-21T01:19:59.567758+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:45:57.208342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.209731+0000","last_change":"2024-05-21T01:19:54.570650+0000","last_active":"2024-05-21T01:20:00.209731+0000","last_peered":"2024-05-21T01:20:00.209731+0000","last_clean":"2024-05-21T01:20:00.209731+0000","last_became_active":"2024-05-21T01:19:54.570034+0000","last_became_peered":"2024-05-21T01:19:54.570034+0000","last_unstale":"2024-05-21T01:20:00.209731+0000","last_undegraded":"2024-05-21T01:20:00.209731+0000","last_fullsized":"2024-05-21T01:20:00.209731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:01:05.887729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"25'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:30.693111+0000","last_change":"2024-05-21T01:19:53.532017+0000","last_active":"2024-05-21T01:20:30.693111+0000","last_peered":"2024-05-21T01:20:30.693111+0000","last_clean":"2024-05-21T01:20:30.693111+0000","last_became_active":"2024-05-21T01:19:53.529457+0000","last_became_peered":"2024-05-21T01:19:53.529457+0000","last_unstale":"2024-05-21T01:20:30.693111+0000","last_undegraded":"2024-05-21T01:20:30.693111+0000","last_fullsized":"2024-05-21T01:20:30.693111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:58:03.979929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"25'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:30.690025+0000","last_change":"2024-05-21T01:19:53.525620+0000","last_active":"2024-05-21T01:20:30.690025+0000","last_peered":"2024-05-21T01:20:30.690025+0000","last_clean":"2024-05-21T01:20:30.690025+0000","last_became_active":"2024-05-21T01:19:53.525315+0000","last_became_peered":"2024-05-21T01:19:53.525315+0000","last_unstale":"2024-05-21T01:20:30.690025+0000","last_undegraded":"2024-05-21T01:20:30.690025+0000","last_fullsized":"2024-05-21T01:20:30.690025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:30:38.075463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.571359+0000","last_change":"2024-05-21T01:19:54.555344+0000","last_active":"2024-05-21T01:19:59.571359+0000","last_peered":"2024-05-21T01:19:59.571359+0000","last_clean":"2024-05-21T01:19:59.571359+0000","last_became_active":"2024-05-21T01:19:54.552817+0000","last_became_peered":"2024-05-21T01:19:54.552817+0000","last_unstale":"2024-05-21T01:19:59.571359+0000","last_undegraded":"2024-05-21T01:19:59.571359+0000","last_fullsized":"2024-05-21T01:19:59.571359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:10:03.810064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.572198+0000","last_change":"2024-05-21T01:19:58.619520+0000","last_active":"2024-05-21T01:19:59.572198+0000","last_peered":"2024-05-21T01:19:59.572198+0000","last_clean":"2024-05-21T01:19:59.572198+0000","last_became_active":"2024-05-21T01:19:58.617165+0000","last_became_peered":"2024-05-21T01:19:58.617165+0000","last_unstale":"2024-05-21T01:19:59.572198+0000","last_undegraded":"2024-05-21T01:19:59.572198+0000","last_fullsized":"2024-05-21T01:19:59.572198+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T13:07:51.530746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"25'5","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:24.652930+0000","last_change":"2024-05-21T01:19:53.551547+0000","last_active":"2024-05-21T01:20:24.652930+0000","last_peered":"2024-05-21T01:20:24.652930+0000","last_clean":"2024-05-21T01:20:24.652930+0000","last_became_active":"2024-05-21T01:19:53.550931+0000","last_became_peered":"2024-05-21T01:19:53.550931+0000","last_unstale":"2024-05-21T01:20:24.652930+0000","last_undegraded":"2024-05-21T01:20:24.652930+0000","last_fullsized":"2024-05-21T01:20:24.652930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:13:47.329230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.208939+0000","last_change":"2024-05-21T01:19:54.574552+0000","last_active":"2024-05-21T01:20:00.208939+0000","last_peered":"2024-05-21T01:20:00.208939+0000","last_clean":"2024-05-21T01:20:00.208939+0000","last_became_active":"2024-05-21T01:19:54.574246+0000","last_became_peered":"2024-05-21T01:19:54.574246+0000","last_unstale":"2024-05-21T01:20:00.208939+0000","last_undegraded":"2024-05-21T01:20:00.208939+0000","last_fullsized":"2024-05-21T01:20:00.208939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:23:33.685798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.208672+0000","last_change":"2024-05-21T01:19:58.624400+0000","last_active":"2024-05-21T01:20:00.208672+0000","last_peered":"2024-05-21T01:20:00.208672+0000","last_clean":"2024-05-21T01:20:00.208672+0000","last_became_active":"2024-05-21T01:19:58.623388+0000","last_became_peered":"2024-05-21T01:19:58.623388+0000","last_unstale":"2024-05-21T01:20:00.208672+0000","last_undegraded":"2024-05-21T01:20:00.208672+0000","last_fullsized":"2024-05-21T01:20:00.208672+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:59:30.019393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.206641+0000","last_change":"2024-05-21T01:19:54.553262+0000","last_active":"2024-05-21T01:20:00.206641+0000","last_peered":"2024-05-21T01:20:00.206641+0000","last_clean":"2024-05-21T01:20:00.206641+0000","last_became_active":"2024-05-21T01:19:54.553060+0000","last_became_peered":"2024-05-21T01:19:54.553060+0000","last_unstale":"2024-05-21T01:20:00.206641+0000","last_undegraded":"2024-05-21T01:20:00.206641+0000","last_fullsized":"2024-05-21T01:20:00.206641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:18:14.077480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207978+0000","last_change":"2024-05-21T01:19:54.566851+0000","last_active":"2024-05-21T01:20:00.207978+0000","last_peered":"2024-05-21T01:20:00.207978+0000","last_clean":"2024-05-21T01:20:00.207978+0000","last_became_active":"2024-05-21T01:19:54.565573+0000","last_became_peered":"2024-05-21T01:19:54.565573+0000","last_unstale":"2024-05-21T01:20:00.207978+0000","last_undegraded":"2024-05-21T01:20:00.207978+0000","last_fullsized":"2024-05-21T01:20:00.207978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:51:30.883954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.566981+0000","last_change":"2024-05-21T01:19:54.566934+0000","last_active":"2024-05-21T01:19:59.566981+0000","last_peered":"2024-05-21T01:19:59.566981+0000","last_clean":"2024-05-21T01:19:59.566981+0000","last_became_active":"2024-05-21T01:19:54.566503+0000","last_became_peered":"2024-05-21T01:19:54.566503+0000","last_unstale":"2024-05-21T01:19:59.566981+0000","last_undegraded":"2024-05-21T01:19:59.566981+0000","last_fullsized":"2024-05-21T01:19:59.566981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:14:54.262165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.210361+0000","last_change":"2024-05-21T01:19:54.573091+0000","last_active":"2024-05-21T01:20:00.210361+0000","last_peered":"2024-05-21T01:20:00.210361+0000","last_clean":"2024-05-21T01:20:00.210361+0000","last_became_active":"2024-05-21T01:19:54.572366+0000","last_became_peered":"2024-05-21T01:19:54.572366+0000","last_unstale":"2024-05-21T01:20:00.210361+0000","last_undegraded":"2024-05-21T01:20:00.210361+0000","last_fullsized":"2024-05-21T01:20:00.210361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:10:09.353807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.576980+0000","last_change":"2024-05-21T01:19:54.563339+0000","last_active":"2024-05-21T01:19:59.576980+0000","last_peered":"2024-05-21T01:19:59.576980+0000","last_clean":"2024-05-21T01:19:59.576980+0000","last_became_active":"2024-05-21T01:19:54.557934+0000","last_became_peered":"2024-05-21T01:19:54.557934+0000","last_unstale":"2024-05-21T01:19:59.576980+0000","last_undegraded":"2024-05-21T01:19:59.576980+0000","last_fullsized":"2024-05-21T01:19:59.576980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:46:21.598689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.577198+0000","last_change":"2024-05-21T01:19:54.553551+0000","last_active":"2024-05-21T01:19:59.577198+0000","last_peered":"2024-05-21T01:19:59.577198+0000","last_clean":"2024-05-21T01:19:59.577198+0000","last_became_active":"2024-05-21T01:19:54.552812+0000","last_became_peered":"2024-05-21T01:19:54.552812+0000","last_unstale":"2024-05-21T01:19:59.577198+0000","last_undegraded":"2024-05-21T01:19:59.577198+0000","last_fullsized":"2024-05-21T01:19:59.577198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:27:41.166606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207853+0000","last_change":"2024-05-21T01:19:54.548604+0000","last_active":"2024-05-21T01:20:00.207853+0000","last_peered":"2024-05-21T01:20:00.207853+0000","last_clean":"2024-05-21T01:20:00.207853+0000","last_became_active":"2024-05-21T01:19:54.548263+0000","last_became_peered":"2024-05-21T01:19:54.548263+0000","last_unstale":"2024-05-21T01:20:00.207853+0000","last_undegraded":"2024-05-21T01:20:00.207853+0000","last_fullsized":"2024-05-21T01:20:00.207853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:33:55.302088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.211381+0000","last_change":"2024-05-21T01:19:54.573995+0000","last_active":"2024-05-21T01:20:00.211381+0000","last_peered":"2024-05-21T01:20:00.211381+0000","last_clean":"2024-05-21T01:20:00.211381+0000","last_became_active":"2024-05-21T01:19:54.570373+0000","last_became_peered":"2024-05-21T01:19:54.570373+0000","last_unstale":"2024-05-21T01:20:00.211381+0000","last_undegraded":"2024-05-21T01:20:00.211381+0000","last_fullsized":"2024-05-21T01:20:00.211381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:44:23.194713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.566746+0000","last_change":"2024-05-21T01:19:54.575196+0000","last_active":"2024-05-21T01:19:59.566746+0000","last_peered":"2024-05-21T01:19:59.566746+0000","last_clean":"2024-05-21T01:19:59.566746+0000","last_became_active":"2024-05-21T01:19:54.574945+0000","last_became_peered":"2024-05-21T01:19:54.574945+0000","last_unstale":"2024-05-21T01:19:59.566746+0000","last_undegraded":"2024-05-21T01:19:59.566746+0000","last_fullsized":"2024-05-21T01:19:59.566746+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:52:56.244771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.209915+0000","last_change":"2024-05-21T01:19:54.566719+0000","last_active":"2024-05-21T01:20:00.209915+0000","last_peered":"2024-05-21T01:20:00.209915+0000","last_clean":"2024-05-21T01:20:00.209915+0000","last_became_active":"2024-05-21T01:19:54.565922+0000","last_became_peered":"2024-05-21T01:19:54.565922+0000","last_unstale":"2024-05-21T01:20:00.209915+0000","last_undegraded":"2024-05-21T01:20:00.209915+0000","last_fullsized":"2024-05-21T01:20:00.209915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:39:19.454688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.208888+0000","last_change":"2024-05-21T01:19:54.536815+0000","last_active":"2024-05-21T01:20:00.208888+0000","last_peered":"2024-05-21T01:20:00.208888+0000","last_clean":"2024-05-21T01:20:00.208888+0000","last_became_active":"2024-05-21T01:19:54.535957+0000","last_became_peered":"2024-05-21T01:19:54.535957+0000","last_unstale":"2024-05-21T01:20:00.208888+0000","last_undegraded":"2024-05-21T01:20:00.208888+0000","last_fullsized":"2024-05-21T01:20:00.208888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:24:53.906256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.571247+0000","last_change":"2024-05-21T01:19:54.552466+0000","last_active":"2024-05-21T01:19:59.571247+0000","last_peered":"2024-05-21T01:19:59.571247+0000","last_clean":"2024-05-21T01:19:59.571247+0000","last_became_active":"2024-05-21T01:19:54.551790+0000","last_became_peered":"2024-05-21T01:19:54.551790+0000","last_unstale":"2024-05-21T01:19:59.571247+0000","last_undegraded":"2024-05-21T01:19:59.571247+0000","last_fullsized":"2024-05-21T01:19:59.571247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:24:34.737707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.206948+0000","last_change":"2024-05-21T01:19:54.535314+0000","last_active":"2024-05-21T01:20:00.206948+0000","last_peered":"2024-05-21T01:20:00.206948+0000","last_clean":"2024-05-21T01:20:00.206948+0000","last_became_active":"2024-05-21T01:19:54.534793+0000","last_became_peered":"2024-05-21T01:19:54.534793+0000","last_unstale":"2024-05-21T01:20:00.206948+0000","last_undegraded":"2024-05-21T01:20:00.206948+0000","last_fullsized":"2024-05-21T01:20:00.206948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:52:35.492250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.568120+0000","last_change":"2024-05-21T01:19:54.556323+0000","last_active":"2024-05-21T01:19:59.568120+0000","last_peered":"2024-05-21T01:19:59.568120+0000","last_clean":"2024-05-21T01:19:59.568120+0000","last_became_active":"2024-05-21T01:19:54.556043+0000","last_became_peered":"2024-05-21T01:19:54.556043+0000","last_unstale":"2024-05-21T01:19:59.568120+0000","last_undegraded":"2024-05-21T01:19:59.568120+0000","last_fullsized":"2024-05-21T01:19:59.568120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:34:02.068527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.209056+0000","last_change":"2024-05-21T01:19:54.567457+0000","last_active":"2024-05-21T01:20:00.209056+0000","last_peered":"2024-05-21T01:20:00.209056+0000","last_clean":"2024-05-21T01:20:00.209056+0000","last_became_active":"2024-05-21T01:19:54.565326+0000","last_became_peered":"2024-05-21T01:19:54.565326+0000","last_unstale":"2024-05-21T01:20:00.209056+0000","last_undegraded":"2024-05-21T01:20:00.209056+0000","last_fullsized":"2024-05-21T01:20:00.209056+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:11:05.775389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.568111+0000","last_change":"2024-05-21T01:19:54.562078+0000","last_active":"2024-05-21T01:19:59.568111+0000","last_peered":"2024-05-21T01:19:59.568111+0000","last_clean":"2024-05-21T01:19:59.568111+0000","last_became_active":"2024-05-21T01:19:54.558286+0000","last_became_peered":"2024-05-21T01:19:54.558286+0000","last_unstale":"2024-05-21T01:19:59.568111+0000","last_undegraded":"2024-05-21T01:19:59.568111+0000","last_fullsized":"2024-05-21T01:19:59.568111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T09:09:58.360014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.566714+0000","last_change":"2024-05-21T01:19:54.548274+0000","last_active":"2024-05-21T01:19:59.566714+0000","last_peered":"2024-05-21T01:19:59.566714+0000","last_clean":"2024-05-21T01:19:59.566714+0000","last_became_active":"2024-05-21T01:19:54.548079+0000","last_became_peered":"2024-05-21T01:19:54.548079+0000","last_unstale":"2024-05-21T01:19:59.566714+0000","last_undegraded":"2024-05-21T01:19:59.566714+0000","last_fullsized":"2024-05-21T01:19:59.566714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:49:03.296571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.209656+0000","last_change":"2024-05-21T01:19:54.568211+0000","last_active":"2024-05-21T01:20:00.209656+0000","last_peered":"2024-05-21T01:20:00.209656+0000","last_clean":"2024-05-21T01:20:00.209656+0000","last_became_active":"2024-05-21T01:19:54.567512+0000","last_became_peered":"2024-05-21T01:19:54.567512+0000","last_unstale":"2024-05-21T01:20:00.209656+0000","last_undegraded":"2024-05-21T01:20:00.209656+0000","last_fullsized":"2024-05-21T01:20:00.209656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:32:18.004763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.575120+0000","last_change":"2024-05-21T01:19:54.556683+0000","last_active":"2024-05-21T01:19:59.575120+0000","last_peered":"2024-05-21T01:19:59.575120+0000","last_clean":"2024-05-21T01:19:59.575120+0000","last_became_active":"2024-05-21T01:19:54.555947+0000","last_became_peered":"2024-05-21T01:19:54.555947+0000","last_unstale":"2024-05-21T01:19:59.575120+0000","last_undegraded":"2024-05-21T01:19:59.575120+0000","last_fullsized":"2024-05-21T01:19:59.575120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:59:04.593946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:19:59.575926+0000","last_change":"2024-05-21T01:19:54.560218+0000","last_active":"2024-05-21T01:19:59.575926+0000","last_peered":"2024-05-21T01:19:59.575926+0000","last_clean":"2024-05-21T01:19:59.575926+0000","last_became_active":"2024-05-21T01:19:54.557787+0000","last_became_peered":"2024-05-21T01:19:54.557787+0000","last_unstale":"2024-05-21T01:19:59.575926+0000","last_undegraded":"2024-05-21T01:19:59.575926+0000","last_fullsized":"2024-05-21T01:19:59.575926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:05:48.282563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.206865+0000","last_change":"2024-05-21T01:19:54.535096+0000","last_active":"2024-05-21T01:20:00.206865+0000","last_peered":"2024-05-21T01:20:00.206865+0000","last_clean":"2024-05-21T01:20:00.206865+0000","last_became_active":"2024-05-21T01:19:54.534472+0000","last_became_peered":"2024-05-21T01:19:54.534472+0000","last_unstale":"2024-05-21T01:20:00.206865+0000","last_undegraded":"2024-05-21T01:20:00.206865+0000","last_fullsized":"2024-05-21T01:20:00.206865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:05:40.018457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207495+0000","last_change":"2024-05-21T01:19:54.546352+0000","last_active":"2024-05-21T01:20:00.207495+0000","last_peered":"2024-05-21T01:20:00.207495+0000","last_clean":"2024-05-21T01:20:00.207495+0000","last_became_active":"2024-05-21T01:19:54.546055+0000","last_became_peered":"2024-05-21T01:19:54.546055+0000","last_unstale":"2024-05-21T01:20:00.207495+0000","last_undegraded":"2024-05-21T01:20:00.207495+0000","last_fullsized":"2024-05-21T01:20:00.207495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:14:56.268312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.208385+0000","last_change":"2024-05-21T01:19:54.539886+0000","last_active":"2024-05-21T01:20:00.208385+0000","last_peered":"2024-05-21T01:20:00.208385+0000","last_clean":"2024-05-21T01:20:00.208385+0000","last_became_active":"2024-05-21T01:19:54.539599+0000","last_became_peered":"2024-05-21T01:19:54.539599+0000","last_unstale":"2024-05-21T01:20:00.208385+0000","last_undegraded":"2024-05-21T01:20:00.208385+0000","last_fullsized":"2024-05-21T01:20:00.208385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:08:51.107275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.209668+0000","last_change":"2024-05-21T01:19:54.548954+0000","last_active":"2024-05-21T01:20:00.209668+0000","last_peered":"2024-05-21T01:20:00.209668+0000","last_clean":"2024-05-21T01:20:00.209668+0000","last_became_active":"2024-05-21T01:19:54.547528+0000","last_became_peered":"2024-05-21T01:19:54.547528+0000","last_unstale":"2024-05-21T01:20:00.209668+0000","last_undegraded":"2024-05-21T01:20:00.209668+0000","last_fullsized":"2024-05-21T01:20:00.209668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:47:24.598610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.209472+0000","last_change":"2024-05-21T01:19:54.575256+0000","last_active":"2024-05-21T01:20:00.209472+0000","last_peered":"2024-05-21T01:20:00.209472+0000","last_clean":"2024-05-21T01:20:00.209472+0000","last_became_active":"2024-05-21T01:19:54.570119+0000","last_became_peered":"2024-05-21T01:19:54.570119+0000","last_unstale":"2024-05-21T01:20:00.209472+0000","last_undegraded":"2024-05-21T01:20:00.209472+0000","last_fullsized":"2024-05-21T01:20:00.209472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:10:02.800110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.206200+0000","last_change":"2024-05-21T01:19:54.550134+0000","last_active":"2024-05-21T01:20:00.206200+0000","last_peered":"2024-05-21T01:20:00.206200+0000","last_clean":"2024-05-21T01:20:00.206200+0000","last_became_active":"2024-05-21T01:19:54.549617+0000","last_became_peered":"2024-05-21T01:19:54.549617+0000","last_unstale":"2024-05-21T01:20:00.206200+0000","last_undegraded":"2024-05-21T01:20:00.206200+0000","last_fullsized":"2024-05-21T01:20:00.206200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:34:59.845458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207085+0000","last_change":"2024-05-21T01:19:54.555653+0000","last_active":"2024-05-21T01:20:00.207085+0000","last_peered":"2024-05-21T01:20:00.207085+0000","last_clean":"2024-05-21T01:20:00.207085+0000","last_became_active":"2024-05-21T01:19:54.555274+0000","last_became_peered":"2024-05-21T01:19:54.555274+0000","last_unstale":"2024-05-21T01:20:00.207085+0000","last_undegraded":"2024-05-21T01:20:00.207085+0000","last_fullsized":"2024-05-21T01:20:00.207085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:43:43.237853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207101+0000","last_change":"2024-05-21T01:19:54.568866+0000","last_active":"2024-05-21T01:20:00.207101+0000","last_peered":"2024-05-21T01:20:00.207101+0000","last_clean":"2024-05-21T01:20:00.207101+0000","last_became_active":"2024-05-21T01:19:54.568605+0000","last_became_peered":"2024-05-21T01:19:54.568605+0000","last_unstale":"2024-05-21T01:20:00.207101+0000","last_undegraded":"2024-05-21T01:20:00.207101+0000","last_fullsized":"2024-05-21T01:20:00.207101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:21:20.820620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.207281+0000","last_change":"2024-05-21T01:19:54.557468+0000","last_active":"2024-05-21T01:20:00.207281+0000","last_peered":"2024-05-21T01:20:00.207281+0000","last_clean":"2024-05-21T01:20:00.207281+0000","last_became_active":"2024-05-21T01:19:54.554976+0000","last_became_peered":"2024-05-21T01:19:54.554976+0000","last_unstale":"2024-05-21T01:20:00.207281+0000","last_undegraded":"2024-05-21T01:20:00.207281+0000","last_fullsized":"2024-05-21T01:20:00.207281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:25:08.737348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.210942+0000","last_change":"2024-05-21T01:19:54.566991+0000","last_active":"2024-05-21T01:20:00.210942+0000","last_peered":"2024-05-21T01:20:00.210942+0000","last_clean":"2024-05-21T01:20:00.210942+0000","last_became_active":"2024-05-21T01:19:54.566349+0000","last_became_peered":"2024-05-21T01:19:54.566349+0000","last_unstale":"2024-05-21T01:20:00.210942+0000","last_undegraded":"2024-05-21T01:20:00.210942+0000","last_fullsized":"2024-05-21T01:20:00.210942+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:25:43.468081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.211304+0000","last_change":"2024-05-21T01:19:54.576100+0000","last_active":"2024-05-21T01:20:00.211304+0000","last_peered":"2024-05-21T01:20:00.211304+0000","last_clean":"2024-05-21T01:20:00.211304+0000","last_became_active":"2024-05-21T01:19:54.574914+0000","last_became_peered":"2024-05-21T01:19:54.574914+0000","last_unstale":"2024-05-21T01:20:00.211304+0000","last_undegraded":"2024-05-21T01:20:00.211304+0000","last_fullsized":"2024-05-21T01:20:00.211304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:29:30.730283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T01:20:00.208436+0000","last_change":"2024-05-21T01:19:54.546570+0000","last_active":"2024-05-21T01:20:00.208436+0000","last_peered":"2024-05-21T01:20:00.208436+0000","last_clean":"2024-05-21T01:20:00.208436+0000","last_became_active":"2024-05-21T01:19:54.546284+0000","last_became_peered":"2024-05-21T01:19:54.546284+0000","last_unstale":"2024-05-21T01:20:00.208436+0000","last_undegraded":"2024-05-21T01:20:00.208436+0000","last_fullsized":"2024-05-21T01:20:00.208436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:36:30.219522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":7452,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":128,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":14904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66932,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509455,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":104037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509454,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":106687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509453,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":331776,"data_stored":693339,"data_compressed":33466,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509453,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":104127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542158,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":270336,"data_stored":104015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542157,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":344064,"data_stored":693983,"data_compressed":33466,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574861,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":103719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574861,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":108221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33466,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33466,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":5410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-21T01:20:41.165 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-21T01:20:41.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.341+0000 7f59a6200640 1 Processor -- start 2024-05-21T01:20:41.345 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.341+0000 7f59a6200640 1 -- start start 2024-05-21T01:20:41.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.341+0000 7f59a6200640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f59a0156070 0x7f59a0071640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:41.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.341+0000 7f59a6200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f59a006f080 0x7f59a015d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:41.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.341+0000 7f59a6200640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59a015bf20 con 0x7f59a0071b80 2024-05-21T01:20:41.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.341+0000 7f59a6200640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f59a015c1e0 con 0x7f59a0156070 2024-05-21T01:20:41.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.341+0000 7f59a6200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f59a015c4c0 con 0x7f59a006f080 2024-05-21T01:20:41.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.341+0000 7f599f400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f59a0156070 0x7f59a0071640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:41.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.341+0000 7f599fe00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f59a006f080 0x7f59a015d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:41.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.341+0000 7f599ea00640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f59a0071b80 0x7f59a00cf530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.63:48910/0 (socket says 172.21.15.63:48910) 2024-05-21T01:20:41.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.341+0000 7f599ea00640 1 -- 172.21.15.63:0/3092440512 learned_addr learned my addr 172.21.15.63:0/3092440512 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-05-21T01:20:41.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.341+0000 7f599f400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f59a0156070 0x7f59a0071640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.63:41908/0 (socket says 172.21.15.63:41908) 2024-05-21T01:20:41.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.341+0000 7f599fe00640 1 -- 172.21.15.63:0/3092440512 >> v2:172.21.15.131:3300/0 conn(0x7f59a0156070 msgr2=0x7f59a0071640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:41.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.341+0000 7f599fe00640 1 --2- 172.21.15.63:0/3092440512 >> v2:172.21.15.131:3300/0 conn(0x7f59a0156070 0x7f59a0071640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:41.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.341+0000 7f599fe00640 1 -- 172.21.15.63:0/3092440512 >> v1:172.21.15.131:6789/0 conn(0x7f59a0071b80 legacy=0x7f59a00cf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:41.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.341+0000 7f599fe00640 1 -- 172.21.15.63:0/3092440512 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59a015c7a0 con 0x7f59a006f080 2024-05-21T01:20:41.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.341+0000 7f599f400640 1 --2- 172.21.15.63:0/3092440512 >> v2:172.21.15.131:3300/0 conn(0x7f59a0156070 0x7f59a0071640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-21T01:20:41.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.345+0000 7f599fe00640 1 --2- 172.21.15.63:0/3092440512 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f59a006f080 0x7f59a015d9d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5998009d90 tx=0x7f599801c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a7c2224ad5b2a84 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:41.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.345+0000 7f599e000640 1 -- 172.21.15.63:0/3092440512 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59980b2070 con 0x7f59a006f080 2024-05-21T01:20:41.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.345+0000 7f599e000640 1 -- 172.21.15.63:0/3092440512 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59980a5830 con 0x7f59a006f080 2024-05-21T01:20:41.350 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.345+0000 7f599e000640 1 -- 172.21.15.63:0/3092440512 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59980a5c00 con 0x7f59a006f080 2024-05-21T01:20:41.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.345+0000 7f59a6200640 1 -- 172.21.15.63:0/3092440512 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f59a006f080 msgr2=0x7f59a015d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:41.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.345+0000 7f59a6200640 1 --2- 172.21.15.63:0/3092440512 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f59a006f080 0x7f59a015d9d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5998009d90 tx=0x7f599801c970 comp rx=0 tx=0).stop 2024-05-21T01:20:41.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.345+0000 7f59a6200640 1 -- 172.21.15.63:0/3092440512 shutdown_connections 2024-05-21T01:20:41.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.345+0000 7f59a6200640 1 --2- 172.21.15.63:0/3092440512 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f59a006f080 0x7f59a015d9d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:41.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.345+0000 7f59a6200640 1 --2- 172.21.15.63:0/3092440512 >> v2:172.21.15.131:3300/0 conn(0x7f59a0156070 0x7f59a0071640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:41.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.345+0000 7f59a6200640 1 -- 172.21.15.63:0/3092440512 >> 172.21.15.63:0/3092440512 conn(0x7f59a00735f0 msgr2=0x7f59a0073a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:41.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.345+0000 7f59a6200640 1 -- 172.21.15.63:0/3092440512 shutdown_connections 2024-05-21T01:20:41.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.345+0000 7f59a6200640 1 -- 172.21.15.63:0/3092440512 wait complete. 2024-05-21T01:20:41.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.349+0000 7f59a6200640 1 Processor -- start 2024-05-21T01:20:41.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.349+0000 7f59a6200640 1 -- start start 2024-05-21T01:20:41.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.349+0000 7f59a6200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f59a006f080 0x7f59a01586e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:41.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.349+0000 7f59a6200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f59a0071b80 0x7f59a0156950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:41.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.349+0000 7f59a6200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f59a0156070 0x7f59a0156e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:41.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.349+0000 7f59a6200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f59a006e140 con 0x7f59a0071b80 2024-05-21T01:20:41.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.349+0000 7f59a6200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f59a006dfc0 con 0x7f59a0156070 2024-05-21T01:20:41.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.349+0000 7f59a6200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f59a00cfc40 con 0x7f59a006f080 2024-05-21T01:20:41.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.349+0000 7f599ea00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f59a0071b80 0x7f59a0156950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:41.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.349+0000 7f599ea00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f59a0071b80 0x7f59a0156950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38274/0 (socket says 172.21.15.63:38274) 2024-05-21T01:20:41.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.349+0000 7f599ea00640 1 -- 172.21.15.63:0/4043025161 learned_addr learned my addr 172.21.15.63:0/4043025161 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:41.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.349+0000 7f599fe00640 1 --2- 172.21.15.63:0/4043025161 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f59a0156070 0x7f59a0156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:41.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.349+0000 7f599f400640 1 --2- 172.21.15.63:0/4043025161 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f59a006f080 0x7f59a01586e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:41.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.349+0000 7f599ea00640 1 -- 172.21.15.63:0/4043025161 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f59a006f080 msgr2=0x7f59a01586e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:41.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.349+0000 7f599ea00640 1 --2- 172.21.15.63:0/4043025161 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f59a006f080 0x7f59a01586e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:41.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.349+0000 7f599ea00640 1 -- 172.21.15.63:0/4043025161 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f59a0156070 msgr2=0x7f59a0156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:41.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.349+0000 7f599ea00640 1 --2- 172.21.15.63:0/4043025161 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f59a0156070 0x7f59a0156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:41.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.349+0000 7f599ea00640 1 -- 172.21.15.63:0/4043025161 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59a01618c0 con 0x7f59a0071b80 2024-05-21T01:20:41.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.349+0000 7f599fe00640 1 --2- 172.21.15.63:0/4043025161 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f59a0156070 0x7f59a0156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T01:20:41.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.349+0000 7f599ea00640 1 --2- 172.21.15.63:0/4043025161 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f59a0071b80 0x7f59a0156950 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f598c00c4b0 tx=0x7f598c00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:41.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.349+0000 7f5997400640 1 -- 172.21.15.63:0/4043025161 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f598c017070 con 0x7f59a0071b80 2024-05-21T01:20:41.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.349+0000 7f5997400640 1 -- 172.21.15.63:0/4043025161 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f598c005d10 con 0x7f59a0071b80 2024-05-21T01:20:41.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.349+0000 7f59a6200640 1 -- 172.21.15.63:0/4043025161 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59a0161b30 con 0x7f59a0071b80 2024-05-21T01:20:41.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.349+0000 7f5997400640 1 -- 172.21.15.63:0/4043025161 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f598c0072b0 con 0x7f59a0071b80 2024-05-21T01:20:41.356 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.349+0000 7f59a6200640 1 -- 172.21.15.63:0/4043025161 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59a01620f0 con 0x7f59a0071b80 2024-05-21T01:20:41.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.353+0000 7f59a6200640 1 -- 172.21.15.63:0/4043025161 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59a00507f0 con 0x7f59a0071b80 2024-05-21T01:20:41.357 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.353+0000 7f5997400640 1 -- 172.21.15.63:0/4043025161 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7f598c01a070 con 0x7f59a0071b80 2024-05-21T01:20:41.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.353+0000 7f5997400640 1 --2- 172.21.15.63:0/4043025161 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f598006f400 0x7f59800718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:41.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.353+0000 7f5997400640 1 -- 172.21.15.63:0/4043025161 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f598c08e910 con 0x7f59a0071b80 2024-05-21T01:20:41.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.353+0000 7f599f400640 1 --2- 172.21.15.63:0/4043025161 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f598006f400 0x7f59800718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:41.359 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.353+0000 7f599f400640 1 --2- 172.21.15.63:0/4043025161 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f598006f400 0x7f59800718c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5990009580 tx=0x7f5990009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:41.362 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.357+0000 7f5997400640 1 -- 172.21.15.63:0/4043025161 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f598c05add0 con 0x7f59a0071b80 2024-05-21T01:20:41.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.561+0000 7f59a6200640 1 -- 172.21.15.63:0/4043025161 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f59a0071f60 con 0x7f59a0071b80 2024-05-21T01:20:41.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.561+0000 7f5997400640 1 -- 172.21.15.63:0/4043025161 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+6876 (secure 0 0 0) 0x7f598c05f0d0 con 0x7f59a0071b80 2024-05-21T01:20:41.566 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-05-21T01:20:41.566 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6839/3045714273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6837","nonce":3045714273},{"type":"v1","addr":"172.21.15.131:6839","nonce":3045714273}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/2978367338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":2978367338},{"type":"v1","addr":"172.21.15.131:6835","nonce":2978367338}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/3005995321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6835","nonce":3005995321},{"type":"v1","addr":"172.21.15.63:6837","nonce":3005995321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-21T01:19:53.915775+0000","modified":"2024-05-21T01:20:31.724475+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4276,"mds_1":4270,"mds_2":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"e","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.63:6833/574189772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":574189772},{"type":"v1","addr":"172.21.15.63:6833","nonce":574189772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4270":{"gid":4270,"name":"f","rank":1,"incarnation":10,"state":"up:active","state_seq":11,"addr":"172.21.15.131:6838/3071941741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":3071941741},{"type":"v1","addr":"172.21.15.131:6838","nonce":3071941741}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.63:6836/2892727989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":2892727989},{"type":"v1","addr":"172.21.15.63:6836","nonce":2892727989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4276,"qdb_cluster":[4267,4270,4276]},"id":1}]} 2024-05-21T01:20:41.566 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 15 2024-05-21T01:20:41.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.561+0000 7f59a6200640 1 -- 172.21.15.63:0/4043025161 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f598006f400 msgr2=0x7f59800718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:41.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.561+0000 7f59a6200640 1 --2- 172.21.15.63:0/4043025161 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f598006f400 0x7f59800718c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5990009580 tx=0x7f5990009190 comp rx=0 tx=0).stop 2024-05-21T01:20:41.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.561+0000 7f59a6200640 1 -- 172.21.15.63:0/4043025161 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f59a0071b80 msgr2=0x7f59a0156950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:41.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.561+0000 7f59a6200640 1 --2- 172.21.15.63:0/4043025161 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f59a0071b80 0x7f59a0156950 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f598c00c4b0 tx=0x7f598c00c970 comp rx=0 tx=0).stop 2024-05-21T01:20:41.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.561+0000 7f59a6200640 1 -- 172.21.15.63:0/4043025161 shutdown_connections 2024-05-21T01:20:41.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.561+0000 7f59a6200640 1 --2- 172.21.15.63:0/4043025161 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f598006f400 0x7f59800718c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:41.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.561+0000 7f59a6200640 1 --2- 172.21.15.63:0/4043025161 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f59a0156070 0x7f59a0156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:41.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.561+0000 7f59a6200640 1 --2- 172.21.15.63:0/4043025161 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f59a0071b80 0x7f59a0156950 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:41.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.561+0000 7f59a6200640 1 --2- 172.21.15.63:0/4043025161 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f59a006f080 0x7f59a01586e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:41.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.561+0000 7f59a6200640 1 -- 172.21.15.63:0/4043025161 >> 172.21.15.63:0/4043025161 conn(0x7f59a00735f0 msgr2=0x7f59a00739d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:41.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.561+0000 7f59a6200640 1 -- 172.21.15.63:0/4043025161 shutdown_connections 2024-05-21T01:20:41.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.561+0000 7f59a6200640 1 -- 172.21.15.63:0/4043025161 wait complete. 2024-05-21T01:20:41.587 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-21T01:20:41.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.725+0000 7f96f3600640 1 Processor -- start 2024-05-21T01:20:41.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.725+0000 7f96f3600640 1 -- start start 2024-05-21T01:20:41.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.725+0000 7f96f3600640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f96ec06f9b0 0x7f96ec152a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:41.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.725+0000 7f96f3600640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f96ec15ce40 0x7f96ec152f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:41.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.725+0000 7f96f3600640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96ec072550 con 0x7f96ec06f5d0 2024-05-21T01:20:41.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.725+0000 7f96f3600640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f96ec159100 con 0x7f96ec15ce40 2024-05-21T01:20:41.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.725+0000 7f96f3600640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f96ec1593e0 con 0x7f96ec06f9b0 2024-05-21T01:20:41.732 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.725+0000 7f96e3e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f96ec06f9b0 0x7f96ec152a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:41.732 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.725+0000 7f96f1600640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f96ec15ce40 0x7f96ec152f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:41.732 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.725+0000 7f96f0c00640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f96ec06f5d0 0x7f96ec0c8a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.63:48920/0 (socket says 172.21.15.63:48920) 2024-05-21T01:20:41.732 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.725+0000 7f96f0c00640 1 -- 172.21.15.63:0/3463481892 learned_addr learned my addr 172.21.15.63:0/3463481892 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-05-21T01:20:41.732 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.725+0000 7f96e3e00640 1 -- 172.21.15.63:0/3463481892 >> v2:172.21.15.131:3300/0 conn(0x7f96ec15ce40 msgr2=0x7f96ec152f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:41.732 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.725+0000 7f96e3e00640 1 --2- 172.21.15.63:0/3463481892 >> v2:172.21.15.131:3300/0 conn(0x7f96ec15ce40 0x7f96ec152f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:41.732 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.725+0000 7f96e3e00640 1 -- 172.21.15.63:0/3463481892 >> v1:172.21.15.131:6789/0 conn(0x7f96ec06f5d0 legacy=0x7f96ec0c8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:41.732 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.725+0000 7f96e3e00640 1 -- 172.21.15.63:0/3463481892 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96ec1596c0 con 0x7f96ec06f9b0 2024-05-21T01:20:41.732 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.725+0000 7f96f1600640 1 --2- 172.21.15.63:0/3463481892 >> v2:172.21.15.131:3300/0 conn(0x7f96ec15ce40 0x7f96ec152f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-21T01:20:41.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.729+0000 7f96e3e00640 1 --2- 172.21.15.63:0/3463481892 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f96ec06f9b0 0x7f96ec152a40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f96d40097c0 tx=0x7f96d401c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ec414253afd648d server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:41.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.729+0000 7f96ebe00640 1 -- 172.21.15.63:0/3463481892 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96d40b2070 con 0x7f96ec06f9b0 2024-05-21T01:20:41.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.729+0000 7f96ebe00640 1 -- 172.21.15.63:0/3463481892 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96d40ad640 con 0x7f96ec06f9b0 2024-05-21T01:20:41.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.729+0000 7f96ebe00640 1 -- 172.21.15.63:0/3463481892 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96d40ada10 con 0x7f96ec06f9b0 2024-05-21T01:20:41.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.729+0000 7f96f3600640 1 -- 172.21.15.63:0/3463481892 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f96ec06f9b0 msgr2=0x7f96ec152a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:41.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.729+0000 7f96f3600640 1 --2- 172.21.15.63:0/3463481892 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f96ec06f9b0 0x7f96ec152a40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f96d40097c0 tx=0x7f96d401c4a0 comp rx=0 tx=0).stop 2024-05-21T01:20:41.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.729+0000 7f96f3600640 1 -- 172.21.15.63:0/3463481892 shutdown_connections 2024-05-21T01:20:41.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.729+0000 7f96f3600640 1 --2- 172.21.15.63:0/3463481892 >> v2:172.21.15.131:3300/0 conn(0x7f96ec15ce40 0x7f96ec152f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:41.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.729+0000 7f96f3600640 1 --2- 172.21.15.63:0/3463481892 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f96ec06f9b0 0x7f96ec152a40 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:41.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.729+0000 7f96f3600640 1 -- 172.21.15.63:0/3463481892 >> 172.21.15.63:0/3463481892 conn(0x7f96ec068460 msgr2=0x7f96ec068870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:41.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.729+0000 7f96f3600640 1 -- 172.21.15.63:0/3463481892 shutdown_connections 2024-05-21T01:20:41.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.729+0000 7f96f3600640 1 -- 172.21.15.63:0/3463481892 wait complete. 2024-05-21T01:20:41.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.733+0000 7f96f3600640 1 Processor -- start 2024-05-21T01:20:41.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.733+0000 7f96f3600640 1 -- start start 2024-05-21T01:20:41.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.733+0000 7f96f3600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96ec06f5d0 0x7f96ec159f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:41.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.733+0000 7f96f3600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f96ec06f9b0 0x7f96ec14f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:41.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.733+0000 7f96f3600640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f96ec15ce40 0x7f96ec14fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:41.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.733+0000 7f96f3600640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f96ec1658a0 con 0x7f96ec06f9b0 2024-05-21T01:20:41.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.733+0000 7f96f3600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f96ec165720 con 0x7f96ec06f5d0 2024-05-21T01:20:41.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.733+0000 7f96f3600640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f96ec165a20 con 0x7f96ec15ce40 2024-05-21T01:20:41.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.733+0000 7f96e3e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f96ec06f9b0 0x7f96ec14f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:41.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.733+0000 7f96e3e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f96ec06f9b0 0x7f96ec14f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38280/0 (socket says 172.21.15.63:38280) 2024-05-21T01:20:41.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.733+0000 7f96e3e00640 1 -- 172.21.15.63:0/937171486 learned_addr learned my addr 172.21.15.63:0/937171486 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:41.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.733+0000 7f96f0c00640 1 --2- 172.21.15.63:0/937171486 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96ec06f5d0 0x7f96ec159f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:41.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.733+0000 7f96f1600640 1 --2- 172.21.15.63:0/937171486 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f96ec15ce40 0x7f96ec14fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:41.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.733+0000 7f96e3e00640 1 -- 172.21.15.63:0/937171486 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f96ec15ce40 msgr2=0x7f96ec14fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:41.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.733+0000 7f96e3e00640 1 --2- 172.21.15.63:0/937171486 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f96ec15ce40 0x7f96ec14fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:41.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.733+0000 7f96e3e00640 1 -- 172.21.15.63:0/937171486 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96ec06f5d0 msgr2=0x7f96ec159f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:41.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.733+0000 7f96e3e00640 1 --2- 172.21.15.63:0/937171486 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96ec06f5d0 0x7f96ec159f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:41.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.733+0000 7f96e3e00640 1 -- 172.21.15.63:0/937171486 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96ec1f9090 con 0x7f96ec06f9b0 2024-05-21T01:20:41.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.733+0000 7f96f1600640 1 --2- 172.21.15.63:0/937171486 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f96ec15ce40 0x7f96ec14fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T01:20:41.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.733+0000 7f96e3e00640 1 --2- 172.21.15.63:0/937171486 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f96ec06f9b0 0x7f96ec14f7a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f96d40b0040 tx=0x7f96d4019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:41.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.733+0000 7f96e9600640 1 -- 172.21.15.63:0/937171486 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96d40b2040 con 0x7f96ec06f9b0 2024-05-21T01:20:41.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.737+0000 7f96e9600640 1 -- 172.21.15.63:0/937171486 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96d40bc070 con 0x7f96ec06f9b0 2024-05-21T01:20:41.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.737+0000 7f96e9600640 1 -- 172.21.15.63:0/937171486 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96d40b6670 con 0x7f96ec06f9b0 2024-05-21T01:20:41.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.737+0000 7f96f3600640 1 -- 172.21.15.63:0/937171486 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96ec1f50b0 con 0x7f96ec06f9b0 2024-05-21T01:20:41.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.737+0000 7f96f3600640 1 -- 172.21.15.63:0/937171486 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96ec1f5670 con 0x7f96ec06f9b0 2024-05-21T01:20:41.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.737+0000 7f96f3600640 1 -- 172.21.15.63:0/937171486 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96ec0507f0 con 0x7f96ec06f9b0 2024-05-21T01:20:41.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.737+0000 7f96e9600640 1 -- 172.21.15.63:0/937171486 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7f96d40b6810 con 0x7f96ec06f9b0 2024-05-21T01:20:41.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.737+0000 7f96e9600640 1 --2- 172.21.15.63:0/937171486 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f96c806f400 0x7f96c80718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:41.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.737+0000 7f96e9600640 1 -- 172.21.15.63:0/937171486 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f96d41294f0 con 0x7f96ec06f9b0 2024-05-21T01:20:41.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.737+0000 7f96f0c00640 1 --2- 172.21.15.63:0/937171486 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f96c806f400 0x7f96c80718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:41.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.741+0000 7f96f0c00640 1 --2- 172.21.15.63:0/937171486 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f96c806f400 0x7f96c80718c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f96dc000f70 tx=0x7f96dc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:41.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.741+0000 7f96e9600640 1 -- 172.21.15.63:0/937171486 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f96d4016090 con 0x7f96ec06f9b0 2024-05-21T01:20:41.944 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.937+0000 7f96f3600640 1 -- 172.21.15.63:0/937171486 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f96ec0c8260 con 0x7f96ec06f9b0 2024-05-21T01:20:41.945 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.941+0000 7f96e9600640 1 -- 172.21.15.63:0/937171486 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+6876 (secure 0 0 0) 0x7f96d40f6090 con 0x7f96ec06f9b0 2024-05-21T01:20:41.945 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-05-21T01:20:41.945 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6839/3045714273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6837","nonce":3045714273},{"type":"v1","addr":"172.21.15.131:6839","nonce":3045714273}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/2978367338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":2978367338},{"type":"v1","addr":"172.21.15.131:6835","nonce":2978367338}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/3005995321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6835","nonce":3005995321},{"type":"v1","addr":"172.21.15.63:6837","nonce":3005995321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-21T01:19:53.915775+0000","modified":"2024-05-21T01:20:31.724475+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4276,"mds_1":4270,"mds_2":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"e","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.63:6833/574189772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":574189772},{"type":"v1","addr":"172.21.15.63:6833","nonce":574189772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4270":{"gid":4270,"name":"f","rank":1,"incarnation":10,"state":"up:active","state_seq":11,"addr":"172.21.15.131:6838/3071941741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":3071941741},{"type":"v1","addr":"172.21.15.131:6838","nonce":3071941741}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.63:6836/2892727989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":2892727989},{"type":"v1","addr":"172.21.15.63:6836","nonce":2892727989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4276,"qdb_cluster":[4267,4270,4276]},"id":1}]} 2024-05-21T01:20:41.945 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 15 2024-05-21T01:20:41.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.941+0000 7f96f3600640 1 -- 172.21.15.63:0/937171486 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f96c806f400 msgr2=0x7f96c80718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:41.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.941+0000 7f96f3600640 1 --2- 172.21.15.63:0/937171486 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f96c806f400 0x7f96c80718c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f96dc000f70 tx=0x7f96dc009040 comp rx=0 tx=0).stop 2024-05-21T01:20:41.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.941+0000 7f96f3600640 1 -- 172.21.15.63:0/937171486 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f96ec06f9b0 msgr2=0x7f96ec14f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:41.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.941+0000 7f96f3600640 1 --2- 172.21.15.63:0/937171486 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f96ec06f9b0 0x7f96ec14f7a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f96d40b0040 tx=0x7f96d4019240 comp rx=0 tx=0).stop 2024-05-21T01:20:41.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.941+0000 7f96f3600640 1 -- 172.21.15.63:0/937171486 shutdown_connections 2024-05-21T01:20:41.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.941+0000 7f96f3600640 1 --2- 172.21.15.63:0/937171486 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f96c806f400 0x7f96c80718c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:41.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.941+0000 7f96f3600640 1 --2- 172.21.15.63:0/937171486 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f96ec15ce40 0x7f96ec14fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:41.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.941+0000 7f96f3600640 1 --2- 172.21.15.63:0/937171486 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f96ec06f9b0 0x7f96ec14f7a0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:41.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.941+0000 7f96f3600640 1 --2- 172.21.15.63:0/937171486 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96ec06f5d0 0x7f96ec159f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:41.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.941+0000 7f96f3600640 1 -- 172.21.15.63:0/937171486 >> 172.21.15.63:0/937171486 conn(0x7f96ec068460 msgr2=0x7f96ec157470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:41.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.941+0000 7f96f3600640 1 -- 172.21.15.63:0/937171486 shutdown_connections 2024-05-21T01:20:41.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:41.941+0000 7f96f3600640 1 -- 172.21.15.63:0/937171486 wait complete. 2024-05-21T01:20:41.966 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-21T01:20:42.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.101+0000 7ff60f600640 1 Processor -- start 2024-05-21T01:20:42.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.101+0000 7ff60f600640 1 -- start start 2024-05-21T01:20:42.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.101+0000 7ff60f600640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff608156150 0x7ff60815bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:42.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.101+0000 7ff60f600640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff608073480 0x7ff608071190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:42.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.101+0000 7ff60f600640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff60806f510 con 0x7ff6080716d0 2024-05-21T01:20:42.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.105+0000 7ff60f600640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7ff608070a20 con 0x7ff608073480 2024-05-21T01:20:42.109 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.105+0000 7ff60f600640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7ff608073ac0 con 0x7ff608156150 2024-05-21T01:20:42.109 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.105+0000 7ff607e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff608073480 0x7ff608071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:42.109 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.105+0000 7ff60cc00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff608156150 0x7ff60815bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:42.109 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.105+0000 7ff60d600640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7ff6080716d0 0x7ff60806d5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.63:48936/0 (socket says 172.21.15.63:48936) 2024-05-21T01:20:42.109 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.105+0000 7ff60d600640 1 -- 172.21.15.63:0/722347600 learned_addr learned my addr 172.21.15.63:0/722347600 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-05-21T01:20:42.109 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.105+0000 7ff607e00640 1 -- 172.21.15.63:0/722347600 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff608156150 msgr2=0x7ff60815bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:42.109 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.105+0000 7ff607e00640 1 --2- 172.21.15.63:0/722347600 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff608156150 0x7ff60815bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:42.109 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.105+0000 7ff607e00640 1 -- 172.21.15.63:0/722347600 >> v1:172.21.15.131:6789/0 conn(0x7ff6080716d0 legacy=0x7ff60806d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:42.109 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.105+0000 7ff607e00640 1 -- 172.21.15.63:0/722347600 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff608073da0 con 0x7ff608073480 2024-05-21T01:20:42.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.105+0000 7ff607e00640 1 --2- 172.21.15.63:0/722347600 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff608073480 0x7ff608071190 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff608070ba0 tx=0x7ff5f401c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14958e997b341ba3 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:42.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.109+0000 7ff607400640 1 -- 172.21.15.63:0/722347600 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5f40b0070 con 0x7ff608073480 2024-05-21T01:20:42.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.109+0000 7ff607400640 1 -- 172.21.15.63:0/722347600 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5f40ab600 con 0x7ff608073480 2024-05-21T01:20:42.112 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.109+0000 7ff607400640 1 -- 172.21.15.63:0/722347600 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5f40ab9d0 con 0x7ff608073480 2024-05-21T01:20:42.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.109+0000 7ff60f600640 1 -- 172.21.15.63:0/722347600 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff608073480 msgr2=0x7ff608071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:42.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.109+0000 7ff60f600640 1 --2- 172.21.15.63:0/722347600 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff608073480 0x7ff608071190 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff608070ba0 tx=0x7ff5f401c410 comp rx=0 tx=0).stop 2024-05-21T01:20:42.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.109+0000 7ff60f600640 1 -- 172.21.15.63:0/722347600 shutdown_connections 2024-05-21T01:20:42.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.109+0000 7ff60f600640 1 --2- 172.21.15.63:0/722347600 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff608073480 0x7ff608071190 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:42.113 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.109+0000 7ff60f600640 1 --2- 172.21.15.63:0/722347600 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff608156150 0x7ff60815bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:42.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.109+0000 7ff60f600640 1 -- 172.21.15.63:0/722347600 >> 172.21.15.63:0/722347600 conn(0x7ff6080cbf10 msgr2=0x7ff6080cc320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:42.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.109+0000 7ff60f600640 1 -- 172.21.15.63:0/722347600 shutdown_connections 2024-05-21T01:20:42.114 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.109+0000 7ff60f600640 1 -- 172.21.15.63:0/722347600 wait complete. 2024-05-21T01:20:42.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.109+0000 7ff60f600640 1 Processor -- start 2024-05-21T01:20:42.115 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.109+0000 7ff60f600640 1 -- start start 2024-05-21T01:20:42.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.109+0000 7ff60f600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff6080716d0 0x7ff60814d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:42.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.109+0000 7ff60f600640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff608073480 0x7ff6080cd510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:42.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.109+0000 7ff60f600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff608156150 0x7ff6080ced80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:42.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.109+0000 7ff60f600640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff60806de40 con 0x7ff608156150 2024-05-21T01:20:42.116 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.109+0000 7ff60f600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7ff60806dcc0 con 0x7ff6080716d0 2024-05-21T01:20:42.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.109+0000 7ff60f600640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7ff608168ed0 con 0x7ff608073480 2024-05-21T01:20:42.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.109+0000 7ff60d600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff608156150 0x7ff6080ced80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:42.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.109+0000 7ff60d600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff608156150 0x7ff6080ced80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38296/0 (socket says 172.21.15.63:38296) 2024-05-21T01:20:42.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.109+0000 7ff60d600640 1 -- 172.21.15.63:0/1028120178 learned_addr learned my addr 172.21.15.63:0/1028120178 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:42.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.113+0000 7ff60cc00640 1 --2- 172.21.15.63:0/1028120178 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff6080716d0 0x7ff60814d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:42.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.113+0000 7ff607e00640 1 --2- 172.21.15.63:0/1028120178 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff608073480 0x7ff6080cd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:42.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.113+0000 7ff60d600640 1 -- 172.21.15.63:0/1028120178 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff608073480 msgr2=0x7ff6080cd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:42.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.113+0000 7ff60d600640 1 --2- 172.21.15.63:0/1028120178 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff608073480 0x7ff6080cd510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:42.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.113+0000 7ff60d600640 1 -- 172.21.15.63:0/1028120178 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff6080716d0 msgr2=0x7ff60814d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:42.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.113+0000 7ff60d600640 1 --2- 172.21.15.63:0/1028120178 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff6080716d0 0x7ff60814d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:42.117 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.113+0000 7ff60d600640 1 -- 172.21.15.63:0/1028120178 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6081f5c20 con 0x7ff608156150 2024-05-21T01:20:42.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.113+0000 7ff60d600640 1 --2- 172.21.15.63:0/1028120178 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff608156150 0x7ff6080ced80 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff60000cb40 tx=0x7ff60000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:42.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.113+0000 7ff604c00640 1 -- 172.21.15.63:0/1028120178 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff600017070 con 0x7ff608156150 2024-05-21T01:20:42.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.113+0000 7ff604c00640 1 -- 172.21.15.63:0/1028120178 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff60000abe0 con 0x7ff608156150 2024-05-21T01:20:42.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.113+0000 7ff604c00640 1 -- 172.21.15.63:0/1028120178 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff600012400 con 0x7ff608156150 2024-05-21T01:20:42.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.113+0000 7ff60f600640 1 -- 172.21.15.63:0/1028120178 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6081f5f00 con 0x7ff608156150 2024-05-21T01:20:42.118 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.113+0000 7ff60f600640 1 -- 172.21.15.63:0/1028120178 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff60815fe90 con 0x7ff608156150 2024-05-21T01:20:42.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.113+0000 7ff60f600640 1 -- 172.21.15.63:0/1028120178 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6081600d0 con 0x7ff608156150 2024-05-21T01:20:42.119 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.113+0000 7ff604c00640 1 -- 172.21.15.63:0/1028120178 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7ff60001a070 con 0x7ff608156150 2024-05-21T01:20:42.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.113+0000 7ff604c00640 1 --2- 172.21.15.63:0/1028120178 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7ff5e806f430 0x7ff5e80718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:42.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.117+0000 7ff604c00640 1 -- 172.21.15.63:0/1028120178 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7ff60008f1e0 con 0x7ff608156150 2024-05-21T01:20:42.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.117+0000 7ff60cc00640 1 --2- 172.21.15.63:0/1028120178 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7ff5e806f430 0x7ff5e80718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:42.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.117+0000 7ff60cc00640 1 --2- 172.21.15.63:0/1028120178 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7ff5e806f430 0x7ff5e80718f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc009ac0 tx=0x7ff5fc009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:42.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.117+0000 7ff604c00640 1 -- 172.21.15.63:0/1028120178 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7ff6081600d0 con 0x7ff608156150 2024-05-21T01:20:42.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.285+0000 7ff60f600640 1 -- 172.21.15.63:0/1028120178 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff6080cea60 con 0x7ff608156150 2024-05-21T01:20:42.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.285+0000 7ff604c00640 1 -- 172.21.15.63:0/1028120178 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18482 (secure 0 0 0) 0x7ff6080cea60 con 0x7ff608156150 2024-05-21T01:20:42.291 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-05-21T01:20:42.291 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":25,"fsid":"9a7cbd84-ceb2-41c8-8b6e-ab931f86c51a","created":"2024-05-21T01:19:37.688082+0000","modified":"2024-05-21T01:19:58.978125+0000","last_up_change":"2024-05-21T01:19:48.472107+0000","last_in_change":"2024-05-21T01:19:39.973975+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-21T01:19:46.485266+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-21T01:19:52.032741+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-21T01:19:52.867322+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-21T01:19:56.562363+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cda28135-00bb-4194-adcb-e0abf3ae43f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":3740454920},{"type":"v1","addr":"172.21.15.63:6801","nonce":3740454920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":3740454920},{"type":"v1","addr":"172.21.15.63:6804","nonce":3740454920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":3740454920},{"type":"v1","addr":"172.21.15.63:6812","nonce":3740454920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":3740454920},{"type":"v1","addr":"172.21.15.63:6808","nonce":3740454920}]},"public_addr":"172.21.15.63:6801/3740454920","cluster_addr":"172.21.15.63:6804/3740454920","heartbeat_back_addr":"172.21.15.63:6812/3740454920","heartbeat_front_addr":"172.21.15.63:6808/3740454920","state":["exists","up"]},{"osd":1,"uuid":"4aeb370d-ec2f-4a91-b17b-035fd72bdaea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6803","nonce":896993303},{"type":"v1","addr":"172.21.15.63:6805","nonce":896993303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6807","nonce":896993303},{"type":"v1","addr":"172.21.15.63:6809","nonce":896993303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":896993303},{"type":"v1","addr":"172.21.15.63:6816","nonce":896993303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6811","nonce":896993303},{"type":"v1","addr":"172.21.15.63:6813","nonce":896993303}]},"public_addr":"172.21.15.63:6805/896993303","cluster_addr":"172.21.15.63:6809/896993303","heartbeat_back_addr":"172.21.15.63:6816/896993303","heartbeat_front_addr":"172.21.15.63:6813/896993303","state":["exists","up"]},{"osd":2,"uuid":"8368b112-35a3-43cf-ad1c-803f05708091","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":845807419},{"type":"v1","addr":"172.21.15.63:6817","nonce":845807419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":845807419},{"type":"v1","addr":"172.21.15.63:6819","nonce":845807419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":845807419},{"type":"v1","addr":"172.21.15.63:6823","nonce":845807419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":845807419},{"type":"v1","addr":"172.21.15.63:6821","nonce":845807419}]},"public_addr":"172.21.15.63:6817/845807419","cluster_addr":"172.21.15.63:6819/845807419","heartbeat_back_addr":"172.21.15.63:6823/845807419","heartbeat_front_addr":"172.21.15.63:6821/845807419","state":["exists","up"]},{"osd":3,"uuid":"26208950-e3ca-4b9a-94cd-c159453a5dfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":521563809},{"type":"v1","addr":"172.21.15.63:6825","nonce":521563809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":521563809},{"type":"v1","addr":"172.21.15.63:6827","nonce":521563809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":521563809},{"type":"v1","addr":"172.21.15.63:6831","nonce":521563809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":521563809},{"type":"v1","addr":"172.21.15.63:6829","nonce":521563809}]},"public_addr":"172.21.15.63:6825/521563809","cluster_addr":"172.21.15.63:6827/521563809","heartbeat_back_addr":"172.21.15.63:6831/521563809","heartbeat_front_addr":"172.21.15.63:6829/521563809","state":["exists","up"]},{"osd":4,"uuid":"d8c93283-1e10-4419-9934-d5048c5d0ad1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":2660673588},{"type":"v1","addr":"172.21.15.131:6801","nonce":2660673588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":2660673588},{"type":"v1","addr":"172.21.15.131:6803","nonce":2660673588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":2660673588},{"type":"v1","addr":"172.21.15.131:6807","nonce":2660673588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":2660673588},{"type":"v1","addr":"172.21.15.131:6805","nonce":2660673588}]},"public_addr":"172.21.15.131:6801/2660673588","cluster_addr":"172.21.15.131:6803/2660673588","heartbeat_back_addr":"172.21.15.131:6807/2660673588","heartbeat_front_addr":"172.21.15.131:6805/2660673588","state":["exists","up"]},{"osd":5,"uuid":"93a6fe9b-eaa6-4474-bf9b-ae0571feacf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6809","nonce":2508702891},{"type":"v1","addr":"172.21.15.131:6811","nonce":2508702891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6813","nonce":2508702891},{"type":"v1","addr":"172.21.15.131:6815","nonce":2508702891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6821","nonce":2508702891},{"type":"v1","addr":"172.21.15.131:6823","nonce":2508702891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6817","nonce":2508702891},{"type":"v1","addr":"172.21.15.131:6819","nonce":2508702891}]},"public_addr":"172.21.15.131:6811/2508702891","cluster_addr":"172.21.15.131:6815/2508702891","heartbeat_back_addr":"172.21.15.131:6823/2508702891","heartbeat_front_addr":"172.21.15.131:6819/2508702891","state":["exists","up"]},{"osd":6,"uuid":"e05e6c8c-2dda-49ab-8116-5ea9038d0f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":614380392},{"type":"v1","addr":"172.21.15.131:6810","nonce":614380392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":614380392},{"type":"v1","addr":"172.21.15.131:6814","nonce":614380392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":614380392},{"type":"v1","addr":"172.21.15.131:6822","nonce":614380392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":614380392},{"type":"v1","addr":"172.21.15.131:6818","nonce":614380392}]},"public_addr":"172.21.15.131:6810/614380392","cluster_addr":"172.21.15.131:6814/614380392","heartbeat_back_addr":"172.21.15.131:6822/614380392","heartbeat_front_addr":"172.21.15.131:6818/614380392","state":["exists","up"]},{"osd":7,"uuid":"0b393e5e-eeef-4e32-b23a-d405a8b0e7b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":4219797450},{"type":"v1","addr":"172.21.15.131:6825","nonce":4219797450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":4219797450},{"type":"v1","addr":"172.21.15.131:6827","nonce":4219797450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":4219797450},{"type":"v1","addr":"172.21.15.131:6831","nonce":4219797450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":4219797450},{"type":"v1","addr":"172.21.15.131:6829","nonce":4219797450}]},"public_addr":"172.21.15.131:6825/4219797450","cluster_addr":"172.21.15.131:6827/4219797450","heartbeat_back_addr":"172.21.15.131:6831/4219797450","heartbeat_front_addr":"172.21.15.131:6829/4219797450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.647841+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.912560+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.684614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.936286+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.380500+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.553497+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.517866+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.310320+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-21T01:20:42.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.289+0000 7ff60f600640 1 -- 172.21.15.63:0/1028120178 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7ff5e806f430 msgr2=0x7ff5e80718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:42.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.289+0000 7ff60f600640 1 --2- 172.21.15.63:0/1028120178 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7ff5e806f430 0x7ff5e80718f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc009ac0 tx=0x7ff5fc009190 comp rx=0 tx=0).stop 2024-05-21T01:20:42.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.289+0000 7ff60f600640 1 -- 172.21.15.63:0/1028120178 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff608156150 msgr2=0x7ff6080ced80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:42.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.289+0000 7ff60f600640 1 --2- 172.21.15.63:0/1028120178 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff608156150 0x7ff6080ced80 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff60000cb40 tx=0x7ff60000a060 comp rx=0 tx=0).stop 2024-05-21T01:20:42.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.289+0000 7ff60f600640 1 -- 172.21.15.63:0/1028120178 shutdown_connections 2024-05-21T01:20:42.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.289+0000 7ff60f600640 1 --2- 172.21.15.63:0/1028120178 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7ff5e806f430 0x7ff5e80718f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:42.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.289+0000 7ff60f600640 1 --2- 172.21.15.63:0/1028120178 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff608156150 0x7ff6080ced80 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:42.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.289+0000 7ff60f600640 1 --2- 172.21.15.63:0/1028120178 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff608073480 0x7ff6080cd510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:42.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.289+0000 7ff60f600640 1 --2- 172.21.15.63:0/1028120178 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff6080716d0 0x7ff60814d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:42.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.289+0000 7ff60f600640 1 -- 172.21.15.63:0/1028120178 >> 172.21.15.63:0/1028120178 conn(0x7ff6080cbf10 msgr2=0x7ff60815c270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:42.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.289+0000 7ff60f600640 1 -- 172.21.15.63:0/1028120178 shutdown_connections 2024-05-21T01:20:42.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.289+0000 7ff60f600640 1 -- 172.21.15.63:0/1028120178 wait complete. 2024-05-21T01:20:42.313 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get run_dir 2024-05-21T01:20:42.465 INFO:teuthology.orchestra.run.smithi063.stdout:{"run_dir":"/var/run/ceph"} 2024-05-21T01:20:42.466 DEBUG:tasks.cephfs.filesystem:_json_asok output { "run_dir": "/var/run/ceph" } 2024-05-21T01:20:42.466 INFO:tasks.quiescer.fs.[cephfs]:Initializing Quiescer with seed 2958 2024-05-21T01:20:42.466 DEBUG:tasks.quiescer:Yielding 2024-05-21T01:20:42.466 INFO:teuthology.run_tasks:Running task workunit... 2024-05-21T01:20:42.479 INFO:tasks.workunit:Pulling workunits from ref 0051ea03417a66dbfd5a17ea02c9049bcda16863 2024-05-21T01:20:42.480 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-05-21T01:20:42.480 INFO:tasks.workunit:timeout=3h 2024-05-21T01:20:42.480 INFO:tasks.workunit:cleanup=True 2024-05-21T01:20:42.480 DEBUG:teuthology.orchestra.run.smithi063:> stat -- /home/ubuntu/cephtest/mnt.0 2024-05-21T01:20:42.480 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-21T01:20:42.489 INFO:teuthology.orchestra.run.smithi063.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-05-21T01:20:42.489 INFO:teuthology.orchestra.run.smithi063.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-05-21T01:20:42.489 INFO:teuthology.orchestra.run.smithi063.stdout:Device: 2ch/44d Inode: 1 Links: 2 2024-05-21T01:20:42.489 INFO:teuthology.orchestra.run.smithi063.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-21T01:20:42.489 INFO:teuthology.orchestra.run.smithi063.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-05-21T01:20:42.489 INFO:teuthology.orchestra.run.smithi063.stdout:Modify: 2024-05-21 01:19:59.539042693 +0000 2024-05-21T01:20:42.489 INFO:teuthology.orchestra.run.smithi063.stdout:Change: 2024-05-21 01:20:09.558390205 +0000 2024-05-21T01:20:42.489 INFO:teuthology.orchestra.run.smithi063.stdout: Birth: 2024-05-21 01:19:59.539042693 +0000 2024-05-21T01:20:42.489 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-05-21T01:20:42.490 DEBUG:teuthology.orchestra.run.smithi063:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-05-21T01:20:42.569 DEBUG:teuthology.orchestra.run.smithi063:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 0051ea03417a66dbfd5a17ea02c9049bcda16863 2024-05-21T01:20:42.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.625+0000 7fd983800640 1 Processor -- start 2024-05-21T01:20:42.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.629+0000 7fd983800640 1 -- start start 2024-05-21T01:20:42.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.629+0000 7fd983800640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd97c156070 0x7fd97c071640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:42.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.629+0000 7fd983800640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd97c06f080 0x7fd97c15d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:42.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.629+0000 7fd983800640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd97c15bf20 con 0x7fd97c071b80 2024-05-21T01:20:42.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.629+0000 7fd983800640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7fd97c15c1e0 con 0x7fd97c156070 2024-05-21T01:20:42.660 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.629+0000 7fd983800640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fd97c15c4c0 con 0x7fd97c06f080 2024-05-21T01:20:42.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.629+0000 7fd980e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd97c156070 0x7fd97c071640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:42.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.629+0000 7fd97be00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fd97c071b80 0x7fd97c0cf530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:38956/0 (socket says 172.21.15.63:38956) 2024-05-21T01:20:42.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.629+0000 7fd97be00640 1 -- 172.21.15.63:0/3381815117 learned_addr learned my addr 172.21.15.63:0/3381815117 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-05-21T01:20:42.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.629+0000 7fd981800640 1 --2- 172.21.15.63:0/3381815117 >> v2:172.21.15.131:3300/0 conn(0x7fd97c06f080 0x7fd97c15d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:42.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.629+0000 7fd980e00640 1 -- 172.21.15.63:0/3381815117 >> v2:172.21.15.131:3300/0 conn(0x7fd97c06f080 msgr2=0x7fd97c15d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:42.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.629+0000 7fd980e00640 1 --2- 172.21.15.63:0/3381815117 >> v2:172.21.15.131:3300/0 conn(0x7fd97c06f080 0x7fd97c15d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:42.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.629+0000 7fd980e00640 1 -- 172.21.15.63:0/3381815117 >> v1:172.21.15.63:6789/0 conn(0x7fd97c071b80 legacy=0x7fd97c0cf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:42.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.629+0000 7fd980e00640 1 -- 172.21.15.63:0/3381815117 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd97c15c7a0 con 0x7fd97c156070 2024-05-21T01:20:42.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.629+0000 7fd97b400640 1 -- 172.21.15.63:0/3381815117 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 331091855 0 0) 0x7fd97c15bf20 con 0x7fd97c071b80 2024-05-21T01:20:42.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.633+0000 7fd980e00640 1 --2- 172.21.15.63:0/3381815117 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd97c156070 0x7fd97c071640 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd97c0ca290 tx=0x7fd97001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c092b2a8bbf0142 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:42.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.633+0000 7fd97b400640 1 -- 172.21.15.63:0/3381815117 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9700b0070 con 0x7fd97c156070 2024-05-21T01:20:42.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.633+0000 7fd97b400640 1 -- 172.21.15.63:0/3381815117 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9700ab600 con 0x7fd97c156070 2024-05-21T01:20:42.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.633+0000 7fd97b400640 1 -- 172.21.15.63:0/3381815117 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9700ab9d0 con 0x7fd97c156070 2024-05-21T01:20:42.662 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.633+0000 7fd983800640 1 -- 172.21.15.63:0/3381815117 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd97c156070 msgr2=0x7fd97c071640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:42.662 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.633+0000 7fd983800640 1 --2- 172.21.15.63:0/3381815117 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd97c156070 0x7fd97c071640 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd97c0ca290 tx=0x7fd97001c480 comp rx=0 tx=0).stop 2024-05-21T01:20:42.662 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.633+0000 7fd983800640 1 -- 172.21.15.63:0/3381815117 shutdown_connections 2024-05-21T01:20:42.662 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.633+0000 7fd983800640 1 --2- 172.21.15.63:0/3381815117 >> v2:172.21.15.131:3300/0 conn(0x7fd97c06f080 0x7fd97c15d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:42.662 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.633+0000 7fd983800640 1 --2- 172.21.15.63:0/3381815117 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd97c156070 0x7fd97c071640 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:42.662 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.633+0000 7fd983800640 1 -- 172.21.15.63:0/3381815117 >> 172.21.15.63:0/3381815117 conn(0x7fd97c0735f0 msgr2=0x7fd97c073a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:42.662 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.633+0000 7fd983800640 1 -- 172.21.15.63:0/3381815117 shutdown_connections 2024-05-21T01:20:42.662 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.633+0000 7fd983800640 1 -- 172.21.15.63:0/3381815117 wait complete. 2024-05-21T01:20:42.662 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.633+0000 7fd983800640 1 Processor -- start 2024-05-21T01:20:42.662 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.633+0000 7fd983800640 1 -- start start 2024-05-21T01:20:42.662 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.637+0000 7fd983800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd97c06f080 0x7fd97c1f4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:42.662 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.637+0000 7fd983800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd97c071b80 0x7fd97c158550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:42.662 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.637+0000 7fd983800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd97c156070 0x7fd97c0ca7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:42.662 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.637+0000 7fd983800640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fd97c06e140 con 0x7fd97c06f080 2024-05-21T01:20:42.663 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.637+0000 7fd983800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd97c06dfc0 con 0x7fd97c156070 2024-05-21T01:20:42.663 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.637+0000 7fd983800640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fd97c0cfc40 con 0x7fd97c071b80 2024-05-21T01:20:42.663 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.637+0000 7fd980e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd97c06f080 0x7fd97c1f4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:42.663 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.637+0000 7fd980e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd97c06f080 0x7fd97c1f4e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38310/0 (socket says 172.21.15.63:38310) 2024-05-21T01:20:42.663 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.637+0000 7fd980e00640 1 -- 172.21.15.63:0/1274383731 learned_addr learned my addr 172.21.15.63:0/1274383731 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:42.663 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.637+0000 7fd981800640 1 --2- 172.21.15.63:0/1274383731 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd97c156070 0x7fd97c0ca7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:42.663 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.637+0000 7fd97be00640 1 --2- 172.21.15.63:0/1274383731 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd97c071b80 0x7fd97c158550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:42.663 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.637+0000 7fd980e00640 1 -- 172.21.15.63:0/1274383731 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd97c071b80 msgr2=0x7fd97c158550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:42.663 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.637+0000 7fd980e00640 1 --2- 172.21.15.63:0/1274383731 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd97c071b80 0x7fd97c158550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:42.663 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.637+0000 7fd980e00640 1 -- 172.21.15.63:0/1274383731 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd97c156070 msgr2=0x7fd97c0ca7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:42.663 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.637+0000 7fd980e00640 1 --2- 172.21.15.63:0/1274383731 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd97c156070 0x7fd97c0ca7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:42.663 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.637+0000 7fd980e00640 1 -- 172.21.15.63:0/1274383731 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd97c156960 con 0x7fd97c06f080 2024-05-21T01:20:42.663 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.637+0000 7fd980e00640 1 --2- 172.21.15.63:0/1274383731 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd97c06f080 0x7fd97c1f4e40 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd9700ae040 tx=0x7fd970019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:42.664 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.637+0000 7fd978c00640 1 -- 172.21.15.63:0/1274383731 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9700b0040 con 0x7fd97c06f080 2024-05-21T01:20:42.664 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.637+0000 7fd978c00640 1 -- 172.21.15.63:0/1274383731 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9700b9070 con 0x7fd97c06f080 2024-05-21T01:20:42.664 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.637+0000 7fd978c00640 1 -- 172.21.15.63:0/1274383731 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9700b4690 con 0x7fd97c06f080 2024-05-21T01:20:42.664 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.637+0000 7fd983800640 1 -- 172.21.15.63:0/1274383731 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd97c156c00 con 0x7fd97c06f080 2024-05-21T01:20:42.664 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.637+0000 7fd983800640 1 -- 172.21.15.63:0/1274383731 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd97c1571a0 con 0x7fd97c06f080 2024-05-21T01:20:42.664 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.637+0000 7fd983800640 1 -- 172.21.15.63:0/1274383731 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd97c0507f0 con 0x7fd97c06f080 2024-05-21T01:20:42.664 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.641+0000 7fd978c00640 1 -- 172.21.15.63:0/1274383731 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7fd9700b4830 con 0x7fd97c06f080 2024-05-21T01:20:42.664 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.641+0000 7fd978c00640 1 --2- 172.21.15.63:0/1274383731 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fd95c06f400 0x7fd95c0718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:42.664 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.641+0000 7fd978c00640 1 -- 172.21.15.63:0/1274383731 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6590+0+0 (secure 0 0 0) 0x7fd9701294c0 con 0x7fd97c06f080 2024-05-21T01:20:42.664 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.641+0000 7fd97be00640 1 --2- 172.21.15.63:0/1274383731 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fd95c06f400 0x7fd95c0718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:42.664 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.641+0000 7fd97be00640 1 --2- 172.21.15.63:0/1274383731 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fd95c06f400 0x7fd95c0718c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd97c15e7e0 tx=0x7fd968007b20 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:42.664 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.645+0000 7fd978c00640 1 -- 172.21.15.63:0/1274383731 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fd970016070 con 0x7fd97c06f080 2024-05-21T01:20:42.674 INFO:tasks.workunit.client.0.smithi063.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-05-21T01:20:42.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.845+0000 7fd983800640 1 -- 172.21.15.63:0/1274383731 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd97c071f60 con 0x7fd97c06f080 2024-05-21T01:20:42.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.845+0000 7fd978c00640 1 -- 172.21.15.63:0/1274383731 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+6876 (secure 0 0 0) 0x7fd9700f6030 con 0x7fd97c06f080 2024-05-21T01:20:42.852 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-05-21T01:20:42.852 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6839/3045714273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6837","nonce":3045714273},{"type":"v1","addr":"172.21.15.131:6839","nonce":3045714273}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/2978367338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":2978367338},{"type":"v1","addr":"172.21.15.131:6835","nonce":2978367338}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/3005995321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6835","nonce":3005995321},{"type":"v1","addr":"172.21.15.63:6837","nonce":3005995321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-21T01:19:53.915775+0000","modified":"2024-05-21T01:20:31.724475+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4276,"mds_1":4270,"mds_2":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"e","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.63:6833/574189772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":574189772},{"type":"v1","addr":"172.21.15.63:6833","nonce":574189772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4270":{"gid":4270,"name":"f","rank":1,"incarnation":10,"state":"up:active","state_seq":11,"addr":"172.21.15.131:6838/3071941741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":3071941741},{"type":"v1","addr":"172.21.15.131:6838","nonce":3071941741}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.63:6836/2892727989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":2892727989},{"type":"v1","addr":"172.21.15.63:6836","nonce":2892727989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4276,"qdb_cluster":[4267,4270,4276]},"id":1}]} 2024-05-21T01:20:42.853 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 15 2024-05-21T01:20:42.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.849+0000 7fd983800640 1 -- 172.21.15.63:0/1274383731 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fd95c06f400 msgr2=0x7fd95c0718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:42.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.849+0000 7fd983800640 1 --2- 172.21.15.63:0/1274383731 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fd95c06f400 0x7fd95c0718c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd97c15e7e0 tx=0x7fd968007b20 comp rx=0 tx=0).stop 2024-05-21T01:20:42.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.849+0000 7fd983800640 1 -- 172.21.15.63:0/1274383731 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd97c06f080 msgr2=0x7fd97c1f4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:42.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.849+0000 7fd983800640 1 --2- 172.21.15.63:0/1274383731 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd97c06f080 0x7fd97c1f4e40 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd9700ae040 tx=0x7fd970019220 comp rx=0 tx=0).stop 2024-05-21T01:20:42.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.849+0000 7fd983800640 1 -- 172.21.15.63:0/1274383731 shutdown_connections 2024-05-21T01:20:42.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.849+0000 7fd983800640 1 --2- 172.21.15.63:0/1274383731 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fd95c06f400 0x7fd95c0718c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:42.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.849+0000 7fd983800640 1 --2- 172.21.15.63:0/1274383731 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd97c156070 0x7fd97c0ca7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:42.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.849+0000 7fd983800640 1 --2- 172.21.15.63:0/1274383731 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd97c071b80 0x7fd97c158550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:42.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.849+0000 7fd983800640 1 --2- 172.21.15.63:0/1274383731 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd97c06f080 0x7fd97c1f4e40 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:42.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.849+0000 7fd983800640 1 -- 172.21.15.63:0/1274383731 >> 172.21.15.63:0/1274383731 conn(0x7fd97c0735f0 msgr2=0x7fd97c15e810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:42.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.849+0000 7fd983800640 1 -- 172.21.15.63:0/1274383731 shutdown_connections 2024-05-21T01:20:42.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:42.849+0000 7fd983800640 1 -- 172.21.15.63:0/1274383731 wait complete. 2024-05-21T01:20:43.478 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 15, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-21T01:19:53.915775+0000', 'modified': '2024-05-21T01:20:31.724475+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 4276, 'mds_1': 4270, 'mds_2': 4267}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4267': {'gid': 4267, 'name': 'e', 'rank': 2, 'incarnation': 14, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.63:6833/574189772', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6832', 'nonce': 574189772}, {'type': 'v1', 'addr': '172.21.15.63:6833', 'nonce': 574189772}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4270': {'gid': 4270, 'name': 'f', 'rank': 1, 'incarnation': 10, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.131:6838/3071941741', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.131:6836', 'nonce': 3071941741}, {'type': 'v1', 'addr': '172.21.15.131:6838', 'nonce': 3071941741}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4276': {'gid': 4276, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.63:6836/2892727989', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6834', 'nonce': 2892727989}, {'type': 'v1', 'addr': '172.21.15.63:6836', 'nonce': 2892727989}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4276, 'qdb_cluster': [4267, 4270, 4276]} 2024-05-21T01:20:43.479 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-05-21T01:20:43.479 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2024-05-21T01:20:43.627 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.621+0000 7f07a4600640 1 Processor -- start 2024-05-21T01:20:43.627 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.621+0000 7f07a4600640 1 -- start start 2024-05-21T01:20:43.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.621+0000 7f07a4600640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f079c06f9b0 0x7f079c152a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:43.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.625+0000 7f07a4600640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f079c072550 con 0x7f079c06f5d0 2024-05-21T01:20:43.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.625+0000 7f07a4600640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f079c159100 con 0x7f079c15ce40 2024-05-21T01:20:43.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.625+0000 7f07a4600640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f079c1593e0 con 0x7f079c06f9b0 2024-05-21T01:20:43.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.625+0000 7f07a1c00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f079c06f5d0 0x7f079c0c8a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:38960/0 (socket says 172.21.15.63:38960) 2024-05-21T01:20:43.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.625+0000 7f07a1c00640 1 -- 172.21.15.63:0/3573840869 learned_addr learned my addr 172.21.15.63:0/3573840869 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-05-21T01:20:43.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.625+0000 7f07a1200640 1 --2- 172.21.15.63:0/3573840869 >> v2:172.21.15.131:3300/0 conn(0x7f079c06f9b0 0x7f079c152a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:43.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.625+0000 7f079be00640 1 -- 172.21.15.63:0/3573840869 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3690020942 0 0) 0x7f079c072550 con 0x7f079c06f5d0 2024-05-21T01:20:43.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.625+0000 7f079be00640 1 -- 172.21.15.63:0/3573840869 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0784003530 con 0x7f079c06f5d0 2024-05-21T01:20:43.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.625+0000 7f079be00640 1 -- 172.21.15.63:0/3573840869 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3870029937 0 0) 0x7f0784003530 con 0x7f079c06f5d0 2024-05-21T01:20:43.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.625+0000 7f079be00640 1 -- 172.21.15.63:0/3573840869 >> v2:172.21.15.131:3300/0 conn(0x7f079c06f9b0 msgr2=0x7f079c152a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:43.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.625+0000 7f079be00640 1 --2- 172.21.15.63:0/3573840869 >> v2:172.21.15.131:3300/0 conn(0x7f079c06f9b0 0x7f079c152a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:43.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.625+0000 7f079be00640 1 -- 172.21.15.63:0/3573840869 >> v1:172.21.15.131:6789/0 conn(0x7f079c15ce40 legacy=0x7f079c072d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:43.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.625+0000 7f079be00640 1 -- 172.21.15.63:0/3573840869 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f079c1596c0 con 0x7f079c06f5d0 2024-05-21T01:20:43.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.625+0000 7f079be00640 1 -- 172.21.15.63:0/3573840869 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 466403955 0 0) 0x7f0790001700 con 0x7f079c06f5d0 2024-05-21T01:20:43.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.625+0000 7f079be00640 1 -- 172.21.15.63:0/3573840869 >> v1:172.21.15.63:6789/0 conn(0x7f079c06f5d0 legacy=0x7f079c0c8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:43.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.625+0000 7f079be00640 1 --2- 172.21.15.63:0/3573840869 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0784003a60 0x7f0784003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:43.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.625+0000 7f079be00640 1 --2- 172.21.15.63:0/3573840869 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0784004810 0x7f0784004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:43.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.625+0000 7f079be00640 1 --2- 172.21.15.63:0/3573840869 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f07840051d0 0x7f078400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:43.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.625+0000 7f079be00640 1 -- 172.21.15.63:0/3573840869 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f079c1593e0 con 0x7f0784004810 2024-05-21T01:20:43.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.625+0000 7f079be00640 1 -- 172.21.15.63:0/3573840869 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f078400c170 con 0x7f0784003a60 2024-05-21T01:20:43.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.625+0000 7f079be00640 1 -- 172.21.15.63:0/3573840869 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f078400c370 con 0x7f07840051d0 2024-05-21T01:20:43.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.625+0000 7f07a1200640 1 --2- 172.21.15.63:0/3573840869 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0784004810 0x7f0784004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:43.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.625+0000 7f07a1c00640 1 --2- 172.21.15.63:0/3573840869 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0784003a60 0x7f0784003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:43.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.625+0000 7f07a2600640 1 --2- 172.21.15.63:0/3573840869 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f07840051d0 0x7f078400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:43.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.625+0000 7f07a1200640 1 -- 172.21.15.63:0/3573840869 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f07840051d0 msgr2=0x7f078400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:43.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.625+0000 7f07a1200640 1 --2- 172.21.15.63:0/3573840869 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f07840051d0 0x7f078400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:43.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.625+0000 7f07a1200640 1 -- 172.21.15.63:0/3573840869 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0784003a60 msgr2=0x7f0784003e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:43.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.625+0000 7f07a1200640 1 --2- 172.21.15.63:0/3573840869 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0784003a60 0x7f0784003e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:43.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.625+0000 7f07a1200640 1 -- 172.21.15.63:0/3573840869 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0784003530 con 0x7f0784004810 2024-05-21T01:20:43.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.625+0000 7f07a2600640 1 -- 172.21.15.63:0/3573840869 reap_dead start 2024-05-21T01:20:43.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.629+0000 7f07a1200640 1 --2- 172.21.15.63:0/3573840869 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0784004810 0x7f0784004c90 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0788009ae0 tx=0x7f078801ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c1bda45a0c0b1c9 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:43.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.629+0000 7f079be00640 1 -- 172.21.15.63:0/3573840869 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07880096b0 con 0x7f0784004810 2024-05-21T01:20:43.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.629+0000 7f079be00640 1 -- 172.21.15.63:0/3573840869 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07880a64e0 con 0x7f0784004810 2024-05-21T01:20:43.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.629+0000 7f079be00640 1 -- 172.21.15.63:0/3573840869 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07880a68d0 con 0x7f0784004810 2024-05-21T01:20:43.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.629+0000 7f07a4600640 1 -- 172.21.15.63:0/3573840869 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0784004810 msgr2=0x7f0784004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:43.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.629+0000 7f07a4600640 1 --2- 172.21.15.63:0/3573840869 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0784004810 0x7f0784004c90 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0788009ae0 tx=0x7f078801ca70 comp rx=0 tx=0).stop 2024-05-21T01:20:43.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.629+0000 7f07a4600640 1 -- 172.21.15.63:0/3573840869 shutdown_connections 2024-05-21T01:20:43.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.629+0000 7f07a4600640 1 --2- 172.21.15.63:0/3573840869 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0784004810 0x7f0784004c90 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:43.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.629+0000 7f07a4600640 1 -- 172.21.15.63:0/3573840869 >> 172.21.15.63:0/3573840869 conn(0x7f079c068460 msgr2=0x7f079c068870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:43.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.629+0000 7f07a4600640 1 -- 172.21.15.63:0/3573840869 shutdown_connections 2024-05-21T01:20:43.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.629+0000 7f07a4600640 1 -- 172.21.15.63:0/3573840869 wait complete. 2024-05-21T01:20:43.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.629+0000 7f07a4600640 1 Processor -- start 2024-05-21T01:20:43.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.629+0000 7f07a4600640 1 -- start start 2024-05-21T01:20:43.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.633+0000 7f07a4600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0784004810 0x7f079c15b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:43.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.633+0000 7f07a4600640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f079c0bf2b0 0x7f079c1f27b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:43.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.633+0000 7f07a4600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f079c1f2cf0 0x7f079c0c2db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:43.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.633+0000 7f07a4600640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f079c158b50 con 0x7f0784004810 2024-05-21T01:20:43.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.633+0000 7f07a4600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f079c072800 con 0x7f079c1f2cf0 2024-05-21T01:20:43.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.633+0000 7f07a4600640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f079c158cd0 con 0x7f079c0bf2b0 2024-05-21T01:20:43.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.633+0000 7f07a1c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0784004810 0x7f079c15b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:43.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.633+0000 7f07a1c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0784004810 0x7f079c15b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38326/0 (socket says 172.21.15.63:38326) 2024-05-21T01:20:43.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.633+0000 7f07a1c00640 1 -- 172.21.15.63:0/584332989 learned_addr learned my addr 172.21.15.63:0/584332989 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:43.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.633+0000 7f07a1200640 1 --2- 172.21.15.63:0/584332989 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f079c0bf2b0 0x7f079c1f27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:43.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.633+0000 7f07a2600640 1 --2- 172.21.15.63:0/584332989 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f079c1f2cf0 0x7f079c0c2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:43.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.633+0000 7f07a1c00640 1 -- 172.21.15.63:0/584332989 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f079c0bf2b0 msgr2=0x7f079c1f27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:43.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.633+0000 7f07a1c00640 1 --2- 172.21.15.63:0/584332989 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f079c0bf2b0 0x7f079c1f27b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:43.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.633+0000 7f07a1c00640 1 -- 172.21.15.63:0/584332989 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f079c1f2cf0 msgr2=0x7f079c0c2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:43.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.633+0000 7f07a1c00640 1 --2- 172.21.15.63:0/584332989 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f079c1f2cf0 0x7f079c0c2db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:43.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.633+0000 7f07a1c00640 1 -- 172.21.15.63:0/584332989 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f079c0c3980 con 0x7f0784004810 2024-05-21T01:20:43.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.633+0000 7f07a1c00640 1 --2- 172.21.15.63:0/584332989 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0784004810 0x7f079c15b7a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0790012510 tx=0x7f07900129d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:43.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.633+0000 7f0799600640 1 -- 172.21.15.63:0/584332989 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f079001c070 con 0x7f0784004810 2024-05-21T01:20:43.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.633+0000 7f0799600640 1 -- 172.21.15.63:0/584332989 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0790014770 con 0x7f0784004810 2024-05-21T01:20:43.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.633+0000 7f0799600640 1 -- 172.21.15.63:0/584332989 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0790014b60 con 0x7f0784004810 2024-05-21T01:20:43.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.633+0000 7f07a4600640 1 -- 172.21.15.63:0/584332989 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f079c1f53d0 con 0x7f0784004810 2024-05-21T01:20:43.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.633+0000 7f07a4600640 1 -- 172.21.15.63:0/584332989 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f079c1518c0 con 0x7f0784004810 2024-05-21T01:20:43.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.637+0000 7f0799600640 1 -- 172.21.15.63:0/584332989 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7f079001f070 con 0x7f0784004810 2024-05-21T01:20:43.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.637+0000 7f0799600640 1 --2- 172.21.15.63:0/584332989 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f077c06f430 0x7f077c0718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:43.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.637+0000 7f0799600640 1 -- 172.21.15.63:0/584332989 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f0790091f20 con 0x7f0784004810 2024-05-21T01:20:43.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.637+0000 7f07a7b34000 1 Processor -- start 2024-05-21T01:20:43.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.637+0000 7f07a7b34000 1 -- start start 2024-05-21T01:20:43.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.637+0000 7f07a1200640 1 --2- 172.21.15.63:0/584332989 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f077c06f430 0x7f077c0718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:43.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.637+0000 7f07a7b34000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5607d99f64a0 0x5607d99bf200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:43.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.637+0000 7f07a7b34000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5607d99bf740 0x5607d99de9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:43.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.637+0000 7f07a7b34000 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5607d99deef0 0x5607d99df2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:43.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.637+0000 7f07a7b34000 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5607d98136d0 con 0x5607d99deef0 2024-05-21T01:20:43.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.637+0000 7f07a7b34000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5607d9803270 con 0x5607d99f64a0 2024-05-21T01:20:43.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.637+0000 7f07a7b34000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5607d98072b0 con 0x5607d99bf740 2024-05-21T01:20:43.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.637+0000 7f07a1200640 1 --2- 172.21.15.63:0/584332989 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f077c06f430 0x7f077c0718f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f07880af000 tx=0x7f07880046d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:43.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.637+0000 7f07a2600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5607d99deef0 0x5607d99df2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:43.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.637+0000 7f07a2600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5607d99deef0 0x5607d99df2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38330/0 (socket says 172.21.15.63:38330) 2024-05-21T01:20:43.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.637+0000 7f07a1c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5607d99f64a0 0x5607d99bf200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:43.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.637+0000 7f07a2600640 1 -- 172.21.15.63:0/1139876013 learned_addr learned my addr 172.21.15.63:0/1139876013 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:43.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.637+0000 7f07a1200640 1 --2- 172.21.15.63:0/1139876013 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5607d99bf740 0x5607d99de9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:43.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.637+0000 7f07a2600640 1 -- 172.21.15.63:0/1139876013 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5607d99bf740 msgr2=0x5607d99de9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:43.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.637+0000 7f07a2600640 1 --2- 172.21.15.63:0/1139876013 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5607d99bf740 0x5607d99de9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:43.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.637+0000 7f07a2600640 1 -- 172.21.15.63:0/1139876013 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5607d99f64a0 msgr2=0x5607d99bf200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:43.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.637+0000 7f07a2600640 1 --2- 172.21.15.63:0/1139876013 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5607d99f64a0 0x5607d99bf200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:43.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.637+0000 7f07a2600640 1 -- 172.21.15.63:0/1139876013 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607d97e1bf0 con 0x5607d99deef0 2024-05-21T01:20:43.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.637+0000 7f07a2600640 1 --2- 172.21.15.63:0/1139876013 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5607d99deef0 0x5607d99df2d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f079c070060 tx=0x7f0794005420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1493862ef04f2d58 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:43.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.637+0000 7f078e000640 1 -- 172.21.15.63:0/1139876013 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07940017a0 con 0x5607d99deef0 2024-05-21T01:20:43.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.637+0000 7f078e000640 1 -- 172.21.15.63:0/1139876013 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0794019070 con 0x5607d99deef0 2024-05-21T01:20:43.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.637+0000 7f078e000640 1 -- 172.21.15.63:0/1139876013 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0794001b60 con 0x5607d99deef0 2024-05-21T01:20:43.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.641+0000 7f07a7b34000 1 -- 172.21.15.63:0/1139876013 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5607d99deef0 msgr2=0x5607d99df2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:43.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.641+0000 7f07a7b34000 1 --2- 172.21.15.63:0/1139876013 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5607d99deef0 0x5607d99df2d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f079c070060 tx=0x7f0794005420 comp rx=0 tx=0).stop 2024-05-21T01:20:43.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.641+0000 7f07a7b34000 1 -- 172.21.15.63:0/1139876013 shutdown_connections 2024-05-21T01:20:43.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.641+0000 7f07a7b34000 1 --2- 172.21.15.63:0/1139876013 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5607d99deef0 0x5607d99df2d0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:43.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.641+0000 7f07a7b34000 1 --2- 172.21.15.63:0/1139876013 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5607d99bf740 0x5607d99de9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:43.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.641+0000 7f07a7b34000 1 --2- 172.21.15.63:0/1139876013 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5607d99f64a0 0x5607d99bf200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:43.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.641+0000 7f07a7b34000 1 -- 172.21.15.63:0/1139876013 >> 172.21.15.63:0/1139876013 conn(0x5607d989eef0 msgr2=0x5607d99f5b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:43.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.641+0000 7f07a7b34000 1 -- 172.21.15.63:0/1139876013 shutdown_connections 2024-05-21T01:20:43.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.641+0000 7f07a7b34000 1 -- 172.21.15.63:0/1139876013 wait complete. 2024-05-21T01:20:43.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.641+0000 7f07a7b34000 1 -- start start 2024-05-21T01:20:43.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.641+0000 7f07a7b34000 1 Processor -- start 2024-05-21T01:20:43.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.641+0000 7f07a7b34000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5607d99bf740 0x5607d9a03050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:43.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.641+0000 7f07a7b34000 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5607d99deef0 0x5607d9a03590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:43.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.641+0000 7f07a7b34000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5607d99f64a0 0x5607d99ba8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:43.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.641+0000 7f07a7b34000 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5607d97c6630 con 0x5607d99deef0 2024-05-21T01:20:43.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.641+0000 7f07a7b34000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5607d9887570 con 0x5607d99f64a0 2024-05-21T01:20:43.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.641+0000 7f07a7b34000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5607d98124a0 con 0x5607d99bf740 2024-05-21T01:20:43.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.641+0000 7f07a7b34000 10 client.0 _ll_register_callbacks cb 0x5607d99a2540 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-21T01:20:43.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.641+0000 7f07a1200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5607d99deef0 0x5607d9a03590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:43.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.641+0000 7f07a1200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5607d99deef0 0x5607d9a03590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38340/0 (socket says 172.21.15.63:38340) 2024-05-21T01:20:43.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.641+0000 7f07a1200640 1 -- 172.21.15.63:0/1570186467 learned_addr learned my addr 172.21.15.63:0/1570186467 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:43.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.641+0000 7f07a1c00640 1 --2- 172.21.15.63:0/1570186467 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5607d99bf740 0x5607d9a03050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:43.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.641+0000 7f07a2600640 1 --2- 172.21.15.63:0/1570186467 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5607d99f64a0 0x5607d99ba8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:43.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.641+0000 7f07a1200640 1 -- 172.21.15.63:0/1570186467 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5607d99bf740 msgr2=0x5607d9a03050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:43.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.641+0000 7f07a1200640 1 --2- 172.21.15.63:0/1570186467 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5607d99bf740 0x5607d9a03050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:43.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.641+0000 7f07a1200640 1 -- 172.21.15.63:0/1570186467 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5607d99f64a0 msgr2=0x5607d99ba8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:43.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.641+0000 7f07a1200640 1 --2- 172.21.15.63:0/1570186467 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5607d99f64a0 0x5607d99ba8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:43.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.641+0000 7f07a1200640 1 -- 172.21.15.63:0/1570186467 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5607d984b9b0 con 0x5607d99deef0 2024-05-21T01:20:43.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.641+0000 7f07a1200640 1 --2- 172.21.15.63:0/1570186467 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5607d99deef0 0x5607d9a03590 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0788000c10 tx=0x7f078801b2b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c783959a019aed0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:43.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.641+0000 7f0782a00640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-05-21T01:20:43.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.641+0000 7f0782a00640 1 -- 172.21.15.63:0/1570186467 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07880c9060 con 0x5607d99deef0 2024-05-21T01:20:43.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.641+0000 7f0782a00640 1 -- 172.21.15.63:0/1570186467 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f0788005da0 con 0x5607d99deef0 2024-05-21T01:20:43.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.641+0000 7f07a7b34000 1 -- 172.21.15.63:0/1570186467 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0794019070 con 0x5607d99deef0 2024-05-21T01:20:43.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.641+0000 7f0782a00640 1 -- 172.21.15.63:0/1570186467 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f07880cf050 con 0x5607d99deef0 2024-05-21T01:20:43.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.641+0000 7f07a7b34000 10 client.4767 fetch_fsmap learned FSMap version 15 2024-05-21T01:20:43.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.641+0000 7f07a7b34000 1 -- 172.21.15.63:0/1570186467 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x5607d97de510 con 0x5607d99deef0 2024-05-21T01:20:43.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.645+0000 7f0782a00640 1 -- 172.21.15.63:0/1570186467 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0794019070 con 0x5607d99deef0 2024-05-21T01:20:43.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.645+0000 7f0782a00640 1 -- 172.21.15.63:0/1570186467 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 15) ==== 4752+0+0 (secure 0 0 0) 0x7f07880d2020 con 0x5607d99deef0 2024-05-21T01:20:43.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.645+0000 7f07a7b34000 10 client.4767 fetch_fsmap finished waiting for FSMap version 15 2024-05-21T01:20:43.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.645+0000 7f07a7b34000 10 client.4767 resolve_mds: resolved name 'e' to daemon mds.e 2024-05-21T01:20:43.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.645+0000 7f07a7b34000 20 client.4767 populate_metadata read hostname 'smithi063' 2024-05-21T01:20:43.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.645+0000 7f07a7b34000 1 --2- 172.21.15.63:0/1570186467 >> [v2:172.21.15.63:6832/574189772,v1:172.21.15.63:6833/574189772] conn(0x5607d99bb660 0x5607d99bba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:43.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.645+0000 7f07a7b34000 4 client.4767 mds_command: new command op to 4267 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-21T01:20:43.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.645+0000 7f07a7b34000 1 -- 172.21.15.63:0/1570186467 --> [v2:172.21.15.63:6832/574189772,v1:172.21.15.63:6833/574189772] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5607d979ebc0 con 0x5607d99bb660 2024-05-21T01:20:43.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.645+0000 7f07a1c00640 1 --2- 172.21.15.63:0/1570186467 >> [v2:172.21.15.63:6832/574189772,v1:172.21.15.63:6833/574189772] conn(0x5607d99bb660 0x5607d99bba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:43.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.645+0000 7f0782a00640 10 client.4767 ms_handle_connect on v2:172.21.15.63:6832/574189772 2024-05-21T01:20:43.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.645+0000 7f07a1c00640 1 --2- 172.21.15.63:0/1570186467 >> [v2:172.21.15.63:6832/574189772,v1:172.21.15.63:6833/574189772] conn(0x5607d99bb660 0x5607d99bba40 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7c1f1327c7f6a4 server_cookie=578e86e9be3e1e0d in_seq=0 out_seq=0 2024-05-21T01:20:43.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.645+0000 7f0782a00640 1 -- 172.21.15.63:0/1570186467 <== mds.2 v2:172.21.15.63:6832/574189772 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x5607d979ebc0 con 0x5607d99bb660 2024-05-21T01:20:43.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.645+0000 7f0782a00640 10 client.4767 handle_command_reply: tid=0 2024-05-21T01:20:43.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.645+0000 7f07a7b34000 1 client.4767 shutdown 2024-05-21T01:20:43.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.645+0000 7f07a7b34000 1 -- 172.21.15.63:0/1570186467 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5607d99deef0 msgr2=0x5607d9a03590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:43.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.645+0000 7f07a7b34000 1 --2- 172.21.15.63:0/1570186467 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5607d99deef0 0x5607d9a03590 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0788000c10 tx=0x7f078801b2b0 comp rx=0 tx=0).stop 2024-05-21T01:20:43.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.645+0000 7f07a7b34000 1 -- 172.21.15.63:0/1570186467 shutdown_connections 2024-05-21T01:20:43.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.645+0000 7f07a7b34000 1 --2- 172.21.15.63:0/1570186467 >> [v2:172.21.15.63:6832/574189772,v1:172.21.15.63:6833/574189772] conn(0x5607d99bb660 0x5607d99bba40 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:43.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.645+0000 7f07a7b34000 1 --2- 172.21.15.63:0/1570186467 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5607d99f64a0 0x5607d99ba8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:43.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.645+0000 7f07a7b34000 1 --2- 172.21.15.63:0/1570186467 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5607d99deef0 0x5607d9a03590 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:43.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.645+0000 7f07a7b34000 1 --2- 172.21.15.63:0/1570186467 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5607d99bf740 0x5607d9a03050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:43.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.645+0000 7f0782a00640 0 client.4767 ms_handle_reset on v2:172.21.15.63:6832/574189772 2024-05-21T01:20:43.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.645+0000 7f07a7b34000 1 -- 172.21.15.63:0/1570186467 >> 172.21.15.63:0/1570186467 conn(0x5607d989eef0 msgr2=0x5607d99b58e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:43.654 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.645+0000 7f07a7b34000 1 -- 172.21.15.63:0/1570186467 shutdown_connections 2024-05-21T01:20:43.654 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.645+0000 7f07a7b34000 1 -- 172.21.15.63:0/1570186467 wait complete. 2024-05-21T01:20:43.654 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.645+0000 7f07a7b34000 20 client.4767 trim_cache size 0 max 16384 2024-05-21T01:20:43.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.665+0000 7f07a7b34000 1 Processor -- start 2024-05-21T01:20:43.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.665+0000 7f07a7b34000 1 -- start start 2024-05-21T01:20:43.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.665+0000 7f07a7b34000 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5607d99bf740 0x5607d99bf090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:43.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.665+0000 7f07a7b34000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5607d99deef0 0x5607d99b78f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:43.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.665+0000 7f07a7b34000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5607d99f64a0 0x5607d99b7e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:43.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.665+0000 7f07a7b34000 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f079c1fe8d0 con 0x5607d99bf740 2024-05-21T01:20:43.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.665+0000 7f07a7b34000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5607d97a0200 con 0x5607d99deef0 2024-05-21T01:20:43.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.665+0000 7f07a7b34000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5607d979b7b0 con 0x5607d99f64a0 2024-05-21T01:20:43.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.665+0000 7f07a1c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5607d99bf740 0x5607d99bf090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:43.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.665+0000 7f07a1c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5607d99bf740 0x5607d99bf090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38344/0 (socket says 172.21.15.63:38344) 2024-05-21T01:20:43.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.665+0000 7f07a1c00640 1 -- 172.21.15.63:0/79456775 learned_addr learned my addr 172.21.15.63:0/79456775 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:43.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.665+0000 7f07a2600640 1 --2- 172.21.15.63:0/79456775 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5607d99f64a0 0x5607d99b7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:43.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.665+0000 7f07a1200640 1 --2- 172.21.15.63:0/79456775 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5607d99deef0 0x5607d99b78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:43.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.665+0000 7f07a1c00640 1 -- 172.21.15.63:0/79456775 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5607d99f64a0 msgr2=0x5607d99b7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:43.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.665+0000 7f07a1c00640 1 --2- 172.21.15.63:0/79456775 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5607d99f64a0 0x5607d99b7e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:43.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.665+0000 7f07a1c00640 1 -- 172.21.15.63:0/79456775 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5607d99deef0 msgr2=0x5607d99b78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:43.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.665+0000 7f07a1c00640 1 --2- 172.21.15.63:0/79456775 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5607d99deef0 0x5607d99b78f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:43.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.665+0000 7f07a1c00640 1 -- 172.21.15.63:0/79456775 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607d97a4860 con 0x5607d99bf740 2024-05-21T01:20:43.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.665+0000 7f07a1c00640 1 --2- 172.21.15.63:0/79456775 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5607d99bf740 0x5607d99bf090 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f079005b690 tx=0x7f0790061040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afff0fa864c081ed server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:43.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.665+0000 7f078d600640 1 -- 172.21.15.63:0/79456775 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f079007b070 con 0x5607d99bf740 2024-05-21T01:20:43.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.665+0000 7f078d600640 1 -- 172.21.15.63:0/79456775 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07900671f0 con 0x5607d99bf740 2024-05-21T01:20:43.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.665+0000 7f078d600640 1 -- 172.21.15.63:0/79456775 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0790007d40 con 0x5607d99bf740 2024-05-21T01:20:43.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.665+0000 7f07a7b34000 1 -- 172.21.15.63:0/79456775 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5607d99bf740 msgr2=0x5607d99bf090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:43.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.665+0000 7f07a7b34000 1 --2- 172.21.15.63:0/79456775 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5607d99bf740 0x5607d99bf090 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f079005b690 tx=0x7f0790061040 comp rx=0 tx=0).stop 2024-05-21T01:20:43.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.665+0000 7f07a7b34000 1 -- 172.21.15.63:0/79456775 shutdown_connections 2024-05-21T01:20:43.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.665+0000 7f07a7b34000 1 --2- 172.21.15.63:0/79456775 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5607d99f64a0 0x5607d99b7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:43.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.665+0000 7f07a7b34000 1 --2- 172.21.15.63:0/79456775 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5607d99deef0 0x5607d99b78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:43.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.665+0000 7f07a7b34000 1 --2- 172.21.15.63:0/79456775 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5607d99bf740 0x5607d99bf090 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:43.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.665+0000 7f07a7b34000 1 -- 172.21.15.63:0/79456775 >> 172.21.15.63:0/79456775 conn(0x5607d989eef0 msgr2=0x5607d99f1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:43.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.665+0000 7f07a7b34000 1 -- 172.21.15.63:0/79456775 shutdown_connections 2024-05-21T01:20:43.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.665+0000 7f07a7b34000 1 -- 172.21.15.63:0/79456775 wait complete. 2024-05-21T01:20:43.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.669+0000 7f07a7b34000 1 -- start start 2024-05-21T01:20:43.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.669+0000 7f07a7b34000 1 Processor -- start 2024-05-21T01:20:43.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.669+0000 7f07a7b34000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5607d99bf740 0x5607d9a6d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:43.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.669+0000 7f07a7b34000 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5607d99deef0 0x5607d9a6d780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:43.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.669+0000 7f07a7b34000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5607d99f64a0 0x5607d9a6dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:43.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.669+0000 7f07a7b34000 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5607d980b8e0 con 0x5607d99deef0 2024-05-21T01:20:43.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.669+0000 7f07a7b34000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5607d98065c0 con 0x5607d99f64a0 2024-05-21T01:20:43.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.669+0000 7f07a7b34000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5607d9787b10 con 0x5607d99bf740 2024-05-21T01:20:43.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.669+0000 7f07a7b34000 10 client.0 _ll_register_callbacks cb 0x7f0788009060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-21T01:20:43.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.669+0000 7f07a1200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5607d99deef0 0x5607d9a6d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:43.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.669+0000 7f07a1200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5607d99deef0 0x5607d9a6d780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38350/0 (socket says 172.21.15.63:38350) 2024-05-21T01:20:43.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.669+0000 7f07a1200640 1 -- 172.21.15.63:0/3308888616 learned_addr learned my addr 172.21.15.63:0/3308888616 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:43.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.669+0000 7f07a1c00640 1 --2- 172.21.15.63:0/3308888616 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5607d99bf740 0x5607d9a6d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:43.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.669+0000 7f07a2600640 1 --2- 172.21.15.63:0/3308888616 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5607d99f64a0 0x5607d9a6dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:43.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.669+0000 7f07a1200640 1 -- 172.21.15.63:0/3308888616 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5607d99bf740 msgr2=0x5607d9a6d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:43.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.669+0000 7f07a1200640 1 --2- 172.21.15.63:0/3308888616 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5607d99bf740 0x5607d9a6d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:43.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.669+0000 7f07a1200640 1 -- 172.21.15.63:0/3308888616 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5607d99f64a0 msgr2=0x5607d9a6dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:43.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.669+0000 7f07a1200640 1 --2- 172.21.15.63:0/3308888616 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5607d99f64a0 0x5607d9a6dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:43.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.669+0000 7f07a1200640 1 -- 172.21.15.63:0/3308888616 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5607d97bae80 con 0x5607d99deef0 2024-05-21T01:20:43.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.669+0000 7f07a1c00640 1 --2- 172.21.15.63:0/3308888616 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5607d99bf740 0x5607d9a6d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T01:20:43.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.669+0000 7f07a2600640 1 --2- 172.21.15.63:0/3308888616 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5607d99f64a0 0x5607d9a6dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T01:20:43.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.669+0000 7f07a1200640 1 --2- 172.21.15.63:0/3308888616 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5607d99deef0 0x5607d9a6d780 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0788004780 tx=0x7f0788019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d19a69c81ac7534d server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:43.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.669+0000 7f0782a00640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-05-21T01:20:43.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.669+0000 7f0782a00640 1 -- 172.21.15.63:0/3308888616 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07880a64e0 con 0x5607d99deef0 2024-05-21T01:20:43.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.669+0000 7f0782a00640 1 -- 172.21.15.63:0/3308888616 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f07880a6680 con 0x5607d99deef0 2024-05-21T01:20:43.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.669+0000 7f07a7b34000 1 -- 172.21.15.63:0/3308888616 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f07900671f0 con 0x5607d99deef0 2024-05-21T01:20:43.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.669+0000 7f0782a00640 1 -- 172.21.15.63:0/3308888616 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f07880a6880 con 0x5607d99deef0 2024-05-21T01:20:43.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.669+0000 7f07a7b34000 10 client.4773 fetch_fsmap learned FSMap version 15 2024-05-21T01:20:43.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.669+0000 7f07a7b34000 1 -- 172.21.15.63:0/3308888616 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x5607d9887a00 con 0x5607d99deef0 2024-05-21T01:20:43.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.669+0000 7f0782a00640 1 -- 172.21.15.63:0/3308888616 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07900671f0 con 0x5607d99deef0 2024-05-21T01:20:43.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.669+0000 7f0782a00640 1 -- 172.21.15.63:0/3308888616 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 15) ==== 4752+0+0 (secure 0 0 0) 0x7f07880db050 con 0x5607d99deef0 2024-05-21T01:20:43.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.669+0000 7f07a7b34000 10 client.4773 fetch_fsmap finished waiting for FSMap version 15 2024-05-21T01:20:43.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.669+0000 7f07a7b34000 10 client.4773 resolve_mds: resolved name 'e' to daemon mds.e 2024-05-21T01:20:43.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.669+0000 7f07a7b34000 20 client.4773 populate_metadata read hostname 'smithi063' 2024-05-21T01:20:43.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.669+0000 7f07a7b34000 1 --2- 172.21.15.63:0/3308888616 >> [v2:172.21.15.63:6832/574189772,v1:172.21.15.63:6833/574189772] conn(0x5607d9a776d0 0x5607d9a79ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:43.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.669+0000 7f07a7b34000 4 client.4773 mds_command: new command op to 4267 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-21T01:20:43.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.669+0000 7f07a7b34000 1 -- 172.21.15.63:0/3308888616 --> [v2:172.21.15.63:6832/574189772,v1:172.21.15.63:6833/574189772] -- command(tid 0: {"prefix": "status"}) -- 0x5607d97a2dc0 con 0x5607d9a776d0 2024-05-21T01:20:43.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.669+0000 7f07a1c00640 1 --2- 172.21.15.63:0/3308888616 >> [v2:172.21.15.63:6832/574189772,v1:172.21.15.63:6833/574189772] conn(0x5607d9a776d0 0x5607d9a79ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:43.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.673+0000 7f0782a00640 10 client.4773 ms_handle_connect on v2:172.21.15.63:6832/574189772 2024-05-21T01:20:43.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.673+0000 7f07a1c00640 1 --2- 172.21.15.63:0/3308888616 >> [v2:172.21.15.63:6832/574189772,v1:172.21.15.63:6833/574189772] conn(0x5607d9a776d0 0x5607d9a79ac0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f7078744c2693879 server_cookie=2f53773ce425627a in_seq=0 out_seq=0 2024-05-21T01:20:43.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.673+0000 7f0782a00640 1 -- 172.21.15.63:0/3308888616 <== mds.2 v2:172.21.15.63:6832/574189772 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x5607d97a2dc0 con 0x5607d9a776d0 2024-05-21T01:20:43.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.673+0000 7f0782a00640 10 client.4773 handle_command_reply: tid=0 2024-05-21T01:20:43.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.673+0000 7f07a7b34000 1 client.4773 shutdown 2024-05-21T01:20:43.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.673+0000 7f07a7b34000 1 -- 172.21.15.63:0/3308888616 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5607d99deef0 msgr2=0x5607d9a6d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:43.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.673+0000 7f07a7b34000 1 --2- 172.21.15.63:0/3308888616 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5607d99deef0 0x5607d9a6d780 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0788004780 tx=0x7f0788019810 comp rx=0 tx=0).stop 2024-05-21T01:20:43.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.673+0000 7f07a7b34000 1 -- 172.21.15.63:0/3308888616 shutdown_connections 2024-05-21T01:20:43.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.673+0000 7f07a7b34000 1 --2- 172.21.15.63:0/3308888616 >> [v2:172.21.15.63:6832/574189772,v1:172.21.15.63:6833/574189772] conn(0x5607d9a776d0 0x5607d9a79ac0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:43.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.673+0000 7f07a7b34000 1 --2- 172.21.15.63:0/3308888616 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5607d99f64a0 0x5607d9a6dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:43.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.673+0000 7f07a7b34000 1 --2- 172.21.15.63:0/3308888616 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5607d99deef0 0x5607d9a6d780 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:43.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.673+0000 7f07a7b34000 1 --2- 172.21.15.63:0/3308888616 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5607d99bf740 0x5607d9a6d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:43.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.673+0000 7f07a7b34000 1 -- 172.21.15.63:0/3308888616 >> 172.21.15.63:0/3308888616 conn(0x5607d989eef0 msgr2=0x5607d99bee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:43.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.673+0000 7f0782a00640 0 client.4773 ms_handle_reset on v2:172.21.15.63:6832/574189772 2024-05-21T01:20:43.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.673+0000 7f07a7b34000 1 -- 172.21.15.63:0/3308888616 shutdown_connections 2024-05-21T01:20:43.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.673+0000 7f07a7b34000 1 -- 172.21.15.63:0/3308888616 wait complete. 2024-05-21T01:20:43.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.673+0000 7f07a7b34000 20 client.4773 trim_cache size 0 max 16384 2024-05-21T01:20:43.682 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-05-21T01:20:43.682 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_fsid": "9a7cbd84-ceb2-41c8-8b6e-ab931f86c51a", 2024-05-21T01:20:43.682 INFO:teuthology.orchestra.run.smithi063.stdout: "whoami": 2, 2024-05-21T01:20:43.682 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 4267, 2024-05-21T01:20:43.682 INFO:teuthology.orchestra.run.smithi063.stdout: "want_state": "up:active", 2024-05-21T01:20:43.682 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "up:active", 2024-05-21T01:20:43.682 INFO:teuthology.orchestra.run.smithi063.stdout: "fs_name": "cephfs", 2024-05-21T01:20:43.682 INFO:teuthology.orchestra.run.smithi063.stdout: "rank_uptime": 17.995867946000001, 2024-05-21T01:20:43.682 INFO:teuthology.orchestra.run.smithi063.stdout: "mdsmap_epoch": 15, 2024-05-21T01:20:43.682 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch": 27, 2024-05-21T01:20:43.682 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch_barrier": 25, 2024-05-21T01:20:43.682 INFO:teuthology.orchestra.run.smithi063.stdout: "uptime": 55.017519065999998 2024-05-21T01:20:43.683 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-05-21T01:20:43.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.673+0000 7f07a4600640 1 -- 172.21.15.63:0/584332989 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f077c06f430 msgr2=0x7f077c0718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:43.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.673+0000 7f07a4600640 1 --2- 172.21.15.63:0/584332989 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f077c06f430 0x7f077c0718f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f07880af000 tx=0x7f07880046d0 comp rx=0 tx=0).stop 2024-05-21T01:20:43.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.673+0000 7f07a4600640 1 -- 172.21.15.63:0/584332989 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0784004810 msgr2=0x7f079c15b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:43.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.673+0000 7f07a4600640 1 --2- 172.21.15.63:0/584332989 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0784004810 0x7f079c15b7a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0790012510 tx=0x7f07900129d0 comp rx=0 tx=0).stop 2024-05-21T01:20:43.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.673+0000 7f07a4600640 1 -- 172.21.15.63:0/584332989 shutdown_connections 2024-05-21T01:20:43.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.673+0000 7f07a4600640 1 --2- 172.21.15.63:0/584332989 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f077c06f430 0x7f077c0718f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:43.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.673+0000 7f07a4600640 1 --2- 172.21.15.63:0/584332989 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f079c1f2cf0 0x7f079c0c2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:43.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.673+0000 7f07a4600640 1 --2- 172.21.15.63:0/584332989 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f079c0bf2b0 0x7f079c1f27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:43.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.673+0000 7f07a4600640 1 --2- 172.21.15.63:0/584332989 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0784004810 0x7f079c15b7a0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:43.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.673+0000 7f07a4600640 1 -- 172.21.15.63:0/584332989 >> 172.21.15.63:0/584332989 conn(0x7f079c068460 msgr2=0x7f079c0c9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:43.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.673+0000 7f07a4600640 1 -- 172.21.15.63:0/584332989 shutdown_connections 2024-05-21T01:20:43.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.673+0000 7f07a4600640 1 -- 172.21.15.63:0/584332989 wait complete. 2024-05-21T01:20:43.697 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2024-05-21T01:20:43.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.833+0000 7f9d77000640 1 Processor -- start 2024-05-21T01:20:43.840 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.833+0000 7f9d77000640 1 -- start start 2024-05-21T01:20:43.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.837+0000 7f9d77000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f9d7006f9b0 0x7f9d700c94f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:43.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.837+0000 7f9d77000640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d700c4fc0 con 0x7f9d7006f5d0 2024-05-21T01:20:43.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.837+0000 7f9d77000640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d700ca240 con 0x7f9d700c69c0 2024-05-21T01:20:43.841 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.837+0000 7f9d77000640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f9d700c52a0 con 0x7f9d7006f9b0 2024-05-21T01:20:43.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.837+0000 7f9d6fe00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f9d7006f5d0 0x7f9d700c47f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:38964/0 (socket says 172.21.15.63:38964) 2024-05-21T01:20:43.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.837+0000 7f9d6fe00640 1 -- 172.21.15.63:0/3516640917 learned_addr learned my addr 172.21.15.63:0/3516640917 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-05-21T01:20:43.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.837+0000 7f9d67e00640 1 --2- 172.21.15.63:0/3516640917 >> v2:172.21.15.131:3300/0 conn(0x7f9d7006f9b0 0x7f9d700c94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:43.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.837+0000 7f9d6f400640 1 -- 172.21.15.63:0/3516640917 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 842500357 0 0) 0x7f9d700c4fc0 con 0x7f9d7006f5d0 2024-05-21T01:20:43.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.837+0000 7f9d6f400640 1 -- 172.21.15.63:0/3516640917 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d54003530 con 0x7f9d7006f5d0 2024-05-21T01:20:43.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.837+0000 7f9d6f400640 1 -- 172.21.15.63:0/3516640917 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2140053002 0 0) 0x7f9d54003530 con 0x7f9d7006f5d0 2024-05-21T01:20:43.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.837+0000 7f9d6f400640 1 -- 172.21.15.63:0/3516640917 >> v2:172.21.15.131:3300/0 conn(0x7f9d7006f9b0 msgr2=0x7f9d700c94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:43.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.837+0000 7f9d6f400640 1 --2- 172.21.15.63:0/3516640917 >> v2:172.21.15.131:3300/0 conn(0x7f9d7006f9b0 0x7f9d700c94f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:43.843 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.837+0000 7f9d6f400640 1 -- 172.21.15.63:0/3516640917 >> v1:172.21.15.131:6789/0 conn(0x7f9d700c69c0 legacy=0x7f9d700c6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:43.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.837+0000 7f9d6f400640 1 -- 172.21.15.63:0/3516640917 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d700ca520 con 0x7f9d7006f5d0 2024-05-21T01:20:43.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.837+0000 7f9d6f400640 1 -- 172.21.15.63:0/3516640917 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 466403955 0 0) 0x7f9d60001700 con 0x7f9d7006f5d0 2024-05-21T01:20:43.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.837+0000 7f9d6f400640 1 -- 172.21.15.63:0/3516640917 >> v1:172.21.15.63:6789/0 conn(0x7f9d7006f5d0 legacy=0x7f9d700c47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:43.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.837+0000 7f9d6f400640 1 --2- 172.21.15.63:0/3516640917 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9d54003a60 0x7f9d54003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:43.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.837+0000 7f9d6f400640 1 --2- 172.21.15.63:0/3516640917 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d54004810 0x7f9d54004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:43.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.837+0000 7f9d6f400640 1 --2- 172.21.15.63:0/3516640917 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9d540051d0 0x7f9d5400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:43.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.837+0000 7f9d6f400640 1 -- 172.21.15.63:0/3516640917 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f9d700c52a0 con 0x7f9d54003a60 2024-05-21T01:20:43.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.837+0000 7f9d6f400640 1 -- 172.21.15.63:0/3516640917 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f9d5400c170 con 0x7f9d54004810 2024-05-21T01:20:43.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.837+0000 7f9d6f400640 1 -- 172.21.15.63:0/3516640917 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f9d5400c370 con 0x7f9d540051d0 2024-05-21T01:20:43.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.837+0000 7f9d6fe00640 1 --2- 172.21.15.63:0/3516640917 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9d54003a60 0x7f9d54003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:43.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.837+0000 7f9d67e00640 1 --2- 172.21.15.63:0/3516640917 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d54004810 0x7f9d54004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:43.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.837+0000 7f9d75000640 1 --2- 172.21.15.63:0/3516640917 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9d540051d0 0x7f9d5400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:43.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.837+0000 7f9d6fe00640 1 -- 172.21.15.63:0/3516640917 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9d540051d0 msgr2=0x7f9d5400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:43.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.837+0000 7f9d6fe00640 1 --2- 172.21.15.63:0/3516640917 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9d540051d0 0x7f9d5400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:43.844 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.837+0000 7f9d6fe00640 1 -- 172.21.15.63:0/3516640917 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d54004810 msgr2=0x7f9d54004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:43.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.837+0000 7f9d6fe00640 1 --2- 172.21.15.63:0/3516640917 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d54004810 0x7f9d54004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:43.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.837+0000 7f9d6fe00640 1 -- 172.21.15.63:0/3516640917 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d54003530 con 0x7f9d54003a60 2024-05-21T01:20:43.845 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.837+0000 7f9d75000640 1 -- 172.21.15.63:0/3516640917 reap_dead start 2024-05-21T01:20:43.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.841+0000 7f9d6fe00640 1 --2- 172.21.15.63:0/3516640917 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9d54003a60 0x7f9d54003e80 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9d6000c240 tx=0x7f9d6001cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d482d2045f4c6d46 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:43.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.841+0000 7f9d6f400640 1 -- 172.21.15.63:0/3516640917 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d60007d80 con 0x7f9d54003a60 2024-05-21T01:20:43.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.841+0000 7f9d6f400640 1 -- 172.21.15.63:0/3516640917 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d600a9020 con 0x7f9d54003a60 2024-05-21T01:20:43.846 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.841+0000 7f9d6f400640 1 -- 172.21.15.63:0/3516640917 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d600a5b30 con 0x7f9d54003a60 2024-05-21T01:20:43.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.841+0000 7f9d77000640 1 -- 172.21.15.63:0/3516640917 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9d54003a60 msgr2=0x7f9d54003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:43.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.841+0000 7f9d77000640 1 --2- 172.21.15.63:0/3516640917 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9d54003a60 0x7f9d54003e80 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9d6000c240 tx=0x7f9d6001cb90 comp rx=0 tx=0).stop 2024-05-21T01:20:43.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.841+0000 7f9d77000640 1 -- 172.21.15.63:0/3516640917 shutdown_connections 2024-05-21T01:20:43.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.841+0000 7f9d77000640 1 --2- 172.21.15.63:0/3516640917 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9d54003a60 0x7f9d54003e80 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:43.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.841+0000 7f9d77000640 1 -- 172.21.15.63:0/3516640917 >> 172.21.15.63:0/3516640917 conn(0x7f9d70068460 msgr2=0x7f9d70068870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:43.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.841+0000 7f9d77000640 1 -- 172.21.15.63:0/3516640917 shutdown_connections 2024-05-21T01:20:43.847 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.841+0000 7f9d77000640 1 -- 172.21.15.63:0/3516640917 wait complete. 2024-05-21T01:20:43.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.845+0000 7f9d77000640 1 Processor -- start 2024-05-21T01:20:43.848 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.845+0000 7f9d77000640 1 -- start start 2024-05-21T01:20:43.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.845+0000 7f9d77000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9d54003a60 0x7f9d700cc160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:43.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.845+0000 7f9d77000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9d701f3150 0x7f9d7014c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:43.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.845+0000 7f9d77000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d7014b420 0x7f9d7014b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:43.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.845+0000 7f9d77000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f9d700c4d80 con 0x7f9d54003a60 2024-05-21T01:20:43.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.845+0000 7f9d77000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f9d700c4c00 con 0x7f9d7014b420 2024-05-21T01:20:43.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.845+0000 7f9d77000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f9d701539c0 con 0x7f9d701f3150 2024-05-21T01:20:43.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.845+0000 7f9d6fe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9d54003a60 0x7f9d700cc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:43.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.845+0000 7f9d6fe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9d54003a60 0x7f9d700cc160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38358/0 (socket says 172.21.15.63:38358) 2024-05-21T01:20:43.850 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.845+0000 7f9d6fe00640 1 -- 172.21.15.63:0/3417326836 learned_addr learned my addr 172.21.15.63:0/3417326836 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:43.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.845+0000 7f9d67e00640 1 --2- 172.21.15.63:0/3417326836 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9d701f3150 0x7f9d7014c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:43.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.845+0000 7f9d75000640 1 --2- 172.21.15.63:0/3417326836 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d7014b420 0x7f9d7014b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:43.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.845+0000 7f9d6fe00640 1 -- 172.21.15.63:0/3417326836 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9d701f3150 msgr2=0x7f9d7014c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:43.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.845+0000 7f9d6fe00640 1 --2- 172.21.15.63:0/3417326836 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9d701f3150 0x7f9d7014c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:43.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.845+0000 7f9d6fe00640 1 -- 172.21.15.63:0/3417326836 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d7014b420 msgr2=0x7f9d7014b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:43.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.845+0000 7f9d6fe00640 1 --2- 172.21.15.63:0/3417326836 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d7014b420 0x7f9d7014b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:43.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.845+0000 7f9d6fe00640 1 -- 172.21.15.63:0/3417326836 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d70149c50 con 0x7f9d54003a60 2024-05-21T01:20:43.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.845+0000 7f9d6fe00640 1 --2- 172.21.15.63:0/3417326836 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9d54003a60 0x7f9d700cc160 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9d6001c650 tx=0x7f9d54005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:43.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.845+0000 7f9d6cc00640 1 -- 172.21.15.63:0/3417326836 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d60007d80 con 0x7f9d54003a60 2024-05-21T01:20:43.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.845+0000 7f9d6cc00640 1 -- 172.21.15.63:0/3417326836 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d600b2070 con 0x7f9d54003a60 2024-05-21T01:20:43.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.845+0000 7f9d6cc00640 1 -- 172.21.15.63:0/3417326836 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d60001cc0 con 0x7f9d54003a60 2024-05-21T01:20:43.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.845+0000 7f9d77000640 1 -- 172.21.15.63:0/3417326836 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d7014d430 con 0x7f9d54003a60 2024-05-21T01:20:43.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.845+0000 7f9d77000640 1 -- 172.21.15.63:0/3417326836 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d701f2950 con 0x7f9d54003a60 2024-05-21T01:20:43.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.849+0000 7f9d6cc00640 1 -- 172.21.15.63:0/3417326836 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7f9d60004a30 con 0x7f9d54003a60 2024-05-21T01:20:43.853 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.849+0000 7f9d6cc00640 1 --2- 172.21.15.63:0/3417326836 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f9d4c06f400 0x7f9d4c0718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:43.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.849+0000 7f9d6cc00640 1 -- 172.21.15.63:0/3417326836 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f9d60128d10 con 0x7f9d54003a60 2024-05-21T01:20:43.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.849+0000 7f9d7a556000 1 Processor -- start 2024-05-21T01:20:43.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.849+0000 7f9d7a556000 1 -- start start 2024-05-21T01:20:43.854 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.849+0000 7f9d67e00640 1 --2- 172.21.15.63:0/3417326836 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f9d4c06f400 0x7f9d4c0718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:43.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.849+0000 7f9d7a556000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c7d19a94a0 0x55c7d1972200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:43.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.849+0000 7f9d7a556000 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c7d1972740 0x55c7d19919b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:43.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.849+0000 7f9d7a556000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c7d1991ef0 0x55c7d19922d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:43.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.849+0000 7f9d7a556000 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55c7d17c66d0 con 0x55c7d1972740 2024-05-21T01:20:43.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.849+0000 7f9d7a556000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55c7d17b6270 con 0x55c7d19a94a0 2024-05-21T01:20:43.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.849+0000 7f9d7a556000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55c7d17ba2b0 con 0x55c7d1991ef0 2024-05-21T01:20:43.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.849+0000 7f9d67e00640 1 --2- 172.21.15.63:0/3417326836 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f9d4c06f400 0x7f9d4c0718c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9d700cb850 tx=0x7f9d58008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:43.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.849+0000 7f9d6fe00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c7d19a94a0 0x55c7d1972200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:43.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.849+0000 7f9d67e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c7d1972740 0x55c7d19919b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:43.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.849+0000 7f9d6fe00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c7d19a94a0 0x55c7d1972200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.63:42034/0 (socket says 172.21.15.63:42034) 2024-05-21T01:20:43.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.849+0000 7f9d6fe00640 1 -- 172.21.15.63:0/717831281 learned_addr learned my addr 172.21.15.63:0/717831281 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:43.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.849+0000 7f9d75000640 1 --2- 172.21.15.63:0/717831281 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c7d1991ef0 0x55c7d19922d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:43.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.849+0000 7f9d67e00640 1 -- 172.21.15.63:0/717831281 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c7d1991ef0 msgr2=0x55c7d19922d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:43.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.849+0000 7f9d67e00640 1 --2- 172.21.15.63:0/717831281 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c7d1991ef0 0x55c7d19922d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:43.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.849+0000 7f9d67e00640 1 -- 172.21.15.63:0/717831281 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c7d19a94a0 msgr2=0x55c7d1972200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:43.856 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.849+0000 7f9d67e00640 1 --2- 172.21.15.63:0/717831281 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c7d19a94a0 0x55c7d1972200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:43.857 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.849+0000 7f9d67e00640 1 -- 172.21.15.63:0/717831281 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7d1794bf0 con 0x55c7d1972740 2024-05-21T01:20:43.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.849+0000 7f9d67e00640 1 --2- 172.21.15.63:0/717831281 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c7d1972740 0x55c7d19919b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f9d58014db0 tx=0x7f9d58017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=974fc28d0d9eca82 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:43.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.853+0000 7f9d64c00640 1 -- 172.21.15.63:0/717831281 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d58027070 con 0x55c7d1972740 2024-05-21T01:20:43.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.853+0000 7f9d64c00640 1 -- 172.21.15.63:0/717831281 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d58016e40 con 0x55c7d1972740 2024-05-21T01:20:43.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.853+0000 7f9d64c00640 1 -- 172.21.15.63:0/717831281 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d58023650 con 0x55c7d1972740 2024-05-21T01:20:43.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.853+0000 7f9d7a556000 1 -- 172.21.15.63:0/717831281 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c7d1972740 msgr2=0x55c7d19919b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:43.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.853+0000 7f9d7a556000 1 --2- 172.21.15.63:0/717831281 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c7d1972740 0x55c7d19919b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f9d58014db0 tx=0x7f9d58017000 comp rx=0 tx=0).stop 2024-05-21T01:20:43.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.853+0000 7f9d7a556000 1 -- 172.21.15.63:0/717831281 shutdown_connections 2024-05-21T01:20:43.858 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.853+0000 7f9d7a556000 1 --2- 172.21.15.63:0/717831281 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c7d1991ef0 0x55c7d19922d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:43.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.853+0000 7f9d7a556000 1 --2- 172.21.15.63:0/717831281 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c7d1972740 0x55c7d19919b0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:43.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.853+0000 7f9d7a556000 1 --2- 172.21.15.63:0/717831281 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c7d19a94a0 0x55c7d1972200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:43.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.853+0000 7f9d7a556000 1 -- 172.21.15.63:0/717831281 >> 172.21.15.63:0/717831281 conn(0x55c7d1851ef0 msgr2=0x55c7d19a8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:43.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.853+0000 7f9d7a556000 1 -- 172.21.15.63:0/717831281 shutdown_connections 2024-05-21T01:20:43.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.853+0000 7f9d7a556000 1 -- 172.21.15.63:0/717831281 wait complete. 2024-05-21T01:20:43.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.853+0000 7f9d7a556000 1 -- start start 2024-05-21T01:20:43.859 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.853+0000 7f9d7a556000 1 Processor -- start 2024-05-21T01:20:43.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.853+0000 7f9d7a556000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c7d1972740 0x55c7d19b6050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:43.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.853+0000 7f9d7a556000 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c7d1991ef0 0x55c7d19b6590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:43.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.853+0000 7f9d7a556000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c7d19a94a0 0x55c7d196dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:43.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.853+0000 7f9d7a556000 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55c7d1779630 con 0x55c7d1991ef0 2024-05-21T01:20:43.861 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.853+0000 7f9d7a556000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55c7d183a570 con 0x55c7d19a94a0 2024-05-21T01:20:43.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.853+0000 7f9d7a556000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55c7d17c54a0 con 0x55c7d1972740 2024-05-21T01:20:43.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.853+0000 7f9d7a556000 10 client.0 _ll_register_callbacks cb 0x55c7d1955540 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-21T01:20:43.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.853+0000 7f9d67e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c7d1991ef0 0x55c7d19b6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:43.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.853+0000 7f9d67e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c7d1991ef0 0x55c7d19b6590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38366/0 (socket says 172.21.15.63:38366) 2024-05-21T01:20:43.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.853+0000 7f9d67e00640 1 -- 172.21.15.63:0/1359779554 learned_addr learned my addr 172.21.15.63:0/1359779554 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:43.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.853+0000 7f9d6fe00640 1 --2- 172.21.15.63:0/1359779554 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c7d1972740 0x55c7d19b6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:43.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.853+0000 7f9d75000640 1 --2- 172.21.15.63:0/1359779554 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c7d19a94a0 0x55c7d196dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:43.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.853+0000 7f9d67e00640 1 -- 172.21.15.63:0/1359779554 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c7d1972740 msgr2=0x55c7d19b6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:43.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.853+0000 7f9d67e00640 1 --2- 172.21.15.63:0/1359779554 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c7d1972740 0x55c7d19b6050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:43.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.853+0000 7f9d67e00640 1 -- 172.21.15.63:0/1359779554 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c7d19a94a0 msgr2=0x55c7d196dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:43.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.853+0000 7f9d67e00640 1 --2- 172.21.15.63:0/1359779554 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c7d19a94a0 0x55c7d196dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:43.862 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.853+0000 7f9d67e00640 1 -- 172.21.15.63:0/1359779554 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c7d17fe9b0 con 0x55c7d1991ef0 2024-05-21T01:20:43.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.853+0000 7f9d75000640 1 --2- 172.21.15.63:0/1359779554 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c7d19a94a0 0x55c7d196dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T01:20:43.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.853+0000 7f9d6fe00640 1 --2- 172.21.15.63:0/1359779554 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c7d1972740 0x55c7d19b6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T01:20:43.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.853+0000 7f9d67e00640 1 --2- 172.21.15.63:0/1359779554 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c7d1991ef0 0x55c7d19b6590 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x55c7d186fa10 tx=0x7f9d58004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20839ad03e43d4c6 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:43.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.853+0000 7f9d5d600640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-05-21T01:20:43.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.857+0000 7f9d5d600640 1 -- 172.21.15.63:0/1359779554 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d58027070 con 0x55c7d1991ef0 2024-05-21T01:20:43.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.857+0000 7f9d5d600640 1 -- 172.21.15.63:0/1359779554 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f9d58023650 con 0x55c7d1991ef0 2024-05-21T01:20:43.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.857+0000 7f9d7a556000 1 -- 172.21.15.63:0/1359779554 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c7d1751bc0 con 0x55c7d1991ef0 2024-05-21T01:20:43.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.857+0000 7f9d5d600640 1 -- 172.21.15.63:0/1359779554 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f9d5803d050 con 0x55c7d1991ef0 2024-05-21T01:20:43.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.857+0000 7f9d7a556000 10 client.4785 fetch_fsmap learned FSMap version 15 2024-05-21T01:20:43.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.857+0000 7f9d7a556000 1 -- 172.21.15.63:0/1359779554 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x55c7d1791510 con 0x55c7d1991ef0 2024-05-21T01:20:43.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.857+0000 7f9d5d600640 1 -- 172.21.15.63:0/1359779554 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55c7d1751bc0 con 0x55c7d1991ef0 2024-05-21T01:20:43.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.857+0000 7f9d5d600640 1 -- 172.21.15.63:0/1359779554 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 15) ==== 4752+0+0 (secure 0 0 0) 0x7f9d58040020 con 0x55c7d1991ef0 2024-05-21T01:20:43.863 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.857+0000 7f9d7a556000 10 client.4785 fetch_fsmap finished waiting for FSMap version 15 2024-05-21T01:20:43.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.857+0000 7f9d7a556000 10 client.4785 resolve_mds: resolved name 'f' to daemon mds.f 2024-05-21T01:20:43.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.857+0000 7f9d7a556000 20 client.4785 populate_metadata read hostname 'smithi063' 2024-05-21T01:20:43.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.857+0000 7f9d7a556000 1 --2- 172.21.15.63:0/1359779554 >> [v2:172.21.15.131:6836/3071941741,v1:172.21.15.131:6838/3071941741] conn(0x55c7d196e9a0 0x55c7d196ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:43.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.857+0000 7f9d7a556000 4 client.4785 mds_command: new command op to 4270 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-21T01:20:43.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.857+0000 7f9d7a556000 1 -- 172.21.15.63:0/1359779554 --> [v2:172.21.15.131:6836/3071941741,v1:172.21.15.131:6838/3071941741] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c7d1755dc0 con 0x55c7d196e9a0 2024-05-21T01:20:43.864 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.857+0000 7f9d6fe00640 1 --2- 172.21.15.63:0/1359779554 >> [v2:172.21.15.131:6836/3071941741,v1:172.21.15.131:6838/3071941741] conn(0x55c7d196e9a0 0x55c7d196ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:43.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.857+0000 7f9d6fe00640 1 --2- 172.21.15.63:0/1359779554 >> [v2:172.21.15.131:6836/3071941741,v1:172.21.15.131:6838/3071941741] conn(0x55c7d196e9a0 0x55c7d196ed80 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5759e3f7bfa52de3 server_cookie=a29a2ff7e7203805 in_seq=0 out_seq=0 2024-05-21T01:20:43.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.857+0000 7f9d5d600640 10 client.4785 ms_handle_connect on v2:172.21.15.131:6836/3071941741 2024-05-21T01:20:43.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.857+0000 7f9d5d600640 1 -- 172.21.15.63:0/1359779554 <== mds.1 v2:172.21.15.131:6836/3071941741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x55c7d1755dc0 con 0x55c7d196e9a0 2024-05-21T01:20:43.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.857+0000 7f9d5d600640 10 client.4785 handle_command_reply: tid=0 2024-05-21T01:20:43.865 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.857+0000 7f9d7a556000 1 client.4785 shutdown 2024-05-21T01:20:43.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.861+0000 7f9d7a556000 1 -- 172.21.15.63:0/1359779554 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c7d1991ef0 msgr2=0x55c7d19b6590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:43.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.861+0000 7f9d7a556000 1 --2- 172.21.15.63:0/1359779554 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c7d1991ef0 0x55c7d19b6590 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x55c7d186fa10 tx=0x7f9d58004740 comp rx=0 tx=0).stop 2024-05-21T01:20:43.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.861+0000 7f9d7a556000 1 -- 172.21.15.63:0/1359779554 shutdown_connections 2024-05-21T01:20:43.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.861+0000 7f9d7a556000 1 --2- 172.21.15.63:0/1359779554 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c7d19a94a0 0x55c7d196dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:43.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.861+0000 7f9d7a556000 1 --2- 172.21.15.63:0/1359779554 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c7d1991ef0 0x55c7d19b6590 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:43.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.861+0000 7f9d7a556000 1 --2- 172.21.15.63:0/1359779554 >> [v2:172.21.15.131:6836/3071941741,v1:172.21.15.131:6838/3071941741] conn(0x55c7d196e9a0 0x55c7d196ed80 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:43.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.861+0000 7f9d7a556000 1 --2- 172.21.15.63:0/1359779554 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c7d1972740 0x55c7d19b6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:43.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.861+0000 7f9d7a556000 1 -- 172.21.15.63:0/1359779554 >> 172.21.15.63:0/1359779554 conn(0x55c7d1851ef0 msgr2=0x55c7d19688e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:43.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.861+0000 7f9d5d600640 0 client.4785 ms_handle_reset on v2:172.21.15.131:6836/3071941741 2024-05-21T01:20:43.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.861+0000 7f9d7a556000 1 -- 172.21.15.63:0/1359779554 shutdown_connections 2024-05-21T01:20:43.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.861+0000 7f9d7a556000 1 -- 172.21.15.63:0/1359779554 wait complete. 2024-05-21T01:20:43.866 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.861+0000 7f9d7a556000 20 client.4785 trim_cache size 0 max 16384 2024-05-21T01:20:43.883 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.877+0000 7f9d7a556000 1 Processor -- start 2024-05-21T01:20:43.883 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.877+0000 7f9d7a556000 1 -- start start 2024-05-21T01:20:43.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.877+0000 7f9d7a556000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c7d1972740 0x55c7d196c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:43.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.877+0000 7f9d7a556000 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c7d1991ef0 0x55c7d196cec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:43.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.877+0000 7f9d7a556000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c7d19a94a0 0x55c7d19c6400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:43.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.877+0000 7f9d7a556000 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f9d701ffc00 con 0x55c7d1991ef0 2024-05-21T01:20:43.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.877+0000 7f9d7a556000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55c7d1753200 con 0x55c7d19a94a0 2024-05-21T01:20:43.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.877+0000 7f9d7a556000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55c7d174e7b0 con 0x55c7d1972740 2024-05-21T01:20:43.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.881+0000 7f9d67e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c7d1991ef0 0x55c7d196cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:43.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.881+0000 7f9d67e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c7d1991ef0 0x55c7d196cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38374/0 (socket says 172.21.15.63:38374) 2024-05-21T01:20:43.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.881+0000 7f9d67e00640 1 -- 172.21.15.63:0/2606917779 learned_addr learned my addr 172.21.15.63:0/2606917779 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:43.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.881+0000 7f9d75000640 1 --2- 172.21.15.63:0/2606917779 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c7d19a94a0 0x55c7d19c6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:43.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.881+0000 7f9d6fe00640 1 --2- 172.21.15.63:0/2606917779 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c7d1972740 0x55c7d196c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:43.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.881+0000 7f9d67e00640 1 -- 172.21.15.63:0/2606917779 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c7d1972740 msgr2=0x55c7d196c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:43.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.881+0000 7f9d67e00640 1 --2- 172.21.15.63:0/2606917779 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c7d1972740 0x55c7d196c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:43.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.881+0000 7f9d67e00640 1 -- 172.21.15.63:0/2606917779 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c7d19a94a0 msgr2=0x55c7d19c6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:43.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.881+0000 7f9d67e00640 1 --2- 172.21.15.63:0/2606917779 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c7d19a94a0 0x55c7d19c6400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:43.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.881+0000 7f9d67e00640 1 -- 172.21.15.63:0/2606917779 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7d1757860 con 0x55c7d1991ef0 2024-05-21T01:20:43.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.881+0000 7f9d67e00640 1 --2- 172.21.15.63:0/2606917779 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c7d1991ef0 0x55c7d196cec0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9d5800a010 tx=0x7f9d5802f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cab74e046607285 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:43.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.881+0000 7f9d5fe00640 1 -- 172.21.15.63:0/2606917779 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d58027040 con 0x55c7d1991ef0 2024-05-21T01:20:43.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.881+0000 7f9d5fe00640 1 -- 172.21.15.63:0/2606917779 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d58023b50 con 0x55c7d1991ef0 2024-05-21T01:20:43.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.881+0000 7f9d5fe00640 1 -- 172.21.15.63:0/2606917779 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d58023450 con 0x55c7d1991ef0 2024-05-21T01:20:43.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.881+0000 7f9d7a556000 1 -- 172.21.15.63:0/2606917779 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c7d1991ef0 msgr2=0x55c7d196cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:43.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.881+0000 7f9d7a556000 1 --2- 172.21.15.63:0/2606917779 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c7d1991ef0 0x55c7d196cec0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9d5800a010 tx=0x7f9d5802f040 comp rx=0 tx=0).stop 2024-05-21T01:20:43.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.881+0000 7f9d7a556000 1 -- 172.21.15.63:0/2606917779 shutdown_connections 2024-05-21T01:20:43.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.881+0000 7f9d7a556000 1 --2- 172.21.15.63:0/2606917779 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c7d19a94a0 0x55c7d19c6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:43.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.881+0000 7f9d7a556000 1 --2- 172.21.15.63:0/2606917779 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c7d1991ef0 0x55c7d196cec0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:43.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.881+0000 7f9d7a556000 1 --2- 172.21.15.63:0/2606917779 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c7d1972740 0x55c7d196c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:43.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.881+0000 7f9d7a556000 1 -- 172.21.15.63:0/2606917779 >> 172.21.15.63:0/2606917779 conn(0x55c7d1851ef0 msgr2=0x55c7d19a5260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:43.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.881+0000 7f9d7a556000 1 -- 172.21.15.63:0/2606917779 shutdown_connections 2024-05-21T01:20:43.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.881+0000 7f9d7a556000 1 -- 172.21.15.63:0/2606917779 wait complete. 2024-05-21T01:20:43.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.881+0000 7f9d7a556000 1 -- start start 2024-05-21T01:20:43.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.881+0000 7f9d7a556000 1 Processor -- start 2024-05-21T01:20:43.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.881+0000 7f9d7a556000 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c7d1972740 0x55c7d1a23270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:43.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.881+0000 7f9d7a556000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c7d1991ef0 0x55c7d1a237b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:43.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.881+0000 7f9d7a556000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c7d19a94a0 0x55c7d1a23cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:43.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.881+0000 7f9d7a556000 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55c7d17be8e0 con 0x55c7d1972740 2024-05-21T01:20:43.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.881+0000 7f9d7a556000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55c7d17b95c0 con 0x55c7d1991ef0 2024-05-21T01:20:43.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.881+0000 7f9d7a556000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55c7d1779630 con 0x55c7d19a94a0 2024-05-21T01:20:43.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.881+0000 7f9d7a556000 10 client.0 _ll_register_callbacks cb 0x7f9d600f1920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-21T01:20:43.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.881+0000 7f9d6fe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c7d1972740 0x55c7d1a23270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:43.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.881+0000 7f9d6fe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c7d1972740 0x55c7d1a23270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38382/0 (socket says 172.21.15.63:38382) 2024-05-21T01:20:43.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.881+0000 7f9d6fe00640 1 -- 172.21.15.63:0/1629469612 learned_addr learned my addr 172.21.15.63:0/1629469612 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:43.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.881+0000 7f9d67e00640 1 --2- 172.21.15.63:0/1629469612 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c7d1991ef0 0x55c7d1a237b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:43.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.881+0000 7f9d75000640 1 --2- 172.21.15.63:0/1629469612 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c7d19a94a0 0x55c7d1a23cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:43.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.885+0000 7f9d6fe00640 1 -- 172.21.15.63:0/1629469612 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c7d19a94a0 msgr2=0x55c7d1a23cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:43.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.885+0000 7f9d6fe00640 1 --2- 172.21.15.63:0/1629469612 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c7d19a94a0 0x55c7d1a23cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:43.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.885+0000 7f9d6fe00640 1 -- 172.21.15.63:0/1629469612 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c7d1991ef0 msgr2=0x55c7d1a237b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:43.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.885+0000 7f9d6fe00640 1 --2- 172.21.15.63:0/1629469612 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c7d1991ef0 0x55c7d1a237b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:43.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.885+0000 7f9d6fe00640 1 -- 172.21.15.63:0/1629469612 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c7d176de80 con 0x55c7d1972740 2024-05-21T01:20:43.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.885+0000 7f9d67e00640 1 --2- 172.21.15.63:0/1629469612 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c7d1991ef0 0x55c7d1a237b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T01:20:43.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.885+0000 7f9d6fe00640 1 --2- 172.21.15.63:0/1629469612 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c7d1972740 0x55c7d1a23270 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9d600f1240 tx=0x7f9d600f1150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d5956b09330b675 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:43.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.885+0000 7f9d5d600640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-05-21T01:20:43.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.885+0000 7f9d5d600640 1 -- 172.21.15.63:0/1629469612 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d60113060 con 0x55c7d1972740 2024-05-21T01:20:43.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.885+0000 7f9d5d600640 1 -- 172.21.15.63:0/1629469612 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f9d600f14a0 con 0x55c7d1972740 2024-05-21T01:20:43.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.885+0000 7f9d7a556000 1 -- 172.21.15.63:0/1629469612 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d58023b50 con 0x55c7d1972740 2024-05-21T01:20:43.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.885+0000 7f9d5d600640 1 -- 172.21.15.63:0/1629469612 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f9d600bc040 con 0x55c7d1972740 2024-05-21T01:20:43.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.885+0000 7f9d7a556000 10 client.4791 fetch_fsmap learned FSMap version 15 2024-05-21T01:20:43.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.885+0000 7f9d7a556000 1 -- 172.21.15.63:0/1629469612 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x55c7d183aa00 con 0x55c7d1972740 2024-05-21T01:20:43.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.885+0000 7f9d5d600640 1 -- 172.21.15.63:0/1629469612 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d58023b50 con 0x55c7d1972740 2024-05-21T01:20:43.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.885+0000 7f9d5d600640 1 -- 172.21.15.63:0/1629469612 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 15) ==== 4752+0+0 (secure 0 0 0) 0x7f9d600fdb50 con 0x55c7d1972740 2024-05-21T01:20:43.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.885+0000 7f9d7a556000 10 client.4791 fetch_fsmap finished waiting for FSMap version 15 2024-05-21T01:20:43.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.885+0000 7f9d7a556000 10 client.4791 resolve_mds: resolved name 'f' to daemon mds.f 2024-05-21T01:20:43.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.885+0000 7f9d7a556000 20 client.4791 populate_metadata read hostname 'smithi063' 2024-05-21T01:20:43.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.885+0000 7f9d7a556000 1 --2- 172.21.15.63:0/1629469612 >> [v2:172.21.15.131:6836/3071941741,v1:172.21.15.131:6838/3071941741] conn(0x55c7d19b8ed0 0x55c7d19b92b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:43.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.885+0000 7f9d7a556000 4 client.4791 mds_command: new command op to 4270 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-21T01:20:43.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.885+0000 7f9d7a556000 1 -- 172.21.15.63:0/1629469612 --> [v2:172.21.15.131:6836/3071941741,v1:172.21.15.131:6838/3071941741] -- command(tid 0: {"prefix": "status"}) -- 0x55c7d17c8620 con 0x55c7d19b8ed0 2024-05-21T01:20:43.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.885+0000 7f9d67e00640 1 --2- 172.21.15.63:0/1629469612 >> [v2:172.21.15.131:6836/3071941741,v1:172.21.15.131:6838/3071941741] conn(0x55c7d19b8ed0 0x55c7d19b92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:43.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.885+0000 7f9d67e00640 1 --2- 172.21.15.63:0/1629469612 >> [v2:172.21.15.131:6836/3071941741,v1:172.21.15.131:6838/3071941741] conn(0x55c7d19b8ed0 0x55c7d19b92b0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ec57158961355acf server_cookie=c4951e2a218d9046 in_seq=0 out_seq=0 2024-05-21T01:20:43.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.885+0000 7f9d5d600640 10 client.4791 ms_handle_connect on v2:172.21.15.131:6836/3071941741 2024-05-21T01:20:43.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.885+0000 7f9d5d600640 1 -- 172.21.15.63:0/1629469612 <== mds.1 v2:172.21.15.131:6836/3071941741 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55c7d17c8620 con 0x55c7d19b8ed0 2024-05-21T01:20:43.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.885+0000 7f9d5d600640 10 client.4791 handle_command_reply: tid=0 2024-05-21T01:20:43.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.885+0000 7f9d7a556000 1 client.4791 shutdown 2024-05-21T01:20:43.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.885+0000 7f9d7a556000 1 -- 172.21.15.63:0/1629469612 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c7d1972740 msgr2=0x55c7d1a23270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:43.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.885+0000 7f9d7a556000 1 --2- 172.21.15.63:0/1629469612 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c7d1972740 0x55c7d1a23270 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9d600f1240 tx=0x7f9d600f1150 comp rx=0 tx=0).stop 2024-05-21T01:20:43.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.885+0000 7f9d7a556000 1 -- 172.21.15.63:0/1629469612 shutdown_connections 2024-05-21T01:20:43.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.885+0000 7f9d7a556000 1 --2- 172.21.15.63:0/1629469612 >> [v2:172.21.15.131:6836/3071941741,v1:172.21.15.131:6838/3071941741] conn(0x55c7d19b8ed0 0x55c7d19b92b0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:43.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.885+0000 7f9d7a556000 1 --2- 172.21.15.63:0/1629469612 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55c7d19a94a0 0x55c7d1a23cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:43.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.885+0000 7f9d7a556000 1 --2- 172.21.15.63:0/1629469612 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c7d1991ef0 0x55c7d1a237b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:43.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.885+0000 7f9d7a556000 1 --2- 172.21.15.63:0/1629469612 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55c7d1972740 0x55c7d1a23270 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:43.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.885+0000 7f9d5d600640 0 client.4791 ms_handle_reset on v2:172.21.15.131:6836/3071941741 2024-05-21T01:20:43.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.885+0000 7f9d7a556000 1 -- 172.21.15.63:0/1629469612 >> 172.21.15.63:0/1629469612 conn(0x55c7d1851ef0 msgr2=0x55c7d196c980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:43.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.885+0000 7f9d7a556000 1 -- 172.21.15.63:0/1629469612 shutdown_connections 2024-05-21T01:20:43.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.885+0000 7f9d7a556000 1 -- 172.21.15.63:0/1629469612 wait complete. 2024-05-21T01:20:43.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.885+0000 7f9d7a556000 20 client.4791 trim_cache size 0 max 16384 2024-05-21T01:20:43.896 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-05-21T01:20:43.896 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_fsid": "9a7cbd84-ceb2-41c8-8b6e-ab931f86c51a", 2024-05-21T01:20:43.896 INFO:teuthology.orchestra.run.smithi063.stdout: "whoami": 1, 2024-05-21T01:20:43.896 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 4270, 2024-05-21T01:20:43.896 INFO:teuthology.orchestra.run.smithi063.stdout: "want_state": "up:active", 2024-05-21T01:20:43.896 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "up:active", 2024-05-21T01:20:43.896 INFO:teuthology.orchestra.run.smithi063.stdout: "fs_name": "cephfs", 2024-05-21T01:20:43.896 INFO:teuthology.orchestra.run.smithi063.stdout: "rank_uptime": 24.251670106999999, 2024-05-21T01:20:43.896 INFO:teuthology.orchestra.run.smithi063.stdout: "mdsmap_epoch": 15, 2024-05-21T01:20:43.896 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch": 27, 2024-05-21T01:20:43.896 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch_barrier": 25, 2024-05-21T01:20:43.896 INFO:teuthology.orchestra.run.smithi063.stdout: "uptime": 55.229722447999997 2024-05-21T01:20:43.896 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-05-21T01:20:43.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.889+0000 7f9d77000640 1 -- 172.21.15.63:0/3417326836 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f9d4c06f400 msgr2=0x7f9d4c0718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:43.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.889+0000 7f9d77000640 1 --2- 172.21.15.63:0/3417326836 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f9d4c06f400 0x7f9d4c0718c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9d700cb850 tx=0x7f9d58008040 comp rx=0 tx=0).stop 2024-05-21T01:20:43.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.889+0000 7f9d77000640 1 -- 172.21.15.63:0/3417326836 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9d54003a60 msgr2=0x7f9d700cc160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:43.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.889+0000 7f9d77000640 1 --2- 172.21.15.63:0/3417326836 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9d54003a60 0x7f9d700cc160 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9d6001c650 tx=0x7f9d54005840 comp rx=0 tx=0).stop 2024-05-21T01:20:43.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.889+0000 7f9d77000640 1 -- 172.21.15.63:0/3417326836 shutdown_connections 2024-05-21T01:20:43.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.889+0000 7f9d77000640 1 --2- 172.21.15.63:0/3417326836 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f9d4c06f400 0x7f9d4c0718c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:43.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.889+0000 7f9d77000640 1 --2- 172.21.15.63:0/3417326836 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d7014b420 0x7f9d7014b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:43.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.889+0000 7f9d77000640 1 --2- 172.21.15.63:0/3417326836 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9d701f3150 0x7f9d7014c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:43.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.889+0000 7f9d77000640 1 --2- 172.21.15.63:0/3417326836 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9d54003a60 0x7f9d700cc160 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:43.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.889+0000 7f9d77000640 1 -- 172.21.15.63:0/3417326836 >> 172.21.15.63:0/3417326836 conn(0x7f9d70068460 msgr2=0x7f9d7014e950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:43.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.889+0000 7f9d77000640 1 -- 172.21.15.63:0/3417326836 shutdown_connections 2024-05-21T01:20:43.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:43.889+0000 7f9d77000640 1 -- 172.21.15.63:0/3417326836 wait complete. 2024-05-21T01:20:43.911 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-05-21T01:20:44.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.049+0000 7f88e1600640 1 Processor -- start 2024-05-21T01:20:44.054 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.049+0000 7f88e1600640 1 -- start start 2024-05-21T01:20:44.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.049+0000 7f88e1600640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f88dc156150 0x7f88dc15bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:44.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.049+0000 7f88e1600640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f88dc06d5b0 0x7f88dc06da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:44.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.049+0000 7f88e1600640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88dc06f510 con 0x7f88dc073480 2024-05-21T01:20:44.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.049+0000 7f88e1600640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f88dc070a20 con 0x7f88dc156150 2024-05-21T01:20:44.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.049+0000 7f88e1600640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f88dc073ac0 con 0x7f88dc06d5b0 2024-05-21T01:20:44.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.049+0000 7f88daa00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f88dc156150 0x7f88dc15bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:44.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.049+0000 7f88daa00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f88dc156150 0x7f88dc15bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38394/0 (socket says 172.21.15.63:38394) 2024-05-21T01:20:44.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.049+0000 7f88daa00640 1 -- 172.21.15.63:0/3689975721 learned_addr learned my addr 172.21.15.63:0/3689975721 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:44.056 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.049+0000 7f88db400640 1 --2- 172.21.15.63:0/3689975721 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f88dc06d5b0 0x7f88dc06da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:44.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.049+0000 7f88daa00640 1 -- 172.21.15.63:0/3689975721 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f88dc06d5b0 msgr2=0x7f88dc06da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:44.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.049+0000 7f88daa00640 1 --2- 172.21.15.63:0/3689975721 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f88dc06d5b0 0x7f88dc06da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:44.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.049+0000 7f88daa00640 1 -- 172.21.15.63:0/3689975721 >> v1:172.21.15.131:6789/0 conn(0x7f88dc073480 legacy=0x7f88dc071190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:44.057 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.049+0000 7f88daa00640 1 -- 172.21.15.63:0/3689975721 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88dc073da0 con 0x7f88dc156150 2024-05-21T01:20:44.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.053+0000 7f88daa00640 1 --2- 172.21.15.63:0/3689975721 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f88dc156150 0x7f88dc15bd30 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f88dc070ba0 tx=0x7f88cc01c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1aa3e4921157252e server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:44.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.053+0000 7f88da000640 1 -- 172.21.15.63:0/3689975721 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88cc0a5640 con 0x7f88dc156150 2024-05-21T01:20:44.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.053+0000 7f88da000640 1 -- 172.21.15.63:0/3689975721 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88cc0a57e0 con 0x7f88dc156150 2024-05-21T01:20:44.059 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.053+0000 7f88da000640 1 -- 172.21.15.63:0/3689975721 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88cc0a5bb0 con 0x7f88dc156150 2024-05-21T01:20:44.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.053+0000 7f88e1600640 1 -- 172.21.15.63:0/3689975721 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f88dc156150 msgr2=0x7f88dc15bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:44.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.053+0000 7f88e1600640 1 --2- 172.21.15.63:0/3689975721 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f88dc156150 0x7f88dc15bd30 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f88dc070ba0 tx=0x7f88cc01c980 comp rx=0 tx=0).stop 2024-05-21T01:20:44.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.053+0000 7f88e1600640 1 -- 172.21.15.63:0/3689975721 shutdown_connections 2024-05-21T01:20:44.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.053+0000 7f88e1600640 1 --2- 172.21.15.63:0/3689975721 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f88dc06d5b0 0x7f88dc06da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:44.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.053+0000 7f88e1600640 1 --2- 172.21.15.63:0/3689975721 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f88dc156150 0x7f88dc15bd30 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:44.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.053+0000 7f88e1600640 1 -- 172.21.15.63:0/3689975721 >> 172.21.15.63:0/3689975721 conn(0x7f88dc0cbf10 msgr2=0x7f88dc0cc320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:44.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.053+0000 7f88e1600640 1 -- 172.21.15.63:0/3689975721 shutdown_connections 2024-05-21T01:20:44.060 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.053+0000 7f88e1600640 1 -- 172.21.15.63:0/3689975721 wait complete. 2024-05-21T01:20:44.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.057+0000 7f88e1600640 1 Processor -- start 2024-05-21T01:20:44.061 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.057+0000 7f88e1600640 1 -- start start 2024-05-21T01:20:44.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.057+0000 7f88e1600640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f88dc06d5b0 0x7f88dc14a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:44.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.057+0000 7f88e1600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f88dc073480 0x7f88dc14a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:44.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.057+0000 7f88e1600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f88dc156150 0x7f88dc147dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:44.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.057+0000 7f88e1600640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f88dc071a20 con 0x7f88dc156150 2024-05-21T01:20:44.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.057+0000 7f88e1600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f88dc0718a0 con 0x7f88dc073480 2024-05-21T01:20:44.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.057+0000 7f88e1600640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f88dc168ed0 con 0x7f88dc06d5b0 2024-05-21T01:20:44.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.057+0000 7f88db400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f88dc156150 0x7f88dc147dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:44.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.057+0000 7f88db400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f88dc156150 0x7f88dc147dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38404/0 (socket says 172.21.15.63:38404) 2024-05-21T01:20:44.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.057+0000 7f88db400640 1 -- 172.21.15.63:0/1005816668 learned_addr learned my addr 172.21.15.63:0/1005816668 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:44.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.057+0000 7f88d2000640 1 --2- 172.21.15.63:0/1005816668 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f88dc073480 0x7f88dc14a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:44.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.057+0000 7f88daa00640 1 --2- 172.21.15.63:0/1005816668 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f88dc06d5b0 0x7f88dc14a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:44.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.057+0000 7f88db400640 1 -- 172.21.15.63:0/1005816668 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f88dc06d5b0 msgr2=0x7f88dc14a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:44.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.057+0000 7f88db400640 1 --2- 172.21.15.63:0/1005816668 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f88dc06d5b0 0x7f88dc14a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:44.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.057+0000 7f88db400640 1 -- 172.21.15.63:0/1005816668 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f88dc073480 msgr2=0x7f88dc14a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:44.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.057+0000 7f88db400640 1 --2- 172.21.15.63:0/1005816668 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f88dc073480 0x7f88dc14a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:44.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.057+0000 7f88db400640 1 -- 172.21.15.63:0/1005816668 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88dc0c87f0 con 0x7f88dc156150 2024-05-21T01:20:44.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.057+0000 7f88d2000640 1 --2- 172.21.15.63:0/1005816668 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f88dc073480 0x7f88dc14a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T01:20:44.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.057+0000 7f88db400640 1 --2- 172.21.15.63:0/1005816668 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f88dc156150 0x7f88dc147dd0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f88d400d560 tx=0x7f88d400da20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:44.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.057+0000 7f88d3400640 1 -- 172.21.15.63:0/1005816668 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88d40125f0 con 0x7f88dc156150 2024-05-21T01:20:44.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.057+0000 7f88d3400640 1 -- 172.21.15.63:0/1005816668 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88d4019070 con 0x7f88dc156150 2024-05-21T01:20:44.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.057+0000 7f88e1600640 1 -- 172.21.15.63:0/1005816668 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88dc14c190 con 0x7f88dc156150 2024-05-21T01:20:44.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.057+0000 7f88d3400640 1 -- 172.21.15.63:0/1005816668 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88d40129f0 con 0x7f88dc156150 2024-05-21T01:20:44.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.057+0000 7f88e1600640 1 -- 172.21.15.63:0/1005816668 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88dc0c69b0 con 0x7f88dc156150 2024-05-21T01:20:44.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.061+0000 7f88d3400640 1 -- 172.21.15.63:0/1005816668 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7f88d4012b90 con 0x7f88dc156150 2024-05-21T01:20:44.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.061+0000 7f88d3400640 1 --2- 172.21.15.63:0/1005816668 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f88b806f400 0x7f88b80718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:44.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.061+0000 7f88e4a5a000 1 Processor -- start 2024-05-21T01:20:44.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.061+0000 7f88d3400640 1 -- 172.21.15.63:0/1005816668 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f88d408f9c0 con 0x7f88dc156150 2024-05-21T01:20:44.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.061+0000 7f88e4a5a000 1 -- start start 2024-05-21T01:20:44.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.061+0000 7f88daa00640 1 --2- 172.21.15.63:0/1005816668 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f88b806f400 0x7f88b80718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:44.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.065+0000 7f88e4a5a000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a7aa574a0 0x559a7aa20200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:44.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.065+0000 7f88e4a5a000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559a7aa20740 0x559a7aa3f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:44.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.065+0000 7f88daa00640 1 --2- 172.21.15.63:0/1005816668 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f88b806f400 0x7f88b80718c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f88cc0ae000 tx=0x7f88cc0a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:44.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.065+0000 7f88e4a5a000 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559a7aa3fef0 0x559a7aa402d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:44.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.065+0000 7f88e4a5a000 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x559a7a8746d0 con 0x559a7aa3fef0 2024-05-21T01:20:44.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.065+0000 7f88e4a5a000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x559a7a864270 con 0x559a7aa574a0 2024-05-21T01:20:44.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.065+0000 7f88e4a5a000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x559a7a8682b0 con 0x559a7aa20740 2024-05-21T01:20:44.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.065+0000 7f88db400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559a7aa3fef0 0x559a7aa402d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:44.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.065+0000 7f88db400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559a7aa3fef0 0x559a7aa402d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38410/0 (socket says 172.21.15.63:38410) 2024-05-21T01:20:44.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.065+0000 7f88db400640 1 -- 172.21.15.63:0/2707551770 learned_addr learned my addr 172.21.15.63:0/2707551770 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:44.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.065+0000 7f88d2000640 1 --2- 172.21.15.63:0/2707551770 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559a7aa20740 0x559a7aa3f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:44.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.065+0000 7f88daa00640 1 --2- 172.21.15.63:0/2707551770 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a7aa574a0 0x559a7aa20200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:44.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.065+0000 7f88db400640 1 -- 172.21.15.63:0/2707551770 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559a7aa20740 msgr2=0x559a7aa3f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:44.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.065+0000 7f88db400640 1 --2- 172.21.15.63:0/2707551770 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559a7aa20740 0x559a7aa3f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:44.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.065+0000 7f88db400640 1 -- 172.21.15.63:0/2707551770 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a7aa574a0 msgr2=0x559a7aa20200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:44.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.065+0000 7f88db400640 1 --2- 172.21.15.63:0/2707551770 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a7aa574a0 0x559a7aa20200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:44.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.065+0000 7f88db400640 1 -- 172.21.15.63:0/2707551770 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a7a842bf0 con 0x559a7aa3fef0 2024-05-21T01:20:44.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.065+0000 7f88db400640 1 --2- 172.21.15.63:0/2707551770 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559a7aa3fef0 0x559a7aa402d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f88d40584b0 tx=0x7f88d405b6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c504c956e66cd115 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:44.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.065+0000 7f88cb400640 1 -- 172.21.15.63:0/2707551770 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88d405bec0 con 0x559a7aa3fef0 2024-05-21T01:20:44.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.065+0000 7f88cb400640 1 -- 172.21.15.63:0/2707551770 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88d4060270 con 0x559a7aa3fef0 2024-05-21T01:20:44.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.065+0000 7f88cb400640 1 -- 172.21.15.63:0/2707551770 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88d4064c90 con 0x559a7aa3fef0 2024-05-21T01:20:44.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.065+0000 7f88e4a5a000 1 -- 172.21.15.63:0/2707551770 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559a7aa3fef0 msgr2=0x559a7aa402d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:44.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.065+0000 7f88e4a5a000 1 --2- 172.21.15.63:0/2707551770 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559a7aa3fef0 0x559a7aa402d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f88d40584b0 tx=0x7f88d405b6f0 comp rx=0 tx=0).stop 2024-05-21T01:20:44.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.065+0000 7f88e4a5a000 1 -- 172.21.15.63:0/2707551770 shutdown_connections 2024-05-21T01:20:44.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.065+0000 7f88e4a5a000 1 --2- 172.21.15.63:0/2707551770 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559a7aa3fef0 0x559a7aa402d0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:44.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.065+0000 7f88e4a5a000 1 --2- 172.21.15.63:0/2707551770 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559a7aa20740 0x559a7aa3f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:44.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.065+0000 7f88e4a5a000 1 --2- 172.21.15.63:0/2707551770 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a7aa574a0 0x559a7aa20200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:44.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.065+0000 7f88e4a5a000 1 -- 172.21.15.63:0/2707551770 >> 172.21.15.63:0/2707551770 conn(0x559a7a8ffef0 msgr2=0x559a7aa56b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:44.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.065+0000 7f88e4a5a000 1 -- 172.21.15.63:0/2707551770 shutdown_connections 2024-05-21T01:20:44.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.065+0000 7f88e4a5a000 1 -- 172.21.15.63:0/2707551770 wait complete. 2024-05-21T01:20:44.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.065+0000 7f88e4a5a000 1 -- start start 2024-05-21T01:20:44.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.065+0000 7f88e4a5a000 1 Processor -- start 2024-05-21T01:20:44.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.069+0000 7f88e4a5a000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559a7aa20740 0x559a7aa64050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:44.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.069+0000 7f88e4a5a000 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559a7aa3fef0 0x559a7aa64590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:44.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.069+0000 7f88e4a5a000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a7aa574a0 0x559a7aa1bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:44.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.069+0000 7f88e4a5a000 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x559a7a827630 con 0x559a7aa3fef0 2024-05-21T01:20:44.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.069+0000 7f88e4a5a000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x559a7a8e8570 con 0x559a7aa574a0 2024-05-21T01:20:44.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.069+0000 7f88e4a5a000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x559a7a8734a0 con 0x559a7aa20740 2024-05-21T01:20:44.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.069+0000 7f88e4a5a000 10 client.0 _ll_register_callbacks cb 0x559a7aa03540 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-21T01:20:44.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.069+0000 7f88d2000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559a7aa3fef0 0x559a7aa64590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:44.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.069+0000 7f88d2000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559a7aa3fef0 0x559a7aa64590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38426/0 (socket says 172.21.15.63:38426) 2024-05-21T01:20:44.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.069+0000 7f88d2000640 1 -- 172.21.15.63:0/699342269 learned_addr learned my addr 172.21.15.63:0/699342269 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:44.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.069+0000 7f88daa00640 1 --2- 172.21.15.63:0/699342269 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559a7aa20740 0x559a7aa64050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:44.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.069+0000 7f88db400640 1 --2- 172.21.15.63:0/699342269 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a7aa574a0 0x559a7aa1bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:44.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.069+0000 7f88d2000640 1 -- 172.21.15.63:0/699342269 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559a7aa20740 msgr2=0x559a7aa64050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:44.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.069+0000 7f88d2000640 1 --2- 172.21.15.63:0/699342269 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559a7aa20740 0x559a7aa64050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:44.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.069+0000 7f88d2000640 1 -- 172.21.15.63:0/699342269 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a7aa574a0 msgr2=0x559a7aa1bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:44.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.069+0000 7f88d2000640 1 --2- 172.21.15.63:0/699342269 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a7aa574a0 0x559a7aa1bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:44.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.069+0000 7f88d2000640 1 -- 172.21.15.63:0/699342269 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a7a8ac9b0 con 0x559a7aa3fef0 2024-05-21T01:20:44.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.069+0000 7f88d2000640 1 --2- 172.21.15.63:0/699342269 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559a7aa3fef0 0x559a7aa64590 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f88c4001dd0 tx=0x7f88c4011620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8be42e0db3889370 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:44.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.069+0000 7f88bfe00640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-05-21T01:20:44.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.069+0000 7f88bfe00640 1 -- 172.21.15.63:0/699342269 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88c4005320 con 0x559a7aa3fef0 2024-05-21T01:20:44.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.069+0000 7f88e4a5a000 1 -- 172.21.15.63:0/699342269 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f88d4060270 con 0x559a7aa3fef0 2024-05-21T01:20:44.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.069+0000 7f88bfe00640 1 -- 172.21.15.63:0/699342269 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f88c4010040 con 0x559a7aa3fef0 2024-05-21T01:20:44.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.069+0000 7f88bfe00640 1 -- 172.21.15.63:0/699342269 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f88c40054c0 con 0x559a7aa3fef0 2024-05-21T01:20:44.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.069+0000 7f88e4a5a000 10 client.4803 fetch_fsmap learned FSMap version 15 2024-05-21T01:20:44.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.069+0000 7f88e4a5a000 1 -- 172.21.15.63:0/699342269 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x559a7a83f510 con 0x559a7aa3fef0 2024-05-21T01:20:44.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.069+0000 7f88bfe00640 1 -- 172.21.15.63:0/699342269 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88d4060270 con 0x559a7aa3fef0 2024-05-21T01:20:44.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.069+0000 7f88bfe00640 1 -- 172.21.15.63:0/699342269 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 15) ==== 4752+0+0 (secure 0 0 0) 0x7f88c4007050 con 0x559a7aa3fef0 2024-05-21T01:20:44.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.069+0000 7f88e4a5a000 10 client.4803 fetch_fsmap finished waiting for FSMap version 15 2024-05-21T01:20:44.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.069+0000 7f88e4a5a000 10 client.4803 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-21T01:20:44.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.069+0000 7f88e4a5a000 20 client.4803 populate_metadata read hostname 'smithi063' 2024-05-21T01:20:44.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.069+0000 7f88e4a5a000 1 --2- 172.21.15.63:0/699342269 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x559a7aa1c950 0x559a7aa1cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:44.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.069+0000 7f88e4a5a000 4 client.4803 mds_command: new command op to 4276 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-21T01:20:44.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.069+0000 7f88e4a5a000 1 -- 172.21.15.63:0/699342269 --> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559a7a7ffbc0 con 0x559a7aa1c950 2024-05-21T01:20:44.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.069+0000 7f88daa00640 1 --2- 172.21.15.63:0/699342269 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x559a7aa1c950 0x559a7aa1cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:44.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.069+0000 7f88daa00640 1 --2- 172.21.15.63:0/699342269 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x559a7aa1c950 0x559a7aa1cd30 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da552462ae3e9e10 server_cookie=e759b09ec551e8c2 in_seq=0 out_seq=0 2024-05-21T01:20:44.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.069+0000 7f88bfe00640 10 client.4803 ms_handle_connect on v2:172.21.15.63:6834/2892727989 2024-05-21T01:20:44.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.073+0000 7f88bfe00640 1 -- 172.21.15.63:0/699342269 <== mds.0 v2:172.21.15.63:6834/2892727989 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x559a7a7ffbc0 con 0x559a7aa1c950 2024-05-21T01:20:44.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.073+0000 7f88bfe00640 10 client.4803 handle_command_reply: tid=0 2024-05-21T01:20:44.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.073+0000 7f88e4a5a000 1 client.4803 shutdown 2024-05-21T01:20:44.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.073+0000 7f88e4a5a000 1 -- 172.21.15.63:0/699342269 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559a7aa3fef0 msgr2=0x559a7aa64590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:44.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.073+0000 7f88e4a5a000 1 --2- 172.21.15.63:0/699342269 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559a7aa3fef0 0x559a7aa64590 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f88c4001dd0 tx=0x7f88c4011620 comp rx=0 tx=0).stop 2024-05-21T01:20:44.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.073+0000 7f88e4a5a000 1 -- 172.21.15.63:0/699342269 shutdown_connections 2024-05-21T01:20:44.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.073+0000 7f88e4a5a000 1 --2- 172.21.15.63:0/699342269 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x559a7aa1c950 0x559a7aa1cd30 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:44.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.073+0000 7f88e4a5a000 1 --2- 172.21.15.63:0/699342269 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a7aa574a0 0x559a7aa1bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:44.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.073+0000 7f88e4a5a000 1 --2- 172.21.15.63:0/699342269 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559a7aa3fef0 0x559a7aa64590 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:44.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.073+0000 7f88e4a5a000 1 --2- 172.21.15.63:0/699342269 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559a7aa20740 0x559a7aa64050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:44.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.073+0000 7f88bfe00640 0 client.4803 ms_handle_reset on v2:172.21.15.63:6834/2892727989 2024-05-21T01:20:44.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.073+0000 7f88e4a5a000 1 -- 172.21.15.63:0/699342269 >> 172.21.15.63:0/699342269 conn(0x559a7a8ffef0 msgr2=0x559a7aa168e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:44.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.073+0000 7f88e4a5a000 1 -- 172.21.15.63:0/699342269 shutdown_connections 2024-05-21T01:20:44.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.073+0000 7f88e4a5a000 1 -- 172.21.15.63:0/699342269 wait complete. 2024-05-21T01:20:44.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.073+0000 7f88e4a5a000 20 client.4803 trim_cache size 0 max 16384 2024-05-21T01:20:44.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.089+0000 7f88e4a5a000 1 Processor -- start 2024-05-21T01:20:44.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.089+0000 7f88e4a5a000 1 -- start start 2024-05-21T01:20:44.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.089+0000 7f88e4a5a000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559a7aa20740 0x559a7aa53370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:44.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.093+0000 7f88e4a5a000 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559a7aa3fef0 0x559a7aa69c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:44.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.093+0000 7f88e4a5a000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a7aa574a0 0x559a7aa6a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:44.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.093+0000 7f88e4a5a000 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f88dc1f9360 con 0x559a7aa3fef0 2024-05-21T01:20:44.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.093+0000 7f88e4a5a000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f88dc15b060 con 0x559a7aa574a0 2024-05-21T01:20:44.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.093+0000 7f88e4a5a000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x559a7a801200 con 0x559a7aa20740 2024-05-21T01:20:44.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.093+0000 7f88d2000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559a7aa3fef0 0x559a7aa69c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:44.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.093+0000 7f88d2000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559a7aa3fef0 0x559a7aa69c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38434/0 (socket says 172.21.15.63:38434) 2024-05-21T01:20:44.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.093+0000 7f88d2000640 1 -- 172.21.15.63:0/2058832664 learned_addr learned my addr 172.21.15.63:0/2058832664 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:44.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.093+0000 7f88db400640 1 --2- 172.21.15.63:0/2058832664 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a7aa574a0 0x559a7aa6a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:44.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.093+0000 7f88daa00640 1 --2- 172.21.15.63:0/2058832664 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559a7aa20740 0x559a7aa53370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:44.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.093+0000 7f88d2000640 1 -- 172.21.15.63:0/2058832664 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559a7aa20740 msgr2=0x559a7aa53370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:44.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.093+0000 7f88d2000640 1 --2- 172.21.15.63:0/2058832664 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559a7aa20740 0x559a7aa53370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:44.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.093+0000 7f88d2000640 1 -- 172.21.15.63:0/2058832664 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a7aa574a0 msgr2=0x559a7aa6a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:44.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.093+0000 7f88d2000640 1 --2- 172.21.15.63:0/2058832664 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a7aa574a0 0x559a7aa6a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:44.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.093+0000 7f88d2000640 1 -- 172.21.15.63:0/2058832664 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a7a805860 con 0x559a7aa3fef0 2024-05-21T01:20:44.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.093+0000 7f88d2000640 1 --2- 172.21.15.63:0/2058832664 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559a7aa3fef0 0x559a7aa69c90 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f88c4007e60 tx=0x7f88c400e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2885df2837e4a66d server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:44.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.093+0000 7f88caa00640 1 -- 172.21.15.63:0/2058832664 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88c4005320 con 0x559a7aa3fef0 2024-05-21T01:20:44.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.093+0000 7f88caa00640 1 -- 172.21.15.63:0/2058832664 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88c40076a0 con 0x559a7aa3fef0 2024-05-21T01:20:44.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.093+0000 7f88caa00640 1 -- 172.21.15.63:0/2058832664 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88c4001a10 con 0x559a7aa3fef0 2024-05-21T01:20:44.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.093+0000 7f88e4a5a000 1 -- 172.21.15.63:0/2058832664 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559a7aa3fef0 msgr2=0x559a7aa69c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:44.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.093+0000 7f88e4a5a000 1 --2- 172.21.15.63:0/2058832664 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559a7aa3fef0 0x559a7aa69c90 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f88c4007e60 tx=0x7f88c400e000 comp rx=0 tx=0).stop 2024-05-21T01:20:44.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.093+0000 7f88e4a5a000 1 -- 172.21.15.63:0/2058832664 shutdown_connections 2024-05-21T01:20:44.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.093+0000 7f88e4a5a000 1 --2- 172.21.15.63:0/2058832664 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a7aa574a0 0x559a7aa6a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:44.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.093+0000 7f88e4a5a000 1 --2- 172.21.15.63:0/2058832664 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559a7aa3fef0 0x559a7aa69c90 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:44.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.093+0000 7f88e4a5a000 1 --2- 172.21.15.63:0/2058832664 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559a7aa20740 0x559a7aa53370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:44.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.093+0000 7f88e4a5a000 1 -- 172.21.15.63:0/2058832664 >> 172.21.15.63:0/2058832664 conn(0x559a7a8ffef0 msgr2=0x559a7aa1a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:44.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.093+0000 7f88e4a5a000 1 -- 172.21.15.63:0/2058832664 shutdown_connections 2024-05-21T01:20:44.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.093+0000 7f88e4a5a000 1 -- 172.21.15.63:0/2058832664 wait complete. 2024-05-21T01:20:44.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.093+0000 7f88e4a5a000 1 -- start start 2024-05-21T01:20:44.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.093+0000 7f88e4a5a000 1 Processor -- start 2024-05-21T01:20:44.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.093+0000 7f88e4a5a000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559a7aa20740 0x559a7aa74620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:44.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.093+0000 7f88e4a5a000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a7aa3fef0 0x559a7aa66c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:44.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.093+0000 7f88e4a5a000 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559a7aa574a0 0x559a7aa671a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:44.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.093+0000 7f88e4a5a000 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x559a7a8675c0 con 0x559a7aa574a0 2024-05-21T01:20:44.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.093+0000 7f88e4a5a000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x559a7a7fc7b0 con 0x559a7aa3fef0 2024-05-21T01:20:44.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.093+0000 7f88e4a5a000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x559a7a86c8e0 con 0x559a7aa20740 2024-05-21T01:20:44.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.093+0000 7f88e4a5a000 10 client.0 _ll_register_callbacks cb 0x7f88c4001290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-21T01:20:44.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.093+0000 7f88db400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559a7aa574a0 0x559a7aa671a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:44.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.093+0000 7f88db400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559a7aa574a0 0x559a7aa671a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38436/0 (socket says 172.21.15.63:38436) 2024-05-21T01:20:44.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.093+0000 7f88db400640 1 -- 172.21.15.63:0/2932484387 learned_addr learned my addr 172.21.15.63:0/2932484387 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:44.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.093+0000 7f88daa00640 1 --2- 172.21.15.63:0/2932484387 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559a7aa20740 0x559a7aa74620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:44.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.097+0000 7f88d2000640 1 --2- 172.21.15.63:0/2932484387 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a7aa3fef0 0x559a7aa66c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:44.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.097+0000 7f88db400640 1 -- 172.21.15.63:0/2932484387 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559a7aa20740 msgr2=0x559a7aa74620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:44.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.097+0000 7f88db400640 1 --2- 172.21.15.63:0/2932484387 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559a7aa20740 0x559a7aa74620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:44.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.097+0000 7f88db400640 1 -- 172.21.15.63:0/2932484387 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a7aa3fef0 msgr2=0x559a7aa66c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:44.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.097+0000 7f88db400640 1 --2- 172.21.15.63:0/2932484387 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a7aa3fef0 0x559a7aa66c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:44.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.097+0000 7f88db400640 1 -- 172.21.15.63:0/2932484387 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a7a81be80 con 0x559a7aa574a0 2024-05-21T01:20:44.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.097+0000 7f88daa00640 1 --2- 172.21.15.63:0/2932484387 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559a7aa20740 0x559a7aa74620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T01:20:44.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.097+0000 7f88d2000640 1 --2- 172.21.15.63:0/2932484387 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a7aa3fef0 0x559a7aa66c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T01:20:44.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.097+0000 7f88db400640 1 --2- 172.21.15.63:0/2932484387 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559a7aa574a0 0x559a7aa671a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f88d405bbc0 tx=0x7f88d4020070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41bb45cf54dc64db server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:44.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.097+0000 7f88bfe00640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-05-21T01:20:44.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.097+0000 7f88bfe00640 1 -- 172.21.15.63:0/2932484387 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88d407a060 con 0x559a7aa574a0 2024-05-21T01:20:44.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.097+0000 7f88bfe00640 1 -- 172.21.15.63:0/2932484387 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f88d40186a0 con 0x559a7aa574a0 2024-05-21T01:20:44.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.097+0000 7f88e4a5a000 1 -- 172.21.15.63:0/2932484387 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f88c40076a0 con 0x559a7aa574a0 2024-05-21T01:20:44.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.097+0000 7f88bfe00640 1 -- 172.21.15.63:0/2932484387 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f88d4081050 con 0x559a7aa574a0 2024-05-21T01:20:44.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.097+0000 7f88e4a5a000 10 client.4809 fetch_fsmap learned FSMap version 15 2024-05-21T01:20:44.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.097+0000 7f88e4a5a000 1 -- 172.21.15.63:0/2932484387 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x559a7a8e8a00 con 0x559a7aa574a0 2024-05-21T01:20:44.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.097+0000 7f88bfe00640 1 -- 172.21.15.63:0/2932484387 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88c40076a0 con 0x559a7aa574a0 2024-05-21T01:20:44.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.097+0000 7f88bfe00640 1 -- 172.21.15.63:0/2932484387 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 15) ==== 4752+0+0 (secure 0 0 0) 0x7f88d4013070 con 0x559a7aa574a0 2024-05-21T01:20:44.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.097+0000 7f88e4a5a000 10 client.4809 fetch_fsmap finished waiting for FSMap version 15 2024-05-21T01:20:44.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.097+0000 7f88e4a5a000 10 client.4809 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-21T01:20:44.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.097+0000 7f88e4a5a000 20 client.4809 populate_metadata read hostname 'smithi063' 2024-05-21T01:20:44.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.097+0000 7f88e4a5a000 1 --2- 172.21.15.63:0/2932484387 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x559a7aad72a0 0x559a7aad9690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:44.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.097+0000 7f88e4a5a000 4 client.4809 mds_command: new command op to 4276 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-21T01:20:44.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.097+0000 7f88e4a5a000 1 -- 172.21.15.63:0/2932484387 --> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] -- command(tid 0: {"prefix": "status"}) -- 0x559a7a803dc0 con 0x559a7aad72a0 2024-05-21T01:20:44.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.097+0000 7f88daa00640 1 --2- 172.21.15.63:0/2932484387 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x559a7aad72a0 0x559a7aad9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:44.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.097+0000 7f88daa00640 1 --2- 172.21.15.63:0/2932484387 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x559a7aad72a0 0x559a7aad9690 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1f2e4003ae4ed5e server_cookie=91c02a1ef71c6b02 in_seq=0 out_seq=0 2024-05-21T01:20:44.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.097+0000 7f88bfe00640 10 client.4809 ms_handle_connect on v2:172.21.15.63:6834/2892727989 2024-05-21T01:20:44.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.097+0000 7f88bfe00640 1 -- 172.21.15.63:0/2932484387 <== mds.0 v2:172.21.15.63:6834/2892727989 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x559a7a803dc0 con 0x559a7aad72a0 2024-05-21T01:20:44.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.097+0000 7f88bfe00640 10 client.4809 handle_command_reply: tid=0 2024-05-21T01:20:44.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.097+0000 7f88e4a5a000 1 client.4809 shutdown 2024-05-21T01:20:44.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.097+0000 7f88e4a5a000 1 -- 172.21.15.63:0/2932484387 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559a7aa574a0 msgr2=0x559a7aa671a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:44.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.097+0000 7f88e4a5a000 1 --2- 172.21.15.63:0/2932484387 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559a7aa574a0 0x559a7aa671a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f88d405bbc0 tx=0x7f88d4020070 comp rx=0 tx=0).stop 2024-05-21T01:20:44.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.097+0000 7f88e4a5a000 1 -- 172.21.15.63:0/2932484387 shutdown_connections 2024-05-21T01:20:44.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.097+0000 7f88e4a5a000 1 --2- 172.21.15.63:0/2932484387 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x559a7aad72a0 0x559a7aad9690 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:44.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.097+0000 7f88e4a5a000 1 --2- 172.21.15.63:0/2932484387 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x559a7aa574a0 0x559a7aa671a0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:44.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.097+0000 7f88e4a5a000 1 --2- 172.21.15.63:0/2932484387 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a7aa3fef0 0x559a7aa66c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:44.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.097+0000 7f88e4a5a000 1 --2- 172.21.15.63:0/2932484387 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x559a7aa20740 0x559a7aa74620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:44.107 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.097+0000 7f88bfe00640 0 client.4809 ms_handle_reset on v2:172.21.15.63:6834/2892727989 2024-05-21T01:20:44.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.097+0000 7f88e4a5a000 1 -- 172.21.15.63:0/2932484387 >> 172.21.15.63:0/2932484387 conn(0x559a7a8ffef0 msgr2=0x559a7aa1a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:44.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.097+0000 7f88e4a5a000 1 -- 172.21.15.63:0/2932484387 shutdown_connections 2024-05-21T01:20:44.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.097+0000 7f88e4a5a000 1 -- 172.21.15.63:0/2932484387 wait complete. 2024-05-21T01:20:44.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.097+0000 7f88e4a5a000 20 client.4809 trim_cache size 0 max 16384 2024-05-21T01:20:44.108 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-05-21T01:20:44.108 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_fsid": "9a7cbd84-ceb2-41c8-8b6e-ab931f86c51a", 2024-05-21T01:20:44.108 INFO:teuthology.orchestra.run.smithi063.stdout: "whoami": 0, 2024-05-21T01:20:44.108 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 4276, 2024-05-21T01:20:44.108 INFO:teuthology.orchestra.run.smithi063.stdout: "want_state": "up:active", 2024-05-21T01:20:44.108 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "up:active", 2024-05-21T01:20:44.109 INFO:teuthology.orchestra.run.smithi063.stdout: "fs_name": "cephfs", 2024-05-21T01:20:44.109 INFO:teuthology.orchestra.run.smithi063.stdout: "rank_uptime": 49.565596620999997, 2024-05-21T01:20:44.109 INFO:teuthology.orchestra.run.smithi063.stdout: "mdsmap_epoch": 15, 2024-05-21T01:20:44.109 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch": 27, 2024-05-21T01:20:44.109 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch_barrier": 25, 2024-05-21T01:20:44.109 INFO:teuthology.orchestra.run.smithi063.stdout: "uptime": 55.439560055000001 2024-05-21T01:20:44.109 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-05-21T01:20:44.109 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.097+0000 7f88e1600640 1 -- 172.21.15.63:0/1005816668 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f88b806f400 msgr2=0x7f88b80718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:44.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.097+0000 7f88e1600640 1 --2- 172.21.15.63:0/1005816668 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f88b806f400 0x7f88b80718c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f88cc0ae000 tx=0x7f88cc0a7070 comp rx=0 tx=0).stop 2024-05-21T01:20:44.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.097+0000 7f88e1600640 1 -- 172.21.15.63:0/1005816668 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f88dc156150 msgr2=0x7f88dc147dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:44.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.097+0000 7f88e1600640 1 --2- 172.21.15.63:0/1005816668 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f88dc156150 0x7f88dc147dd0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f88d400d560 tx=0x7f88d400da20 comp rx=0 tx=0).stop 2024-05-21T01:20:44.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.097+0000 7f88e1600640 1 -- 172.21.15.63:0/1005816668 shutdown_connections 2024-05-21T01:20:44.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.097+0000 7f88e1600640 1 --2- 172.21.15.63:0/1005816668 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f88b806f400 0x7f88b80718c0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:44.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.097+0000 7f88e1600640 1 --2- 172.21.15.63:0/1005816668 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f88dc156150 0x7f88dc147dd0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:44.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.097+0000 7f88e1600640 1 --2- 172.21.15.63:0/1005816668 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f88dc073480 0x7f88dc14a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:44.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.097+0000 7f88e1600640 1 --2- 172.21.15.63:0/1005816668 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f88dc06d5b0 0x7f88dc14a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:44.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.097+0000 7f88e1600640 1 -- 172.21.15.63:0/1005816668 >> 172.21.15.63:0/1005816668 conn(0x7f88dc0cbf10 msgr2=0x7f88dc145a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:44.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.097+0000 7f88e1600640 1 -- 172.21.15.63:0/1005816668 shutdown_connections 2024-05-21T01:20:44.110 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:44.097+0000 7f88e1600640 1 -- 172.21.15.63:0/1005816668 wait complete. 2024-05-21T01:20:44.123 INFO:tasks.quiescer:Ready to start quiesce thrashing; initial delay: 15 sec 2024-05-21T01:20:56.179 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-21T01:20:56.183 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-21T01:20:59.124 INFO:tasks.quiescer.fs.[cephfs]:Total duration (60) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-05-21T01:20:59.124 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2024-05-21T01:20:59.124 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-21T01:20:59.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.272+0000 7f4eeba00640 1 Processor -- start 2024-05-21T01:20:59.277 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.272+0000 7f4eeba00640 1 -- start start 2024-05-21T01:20:59.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.272+0000 7f4eeba00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4ee4156070 0x7f4ee4071640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:59.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.272+0000 7f4eeba00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4ee4071b80 0x7f4ee40cf530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:59.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.272+0000 7f4eeba00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f4ee406f080 0x7f4ee40cfa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:59.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.272+0000 7f4eeba00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f4ee415bf20 con 0x7f4ee4156070 2024-05-21T01:20:59.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.272+0000 7f4eeba00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f4ee415c1e0 con 0x7f4ee406f080 2024-05-21T01:20:59.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.272+0000 7f4eeba00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f4ee415c4c0 con 0x7f4ee4071b80 2024-05-21T01:20:59.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.272+0000 7f4ee9000640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4ee4156070 0x7f4ee4071640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:59.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.272+0000 7f4ee9000640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4ee4156070 0x7f4ee4071640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:40522/0 (socket says 172.21.15.63:40522) 2024-05-21T01:20:59.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.272+0000 7f4ee9000640 1 -- 172.21.15.63:0/3613997554 learned_addr learned my addr 172.21.15.63:0/3613997554 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:59.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.272+0000 7f4edbe00640 1 --2- 172.21.15.63:0/3613997554 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4ee4071b80 0x7f4ee40cf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:59.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.272+0000 7f4ee9a00640 1 --2- 172.21.15.63:0/3613997554 >> v2:172.21.15.131:3300/0 conn(0x7f4ee406f080 0x7f4ee40cfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:59.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.272+0000 7f4ee9000640 1 -- 172.21.15.63:0/3613997554 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4ee4071b80 msgr2=0x7f4ee40cf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:59.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.272+0000 7f4ee9000640 1 --2- 172.21.15.63:0/3613997554 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4ee4071b80 0x7f4ee40cf530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:59.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.272+0000 7f4ee9000640 1 -- 172.21.15.63:0/3613997554 >> v2:172.21.15.131:3300/0 conn(0x7f4ee406f080 msgr2=0x7f4ee40cfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:59.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.272+0000 7f4ee9000640 1 --2- 172.21.15.63:0/3613997554 >> v2:172.21.15.131:3300/0 conn(0x7f4ee406f080 0x7f4ee40cfa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:59.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.272+0000 7f4ee9000640 1 -- 172.21.15.63:0/3613997554 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ee415c7a0 con 0x7f4ee4156070 2024-05-21T01:20:59.282 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.276+0000 7f4ee9000640 1 --2- 172.21.15.63:0/3613997554 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ee4156070 0x7f4ee4071640 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4ee406f750 tx=0x7f4ed401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=802c4c9b3803c4d2 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:59.282 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.276+0000 7f4ee3e00640 1 -- 172.21.15.63:0/3613997554 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ed40b0070 con 0x7f4ee4156070 2024-05-21T01:20:59.282 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.276+0000 7f4ee3e00640 1 -- 172.21.15.63:0/3613997554 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ed40ab600 con 0x7f4ee4156070 2024-05-21T01:20:59.282 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.276+0000 7f4ee3e00640 1 -- 172.21.15.63:0/3613997554 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ed40ab9d0 con 0x7f4ee4156070 2024-05-21T01:20:59.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.276+0000 7f4eeba00640 1 -- 172.21.15.63:0/3613997554 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ee4156070 msgr2=0x7f4ee4071640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:59.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.276+0000 7f4eeba00640 1 --2- 172.21.15.63:0/3613997554 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ee4156070 0x7f4ee4071640 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4ee406f750 tx=0x7f4ed401c520 comp rx=0 tx=0).stop 2024-05-21T01:20:59.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.276+0000 7f4eeba00640 1 -- 172.21.15.63:0/3613997554 shutdown_connections 2024-05-21T01:20:59.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.276+0000 7f4eeba00640 1 --2- 172.21.15.63:0/3613997554 >> v2:172.21.15.131:3300/0 conn(0x7f4ee406f080 0x7f4ee40cfa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:59.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.276+0000 7f4eeba00640 1 --2- 172.21.15.63:0/3613997554 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4ee4071b80 0x7f4ee40cf530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:59.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.276+0000 7f4eeba00640 1 --2- 172.21.15.63:0/3613997554 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ee4156070 0x7f4ee4071640 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:59.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.276+0000 7f4eeba00640 1 -- 172.21.15.63:0/3613997554 >> 172.21.15.63:0/3613997554 conn(0x7f4ee40735f0 msgr2=0x7f4ee4073a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:59.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.276+0000 7f4eeba00640 1 -- 172.21.15.63:0/3613997554 shutdown_connections 2024-05-21T01:20:59.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.276+0000 7f4eeba00640 1 -- 172.21.15.63:0/3613997554 wait complete. 2024-05-21T01:20:59.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.280+0000 7f4eeba00640 1 Processor -- start 2024-05-21T01:20:59.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.280+0000 7f4eeba00640 1 -- start start 2024-05-21T01:20:59.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.280+0000 7f4eeba00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4ee406f080 0x7f4ee41f2820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:59.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.280+0000 7f4eeba00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4ee4071b80 0x7f4ee41660b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:59.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.280+0000 7f4eeba00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ee4156070 0x7f4ee4158d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:59.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.280+0000 7f4eeba00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f4ee41565d0 con 0x7f4ee4156070 2024-05-21T01:20:59.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.280+0000 7f4eeba00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f4ee4156450 con 0x7f4ee406f080 2024-05-21T01:20:59.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.280+0000 7f4eeba00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f4ee415f510 con 0x7f4ee4071b80 2024-05-21T01:20:59.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.280+0000 7f4ee9a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ee4156070 0x7f4ee4158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:59.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.280+0000 7f4ee9a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ee4156070 0x7f4ee4158d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:40532/0 (socket says 172.21.15.63:40532) 2024-05-21T01:20:59.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.280+0000 7f4ee9a00640 1 -- 172.21.15.63:0/4059975578 learned_addr learned my addr 172.21.15.63:0/4059975578 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:59.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.280+0000 7f4ee9000640 1 --2- 172.21.15.63:0/4059975578 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4ee406f080 0x7f4ee41f2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:59.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.280+0000 7f4edbe00640 1 --2- 172.21.15.63:0/4059975578 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4ee4071b80 0x7f4ee41660b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:59.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.280+0000 7f4ee9a00640 1 -- 172.21.15.63:0/4059975578 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4ee4071b80 msgr2=0x7f4ee41660b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:59.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.280+0000 7f4ee9a00640 1 --2- 172.21.15.63:0/4059975578 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4ee4071b80 0x7f4ee41660b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:59.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.280+0000 7f4ee9a00640 1 -- 172.21.15.63:0/4059975578 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4ee406f080 msgr2=0x7f4ee41f2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:59.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.280+0000 7f4ee9a00640 1 --2- 172.21.15.63:0/4059975578 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4ee406f080 0x7f4ee41f2820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:59.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.280+0000 7f4ee9a00640 1 -- 172.21.15.63:0/4059975578 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ee414f510 con 0x7f4ee4156070 2024-05-21T01:20:59.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.280+0000 7f4ee9000640 1 --2- 172.21.15.63:0/4059975578 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4ee406f080 0x7f4ee41f2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T01:20:59.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.280+0000 7f4ee9a00640 1 --2- 172.21.15.63:0/4059975578 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ee4156070 0x7f4ee4158d30 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f4edc007d60 tx=0x7f4edc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:59.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.280+0000 7f4ee1600640 1 -- 172.21.15.63:0/4059975578 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4edc014420 con 0x7f4ee4156070 2024-05-21T01:20:59.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.280+0000 7f4ee1600640 1 -- 172.21.15.63:0/4059975578 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4edc019070 con 0x7f4ee4156070 2024-05-21T01:20:59.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.280+0000 7f4ee1600640 1 -- 172.21.15.63:0/4059975578 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4edc014820 con 0x7f4ee4156070 2024-05-21T01:20:59.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.280+0000 7f4eeba00640 1 -- 172.21.15.63:0/4059975578 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ee41f8970 con 0x7f4ee4156070 2024-05-21T01:20:59.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.280+0000 7f4eeba00640 1 -- 172.21.15.63:0/4059975578 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ee4157e60 con 0x7f4ee4156070 2024-05-21T01:20:59.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.280+0000 7f4eeba00640 1 -- 172.21.15.63:0/4059975578 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ee40507f0 con 0x7f4ee4156070 2024-05-21T01:20:59.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.284+0000 7f4ee1600640 1 -- 172.21.15.63:0/4059975578 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7f4edc0149c0 con 0x7f4ee4156070 2024-05-21T01:20:59.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.284+0000 7f4ee1600640 1 --2- 172.21.15.63:0/4059975578 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f4ec006f400 0x7f4ec00718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:59.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.284+0000 7f4ee1600640 1 -- 172.21.15.63:0/4059975578 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f4edc08fe30 con 0x7f4ee4156070 2024-05-21T01:20:59.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.284+0000 7f4ee9000640 1 --2- 172.21.15.63:0/4059975578 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f4ec006f400 0x7f4ec00718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:59.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.284+0000 7f4ee9000640 1 --2- 172.21.15.63:0/4059975578 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f4ec006f400 0x7f4ec00718c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4ed40ad000 tx=0x7f4ed4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:59.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.288+0000 7f4ee1600640 1 -- 172.21.15.63:0/4059975578 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f4edc05c3e0 con 0x7f4ee4156070 2024-05-21T01:20:59.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.488+0000 7f4eeba00640 1 -- 172.21.15.63:0/4059975578 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4ee4166680 con 0x7f4ee4156070 2024-05-21T01:20:59.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.488+0000 7f4ee1600640 1 -- 172.21.15.63:0/4059975578 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+6876 (secure 0 0 0) 0x7f4edc0606e0 con 0x7f4ee4156070 2024-05-21T01:20:59.496 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-05-21T01:20:59.496 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6839/3045714273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6837","nonce":3045714273},{"type":"v1","addr":"172.21.15.131:6839","nonce":3045714273}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/2978367338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":2978367338},{"type":"v1","addr":"172.21.15.131:6835","nonce":2978367338}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/3005995321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6835","nonce":3005995321},{"type":"v1","addr":"172.21.15.63:6837","nonce":3005995321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-21T01:19:53.915775+0000","modified":"2024-05-21T01:20:31.724475+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4276,"mds_1":4270,"mds_2":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"e","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.63:6833/574189772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":574189772},{"type":"v1","addr":"172.21.15.63:6833","nonce":574189772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4270":{"gid":4270,"name":"f","rank":1,"incarnation":10,"state":"up:active","state_seq":11,"addr":"172.21.15.131:6838/3071941741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":3071941741},{"type":"v1","addr":"172.21.15.131:6838","nonce":3071941741}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.63:6836/2892727989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":2892727989},{"type":"v1","addr":"172.21.15.63:6836","nonce":2892727989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4276,"qdb_cluster":[4267,4270,4276]},"id":1}]} 2024-05-21T01:20:59.496 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 15 2024-05-21T01:20:59.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.492+0000 7f4eeba00640 1 -- 172.21.15.63:0/4059975578 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f4ec006f400 msgr2=0x7f4ec00718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:59.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.492+0000 7f4eeba00640 1 --2- 172.21.15.63:0/4059975578 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f4ec006f400 0x7f4ec00718c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4ed40ad000 tx=0x7f4ed4008040 comp rx=0 tx=0).stop 2024-05-21T01:20:59.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.492+0000 7f4eeba00640 1 -- 172.21.15.63:0/4059975578 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ee4156070 msgr2=0x7f4ee4158d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:59.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.492+0000 7f4eeba00640 1 --2- 172.21.15.63:0/4059975578 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ee4156070 0x7f4ee4158d30 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f4edc007d60 tx=0x7f4edc00e4b0 comp rx=0 tx=0).stop 2024-05-21T01:20:59.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.492+0000 7f4eeba00640 1 -- 172.21.15.63:0/4059975578 shutdown_connections 2024-05-21T01:20:59.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.492+0000 7f4eeba00640 1 --2- 172.21.15.63:0/4059975578 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f4ec006f400 0x7f4ec00718c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:59.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.492+0000 7f4eeba00640 1 --2- 172.21.15.63:0/4059975578 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4ee4156070 0x7f4ee4158d30 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:59.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.492+0000 7f4eeba00640 1 --2- 172.21.15.63:0/4059975578 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4ee4071b80 0x7f4ee41660b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:59.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.492+0000 7f4eeba00640 1 --2- 172.21.15.63:0/4059975578 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4ee406f080 0x7f4ee41f2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:59.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.492+0000 7f4eeba00640 1 -- 172.21.15.63:0/4059975578 >> 172.21.15.63:0/4059975578 conn(0x7f4ee40735f0 msgr2=0x7f4ee415b210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:59.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.492+0000 7f4eeba00640 1 -- 172.21.15.63:0/4059975578 shutdown_connections 2024-05-21T01:20:59.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.492+0000 7f4eeba00640 1 -- 172.21.15.63:0/4059975578 wait complete. 2024-05-21T01:20:59.518 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4276 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0' 2024-05-21T01:20:59.518 DEBUG:teuthology.orchestra.run.smithi063:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4276 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0 2024-05-21T01:20:59.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.664+0000 7f3c98000640 1 Processor -- start 2024-05-21T01:20:59.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.668+0000 7f3c98000640 1 -- start start 2024-05-21T01:20:59.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.668+0000 7f3c98000640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3c9006f4d0 0x7f3c900c6850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:59.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.668+0000 7f3c98000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3c9006f8b0 0x7f3c900cd630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:59.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.668+0000 7f3c98000640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c900cdf40 con 0x7f3c90153a60 2024-05-21T01:20:59.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.668+0000 7f3c98000640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f3c900c6590 con 0x7f3c9006f4d0 2024-05-21T01:20:59.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.668+0000 7f3c98000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f3c9015b570 con 0x7f3c9006f8b0 2024-05-21T01:20:59.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.668+0000 7f3c95600640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3c9006f4d0 0x7f3c900c6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:59.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.668+0000 7f3c95600640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3c9006f4d0 0x7f3c900c6850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:40534/0 (socket says 172.21.15.63:40534) 2024-05-21T01:20:59.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.668+0000 7f3c95600640 1 -- 172.21.15.63:0/1690949658 learned_addr learned my addr 172.21.15.63:0/1690949658 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:59.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.668+0000 7f3c94c00640 1 --2- 172.21.15.63:0/1690949658 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3c9006f8b0 0x7f3c900cd630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:59.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.668+0000 7f3c95600640 1 -- 172.21.15.63:0/1690949658 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3c9006f8b0 msgr2=0x7f3c900cd630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:59.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.668+0000 7f3c95600640 1 --2- 172.21.15.63:0/1690949658 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3c9006f8b0 0x7f3c900cd630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:59.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.668+0000 7f3c95600640 1 -- 172.21.15.63:0/1690949658 >> v1:172.21.15.131:6789/0 conn(0x7f3c90153a60 legacy=0x7f3c9015ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:59.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.668+0000 7f3c95600640 1 -- 172.21.15.63:0/1690949658 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c900c6f00 con 0x7f3c9006f4d0 2024-05-21T01:20:59.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.672+0000 7f3c95600640 1 --2- 172.21.15.63:0/1690949658 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3c9006f4d0 0x7f3c900c6850 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3c84009870 tx=0x7f3c8401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dec3d16098c29e08 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:59.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.672+0000 7f3c8fe00640 1 -- 172.21.15.63:0/1690949658 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c840a9620 con 0x7f3c9006f4d0 2024-05-21T01:20:59.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.672+0000 7f3c8fe00640 1 -- 172.21.15.63:0/1690949658 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c840a97c0 con 0x7f3c9006f4d0 2024-05-21T01:20:59.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.672+0000 7f3c8fe00640 1 -- 172.21.15.63:0/1690949658 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c840a9b90 con 0x7f3c9006f4d0 2024-05-21T01:20:59.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.672+0000 7f3c98000640 1 -- 172.21.15.63:0/1690949658 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3c9006f4d0 msgr2=0x7f3c900c6850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:59.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.672+0000 7f3c98000640 1 --2- 172.21.15.63:0/1690949658 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3c9006f4d0 0x7f3c900c6850 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3c84009870 tx=0x7f3c8401c560 comp rx=0 tx=0).stop 2024-05-21T01:20:59.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.672+0000 7f3c98000640 1 -- 172.21.15.63:0/1690949658 shutdown_connections 2024-05-21T01:20:59.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.672+0000 7f3c98000640 1 --2- 172.21.15.63:0/1690949658 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3c9006f8b0 0x7f3c900cd630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:59.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.672+0000 7f3c98000640 1 --2- 172.21.15.63:0/1690949658 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3c9006f4d0 0x7f3c900c6850 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:59.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.672+0000 7f3c98000640 1 -- 172.21.15.63:0/1690949658 >> 172.21.15.63:0/1690949658 conn(0x7f3c90068290 msgr2=0x7f3c900686a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:59.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.672+0000 7f3c98000640 1 -- 172.21.15.63:0/1690949658 shutdown_connections 2024-05-21T01:20:59.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.672+0000 7f3c98000640 1 -- 172.21.15.63:0/1690949658 wait complete. 2024-05-21T01:20:59.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.672+0000 7f3c98000640 1 Processor -- start 2024-05-21T01:20:59.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.672+0000 7f3c98000640 1 -- start start 2024-05-21T01:20:59.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.676+0000 7f3c98000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3c9006f4d0 0x7f3c901f9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:59.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.676+0000 7f3c98000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3c9006f8b0 0x7f3c901f50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:59.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.676+0000 7f3c98000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3c90153a60 0x7f3c90072d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:59.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.676+0000 7f3c98000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f3c900cdb70 con 0x7f3c9006f4d0 2024-05-21T01:20:59.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.676+0000 7f3c98000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f3c9015b200 con 0x7f3c9006f8b0 2024-05-21T01:20:59.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.676+0000 7f3c98000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f3c90154280 con 0x7f3c90153a60 2024-05-21T01:20:59.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.676+0000 7f3c95600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3c9006f4d0 0x7f3c901f9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:59.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.676+0000 7f3c95600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3c9006f4d0 0x7f3c901f9180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:40544/0 (socket says 172.21.15.63:40544) 2024-05-21T01:20:59.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.676+0000 7f3c95600640 1 -- 172.21.15.63:0/3944954750 learned_addr learned my addr 172.21.15.63:0/3944954750 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:59.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.676+0000 7f3c96000640 1 --2- 172.21.15.63:0/3944954750 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3c90153a60 0x7f3c90072d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:59.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.676+0000 7f3c94c00640 1 --2- 172.21.15.63:0/3944954750 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3c9006f8b0 0x7f3c901f50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:59.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.676+0000 7f3c95600640 1 -- 172.21.15.63:0/3944954750 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3c90153a60 msgr2=0x7f3c90072d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:59.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.676+0000 7f3c95600640 1 --2- 172.21.15.63:0/3944954750 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3c90153a60 0x7f3c90072d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:59.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.676+0000 7f3c95600640 1 -- 172.21.15.63:0/3944954750 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3c9006f8b0 msgr2=0x7f3c901f50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:59.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.676+0000 7f3c95600640 1 --2- 172.21.15.63:0/3944954750 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3c9006f8b0 0x7f3c901f50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:59.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.676+0000 7f3c95600640 1 -- 172.21.15.63:0/3944954750 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c901f86e0 con 0x7f3c9006f4d0 2024-05-21T01:20:59.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.676+0000 7f3c95600640 1 --2- 172.21.15.63:0/3944954750 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3c9006f4d0 0x7f3c901f9180 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3c840ab040 tx=0x7f3c8401ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:59.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.676+0000 7f3c8d600640 1 -- 172.21.15.63:0/3944954750 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c840bc450 con 0x7f3c9006f4d0 2024-05-21T01:20:59.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.676+0000 7f3c8d600640 1 -- 172.21.15.63:0/3944954750 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c840bc5f0 con 0x7f3c9006f4d0 2024-05-21T01:20:59.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.676+0000 7f3c8d600640 1 -- 172.21.15.63:0/3944954750 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c840bc9e0 con 0x7f3c9006f4d0 2024-05-21T01:20:59.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.676+0000 7f3c98000640 1 -- 172.21.15.63:0/3944954750 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c90151b30 con 0x7f3c9006f4d0 2024-05-21T01:20:59.683 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.676+0000 7f3c98000640 1 -- 172.21.15.63:0/3944954750 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c901f8c60 con 0x7f3c9006f4d0 2024-05-21T01:20:59.684 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.680+0000 7f3c8d600640 1 -- 172.21.15.63:0/3944954750 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7f3c840bcb80 con 0x7f3c9006f4d0 2024-05-21T01:20:59.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.680+0000 7f3c8d600640 1 --2- 172.21.15.63:0/3944954750 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f3c7006f400 0x7f3c700718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:59.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.680+0000 7f3c8d600640 1 -- 172.21.15.63:0/3944954750 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f3c84129700 con 0x7f3c9006f4d0 2024-05-21T01:20:59.685 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.680+0000 7f3c9b471000 1 Processor -- start 2024-05-21T01:20:59.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.680+0000 7f3c9b471000 1 -- start start 2024-05-21T01:20:59.686 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.680+0000 7f3c94c00640 1 --2- 172.21.15.63:0/3944954750 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f3c7006f400 0x7f3c700718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:59.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.680+0000 7f3c9b471000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bb0e5a5130 0x55bb0e56ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:59.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.680+0000 7f3c9b471000 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bb0e56f100 0x55bb0e5a9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:59.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.680+0000 7f3c9b471000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55bb0e5aa100 0x55bb0e5aa4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:59.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.680+0000 7f3c9b471000 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55bb0e3c4740 con 0x55bb0e56f100 2024-05-21T01:20:59.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.680+0000 7f3c9b471000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55bb0e3b42e0 con 0x55bb0e5a5130 2024-05-21T01:20:59.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.680+0000 7f3c9b471000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55bb0e3b8320 con 0x55bb0e5aa100 2024-05-21T01:20:59.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.680+0000 7f3c94c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bb0e56f100 0x55bb0e5a9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:59.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.680+0000 7f3c94c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bb0e56f100 0x55bb0e5a9bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:40552/0 (socket says 172.21.15.63:40552) 2024-05-21T01:20:59.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.680+0000 7f3c94c00640 1 -- 172.21.15.63:0/2906527013 learned_addr learned my addr 172.21.15.63:0/2906527013 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:59.688 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.680+0000 7f3c94c00640 1 --2- 172.21.15.63:0/3944954750 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f3c7006f400 0x7f3c700718c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3c9014a050 tx=0x7f3c7c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:59.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.680+0000 7f3c95600640 1 --2- 172.21.15.63:0/2906527013 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bb0e5a5130 0x55bb0e56ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:59.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.680+0000 7f3c96000640 1 --2- 172.21.15.63:0/2906527013 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55bb0e5aa100 0x55bb0e5aa4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:59.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.680+0000 7f3c94c00640 1 -- 172.21.15.63:0/2906527013 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55bb0e5aa100 msgr2=0x55bb0e5aa4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:59.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.680+0000 7f3c94c00640 1 --2- 172.21.15.63:0/2906527013 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55bb0e5aa100 0x55bb0e5aa4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:59.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.680+0000 7f3c94c00640 1 -- 172.21.15.63:0/2906527013 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bb0e5a5130 msgr2=0x55bb0e56ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:59.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.680+0000 7f3c94c00640 1 --2- 172.21.15.63:0/2906527013 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bb0e5a5130 0x55bb0e56ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:59.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.680+0000 7f3c94c00640 1 -- 172.21.15.63:0/2906527013 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb0e356490 con 0x55bb0e56f100 2024-05-21T01:20:59.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.680+0000 7f3c94c00640 1 --2- 172.21.15.63:0/2906527013 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bb0e56f100 0x55bb0e5a9bc0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c00fa10 tx=0x7f3c7c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5926478a5be1fe4 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:59.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.680+0000 7f3c82000640 1 -- 172.21.15.63:0/2906527013 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c7c01b050 con 0x55bb0e56f100 2024-05-21T01:20:59.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.680+0000 7f3c82000640 1 -- 172.21.15.63:0/2906527013 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c7c025070 con 0x55bb0e56f100 2024-05-21T01:20:59.689 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.680+0000 7f3c82000640 1 -- 172.21.15.63:0/2906527013 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c7c014e00 con 0x55bb0e56f100 2024-05-21T01:20:59.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.684+0000 7f3c9b471000 1 -- 172.21.15.63:0/2906527013 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bb0e56f100 msgr2=0x55bb0e5a9bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:59.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.684+0000 7f3c9b471000 1 --2- 172.21.15.63:0/2906527013 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bb0e56f100 0x55bb0e5a9bc0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c00fa10 tx=0x7f3c7c012000 comp rx=0 tx=0).stop 2024-05-21T01:20:59.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.684+0000 7f3c9b471000 1 -- 172.21.15.63:0/2906527013 shutdown_connections 2024-05-21T01:20:59.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.684+0000 7f3c9b471000 1 --2- 172.21.15.63:0/2906527013 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55bb0e5aa100 0x55bb0e5aa4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:59.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.684+0000 7f3c9b471000 1 --2- 172.21.15.63:0/2906527013 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bb0e56f100 0x55bb0e5a9bc0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:59.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.684+0000 7f3c9b471000 1 --2- 172.21.15.63:0/2906527013 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bb0e5a5130 0x55bb0e56ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:59.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.684+0000 7f3c9b471000 1 -- 172.21.15.63:0/2906527013 >> 172.21.15.63:0/2906527013 conn(0x55bb0e450d80 msgr2=0x55bb0e5a7980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:59.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.684+0000 7f3c9b471000 1 -- 172.21.15.63:0/2906527013 shutdown_connections 2024-05-21T01:20:59.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.684+0000 7f3c9b471000 1 -- 172.21.15.63:0/2906527013 wait complete. 2024-05-21T01:20:59.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.684+0000 7f3c9b471000 1 -- start start 2024-05-21T01:20:59.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.684+0000 7f3c9b471000 1 Processor -- start 2024-05-21T01:20:59.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.684+0000 7f3c9b471000 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bb0e56f100 0x55bb0e5698d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:59.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.684+0000 7f3c9b471000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55bb0e5a5130 0x55bb0e569e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:59.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.684+0000 7f3c9b471000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bb0e5aa100 0x55bb0e56a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:59.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.684+0000 7f3c9b471000 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55bb0e07fb10 con 0x55bb0e56f100 2024-05-21T01:20:59.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.684+0000 7f3c9b471000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55bb0e370670 con 0x55bb0e5aa100 2024-05-21T01:20:59.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.684+0000 7f3c9b471000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55bb0e3bc950 con 0x55bb0e5a5130 2024-05-21T01:20:59.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.684+0000 7f3c9b471000 10 client.0 _ll_register_callbacks cb 0x55bb0e554540 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-21T01:20:59.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.684+0000 7f3c95600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bb0e56f100 0x55bb0e5698d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:59.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.684+0000 7f3c95600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bb0e56f100 0x55bb0e5698d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:40558/0 (socket says 172.21.15.63:40558) 2024-05-21T01:20:59.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.684+0000 7f3c95600640 1 -- 172.21.15.63:0/1224880241 learned_addr learned my addr 172.21.15.63:0/1224880241 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:59.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.684+0000 7f3c94c00640 1 --2- 172.21.15.63:0/1224880241 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55bb0e5a5130 0x55bb0e569e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:59.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.684+0000 7f3c96000640 1 --2- 172.21.15.63:0/1224880241 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bb0e5aa100 0x55bb0e56a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:59.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.684+0000 7f3c95600640 1 -- 172.21.15.63:0/1224880241 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55bb0e5a5130 msgr2=0x55bb0e569e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:59.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.684+0000 7f3c95600640 1 --2- 172.21.15.63:0/1224880241 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55bb0e5a5130 0x55bb0e569e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:59.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.684+0000 7f3c95600640 1 -- 172.21.15.63:0/1224880241 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bb0e5aa100 msgr2=0x55bb0e56a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:59.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.684+0000 7f3c95600640 1 --2- 172.21.15.63:0/1224880241 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bb0e5aa100 0x55bb0e56a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:59.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.684+0000 7f3c95600640 1 -- 172.21.15.63:0/1224880241 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb0e369e40 con 0x55bb0e56f100 2024-05-21T01:20:59.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.684+0000 7f3c94c00640 1 --2- 172.21.15.63:0/1224880241 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55bb0e5a5130 0x55bb0e569e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T01:20:59.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.684+0000 7f3c95600640 1 --2- 172.21.15.63:0/1224880241 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bb0e56f100 0x55bb0e5698d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3c8401cad0 tx=0x7f3c840f5550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2cb2deb873e8358 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:59.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.684+0000 7f3c76a00640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-05-21T01:20:59.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.684+0000 7f3c76a00640 1 -- 172.21.15.63:0/1224880241 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c840f5710 con 0x55bb0e56f100 2024-05-21T01:20:59.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.684+0000 7f3c76a00640 1 -- 172.21.15.63:0/1224880241 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f3c8410f0d0 con 0x55bb0e56f100 2024-05-21T01:20:59.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.684+0000 7f3c9b471000 1 -- 172.21.15.63:0/1224880241 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3c7c025070 con 0x55bb0e56f100 2024-05-21T01:20:59.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.684+0000 7f3c76a00640 1 -- 172.21.15.63:0/1224880241 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f3c840f6300 con 0x55bb0e56f100 2024-05-21T01:20:59.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.684+0000 7f3c9b471000 10 client.4827 fetch_fsmap learned FSMap version 15 2024-05-21T01:20:59.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.684+0000 7f3c9b471000 1 -- 172.21.15.63:0/1224880241 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x55bb0e439890 con 0x55bb0e56f100 2024-05-21T01:20:59.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.684+0000 7f3c76a00640 1 -- 172.21.15.63:0/1224880241 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c7c025070 con 0x55bb0e56f100 2024-05-21T01:20:59.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.688+0000 7f3c76a00640 1 -- 172.21.15.63:0/1224880241 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 15) ==== 4752+0+0 (secure 0 0 0) 0x7f3c840f4e60 con 0x55bb0e56f100 2024-05-21T01:20:59.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.688+0000 7f3c9b471000 10 client.4827 fetch_fsmap finished waiting for FSMap version 15 2024-05-21T01:20:59.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.688+0000 7f3c9b471000 10 client.4827 resolve_mds: validated gid 4276 aka daemon mds.c 2024-05-21T01:20:59.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.688+0000 7f3c9b471000 20 client.4827 populate_metadata read hostname 'smithi063' 2024-05-21T01:20:59.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.688+0000 7f3c9b471000 1 --2- 172.21.15.63:0/1224880241 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x55bb0e5bd8c0 0x55bb0e5bfcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:59.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.688+0000 7f3c9b471000 4 client.4827 mds_command: new command op to 4276 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-21T01:20:59.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.688+0000 7f3c9b471000 1 -- 172.21.15.63:0/1224880241 --> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bb0e3507f0 con 0x55bb0e5bd8c0 2024-05-21T01:20:59.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.688+0000 7f3c94c00640 1 --2- 172.21.15.63:0/1224880241 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x55bb0e5bd8c0 0x55bb0e5bfcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:59.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.688+0000 7f3c76a00640 10 client.4827 ms_handle_connect on v2:172.21.15.63:6834/2892727989 2024-05-21T01:20:59.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.688+0000 7f3c94c00640 1 --2- 172.21.15.63:0/1224880241 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x55bb0e5bd8c0 0x55bb0e5bfcb0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ebb2436bda0b851f server_cookie=29f541eba1a13ee9 in_seq=0 out_seq=0 2024-05-21T01:20:59.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.688+0000 7f3c76a00640 1 -- 172.21.15.63:0/1224880241 <== mds.0 v2:172.21.15.63:6834/2892727989 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x55bb0e3507f0 con 0x55bb0e5bd8c0 2024-05-21T01:20:59.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.688+0000 7f3c76a00640 10 client.4827 handle_command_reply: tid=0 2024-05-21T01:20:59.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.688+0000 7f3c9b471000 1 client.4827 shutdown 2024-05-21T01:20:59.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.688+0000 7f3c9b471000 1 -- 172.21.15.63:0/1224880241 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bb0e56f100 msgr2=0x55bb0e5698d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:59.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.688+0000 7f3c9b471000 1 --2- 172.21.15.63:0/1224880241 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bb0e56f100 0x55bb0e5698d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3c8401cad0 tx=0x7f3c840f5550 comp rx=0 tx=0).stop 2024-05-21T01:20:59.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.688+0000 7f3c9b471000 1 -- 172.21.15.63:0/1224880241 shutdown_connections 2024-05-21T01:20:59.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.688+0000 7f3c9b471000 1 --2- 172.21.15.63:0/1224880241 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x55bb0e5bd8c0 0x55bb0e5bfcb0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:59.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.688+0000 7f3c9b471000 1 --2- 172.21.15.63:0/1224880241 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bb0e5aa100 0x55bb0e56a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:59.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.688+0000 7f3c9b471000 1 --2- 172.21.15.63:0/1224880241 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55bb0e5a5130 0x55bb0e569e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:59.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.688+0000 7f3c9b471000 1 --2- 172.21.15.63:0/1224880241 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bb0e56f100 0x55bb0e5698d0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:59.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.688+0000 7f3c76a00640 0 client.4827 ms_handle_reset on v2:172.21.15.63:6834/2892727989 2024-05-21T01:20:59.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.688+0000 7f3c9b471000 1 -- 172.21.15.63:0/1224880241 >> 172.21.15.63:0/1224880241 conn(0x55bb0e450d80 msgr2=0x55bb0e56e330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:59.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.688+0000 7f3c9b471000 1 -- 172.21.15.63:0/1224880241 shutdown_connections 2024-05-21T01:20:59.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.688+0000 7f3c9b471000 1 -- 172.21.15.63:0/1224880241 wait complete. 2024-05-21T01:20:59.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.688+0000 7f3c9b471000 20 client.4827 trim_cache size 0 max 16384 2024-05-21T01:20:59.712 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.708+0000 7f3c9b471000 1 Processor -- start 2024-05-21T01:20:59.712 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.708+0000 7f3c9b471000 1 -- start start 2024-05-21T01:20:59.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.708+0000 7f3c9b471000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bb0e5a8f20 0x55bb0e5c0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:59.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.708+0000 7f3c9b471000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55bb0e450d80 0x55bb0e5c1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:59.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.708+0000 7f3c9b471000 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bb0e56f100 0x55bb0e5c1740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:59.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.708+0000 7f3c9b471000 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f3c902019d0 con 0x55bb0e56f100 2024-05-21T01:20:59.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.708+0000 7f3c9b471000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f3c90146560 con 0x55bb0e5a8f20 2024-05-21T01:20:59.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.708+0000 7f3c9b471000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f3c901ec810 con 0x55bb0e450d80 2024-05-21T01:20:59.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.708+0000 7f3c96000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bb0e56f100 0x55bb0e5c1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:59.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.708+0000 7f3c96000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bb0e56f100 0x55bb0e5c1740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:40566/0 (socket says 172.21.15.63:40566) 2024-05-21T01:20:59.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.708+0000 7f3c96000640 1 -- 172.21.15.63:0/1326077633 learned_addr learned my addr 172.21.15.63:0/1326077633 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:59.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.708+0000 7f3c95600640 1 --2- 172.21.15.63:0/1326077633 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bb0e5a8f20 0x55bb0e5c0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:59.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.708+0000 7f3c94c00640 1 --2- 172.21.15.63:0/1326077633 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55bb0e450d80 0x55bb0e5c1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:59.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.708+0000 7f3c96000640 1 -- 172.21.15.63:0/1326077633 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55bb0e450d80 msgr2=0x55bb0e5c1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:59.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.708+0000 7f3c96000640 1 --2- 172.21.15.63:0/1326077633 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55bb0e450d80 0x55bb0e5c1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:59.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.708+0000 7f3c96000640 1 -- 172.21.15.63:0/1326077633 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bb0e5a8f20 msgr2=0x55bb0e5c0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:59.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.708+0000 7f3c96000640 1 --2- 172.21.15.63:0/1326077633 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bb0e5a8f20 0x55bb0e5c0cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:59.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.708+0000 7f3c96000640 1 -- 172.21.15.63:0/1326077633 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb0e410da0 con 0x55bb0e56f100 2024-05-21T01:20:59.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.708+0000 7f3c96000640 1 --2- 172.21.15.63:0/1326077633 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bb0e56f100 0x55bb0e5c1740 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3c880051b0 tx=0x7f3c88003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5efe298c04bc5027 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:59.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.708+0000 7f3c81600640 1 -- 172.21.15.63:0/1326077633 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c88001a90 con 0x55bb0e56f100 2024-05-21T01:20:59.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.708+0000 7f3c81600640 1 -- 172.21.15.63:0/1326077633 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c8801b070 con 0x55bb0e56f100 2024-05-21T01:20:59.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.708+0000 7f3c81600640 1 -- 172.21.15.63:0/1326077633 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c88001e50 con 0x55bb0e56f100 2024-05-21T01:20:59.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.708+0000 7f3c9b471000 1 -- 172.21.15.63:0/1326077633 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bb0e56f100 msgr2=0x55bb0e5c1740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:59.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.708+0000 7f3c9b471000 1 --2- 172.21.15.63:0/1326077633 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bb0e56f100 0x55bb0e5c1740 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3c880051b0 tx=0x7f3c88003f90 comp rx=0 tx=0).stop 2024-05-21T01:20:59.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.708+0000 7f3c9b471000 1 -- 172.21.15.63:0/1326077633 shutdown_connections 2024-05-21T01:20:59.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.708+0000 7f3c9b471000 1 --2- 172.21.15.63:0/1326077633 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bb0e56f100 0x55bb0e5c1740 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:59.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.708+0000 7f3c9b471000 1 --2- 172.21.15.63:0/1326077633 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55bb0e450d80 0x55bb0e5c1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:59.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.708+0000 7f3c9b471000 1 --2- 172.21.15.63:0/1326077633 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bb0e5a8f20 0x55bb0e5c0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:59.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.708+0000 7f3c9b471000 1 -- 172.21.15.63:0/1326077633 >> 172.21.15.63:0/1326077633 conn(0x55bb0e56ea10 msgr2=0x55bb0e5a4200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:59.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.708+0000 7f3c9b471000 1 -- 172.21.15.63:0/1326077633 shutdown_connections 2024-05-21T01:20:59.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.708+0000 7f3c9b471000 1 -- 172.21.15.63:0/1326077633 wait complete. 2024-05-21T01:20:59.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.708+0000 7f3c9b471000 1 -- start start 2024-05-21T01:20:59.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.712+0000 7f3c9b471000 1 Processor -- start 2024-05-21T01:20:59.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.712+0000 7f3c9b471000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bb0e450d80 0x55bb0e5e3300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:59.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.712+0000 7f3c9b471000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55bb0e56f100 0x55bb0e5e3840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:59.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.712+0000 7f3c9b471000 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bb0e5a8f20 0x55bb0e5e3d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:59.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.712+0000 7f3c9b471000 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55bb0e3b00e0 con 0x55bb0e5a8f20 2024-05-21T01:20:59.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.712+0000 7f3c9b471000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55bb0e439400 con 0x55bb0e450d80 2024-05-21T01:20:59.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.712+0000 7f3c9b471000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55bb0e34d3e0 con 0x55bb0e56f100 2024-05-21T01:20:59.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.712+0000 7f3c9b471000 10 client.0 _ll_register_callbacks cb 0x7f3c840bce70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-21T01:20:59.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.712+0000 7f3c96000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bb0e5a8f20 0x55bb0e5e3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:59.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.712+0000 7f3c96000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bb0e5a8f20 0x55bb0e5e3d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:40580/0 (socket says 172.21.15.63:40580) 2024-05-21T01:20:59.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.712+0000 7f3c96000640 1 -- 172.21.15.63:0/1299141908 learned_addr learned my addr 172.21.15.63:0/1299141908 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:20:59.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.712+0000 7f3c94c00640 1 --2- 172.21.15.63:0/1299141908 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55bb0e56f100 0x55bb0e5e3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:59.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.712+0000 7f3c95600640 1 --2- 172.21.15.63:0/1299141908 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bb0e450d80 0x55bb0e5e3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:59.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.712+0000 7f3c96000640 1 -- 172.21.15.63:0/1299141908 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55bb0e56f100 msgr2=0x55bb0e5e3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:59.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.712+0000 7f3c96000640 1 --2- 172.21.15.63:0/1299141908 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55bb0e56f100 0x55bb0e5e3840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:59.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.712+0000 7f3c96000640 1 -- 172.21.15.63:0/1299141908 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bb0e450d80 msgr2=0x55bb0e5e3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:20:59.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.712+0000 7f3c96000640 1 --2- 172.21.15.63:0/1299141908 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bb0e450d80 0x55bb0e5e3300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:59.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.712+0000 7f3c96000640 1 -- 172.21.15.63:0/1299141908 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb0e348f40 con 0x55bb0e5a8f20 2024-05-21T01:20:59.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.712+0000 7f3c95600640 1 --2- 172.21.15.63:0/1299141908 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bb0e450d80 0x55bb0e5e3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T01:20:59.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.712+0000 7f3c96000640 1 --2- 172.21.15.63:0/1299141908 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bb0e5a8f20 0x55bb0e5e3d80 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3c880012f0 tx=0x7f3c88015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b987bee417f9edf server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:20:59.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.712+0000 7f3c76a00640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-05-21T01:20:59.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.712+0000 7f3c76a00640 1 -- 172.21.15.63:0/1299141908 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c88025070 con 0x55bb0e5a8f20 2024-05-21T01:20:59.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.712+0000 7f3c76a00640 1 -- 172.21.15.63:0/1299141908 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f3c88016680 con 0x55bb0e5a8f20 2024-05-21T01:20:59.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.712+0000 7f3c9b471000 1 -- 172.21.15.63:0/1299141908 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3c8801b070 con 0x55bb0e5a8f20 2024-05-21T01:20:59.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.712+0000 7f3c76a00640 1 -- 172.21.15.63:0/1299141908 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f3c88031050 con 0x55bb0e5a8f20 2024-05-21T01:20:59.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.712+0000 7f3c9b471000 10 client.4833 fetch_fsmap learned FSMap version 15 2024-05-21T01:20:59.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.712+0000 7f3c9b471000 1 -- 172.21.15.63:0/1299141908 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x55bb0e35bf80 con 0x55bb0e5a8f20 2024-05-21T01:20:59.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.712+0000 7f3c76a00640 1 -- 172.21.15.63:0/1299141908 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c8801b070 con 0x55bb0e5a8f20 2024-05-21T01:20:59.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.712+0000 7f3c76a00640 1 -- 172.21.15.63:0/1299141908 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 15) ==== 4752+0+0 (secure 0 0 0) 0x7f3c88034020 con 0x55bb0e5a8f20 2024-05-21T01:20:59.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.712+0000 7f3c9b471000 10 client.4833 fetch_fsmap finished waiting for FSMap version 15 2024-05-21T01:20:59.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.712+0000 7f3c9b471000 10 client.4833 resolve_mds: validated gid 4276 aka daemon mds.c 2024-05-21T01:20:59.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.712+0000 7f3c9b471000 20 client.4833 populate_metadata read hostname 'smithi063' 2024-05-21T01:20:59.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.712+0000 7f3c9b471000 1 --2- 172.21.15.63:0/1299141908 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x55bb0e5a5130 0x55bb0e62add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:20:59.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.712+0000 7f3c9b471000 4 client.4833 mds_command: new command op to 4276 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}] 2024-05-21T01:20:59.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.712+0000 7f3c9b471000 1 -- 172.21.15.63:0/1299141908 --> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}) -- 0x55bb0e391e60 con 0x55bb0e5a5130 2024-05-21T01:20:59.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.712+0000 7f3c95600640 1 --2- 172.21.15.63:0/1299141908 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x55bb0e5a5130 0x55bb0e62add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:20:59.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.712+0000 7f3c95600640 1 --2- 172.21.15.63:0/1299141908 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x55bb0e5a5130 0x55bb0e62add0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d529b578f5eecb1e server_cookie=a74aa0a40bc91432 in_seq=0 out_seq=0 2024-05-21T01:20:59.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.712+0000 7f3c76a00640 10 client.4833 ms_handle_connect on v2:172.21.15.63:6834/2892727989 2024-05-21T01:20:59.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.720+0000 7f3c76a00640 1 -- 172.21.15.63:0/1299141908 <== mds.0 v2:172.21.15.63:6834/2892727989 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x55bb0e391e60 con 0x55bb0e5a5130 2024-05-21T01:20:59.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.720+0000 7f3c76a00640 10 client.4833 handle_command_reply: tid=0 2024-05-21T01:20:59.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.720+0000 7f3c9b471000 1 client.4833 shutdown 2024-05-21T01:20:59.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.720+0000 7f3c9b471000 1 -- 172.21.15.63:0/1299141908 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bb0e5a8f20 msgr2=0x55bb0e5e3d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:59.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.720+0000 7f3c9b471000 1 --2- 172.21.15.63:0/1299141908 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bb0e5a8f20 0x55bb0e5e3d80 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3c880012f0 tx=0x7f3c88015000 comp rx=0 tx=0).stop 2024-05-21T01:20:59.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.720+0000 7f3c9b471000 1 -- 172.21.15.63:0/1299141908 shutdown_connections 2024-05-21T01:20:59.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.720+0000 7f3c9b471000 1 --2- 172.21.15.63:0/1299141908 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x55bb0e5a5130 0x55bb0e62add0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:59.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.720+0000 7f3c9b471000 1 --2- 172.21.15.63:0/1299141908 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55bb0e5a8f20 0x55bb0e5e3d80 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:59.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.720+0000 7f3c9b471000 1 --2- 172.21.15.63:0/1299141908 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55bb0e56f100 0x55bb0e5e3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:59.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.720+0000 7f3c9b471000 1 --2- 172.21.15.63:0/1299141908 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bb0e450d80 0x55bb0e5e3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:59.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.720+0000 7f3c76a00640 0 client.4833 ms_handle_reset on v2:172.21.15.63:6834/2892727989 2024-05-21T01:20:59.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.720+0000 7f3c9b471000 1 -- 172.21.15.63:0/1299141908 >> 172.21.15.63:0/1299141908 conn(0x55bb0e56ea10 msgr2=0x55bb0e5a4910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:59.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.720+0000 7f3c9b471000 1 -- 172.21.15.63:0/1299141908 shutdown_connections 2024-05-21T01:20:59.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.720+0000 7f3c9b471000 1 -- 172.21.15.63:0/1299141908 wait complete. 2024-05-21T01:20:59.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.720+0000 7f3c9b471000 20 client.4833 trim_cache size 0 max 16384 2024-05-21T01:20:59.727 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-05-21T01:20:59.728 INFO:teuthology.orchestra.run.smithi063.stdout: "epoch": 15, 2024-05-21T01:20:59.728 INFO:teuthology.orchestra.run.smithi063.stdout: "leader": 4276, 2024-05-21T01:20:59.728 INFO:teuthology.orchestra.run.smithi063.stdout: "set_version": 2, 2024-05-21T01:20:59.728 INFO:teuthology.orchestra.run.smithi063.stdout: "sets": { 2024-05-21T01:20:59.728 INFO:teuthology.orchestra.run.smithi063.stdout: "d3637759": { 2024-05-21T01:20:59.728 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 2, 2024-05-21T01:20:59.728 INFO:teuthology.orchestra.run.smithi063.stdout: "age_ref": 0.0, 2024-05-21T01:20:59.728 INFO:teuthology.orchestra.run.smithi063.stdout: "state": { 2024-05-21T01:20:59.728 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "QUIESCED", 2024-05-21T01:20:59.728 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 0.0 2024-05-21T01:20:59.728 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-05-21T01:20:59.728 INFO:teuthology.orchestra.run.smithi063.stdout: "timeout": 90.0, 2024-05-21T01:20:59.728 INFO:teuthology.orchestra.run.smithi063.stdout: "expiration": 150.0, 2024-05-21T01:20:59.728 INFO:teuthology.orchestra.run.smithi063.stdout: "members": { 2024-05-21T01:20:59.729 INFO:teuthology.orchestra.run.smithi063.stdout: "file:/": { 2024-05-21T01:20:59.729 INFO:teuthology.orchestra.run.smithi063.stdout: "excluded": false, 2024-05-21T01:20:59.729 INFO:teuthology.orchestra.run.smithi063.stdout: "state": { 2024-05-21T01:20:59.729 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "QUIESCED", 2024-05-21T01:20:59.729 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 0.0 2024-05-21T01:20:59.729 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-05-21T01:20:59.729 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-05-21T01:20:59.729 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-05-21T01:20:59.729 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-05-21T01:20:59.729 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-05-21T01:20:59.729 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-05-21T01:20:59.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.720+0000 7f3c98000640 1 -- 172.21.15.63:0/3944954750 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f3c7006f400 msgr2=0x7f3c700718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:59.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.720+0000 7f3c98000640 1 --2- 172.21.15.63:0/3944954750 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f3c7006f400 0x7f3c700718c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3c9014a050 tx=0x7f3c7c008040 comp rx=0 tx=0).stop 2024-05-21T01:20:59.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.720+0000 7f3c98000640 1 -- 172.21.15.63:0/3944954750 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3c9006f4d0 msgr2=0x7f3c901f9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:20:59.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.720+0000 7f3c98000640 1 --2- 172.21.15.63:0/3944954750 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3c9006f4d0 0x7f3c901f9180 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3c840ab040 tx=0x7f3c8401ada0 comp rx=0 tx=0).stop 2024-05-21T01:20:59.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.720+0000 7f3c98000640 1 -- 172.21.15.63:0/3944954750 shutdown_connections 2024-05-21T01:20:59.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.720+0000 7f3c98000640 1 --2- 172.21.15.63:0/3944954750 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f3c7006f400 0x7f3c700718c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:59.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.720+0000 7f3c98000640 1 --2- 172.21.15.63:0/3944954750 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3c90153a60 0x7f3c90072d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:59.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.720+0000 7f3c98000640 1 --2- 172.21.15.63:0/3944954750 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3c9006f8b0 0x7f3c901f50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:59.730 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.720+0000 7f3c98000640 1 --2- 172.21.15.63:0/3944954750 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3c9006f4d0 0x7f3c901f9180 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:20:59.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.720+0000 7f3c98000640 1 -- 172.21.15.63:0/3944954750 >> 172.21.15.63:0/3944954750 conn(0x7f3c90068290 msgr2=0x7f3c900737f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:20:59.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.720+0000 7f3c98000640 1 -- 172.21.15.63:0/3944954750 shutdown_connections 2024-05-21T01:20:59.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:20:59.720+0000 7f3c98000640 1 -- 172.21.15.63:0/3944954750 wait complete. 2024-05-21T01:20:59.746 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'd3637759', quiesce took 0.6 seconds. Will release after: 29.4 2024-05-21T01:21:26.242 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-21T01:21:26.247 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-21T01:21:29.147 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-21T01:21:29.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.288+0000 7fa5d1000640 1 Processor -- start 2024-05-21T01:21:29.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.288+0000 7fa5d1000640 1 -- start start 2024-05-21T01:21:29.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.292+0000 7fa5d1000640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa5cc153b40 0x7fa5cc15a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:21:29.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.292+0000 7fa5d1000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa5cc0c8e30 0x7fa5cc0c7790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:21:29.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.292+0000 7fa5d1000640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5cc153f20 con 0x7fa5cc06d8a0 2024-05-21T01:21:29.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.292+0000 7fa5d1000640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7fa5cc159e80 con 0x7fa5cc153b40 2024-05-21T01:21:29.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.292+0000 7fa5d1000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fa5cc15a850 con 0x7fa5cc0c8e30 2024-05-21T01:21:29.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.292+0000 7fa5cb400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa5cc153b40 0x7fa5cc15a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:21:29.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.292+0000 7fa5cb400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa5cc153b40 0x7fa5cc15a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33084/0 (socket says 172.21.15.63:33084) 2024-05-21T01:21:29.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.292+0000 7fa5cb400640 1 -- 172.21.15.63:0/1930440541 learned_addr learned my addr 172.21.15.63:0/1930440541 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:21:29.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.292+0000 7fa5cbe00640 1 --2- 172.21.15.63:0/1930440541 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa5cc0c8e30 0x7fa5cc0c7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:21:29.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.292+0000 7fa5cb400640 1 -- 172.21.15.63:0/1930440541 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa5cc0c8e30 msgr2=0x7fa5cc0c7790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:21:29.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.292+0000 7fa5cb400640 1 --2- 172.21.15.63:0/1930440541 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa5cc0c8e30 0x7fa5cc0c7790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:21:29.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.292+0000 7fa5cb400640 1 -- 172.21.15.63:0/1930440541 >> v1:172.21.15.131:6789/0 conn(0x7fa5cc06d8a0 legacy=0x7fa5cc15ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:21:29.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.292+0000 7fa5cb400640 1 -- 172.21.15.63:0/1930440541 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5cc159850 con 0x7fa5cc153b40 2024-05-21T01:21:29.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.296+0000 7fa5cb400640 1 --2- 172.21.15.63:0/1930440541 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa5cc153b40 0x7fa5cc15a310 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc009870 tx=0x7fa5bc01c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1493491250f7ed9b server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:21:29.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.296+0000 7fa5caa00640 1 -- 172.21.15.63:0/1930440541 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5bc0b1070 con 0x7fa5cc153b40 2024-05-21T01:21:29.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.296+0000 7fa5caa00640 1 -- 172.21.15.63:0/1930440541 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5bc0ac620 con 0x7fa5cc153b40 2024-05-21T01:21:29.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.296+0000 7fa5caa00640 1 -- 172.21.15.63:0/1930440541 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5bc0ac9f0 con 0x7fa5cc153b40 2024-05-21T01:21:29.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.296+0000 7fa5d1000640 1 -- 172.21.15.63:0/1930440541 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa5cc153b40 msgr2=0x7fa5cc15a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:21:29.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.296+0000 7fa5d1000640 1 --2- 172.21.15.63:0/1930440541 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa5cc153b40 0x7fa5cc15a310 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc009870 tx=0x7fa5bc01c530 comp rx=0 tx=0).stop 2024-05-21T01:21:29.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.296+0000 7fa5d1000640 1 -- 172.21.15.63:0/1930440541 shutdown_connections 2024-05-21T01:21:29.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.296+0000 7fa5d1000640 1 --2- 172.21.15.63:0/1930440541 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa5cc0c8e30 0x7fa5cc0c7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:21:29.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.296+0000 7fa5d1000640 1 --2- 172.21.15.63:0/1930440541 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa5cc153b40 0x7fa5cc15a310 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:21:29.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.296+0000 7fa5d1000640 1 -- 172.21.15.63:0/1930440541 >> 172.21.15.63:0/1930440541 conn(0x7fa5cc068690 msgr2=0x7fa5cc06fd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:21:29.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.296+0000 7fa5d1000640 1 -- 172.21.15.63:0/1930440541 shutdown_connections 2024-05-21T01:21:29.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.296+0000 7fa5d1000640 1 -- 172.21.15.63:0/1930440541 wait complete. 2024-05-21T01:21:29.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.296+0000 7fa5d1000640 1 Processor -- start 2024-05-21T01:21:29.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.296+0000 7fa5d1000640 1 -- start start 2024-05-21T01:21:29.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.300+0000 7fa5d1000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa5cc06d8a0 0x7fa5cc148ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:21:29.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.300+0000 7fa5d1000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa5cc0c8e30 0x7fa5cc0cd990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:21:29.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.300+0000 7fa5d1000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa5cc153b40 0x7fa5cc0cce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:21:29.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.300+0000 7fa5d1000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fa5cc073950 con 0x7fa5cc06d8a0 2024-05-21T01:21:29.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.300+0000 7fa5d1000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa5cc159b10 con 0x7fa5cc153b40 2024-05-21T01:21:29.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.300+0000 7fa5d1000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fa5cc073ad0 con 0x7fa5cc0c8e30 2024-05-21T01:21:29.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.300+0000 7fa5cb400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa5cc06d8a0 0x7fa5cc148ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:21:29.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.300+0000 7fa5cb400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa5cc06d8a0 0x7fa5cc148ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33086/0 (socket says 172.21.15.63:33086) 2024-05-21T01:21:29.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.300+0000 7fa5cb400640 1 -- 172.21.15.63:0/3637500767 learned_addr learned my addr 172.21.15.63:0/3637500767 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:21:29.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.300+0000 7fa5c2a00640 1 --2- 172.21.15.63:0/3637500767 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa5cc0c8e30 0x7fa5cc0cd990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:21:29.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.300+0000 7fa5cbe00640 1 --2- 172.21.15.63:0/3637500767 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa5cc153b40 0x7fa5cc0cce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:21:29.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.300+0000 7fa5cb400640 1 -- 172.21.15.63:0/3637500767 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa5cc0c8e30 msgr2=0x7fa5cc0cd990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:21:29.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.300+0000 7fa5cb400640 1 --2- 172.21.15.63:0/3637500767 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa5cc0c8e30 0x7fa5cc0cd990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:21:29.303 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.300+0000 7fa5cb400640 1 -- 172.21.15.63:0/3637500767 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa5cc153b40 msgr2=0x7fa5cc0cce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:21:29.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.300+0000 7fa5cb400640 1 --2- 172.21.15.63:0/3637500767 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa5cc153b40 0x7fa5cc0cce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:21:29.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.300+0000 7fa5cb400640 1 -- 172.21.15.63:0/3637500767 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5cc149b30 con 0x7fa5cc06d8a0 2024-05-21T01:21:29.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.300+0000 7fa5cb400640 1 --2- 172.21.15.63:0/3637500767 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa5cc06d8a0 0x7fa5cc148ec0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc0af040 tx=0x7fa5bc01ad70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:21:29.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.300+0000 7fa5c3e00640 1 -- 172.21.15.63:0/3637500767 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5bc0b1040 con 0x7fa5cc06d8a0 2024-05-21T01:21:29.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.300+0000 7fa5c3e00640 1 -- 172.21.15.63:0/3637500767 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5bc0bd070 con 0x7fa5cc06d8a0 2024-05-21T01:21:29.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.300+0000 7fa5d1000640 1 -- 172.21.15.63:0/3637500767 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5cc149570 con 0x7fa5cc06d8a0 2024-05-21T01:21:29.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.300+0000 7fa5c3e00640 1 -- 172.21.15.63:0/3637500767 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5bc0b7880 con 0x7fa5cc06d8a0 2024-05-21T01:21:29.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.300+0000 7fa5d1000640 1 -- 172.21.15.63:0/3637500767 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5cc1f5d80 con 0x7fa5cc06d8a0 2024-05-21T01:21:29.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.304+0000 7fa5d1000640 1 -- 172.21.15.63:0/3637500767 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5cc06c0c0 con 0x7fa5cc06d8a0 2024-05-21T01:21:29.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.304+0000 7fa5c3e00640 1 -- 172.21.15.63:0/3637500767 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7fa5bc0ac4e0 con 0x7fa5cc06d8a0 2024-05-21T01:21:29.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.304+0000 7fa5c3e00640 1 --2- 172.21.15.63:0/3637500767 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fa5a806f400 0x7fa5a80718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:21:29.306 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.304+0000 7fa5c3e00640 1 -- 172.21.15.63:0/3637500767 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7fa5bc129a00 con 0x7fa5cc06d8a0 2024-05-21T01:21:29.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.304+0000 7fa5c2a00640 1 --2- 172.21.15.63:0/3637500767 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fa5a806f400 0x7fa5a80718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:21:29.307 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.304+0000 7fa5c2a00640 1 --2- 172.21.15.63:0/3637500767 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fa5a806f400 0x7fa5a80718c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa5cc1530e0 tx=0x7fa5b40094d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:21:29.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.308+0000 7fa5c3e00640 1 -- 172.21.15.63:0/3637500767 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fa5bc016150 con 0x7fa5cc06d8a0 2024-05-21T01:21:29.514 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.512+0000 7fa5d1000640 1 -- 172.21.15.63:0/3637500767 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa5cc072f20 con 0x7fa5cc06d8a0 2024-05-21T01:21:29.515 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.512+0000 7fa5c3e00640 1 -- 172.21.15.63:0/3637500767 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+6876 (secure 0 0 0) 0x7fa5bc0f6570 con 0x7fa5cc06d8a0 2024-05-21T01:21:29.515 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-05-21T01:21:29.516 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6839/3045714273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6837","nonce":3045714273},{"type":"v1","addr":"172.21.15.131:6839","nonce":3045714273}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/2978367338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":2978367338},{"type":"v1","addr":"172.21.15.131:6835","nonce":2978367338}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/3005995321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6835","nonce":3005995321},{"type":"v1","addr":"172.21.15.63:6837","nonce":3005995321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-21T01:19:53.915775+0000","modified":"2024-05-21T01:20:31.724475+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4276,"mds_1":4270,"mds_2":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"e","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.63:6833/574189772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":574189772},{"type":"v1","addr":"172.21.15.63:6833","nonce":574189772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4270":{"gid":4270,"name":"f","rank":1,"incarnation":10,"state":"up:active","state_seq":11,"addr":"172.21.15.131:6838/3071941741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":3071941741},{"type":"v1","addr":"172.21.15.131:6838","nonce":3071941741}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.63:6836/2892727989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":2892727989},{"type":"v1","addr":"172.21.15.63:6836","nonce":2892727989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4276,"qdb_cluster":[4267,4270,4276]},"id":1}]} 2024-05-21T01:21:29.516 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 15 2024-05-21T01:21:29.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.516+0000 7fa5d1000640 1 -- 172.21.15.63:0/3637500767 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fa5a806f400 msgr2=0x7fa5a80718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:21:29.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.516+0000 7fa5d1000640 1 --2- 172.21.15.63:0/3637500767 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fa5a806f400 0x7fa5a80718c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa5cc1530e0 tx=0x7fa5b40094d0 comp rx=0 tx=0).stop 2024-05-21T01:21:29.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.516+0000 7fa5d1000640 1 -- 172.21.15.63:0/3637500767 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa5cc06d8a0 msgr2=0x7fa5cc148ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:21:29.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.516+0000 7fa5d1000640 1 --2- 172.21.15.63:0/3637500767 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa5cc06d8a0 0x7fa5cc148ec0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc0af040 tx=0x7fa5bc01ad70 comp rx=0 tx=0).stop 2024-05-21T01:21:29.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.516+0000 7fa5d1000640 1 -- 172.21.15.63:0/3637500767 shutdown_connections 2024-05-21T01:21:29.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.516+0000 7fa5d1000640 1 --2- 172.21.15.63:0/3637500767 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fa5a806f400 0x7fa5a80718c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:21:29.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.516+0000 7fa5d1000640 1 --2- 172.21.15.63:0/3637500767 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa5cc153b40 0x7fa5cc0cce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:21:29.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.516+0000 7fa5d1000640 1 --2- 172.21.15.63:0/3637500767 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa5cc0c8e30 0x7fa5cc0cd990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:21:29.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.516+0000 7fa5d1000640 1 --2- 172.21.15.63:0/3637500767 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa5cc06d8a0 0x7fa5cc148ec0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:21:29.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.516+0000 7fa5d1000640 1 -- 172.21.15.63:0/3637500767 >> 172.21.15.63:0/3637500767 conn(0x7fa5cc068690 msgr2=0x7fa5cc072130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:21:29.518 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.516+0000 7fa5d1000640 1 -- 172.21.15.63:0/3637500767 shutdown_connections 2024-05-21T01:21:29.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.516+0000 7fa5d1000640 1 -- 172.21.15.63:0/3637500767 wait complete. 2024-05-21T01:21:29.539 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4276 quiesce db --set-id d3637759 --release --await' 2024-05-21T01:21:29.539 DEBUG:teuthology.orchestra.run.smithi063:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4276 quiesce db --set-id d3637759 --release --await 2024-05-21T01:21:29.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.692+0000 7f1035000640 1 Processor -- start 2024-05-21T01:21:29.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.692+0000 7f1035000640 1 -- start start 2024-05-21T01:21:29.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.692+0000 7f1035000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f103006f5d0 0x7f10300c47f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:21:29.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.692+0000 7f1035000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f10300c69c0 0x7f10300c6df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:21:29.696 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.692+0000 7f1035000640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10300c4d30 con 0x7f103006f9b0 2024-05-21T01:21:29.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.692+0000 7f1035000640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f10300c52a0 con 0x7f10300c69c0 2024-05-21T01:21:29.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.692+0000 7f1035000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f10300c7330 con 0x7f103006f5d0 2024-05-21T01:21:29.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.692+0000 7f102d400640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f103006f9b0 0x7f10300c94f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57104/0 (socket says 172.21.15.63:57104) 2024-05-21T01:21:29.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.692+0000 7f102d400640 1 -- 172.21.15.63:0/3227716930 learned_addr learned my addr 172.21.15.63:0/3227716930 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-05-21T01:21:29.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.696+0000 7f102e800640 1 --2- 172.21.15.63:0/3227716930 >> v2:172.21.15.131:3300/0 conn(0x7f10300c69c0 0x7f10300c6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:21:29.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.696+0000 7f102de00640 1 --2- 172.21.15.63:0/3227716930 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f103006f5d0 0x7f10300c47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:21:29.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.696+0000 7f102ca00640 1 -- 172.21.15.63:0/3227716930 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 80408535 0 0) 0x7f10300c4d30 con 0x7f103006f9b0 2024-05-21T01:21:29.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.696+0000 7f102ca00640 1 -- 172.21.15.63:0/3227716930 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1014003530 con 0x7f103006f9b0 2024-05-21T01:21:29.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.696+0000 7f102ca00640 1 -- 172.21.15.63:0/3227716930 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 994698899 0 0) 0x7f1014003530 con 0x7f103006f9b0 2024-05-21T01:21:29.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.696+0000 7f102ca00640 1 -- 172.21.15.63:0/3227716930 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f103006f5d0 msgr2=0x7f10300c47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:21:29.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.696+0000 7f102ca00640 1 --2- 172.21.15.63:0/3227716930 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f103006f5d0 0x7f10300c47f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:21:29.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.696+0000 7f102ca00640 1 -- 172.21.15.63:0/3227716930 >> v2:172.21.15.131:3300/0 conn(0x7f10300c69c0 msgr2=0x7f10300c6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:21:29.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.696+0000 7f102ca00640 1 --2- 172.21.15.63:0/3227716930 >> v2:172.21.15.131:3300/0 conn(0x7f10300c69c0 0x7f10300c6df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:21:29.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.696+0000 7f102ca00640 1 -- 172.21.15.63:0/3227716930 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10300c4fc0 con 0x7f103006f9b0 2024-05-21T01:21:29.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.696+0000 7f102ca00640 1 -- 172.21.15.63:0/3227716930 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 466403955 0 0) 0x7f101c001700 con 0x7f103006f9b0 2024-05-21T01:21:29.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.696+0000 7f102ca00640 1 -- 172.21.15.63:0/3227716930 >> v1:172.21.15.63:6789/0 conn(0x7f103006f9b0 legacy=0x7f10300c94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:21:29.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.696+0000 7f102ca00640 1 --2- 172.21.15.63:0/3227716930 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1014003a10 0x7f1014003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:21:29.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.696+0000 7f102ca00640 1 --2- 172.21.15.63:0/3227716930 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f103006f5d0 0x7f1014004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:21:29.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.696+0000 7f102ca00640 1 --2- 172.21.15.63:0/3227716930 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1014004d50 0x7f10140051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:21:29.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.696+0000 7f102ca00640 1 -- 172.21.15.63:0/3227716930 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f10300c52a0 con 0x7f1014003a10 2024-05-21T01:21:29.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.696+0000 7f102ca00640 1 -- 172.21.15.63:0/3227716930 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f10300c7330 con 0x7f1014004d50 2024-05-21T01:21:29.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.696+0000 7f102ca00640 1 -- 172.21.15.63:0/3227716930 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f101400b9d0 con 0x7f103006f5d0 2024-05-21T01:21:29.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.696+0000 7f102de00640 1 --2- 172.21.15.63:0/3227716930 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1014003a10 0x7f1014003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:21:29.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.696+0000 7f102d400640 1 --2- 172.21.15.63:0/3227716930 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f103006f5d0 0x7f1014004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:21:29.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.696+0000 7f102e800640 1 --2- 172.21.15.63:0/3227716930 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1014004d50 0x7f10140051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:21:29.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.696+0000 7f102de00640 1 -- 172.21.15.63:0/3227716930 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f103006f5d0 msgr2=0x7f1014004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:21:29.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.696+0000 7f102de00640 1 --2- 172.21.15.63:0/3227716930 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f103006f5d0 0x7f1014004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:21:29.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.696+0000 7f102de00640 1 -- 172.21.15.63:0/3227716930 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1014004d50 msgr2=0x7f10140051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:21:29.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.696+0000 7f102de00640 1 --2- 172.21.15.63:0/3227716930 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1014004d50 0x7f10140051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:21:29.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.696+0000 7f102de00640 1 -- 172.21.15.63:0/3227716930 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1014003530 con 0x7f1014003a10 2024-05-21T01:21:29.701 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.696+0000 7f102e800640 1 --2- 172.21.15.63:0/3227716930 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1014004d50 0x7f10140051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T01:21:29.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.700+0000 7f102de00640 1 --2- 172.21.15.63:0/3227716930 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1014003a10 0x7f1014003e30 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f1020009ae0 tx=0x7f102001ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc09dd5f27254e4d server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:21:29.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.700+0000 7f102ca00640 1 -- 172.21.15.63:0/3227716930 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10200096b0 con 0x7f1014003a10 2024-05-21T01:21:29.704 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.700+0000 7f102ca00640 1 -- 172.21.15.63:0/3227716930 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10200a6470 con 0x7f1014003a10 2024-05-21T01:21:29.704 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.700+0000 7f102ca00640 1 -- 172.21.15.63:0/3227716930 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10200a6860 con 0x7f1014003a10 2024-05-21T01:21:29.704 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.700+0000 7f1035000640 1 -- 172.21.15.63:0/3227716930 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1014003a10 msgr2=0x7f1014003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:21:29.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.700+0000 7f1035000640 1 --2- 172.21.15.63:0/3227716930 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1014003a10 0x7f1014003e30 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f1020009ae0 tx=0x7f102001ca90 comp rx=0 tx=0).stop 2024-05-21T01:21:29.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.700+0000 7f102e800640 1 -- 172.21.15.63:0/3227716930 reap_dead start 2024-05-21T01:21:29.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.704+0000 7f1035000640 1 -- 172.21.15.63:0/3227716930 shutdown_connections 2024-05-21T01:21:29.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.704+0000 7f1035000640 1 -- 172.21.15.63:0/3227716930 >> 172.21.15.63:0/3227716930 conn(0x7f1030068460 msgr2=0x7f1030068870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:21:29.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.704+0000 7f1035000640 1 -- 172.21.15.63:0/3227716930 shutdown_connections 2024-05-21T01:21:29.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.704+0000 7f1035000640 1 -- 172.21.15.63:0/3227716930 wait complete. 2024-05-21T01:21:29.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.704+0000 7f1035000640 1 Processor -- start 2024-05-21T01:21:29.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.704+0000 7f1035000640 1 -- start start 2024-05-21T01:21:29.707 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.704+0000 7f1035000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1014003a10 0x7f10301569f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:21:29.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.704+0000 7f1035000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1030157560 0x7f10301f3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:21:29.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.704+0000 7f1035000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f10301546c0 0x7f1030154b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:21:29.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.704+0000 7f1035000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f10301541d0 con 0x7f10301546c0 2024-05-21T01:21:29.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.704+0000 7f1035000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f10300caae0 con 0x7f1014003a10 2024-05-21T01:21:29.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.704+0000 7f1035000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f1030154350 con 0x7f1030157560 2024-05-21T01:21:29.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.704+0000 7f102e800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f10301546c0 0x7f1030154b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:21:29.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.704+0000 7f102e800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f10301546c0 0x7f1030154b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33100/0 (socket says 172.21.15.63:33100) 2024-05-21T01:21:29.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.704+0000 7f102e800640 1 -- 172.21.15.63:0/2724166761 learned_addr learned my addr 172.21.15.63:0/2724166761 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:21:29.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.704+0000 7f102de00640 1 --2- 172.21.15.63:0/2724166761 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1014003a10 0x7f10301569f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:21:29.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.704+0000 7f102d400640 1 --2- 172.21.15.63:0/2724166761 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1030157560 0x7f10301f3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:21:29.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.704+0000 7f102e800640 1 -- 172.21.15.63:0/2724166761 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1030157560 msgr2=0x7f10301f3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:21:29.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.704+0000 7f102e800640 1 --2- 172.21.15.63:0/2724166761 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1030157560 0x7f10301f3b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:21:29.709 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.704+0000 7f102e800640 1 -- 172.21.15.63:0/2724166761 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1014003a10 msgr2=0x7f10301569f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:21:29.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.704+0000 7f102e800640 1 --2- 172.21.15.63:0/2724166761 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1014003a10 0x7f10301569f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:21:29.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.704+0000 7f102e800640 1 -- 172.21.15.63:0/2724166761 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10301564a0 con 0x7f10301546c0 2024-05-21T01:21:29.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.708+0000 7f102e800640 1 --2- 172.21.15.63:0/2724166761 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f10301546c0 0x7f1030154b40 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f10300c6da0 tx=0x7f1028010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:21:29.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.708+0000 7f1026000640 1 -- 172.21.15.63:0/2724166761 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f102801a030 con 0x7f10301546c0 2024-05-21T01:21:29.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.708+0000 7f1035000640 1 -- 172.21.15.63:0/2724166761 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10300ccd70 con 0x7f10301546c0 2024-05-21T01:21:29.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.708+0000 7f1026000640 1 -- 172.21.15.63:0/2724166761 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1028010d00 con 0x7f10301546c0 2024-05-21T01:21:29.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.708+0000 7f1035000640 1 -- 172.21.15.63:0/2724166761 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10300cd2f0 con 0x7f10301546c0 2024-05-21T01:21:29.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.708+0000 7f1026000640 1 -- 172.21.15.63:0/2724166761 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1028003ba0 con 0x7f10301546c0 2024-05-21T01:21:29.711 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.708+0000 7f1026000640 1 -- 172.21.15.63:0/2724166761 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7f102801d070 con 0x7f10301546c0 2024-05-21T01:21:29.712 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.712+0000 7f1026000640 1 --2- 172.21.15.63:0/2724166761 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f101006f400 0x7f10100718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:21:29.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.712+0000 7f1026000640 1 -- 172.21.15.63:0/2724166761 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f102808f890 con 0x7f10301546c0 2024-05-21T01:21:29.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.712+0000 7f102de00640 1 --2- 172.21.15.63:0/2724166761 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f101006f400 0x7f10100718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:21:29.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.712+0000 7f103854c000 1 Processor -- start 2024-05-21T01:21:29.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.712+0000 7f103854c000 1 -- start start 2024-05-21T01:21:29.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.712+0000 7f102de00640 1 --2- 172.21.15.63:0/2724166761 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f101006f400 0x7f10100718c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f10200ad000 tx=0x7f10200046d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:21:29.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.712+0000 7f103854c000 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558668299b90 0x558668263390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:21:29.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.712+0000 7f103854c000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5586682638d0 0x55866829e620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:21:29.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.712+0000 7f103854c000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55866829eb60 0x55866829ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:21:29.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.712+0000 7f103854c000 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5586680b88a0 con 0x558668299b90 2024-05-21T01:21:29.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.712+0000 7f103854c000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5586680a8440 con 0x5586682638d0 2024-05-21T01:21:29.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.712+0000 7f103854c000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5586680ac480 con 0x55866829eb60 2024-05-21T01:21:29.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.712+0000 7f102de00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558668299b90 0x558668263390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:21:29.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.712+0000 7f102de00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558668299b90 0x558668263390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33112/0 (socket says 172.21.15.63:33112) 2024-05-21T01:21:29.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.712+0000 7f102de00640 1 -- 172.21.15.63:0/3641204326 learned_addr learned my addr 172.21.15.63:0/3641204326 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:21:29.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.712+0000 7f102e800640 1 --2- 172.21.15.63:0/3641204326 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55866829eb60 0x55866829ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:21:29.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.712+0000 7f102d400640 1 --2- 172.21.15.63:0/3641204326 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5586682638d0 0x55866829e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:21:29.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.712+0000 7f102de00640 1 -- 172.21.15.63:0/3641204326 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55866829eb60 msgr2=0x55866829ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:21:29.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.712+0000 7f102de00640 1 --2- 172.21.15.63:0/3641204326 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55866829eb60 0x55866829ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:21:29.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.712+0000 7f102de00640 1 -- 172.21.15.63:0/3641204326 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5586682638d0 msgr2=0x55866829e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:21:29.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.712+0000 7f102de00640 1 --2- 172.21.15.63:0/3641204326 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5586682638d0 0x55866829e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:21:29.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.712+0000 7f102de00640 1 -- 172.21.15.63:0/3641204326 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558668154370 con 0x558668299b90 2024-05-21T01:21:29.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.712+0000 7f102de00640 1 --2- 172.21.15.63:0/3641204326 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558668299b90 0x558668263390 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1020098280 tx=0x7f1020004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=651891844b924c19 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:21:29.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.712+0000 7f101aa00640 1 -- 172.21.15.63:0/3641204326 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10200cc070 con 0x558668299b90 2024-05-21T01:21:29.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.712+0000 7f101aa00640 1 -- 172.21.15.63:0/3641204326 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10200a6470 con 0x558668299b90 2024-05-21T01:21:29.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.712+0000 7f101aa00640 1 -- 172.21.15.63:0/3641204326 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10200a6820 con 0x558668299b90 2024-05-21T01:21:29.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.716+0000 7f103854c000 1 -- 172.21.15.63:0/3641204326 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558668299b90 msgr2=0x558668263390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:21:29.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.716+0000 7f103854c000 1 --2- 172.21.15.63:0/3641204326 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558668299b90 0x558668263390 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1020098280 tx=0x7f1020004740 comp rx=0 tx=0).stop 2024-05-21T01:21:29.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.716+0000 7f103854c000 1 -- 172.21.15.63:0/3641204326 shutdown_connections 2024-05-21T01:21:29.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.716+0000 7f103854c000 1 --2- 172.21.15.63:0/3641204326 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55866829eb60 0x55866829ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:21:29.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.716+0000 7f103854c000 1 --2- 172.21.15.63:0/3641204326 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5586682638d0 0x55866829e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:21:29.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.716+0000 7f103854c000 1 --2- 172.21.15.63:0/3641204326 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558668299b90 0x558668263390 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:21:29.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.716+0000 7f103854c000 1 -- 172.21.15.63:0/3641204326 >> 172.21.15.63:0/3641204326 conn(0x558668145f90 msgr2=0x55866829c3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:21:29.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.716+0000 7f103854c000 1 -- 172.21.15.63:0/3641204326 shutdown_connections 2024-05-21T01:21:29.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.716+0000 7f103854c000 1 -- 172.21.15.63:0/3641204326 wait complete. 2024-05-21T01:21:29.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.716+0000 7f103854c000 1 -- start start 2024-05-21T01:21:29.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.716+0000 7f103854c000 1 Processor -- start 2024-05-21T01:21:29.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.716+0000 7f103854c000 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5586682638d0 0x558668299350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:21:29.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.716+0000 7f103854c000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558668299b90 0x55866825efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:21:29.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.716+0000 7f103854c000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55866829eb60 0x55866825f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:21:29.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.716+0000 7f103854c000 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55866804f4d0 con 0x5586682638d0 2024-05-21T01:21:29.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.716+0000 7f103854c000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5586680b0ab0 con 0x55866829eb60 2024-05-21T01:21:29.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.716+0000 7f103854c000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5586680b88a0 con 0x558668299b90 2024-05-21T01:21:29.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.716+0000 7f103854c000 10 client.0 _ll_register_callbacks cb 0x55866804aee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-21T01:21:29.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.716+0000 7f102de00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5586682638d0 0x558668299350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:21:29.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.716+0000 7f102de00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5586682638d0 0x558668299350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33128/0 (socket says 172.21.15.63:33128) 2024-05-21T01:21:29.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.716+0000 7f102de00640 1 -- 172.21.15.63:0/4052063178 learned_addr learned my addr 172.21.15.63:0/4052063178 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:21:29.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.716+0000 7f102d400640 1 --2- 172.21.15.63:0/4052063178 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558668299b90 0x55866825efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:21:29.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.716+0000 7f102e800640 1 --2- 172.21.15.63:0/4052063178 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55866829eb60 0x55866825f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:21:29.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.716+0000 7f102de00640 1 -- 172.21.15.63:0/4052063178 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558668299b90 msgr2=0x55866825efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:21:29.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.716+0000 7f102de00640 1 --2- 172.21.15.63:0/4052063178 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558668299b90 0x55866825efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:21:29.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.716+0000 7f102de00640 1 -- 172.21.15.63:0/4052063178 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55866829eb60 msgr2=0x55866825f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:21:29.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.716+0000 7f102de00640 1 --2- 172.21.15.63:0/4052063178 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55866829eb60 0x55866825f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:21:29.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.716+0000 7f102de00640 1 -- 172.21.15.63:0/4052063178 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586680f2260 con 0x5586682638d0 2024-05-21T01:21:29.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.716+0000 7f102d400640 1 --2- 172.21.15.63:0/4052063178 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558668299b90 0x55866825efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T01:21:29.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.716+0000 7f102e800640 1 --2- 172.21.15.63:0/4052063178 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55866829eb60 0x55866825f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T01:21:29.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.716+0000 7f102de00640 1 --2- 172.21.15.63:0/4052063178 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5586682638d0 0x558668299350 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f102001cf70 tx=0x7f1020019830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc6803d5700acec9 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:21:29.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.716+0000 7f100f400640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-05-21T01:21:29.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.720+0000 7f100f400640 1 -- 172.21.15.63:0/4052063178 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10200d6060 con 0x5586682638d0 2024-05-21T01:21:29.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.720+0000 7f100f400640 1 -- 172.21.15.63:0/4052063178 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f10200a9a50 con 0x5586682638d0 2024-05-21T01:21:29.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.720+0000 7f103854c000 1 -- 172.21.15.63:0/4052063178 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f10200a6470 con 0x5586682638d0 2024-05-21T01:21:29.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.720+0000 7f100f400640 1 -- 172.21.15.63:0/4052063178 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f10200cc070 con 0x5586682638d0 2024-05-21T01:21:29.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.720+0000 7f103854c000 10 client.4851 fetch_fsmap learned FSMap version 15 2024-05-21T01:21:29.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.720+0000 7f103854c000 1 -- 172.21.15.63:0/4052063178 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x55866804f6e0 con 0x5586682638d0 2024-05-21T01:21:29.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.720+0000 7f100f400640 1 -- 172.21.15.63:0/4052063178 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10200a6470 con 0x5586682638d0 2024-05-21T01:21:29.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.720+0000 7f100f400640 1 -- 172.21.15.63:0/4052063178 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 15) ==== 4752+0+0 (secure 0 0 0) 0x7f10200a9c50 con 0x5586682638d0 2024-05-21T01:21:29.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.720+0000 7f103854c000 10 client.4851 fetch_fsmap finished waiting for FSMap version 15 2024-05-21T01:21:29.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.720+0000 7f103854c000 10 client.4851 resolve_mds: validated gid 4276 aka daemon mds.c 2024-05-21T01:21:29.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.720+0000 7f103854c000 20 client.4851 populate_metadata read hostname 'smithi063' 2024-05-21T01:21:29.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.720+0000 7f103854c000 1 --2- 172.21.15.63:0/4052063178 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x55866825ff20 0x558668260330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:21:29.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.720+0000 7f103854c000 4 client.4851 mds_command: new command op to 4276 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-21T01:21:29.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.720+0000 7f103854c000 1 -- 172.21.15.63:0/4052063178 --> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558668044060 con 0x55866825ff20 2024-05-21T01:21:29.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.720+0000 7f102d400640 1 --2- 172.21.15.63:0/4052063178 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x55866825ff20 0x558668260330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:21:29.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.720+0000 7f102d400640 1 --2- 172.21.15.63:0/4052063178 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x55866825ff20 0x558668260330 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=44cb58de7142d8fb server_cookie=8b3158027c50193 in_seq=0 out_seq=0 2024-05-21T01:21:29.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.720+0000 7f100f400640 10 client.4851 ms_handle_connect on v2:172.21.15.63:6834/2892727989 2024-05-21T01:21:29.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.720+0000 7f100f400640 1 -- 172.21.15.63:0/4052063178 <== mds.0 v2:172.21.15.63:6834/2892727989 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x558668044060 con 0x55866825ff20 2024-05-21T01:21:29.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.720+0000 7f100f400640 10 client.4851 handle_command_reply: tid=0 2024-05-21T01:21:29.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.720+0000 7f103854c000 1 client.4851 shutdown 2024-05-21T01:21:29.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.720+0000 7f103854c000 1 -- 172.21.15.63:0/4052063178 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5586682638d0 msgr2=0x558668299350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:21:29.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.720+0000 7f103854c000 1 --2- 172.21.15.63:0/4052063178 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5586682638d0 0x558668299350 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f102001cf70 tx=0x7f1020019830 comp rx=0 tx=0).stop 2024-05-21T01:21:29.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.720+0000 7f103854c000 1 -- 172.21.15.63:0/4052063178 shutdown_connections 2024-05-21T01:21:29.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.720+0000 7f103854c000 1 --2- 172.21.15.63:0/4052063178 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x55866825ff20 0x558668260330 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:21:29.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.720+0000 7f103854c000 1 --2- 172.21.15.63:0/4052063178 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55866829eb60 0x55866825f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:21:29.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.720+0000 7f103854c000 1 --2- 172.21.15.63:0/4052063178 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558668299b90 0x55866825efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:21:29.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.720+0000 7f100f400640 0 client.4851 ms_handle_reset on v2:172.21.15.63:6834/2892727989 2024-05-21T01:21:29.726 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.720+0000 7f103854c000 1 --2- 172.21.15.63:0/4052063178 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5586682638d0 0x558668299350 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:21:29.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.720+0000 7f103854c000 1 -- 172.21.15.63:0/4052063178 >> 172.21.15.63:0/4052063178 conn(0x558668145f90 msgr2=0x55866829c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:21:29.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.720+0000 7f103854c000 1 -- 172.21.15.63:0/4052063178 shutdown_connections 2024-05-21T01:21:29.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.720+0000 7f103854c000 1 -- 172.21.15.63:0/4052063178 wait complete. 2024-05-21T01:21:29.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.720+0000 7f103854c000 20 client.4851 trim_cache size 0 max 16384 2024-05-21T01:21:29.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.740+0000 7f103854c000 1 Processor -- start 2024-05-21T01:21:29.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.740+0000 7f103854c000 1 -- start start 2024-05-21T01:21:29.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.740+0000 7f103854c000 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5586682638d0 0x55866825f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:21:29.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.740+0000 7f103854c000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558668299b90 0x5586682be250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:21:29.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.740+0000 7f103854c000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55866829eb60 0x5586682be790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:21:29.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.740+0000 7f103854c000 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f100800ce20 con 0x5586682638d0 2024-05-21T01:21:29.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.740+0000 7f103854c000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f100800c0e0 con 0x558668299b90 2024-05-21T01:21:29.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.740+0000 7f103854c000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f100800c750 con 0x55866829eb60 2024-05-21T01:21:29.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.740+0000 7f102de00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5586682638d0 0x55866825f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:21:29.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.740+0000 7f102de00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5586682638d0 0x55866825f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33136/0 (socket says 172.21.15.63:33136) 2024-05-21T01:21:29.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.740+0000 7f102de00640 1 -- 172.21.15.63:0/1370865751 learned_addr learned my addr 172.21.15.63:0/1370865751 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:21:29.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.740+0000 7f102d400640 1 --2- 172.21.15.63:0/1370865751 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558668299b90 0x5586682be250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:21:29.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.740+0000 7f102de00640 1 -- 172.21.15.63:0/1370865751 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55866829eb60 msgr2=0x5586682be790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:21:29.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.740+0000 7f102e800640 1 --2- 172.21.15.63:0/1370865751 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55866829eb60 0x5586682be790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:21:29.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.740+0000 7f102de00640 1 --2- 172.21.15.63:0/1370865751 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55866829eb60 0x5586682be790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:21:29.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.740+0000 7f102de00640 1 -- 172.21.15.63:0/1370865751 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558668299b90 msgr2=0x5586682be250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:21:29.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.740+0000 7f102de00640 1 --2- 172.21.15.63:0/1370865751 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558668299b90 0x5586682be250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:21:29.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.740+0000 7f102de00640 1 -- 172.21.15.63:0/1370865751 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55866812dcf0 con 0x5586682638d0 2024-05-21T01:21:29.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.740+0000 7f102e800640 1 --2- 172.21.15.63:0/1370865751 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55866829eb60 0x5586682be790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T01:21:29.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.740+0000 7f102d400640 1 --2- 172.21.15.63:0/1370865751 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558668299b90 0x5586682be250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T01:21:29.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.740+0000 7f102de00640 1 --2- 172.21.15.63:0/1370865751 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5586682638d0 0x55866825f3b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1020004610 tx=0x7f10200cf000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31eca2248560428f server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:21:29.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.740+0000 7f101a000640 1 -- 172.21.15.63:0/1370865751 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10200a6760 con 0x5586682638d0 2024-05-21T01:21:29.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.740+0000 7f101a000640 1 -- 172.21.15.63:0/1370865751 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10200cd040 con 0x5586682638d0 2024-05-21T01:21:29.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.740+0000 7f101a000640 1 -- 172.21.15.63:0/1370865751 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10200a6e40 con 0x5586682638d0 2024-05-21T01:21:29.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.740+0000 7f103854c000 1 -- 172.21.15.63:0/1370865751 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5586682638d0 msgr2=0x55866825f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:21:29.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.740+0000 7f103854c000 1 --2- 172.21.15.63:0/1370865751 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5586682638d0 0x55866825f3b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1020004610 tx=0x7f10200cf000 comp rx=0 tx=0).stop 2024-05-21T01:21:29.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.740+0000 7f103854c000 1 -- 172.21.15.63:0/1370865751 shutdown_connections 2024-05-21T01:21:29.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.740+0000 7f103854c000 1 --2- 172.21.15.63:0/1370865751 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55866829eb60 0x5586682be790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:21:29.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.740+0000 7f103854c000 1 --2- 172.21.15.63:0/1370865751 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558668299b90 0x5586682be250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:21:29.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.740+0000 7f103854c000 1 --2- 172.21.15.63:0/1370865751 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5586682638d0 0x55866825f3b0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:21:29.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.740+0000 7f103854c000 1 -- 172.21.15.63:0/1370865751 >> 172.21.15.63:0/1370865751 conn(0x558668145f90 msgr2=0x55866829d3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:21:29.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.740+0000 7f103854c000 1 -- 172.21.15.63:0/1370865751 shutdown_connections 2024-05-21T01:21:29.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.740+0000 7f103854c000 1 -- 172.21.15.63:0/1370865751 wait complete. 2024-05-21T01:21:29.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.744+0000 7f103854c000 1 -- start start 2024-05-21T01:21:29.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.744+0000 7f103854c000 1 Processor -- start 2024-05-21T01:21:29.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.744+0000 7f103854c000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5586682638d0 0x5586682b0d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:21:29.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.744+0000 7f103854c000 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558668299b90 0x5586682b1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:21:29.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.744+0000 7f103854c000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55866829eb60 0x5586682b17a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:21:29.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.744+0000 7f103854c000 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5586680a45f0 con 0x558668299b90 2024-05-21T01:21:29.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.744+0000 7f103854c000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55866812d860 con 0x5586682638d0 2024-05-21T01:21:29.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.744+0000 7f103854c000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x558668040c50 con 0x55866829eb60 2024-05-21T01:21:29.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.744+0000 7f103854c000 10 client.0 _ll_register_callbacks cb 0x7f10200ca070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-21T01:21:29.749 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.744+0000 7f102d400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558668299b90 0x5586682b1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:21:29.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.744+0000 7f102d400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558668299b90 0x5586682b1260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33148/0 (socket says 172.21.15.63:33148) 2024-05-21T01:21:29.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.744+0000 7f102d400640 1 -- 172.21.15.63:0/437389228 learned_addr learned my addr 172.21.15.63:0/437389228 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:21:29.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.744+0000 7f102de00640 1 --2- 172.21.15.63:0/437389228 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5586682638d0 0x5586682b0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:21:29.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.744+0000 7f102e800640 1 --2- 172.21.15.63:0/437389228 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55866829eb60 0x5586682b17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:21:29.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.744+0000 7f102d400640 1 -- 172.21.15.63:0/437389228 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55866829eb60 msgr2=0x5586682b17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:21:29.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.744+0000 7f102d400640 1 --2- 172.21.15.63:0/437389228 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55866829eb60 0x5586682b17a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:21:29.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.744+0000 7f102d400640 1 -- 172.21.15.63:0/437389228 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5586682638d0 msgr2=0x5586682b0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:21:29.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.744+0000 7f102d400640 1 --2- 172.21.15.63:0/437389228 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5586682638d0 0x5586682b0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:21:29.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.744+0000 7f102d400640 1 -- 172.21.15.63:0/437389228 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55866805aca0 con 0x558668299b90 2024-05-21T01:21:29.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.744+0000 7f102d400640 1 --2- 172.21.15.63:0/437389228 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558668299b90 0x5586682b1260 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f103006fdd0 tx=0x7f101c001b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5adfc6f0477df6d5 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:21:29.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.744+0000 7f100f400640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-05-21T01:21:29.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.744+0000 7f100f400640 1 -- 172.21.15.63:0/437389228 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f101c007450 con 0x558668299b90 2024-05-21T01:21:29.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.744+0000 7f100f400640 1 -- 172.21.15.63:0/437389228 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f101c0075f0 con 0x558668299b90 2024-05-21T01:21:29.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.744+0000 7f103854c000 1 -- 172.21.15.63:0/437389228 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f10200cd040 con 0x558668299b90 2024-05-21T01:21:29.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.744+0000 7f100f400640 1 -- 172.21.15.63:0/437389228 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f101c02a470 con 0x558668299b90 2024-05-21T01:21:29.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.744+0000 7f103854c000 10 client.4857 fetch_fsmap learned FSMap version 15 2024-05-21T01:21:29.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.744+0000 7f103854c000 1 -- 172.21.15.63:0/437389228 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x55866803f9c0 con 0x558668299b90 2024-05-21T01:21:29.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.744+0000 7f100f400640 1 -- 172.21.15.63:0/437389228 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10200cd040 con 0x558668299b90 2024-05-21T01:21:29.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.744+0000 7f100f400640 1 -- 172.21.15.63:0/437389228 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 15) ==== 4752+0+0 (secure 0 0 0) 0x7f101c02a610 con 0x558668299b90 2024-05-21T01:21:29.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.744+0000 7f103854c000 10 client.4857 fetch_fsmap finished waiting for FSMap version 15 2024-05-21T01:21:29.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.744+0000 7f103854c000 10 client.4857 resolve_mds: validated gid 4276 aka daemon mds.c 2024-05-21T01:21:29.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.744+0000 7f103854c000 20 client.4857 populate_metadata read hostname 'smithi063' 2024-05-21T01:21:29.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.744+0000 7f103854c000 1 --2- 172.21.15.63:0/437389228 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x558668322100 0x5586683244f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:21:29.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.744+0000 7f103854c000 4 client.4857 mds_command: new command op to 4276 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "d3637759", "release": true, "await": true}] 2024-05-21T01:21:29.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.744+0000 7f103854c000 1 -- 172.21.15.63:0/437389228 --> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] -- command(tid 0: {"prefix": "quiesce db", "set_id": "d3637759", "release": true, "await": true}) -- 0x5586680ba7f0 con 0x558668322100 2024-05-21T01:21:29.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.744+0000 7f102de00640 1 --2- 172.21.15.63:0/437389228 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x558668322100 0x5586683244f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:21:29.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.748+0000 7f100f400640 10 client.4857 ms_handle_connect on v2:172.21.15.63:6834/2892727989 2024-05-21T01:21:29.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:29.748+0000 7f102de00640 1 --2- 172.21.15.63:0/437389228 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x558668322100 0x5586683244f0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d0e411ed172617a server_cookie=7addbd4afbf9274 in_seq=0 out_seq=0 2024-05-21T01:21:30.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.584+0000 7f100f400640 1 -- 172.21.15.63:0/437389228 <== mds.0 v2:172.21.15.63:6834/2892727989 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x5586680ba7f0 con 0x558668322100 2024-05-21T01:21:30.588 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.584+0000 7f100f400640 10 client.4857 handle_command_reply: tid=0 2024-05-21T01:21:30.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.584+0000 7f103854c000 1 client.4857 shutdown 2024-05-21T01:21:30.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.584+0000 7f103854c000 1 -- 172.21.15.63:0/437389228 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558668299b90 msgr2=0x5586682b1260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:21:30.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.584+0000 7f103854c000 1 --2- 172.21.15.63:0/437389228 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558668299b90 0x5586682b1260 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f103006fdd0 tx=0x7f101c001b50 comp rx=0 tx=0).stop 2024-05-21T01:21:30.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.584+0000 7f103854c000 1 -- 172.21.15.63:0/437389228 shutdown_connections 2024-05-21T01:21:30.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.584+0000 7f103854c000 1 --2- 172.21.15.63:0/437389228 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x558668322100 0x5586683244f0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:21:30.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.584+0000 7f103854c000 1 --2- 172.21.15.63:0/437389228 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55866829eb60 0x5586682b17a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:21:30.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.584+0000 7f103854c000 1 --2- 172.21.15.63:0/437389228 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558668299b90 0x5586682b1260 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:21:30.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.584+0000 7f103854c000 1 --2- 172.21.15.63:0/437389228 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5586682638d0 0x5586682b0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:21:30.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.584+0000 7f103854c000 1 -- 172.21.15.63:0/437389228 >> 172.21.15.63:0/437389228 conn(0x558668145f90 msgr2=0x55866825df80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:21:30.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.584+0000 7f100f400640 0 client.4857 ms_handle_reset on v2:172.21.15.63:6834/2892727989 2024-05-21T01:21:30.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.584+0000 7f103854c000 1 -- 172.21.15.63:0/437389228 shutdown_connections 2024-05-21T01:21:30.589 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.584+0000 7f103854c000 1 -- 172.21.15.63:0/437389228 wait complete. 2024-05-21T01:21:30.590 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.588+0000 7f103854c000 20 client.4857 trim_cache size 0 max 16384 2024-05-21T01:21:30.590 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-05-21T01:21:30.590 INFO:teuthology.orchestra.run.smithi063.stdout: "epoch": 15, 2024-05-21T01:21:30.590 INFO:teuthology.orchestra.run.smithi063.stdout: "leader": 4276, 2024-05-21T01:21:30.590 INFO:teuthology.orchestra.run.smithi063.stdout: "set_version": 4, 2024-05-21T01:21:30.590 INFO:teuthology.orchestra.run.smithi063.stdout: "sets": { 2024-05-21T01:21:30.590 INFO:teuthology.orchestra.run.smithi063.stdout: "d3637759": { 2024-05-21T01:21:30.590 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 4, 2024-05-21T01:21:30.590 INFO:teuthology.orchestra.run.smithi063.stdout: "age_ref": 0.0, 2024-05-21T01:21:30.591 INFO:teuthology.orchestra.run.smithi063.stdout: "state": { 2024-05-21T01:21:30.591 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "RELEASED", 2024-05-21T01:21:30.591 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 0.0 2024-05-21T01:21:30.591 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-05-21T01:21:30.591 INFO:teuthology.orchestra.run.smithi063.stdout: "timeout": 90.0, 2024-05-21T01:21:30.591 INFO:teuthology.orchestra.run.smithi063.stdout: "expiration": 150.0, 2024-05-21T01:21:30.591 INFO:teuthology.orchestra.run.smithi063.stdout: "members": { 2024-05-21T01:21:30.591 INFO:teuthology.orchestra.run.smithi063.stdout: "file:/": { 2024-05-21T01:21:30.591 INFO:teuthology.orchestra.run.smithi063.stdout: "excluded": false, 2024-05-21T01:21:30.591 INFO:teuthology.orchestra.run.smithi063.stdout: "state": { 2024-05-21T01:21:30.591 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "RELEASED", 2024-05-21T01:21:30.591 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 0.0 2024-05-21T01:21:30.591 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-05-21T01:21:30.591 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-05-21T01:21:30.591 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-05-21T01:21:30.592 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-05-21T01:21:30.592 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-05-21T01:21:30.592 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-05-21T01:21:30.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.588+0000 7f1035000640 1 -- 172.21.15.63:0/2724166761 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f101006f400 msgr2=0x7f10100718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:21:30.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.588+0000 7f1035000640 1 --2- 172.21.15.63:0/2724166761 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f101006f400 0x7f10100718c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f10200ad000 tx=0x7f10200046d0 comp rx=0 tx=0).stop 2024-05-21T01:21:30.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.588+0000 7f1035000640 1 -- 172.21.15.63:0/2724166761 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f10301546c0 msgr2=0x7f1030154b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:21:30.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.588+0000 7f1035000640 1 --2- 172.21.15.63:0/2724166761 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f10301546c0 0x7f1030154b40 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f10300c6da0 tx=0x7f1028010590 comp rx=0 tx=0).stop 2024-05-21T01:21:30.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.588+0000 7f1035000640 1 -- 172.21.15.63:0/2724166761 shutdown_connections 2024-05-21T01:21:30.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.588+0000 7f1035000640 1 --2- 172.21.15.63:0/2724166761 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f101006f400 0x7f10100718c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:21:30.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.588+0000 7f1035000640 1 --2- 172.21.15.63:0/2724166761 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f10301546c0 0x7f1030154b40 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:21:30.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.588+0000 7f1035000640 1 --2- 172.21.15.63:0/2724166761 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1030157560 0x7f10301f3b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:21:30.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.588+0000 7f1035000640 1 --2- 172.21.15.63:0/2724166761 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1014003a10 0x7f10301569f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:21:30.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.588+0000 7f1035000640 1 -- 172.21.15.63:0/2724166761 >> 172.21.15.63:0/2724166761 conn(0x7f1030068460 msgr2=0x7f10301515b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:21:30.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.588+0000 7f1035000640 1 -- 172.21.15.63:0/2724166761 shutdown_connections 2024-05-21T01:21:30.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.588+0000 7f1035000640 1 -- 172.21.15.63:0/2724166761 wait complete. 2024-05-21T01:21:30.612 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'd3637759', total seconds elapsed: 31.5 2024-05-21T01:21:30.612 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2024-05-21T01:21:30.613 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-21T01:21:30.757 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.756+0000 7f7a25800640 1 Processor -- start 2024-05-21T01:21:30.757 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.756+0000 7f7a25800640 1 -- start start 2024-05-21T01:21:30.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.756+0000 7f7a25800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7a20152020 0x7f7a200c8a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:21:30.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.756+0000 7f7a25800640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f7a2006dd80 0x7f7a2006cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:21:30.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.756+0000 7f7a25800640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a2006d8c0 con 0x7f7a2006d270 2024-05-21T01:21:30.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.756+0000 7f7a25800640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f7a200c9b60 con 0x7f7a2006dd80 2024-05-21T01:21:30.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.756+0000 7f7a25800640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f7a200c7f70 con 0x7f7a20152020 2024-05-21T01:21:30.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.756+0000 7f7a24e00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f7a2006d270 0x7f7a2015b5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57112/0 (socket says 172.21.15.63:57112) 2024-05-21T01:21:30.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.756+0000 7f7a24e00640 1 -- 172.21.15.63:0/3708898977 learned_addr learned my addr 172.21.15.63:0/3708898977 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-05-21T01:21:30.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.756+0000 7f7a17e00640 1 --2- 172.21.15.63:0/3708898977 >> v2:172.21.15.131:3300/0 conn(0x7f7a2006dd80 0x7f7a2006cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:21:30.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.756+0000 7f7a1fe00640 1 --2- 172.21.15.63:0/3708898977 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7a20152020 0x7f7a200c8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:21:30.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.756+0000 7f7a1f400640 1 -- 172.21.15.63:0/3708898977 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3088240761 0 0) 0x7f7a180014a0 con 0x7f7a2006d270 2024-05-21T01:21:30.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.756+0000 7f7a1f400640 1 -- 172.21.15.63:0/3708898977 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a04003530 con 0x7f7a2006d270 2024-05-21T01:21:30.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.756+0000 7f7a1f400640 1 -- 172.21.15.63:0/3708898977 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3042945927 0 0) 0x7f7a04003530 con 0x7f7a2006d270 2024-05-21T01:21:30.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.756+0000 7f7a1f400640 1 -- 172.21.15.63:0/3708898977 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7a20152020 msgr2=0x7f7a200c8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:21:30.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.756+0000 7f7a1f400640 1 --2- 172.21.15.63:0/3708898977 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7a20152020 0x7f7a200c8a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:21:30.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.756+0000 7f7a1f400640 1 -- 172.21.15.63:0/3708898977 >> v2:172.21.15.131:3300/0 conn(0x7f7a2006dd80 msgr2=0x7f7a2006cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:21:30.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.756+0000 7f7a1f400640 1 --2- 172.21.15.63:0/3708898977 >> v2:172.21.15.131:3300/0 conn(0x7f7a2006dd80 0x7f7a2006cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:21:30.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.756+0000 7f7a1f400640 1 -- 172.21.15.63:0/3708898977 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a20152400 con 0x7f7a2006d270 2024-05-21T01:21:30.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.756+0000 7f7a1f400640 1 -- 172.21.15.63:0/3708898977 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 466403955 0 0) 0x7f7a18001c50 con 0x7f7a2006d270 2024-05-21T01:21:30.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.756+0000 7f7a1f400640 1 -- 172.21.15.63:0/3708898977 >> v1:172.21.15.63:6789/0 conn(0x7f7a2006d270 legacy=0x7f7a2015b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:21:30.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.756+0000 7f7a1f400640 1 --2- 172.21.15.63:0/3708898977 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7a20152020 0x7f7a04003a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:21:30.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.756+0000 7f7a1f400640 1 --2- 172.21.15.63:0/3708898977 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7a04003fe0 0x7f7a04004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:21:30.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.756+0000 7f7a1f400640 1 --2- 172.21.15.63:0/3708898977 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7a04004d50 0x7f7a040051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:21:30.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.756+0000 7f7a1f400640 1 -- 172.21.15.63:0/3708898977 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f7a200c9b60 con 0x7f7a04004d50 2024-05-21T01:21:30.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.756+0000 7f7a1f400640 1 -- 172.21.15.63:0/3708898977 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f7a200c7f70 con 0x7f7a04003fe0 2024-05-21T01:21:30.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.756+0000 7f7a1f400640 1 -- 172.21.15.63:0/3708898977 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f7a0400ba20 con 0x7f7a20152020 2024-05-21T01:21:30.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.756+0000 7f7a24e00640 1 --2- 172.21.15.63:0/3708898977 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7a04004d50 0x7f7a040051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:21:30.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.756+0000 7f7a1fe00640 1 --2- 172.21.15.63:0/3708898977 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7a20152020 0x7f7a04003a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:21:30.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.756+0000 7f7a17e00640 1 --2- 172.21.15.63:0/3708898977 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7a04003fe0 0x7f7a04004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:21:30.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.760+0000 7f7a24e00640 1 -- 172.21.15.63:0/3708898977 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7a20152020 msgr2=0x7f7a04003a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:21:30.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.760+0000 7f7a24e00640 1 --2- 172.21.15.63:0/3708898977 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7a20152020 0x7f7a04003a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:21:30.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.760+0000 7f7a24e00640 1 -- 172.21.15.63:0/3708898977 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7a04003fe0 msgr2=0x7f7a04004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:21:30.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.760+0000 7f7a24e00640 1 --2- 172.21.15.63:0/3708898977 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7a04003fe0 0x7f7a04004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:21:30.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.760+0000 7f7a24e00640 1 -- 172.21.15.63:0/3708898977 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a04003530 con 0x7f7a04004d50 2024-05-21T01:21:30.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.760+0000 7f7a24e00640 1 --2- 172.21.15.63:0/3708898977 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7a04004d50 0x7f7a040051d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7a1800aaa0 tx=0x7f7a1801d300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2db00468c72371de server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:21:30.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.760+0000 7f7a1f400640 1 -- 172.21.15.63:0/3708898977 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a1800a690 con 0x7f7a04004d50 2024-05-21T01:21:30.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.760+0000 7f7a1f400640 1 -- 172.21.15.63:0/3708898977 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a180072d0 con 0x7f7a04004d50 2024-05-21T01:21:30.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.760+0000 7f7a1f400640 1 -- 172.21.15.63:0/3708898977 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a18007700 con 0x7f7a04004d50 2024-05-21T01:21:30.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.764+0000 7f7a25800640 1 -- 172.21.15.63:0/3708898977 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7a04004d50 msgr2=0x7f7a040051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:21:30.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.764+0000 7f7a25800640 1 --2- 172.21.15.63:0/3708898977 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7a04004d50 0x7f7a040051d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7a1800aaa0 tx=0x7f7a1801d300 comp rx=0 tx=0).stop 2024-05-21T01:21:30.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.764+0000 7f7a24e00640 1 -- 172.21.15.63:0/3708898977 reap_dead start 2024-05-21T01:21:30.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.764+0000 7f7a25800640 1 -- 172.21.15.63:0/3708898977 shutdown_connections 2024-05-21T01:21:30.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.764+0000 7f7a25800640 1 -- 172.21.15.63:0/3708898977 >> 172.21.15.63:0/3708898977 conn(0x7f7a200cdde0 msgr2=0x7f7a2006f070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:21:30.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.764+0000 7f7a25800640 1 -- 172.21.15.63:0/3708898977 shutdown_connections 2024-05-21T01:21:30.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.764+0000 7f7a25800640 1 -- 172.21.15.63:0/3708898977 wait complete. 2024-05-21T01:21:30.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.764+0000 7f7a25800640 1 Processor -- start 2024-05-21T01:21:30.766 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.764+0000 7f7a25800640 1 -- start start 2024-05-21T01:21:30.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.764+0000 7f7a25800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7a04004d50 0x7f7a201f4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:21:30.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.764+0000 7f7a25800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7a20159bc0 0x7f7a201eb930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:21:30.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.764+0000 7f7a25800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7a200c39b0 0x7f7a200733b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:21:30.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.764+0000 7f7a25800640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f7a200c84f0 con 0x7f7a200c39b0 2024-05-21T01:21:30.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.764+0000 7f7a25800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f7a200c8210 con 0x7f7a20159bc0 2024-05-21T01:21:30.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.764+0000 7f7a25800640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f7a20158e80 con 0x7f7a04004d50 2024-05-21T01:21:30.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.764+0000 7f7a24e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7a200c39b0 0x7f7a200733b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:21:30.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.764+0000 7f7a24e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7a200c39b0 0x7f7a200733b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33164/0 (socket says 172.21.15.63:33164) 2024-05-21T01:21:30.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.764+0000 7f7a24e00640 1 -- 172.21.15.63:0/2610646217 learned_addr learned my addr 172.21.15.63:0/2610646217 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:21:30.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.764+0000 7f7a1fe00640 1 --2- 172.21.15.63:0/2610646217 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7a04004d50 0x7f7a201f4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:21:30.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.764+0000 7f7a17e00640 1 --2- 172.21.15.63:0/2610646217 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7a20159bc0 0x7f7a201eb930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:21:30.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.764+0000 7f7a24e00640 1 -- 172.21.15.63:0/2610646217 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7a04004d50 msgr2=0x7f7a201f4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:21:30.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.764+0000 7f7a24e00640 1 --2- 172.21.15.63:0/2610646217 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7a04004d50 0x7f7a201f4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:21:30.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.764+0000 7f7a24e00640 1 -- 172.21.15.63:0/2610646217 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7a20159bc0 msgr2=0x7f7a201eb930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:21:30.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.764+0000 7f7a24e00640 1 --2- 172.21.15.63:0/2610646217 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7a20159bc0 0x7f7a201eb930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:21:30.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.764+0000 7f7a24e00640 1 -- 172.21.15.63:0/2610646217 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a2015a000 con 0x7f7a200c39b0 2024-05-21T01:21:30.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.764+0000 7f7a24e00640 1 --2- 172.21.15.63:0/2610646217 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7a200c39b0 0x7f7a200733b0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7a1800a0d0 tx=0x7f7a04005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:21:30.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.768+0000 7f7a1cc00640 1 -- 172.21.15.63:0/2610646217 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a180070d0 con 0x7f7a200c39b0 2024-05-21T01:21:30.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.768+0000 7f7a1cc00640 1 -- 172.21.15.63:0/2610646217 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a180014a0 con 0x7f7a200c39b0 2024-05-21T01:21:30.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.768+0000 7f7a1cc00640 1 -- 172.21.15.63:0/2610646217 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a18004b70 con 0x7f7a200c39b0 2024-05-21T01:21:30.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.768+0000 7f7a25800640 1 -- 172.21.15.63:0/2610646217 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a201562a0 con 0x7f7a200c39b0 2024-05-21T01:21:30.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.768+0000 7f7a25800640 1 -- 172.21.15.63:0/2610646217 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a20156860 con 0x7f7a200c39b0 2024-05-21T01:21:30.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.768+0000 7f7a25800640 1 -- 172.21.15.63:0/2610646217 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a20156aa0 con 0x7f7a200c39b0 2024-05-21T01:21:30.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.768+0000 7f7a1cc00640 1 -- 172.21.15.63:0/2610646217 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7f7a180bd020 con 0x7f7a200c39b0 2024-05-21T01:21:30.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.768+0000 7f7a1cc00640 1 --2- 172.21.15.63:0/2610646217 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f79fc06f430 0x7f79fc0718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:21:30.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.768+0000 7f7a1cc00640 1 -- 172.21.15.63:0/2610646217 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f7a181292e0 con 0x7f7a200c39b0 2024-05-21T01:21:30.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.768+0000 7f7a1fe00640 1 --2- 172.21.15.63:0/2610646217 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f79fc06f430 0x7f79fc0718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:21:30.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.772+0000 7f7a1fe00640 1 --2- 172.21.15.63:0/2610646217 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f79fc06f430 0x7f79fc0718f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7a10009b20 tx=0x7f7a10008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:21:30.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.772+0000 7f7a1cc00640 1 -- 172.21.15.63:0/2610646217 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f7a20156aa0 con 0x7f7a200c39b0 2024-05-21T01:21:30.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.984+0000 7f7a25800640 1 -- 172.21.15.63:0/2610646217 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7a2006c0c0 con 0x7f7a200c39b0 2024-05-21T01:21:30.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.988+0000 7f7a1cc00640 1 -- 172.21.15.63:0/2610646217 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+6876 (secure 0 0 0) 0x7f7a180c4020 con 0x7f7a200c39b0 2024-05-21T01:21:30.989 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-05-21T01:21:30.989 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6839/3045714273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6837","nonce":3045714273},{"type":"v1","addr":"172.21.15.131:6839","nonce":3045714273}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/2978367338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":2978367338},{"type":"v1","addr":"172.21.15.131:6835","nonce":2978367338}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/3005995321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6835","nonce":3005995321},{"type":"v1","addr":"172.21.15.63:6837","nonce":3005995321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-21T01:19:53.915775+0000","modified":"2024-05-21T01:20:31.724475+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4276,"mds_1":4270,"mds_2":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"e","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.63:6833/574189772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":574189772},{"type":"v1","addr":"172.21.15.63:6833","nonce":574189772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4270":{"gid":4270,"name":"f","rank":1,"incarnation":10,"state":"up:active","state_seq":11,"addr":"172.21.15.131:6838/3071941741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":3071941741},{"type":"v1","addr":"172.21.15.131:6838","nonce":3071941741}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.63:6836/2892727989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":2892727989},{"type":"v1","addr":"172.21.15.63:6836","nonce":2892727989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4276,"qdb_cluster":[4267,4270,4276]},"id":1}]} 2024-05-21T01:21:30.989 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 15 2024-05-21T01:21:30.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.988+0000 7f7a25800640 1 -- 172.21.15.63:0/2610646217 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f79fc06f430 msgr2=0x7f79fc0718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:21:30.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.988+0000 7f7a25800640 1 --2- 172.21.15.63:0/2610646217 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f79fc06f430 0x7f79fc0718f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7a10009b20 tx=0x7f7a10008040 comp rx=0 tx=0).stop 2024-05-21T01:21:30.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.988+0000 7f7a25800640 1 -- 172.21.15.63:0/2610646217 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7a200c39b0 msgr2=0x7f7a200733b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:21:30.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.988+0000 7f7a25800640 1 --2- 172.21.15.63:0/2610646217 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7a200c39b0 0x7f7a200733b0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7a1800a0d0 tx=0x7f7a04005840 comp rx=0 tx=0).stop 2024-05-21T01:21:30.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.988+0000 7f7a25800640 1 -- 172.21.15.63:0/2610646217 shutdown_connections 2024-05-21T01:21:30.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.988+0000 7f7a25800640 1 --2- 172.21.15.63:0/2610646217 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f79fc06f430 0x7f79fc0718f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:21:30.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.988+0000 7f7a25800640 1 --2- 172.21.15.63:0/2610646217 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7a200c39b0 0x7f7a200733b0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:21:30.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.988+0000 7f7a25800640 1 --2- 172.21.15.63:0/2610646217 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7a20159bc0 0x7f7a201eb930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:21:30.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.988+0000 7f7a25800640 1 --2- 172.21.15.63:0/2610646217 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7a04004d50 0x7f7a201f4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:21:30.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.988+0000 7f7a25800640 1 -- 172.21.15.63:0/2610646217 >> 172.21.15.63:0/2610646217 conn(0x7f7a200cdde0 msgr2=0x7f7a2006f050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:21:30.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.988+0000 7f7a25800640 1 -- 172.21.15.63:0/2610646217 shutdown_connections 2024-05-21T01:21:30.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:30.988+0000 7f7a25800640 1 -- 172.21.15.63:0/2610646217 wait complete. 2024-05-21T01:21:31.012 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4276 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0' 2024-05-21T01:21:31.012 DEBUG:teuthology.orchestra.run.smithi063:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4276 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0 2024-05-21T01:21:31.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.164+0000 7f53a7a00640 1 Processor -- start 2024-05-21T01:21:31.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.164+0000 7f53a7a00640 1 -- start start 2024-05-21T01:21:31.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.168+0000 7f53a7a00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f53a0159bd0 0x7f53a00cad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:21:31.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.168+0000 7f53a7a00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f53a00cb250 0x7f53a00cf420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:21:31.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.168+0000 7f53a7a00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53a0074500 con 0x7f53a0153c00 2024-05-21T01:21:31.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.168+0000 7f53a7a00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f53a0073bf0 con 0x7f53a00cb250 2024-05-21T01:21:31.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.168+0000 7f53a7a00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f53a015a030 con 0x7f53a0159bd0 2024-05-21T01:21:31.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.168+0000 7f53a5a00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f53a00cb250 0x7f53a00cf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:21:31.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.168+0000 7f53a5a00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f53a00cb250 0x7f53a00cf420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33170/0 (socket says 172.21.15.63:33170) 2024-05-21T01:21:31.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.168+0000 7f53a5a00640 1 -- 172.21.15.63:0/1633100898 learned_addr learned my addr 172.21.15.63:0/1633100898 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:21:31.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.168+0000 7f539fe00640 1 --2- 172.21.15.63:0/1633100898 >> v2:172.21.15.131:3300/0 conn(0x7f53a0159bd0 0x7f53a00cad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:21:31.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.168+0000 7f53a5a00640 1 -- 172.21.15.63:0/1633100898 >> v2:172.21.15.131:3300/0 conn(0x7f53a0159bd0 msgr2=0x7f53a00cad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:21:31.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.168+0000 7f53a5a00640 1 --2- 172.21.15.63:0/1633100898 >> v2:172.21.15.131:3300/0 conn(0x7f53a0159bd0 0x7f53a00cad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:21:31.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.168+0000 7f53a5a00640 1 -- 172.21.15.63:0/1633100898 >> v1:172.21.15.131:6789/0 conn(0x7f53a0153c00 legacy=0x7f53a0073df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:21:31.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.168+0000 7f53a5a00640 1 -- 172.21.15.63:0/1633100898 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53a015a260 con 0x7f53a00cb250 2024-05-21T01:21:31.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.172+0000 7f53a5a00640 1 --2- 172.21.15.63:0/1633100898 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f53a00cb250 0x7f53a00cf420 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f53a0068ed0 tx=0x7f539801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6d660f92d9bd61 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:21:31.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.172+0000 7f539f400640 1 -- 172.21.15.63:0/1633100898 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53980a56c0 con 0x7f53a00cb250 2024-05-21T01:21:31.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.172+0000 7f539f400640 1 -- 172.21.15.63:0/1633100898 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53980a5860 con 0x7f53a00cb250 2024-05-21T01:21:31.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.172+0000 7f539f400640 1 -- 172.21.15.63:0/1633100898 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53980a5c30 con 0x7f53a00cb250 2024-05-21T01:21:31.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.172+0000 7f53a7a00640 1 -- 172.21.15.63:0/1633100898 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f53a00cb250 msgr2=0x7f53a00cf420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:21:31.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.172+0000 7f53a7a00640 1 --2- 172.21.15.63:0/1633100898 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f53a00cb250 0x7f53a00cf420 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f53a0068ed0 tx=0x7f539801c9f0 comp rx=0 tx=0).stop 2024-05-21T01:21:31.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.172+0000 7f53a7a00640 1 -- 172.21.15.63:0/1633100898 shutdown_connections 2024-05-21T01:21:31.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.172+0000 7f53a7a00640 1 --2- 172.21.15.63:0/1633100898 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f53a00cb250 0x7f53a00cf420 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:21:31.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.172+0000 7f53a7a00640 1 --2- 172.21.15.63:0/1633100898 >> v2:172.21.15.131:3300/0 conn(0x7f53a0159bd0 0x7f53a00cad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:21:31.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.172+0000 7f53a7a00640 1 -- 172.21.15.63:0/1633100898 >> 172.21.15.63:0/1633100898 conn(0x7f53a0068290 msgr2=0x7f53a00686a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:21:31.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.172+0000 7f53a7a00640 1 -- 172.21.15.63:0/1633100898 shutdown_connections 2024-05-21T01:21:31.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.172+0000 7f53a7a00640 1 -- 172.21.15.63:0/1633100898 wait complete. 2024-05-21T01:21:31.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.172+0000 7f53a7a00640 1 Processor -- start 2024-05-21T01:21:31.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.172+0000 7f53a7a00640 1 -- start start 2024-05-21T01:21:31.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.172+0000 7f53a7a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53a00cb250 0x7f53a006e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:21:31.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.172+0000 7f53a7a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f53a0153c00 0x7f53a01458f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:21:31.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.172+0000 7f53a7a00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f53a0159bd0 0x7f53a0141230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:21:31.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.172+0000 7f53a7a00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f53a00c8800 con 0x7f53a0153c00 2024-05-21T01:21:31.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.172+0000 7f53a7a00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f53a00ca510 con 0x7f53a00cb250 2024-05-21T01:21:31.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.172+0000 7f53a7a00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f53a0153fe0 con 0x7f53a0159bd0 2024-05-21T01:21:31.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.176+0000 7f53a5000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53a00cb250 0x7f53a006e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:21:31.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.176+0000 7f53a5000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53a00cb250 0x7f53a006e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.63:52384/0 (socket says 172.21.15.63:52384) 2024-05-21T01:21:31.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.176+0000 7f53a5000640 1 -- 172.21.15.63:0/1356809341 learned_addr learned my addr 172.21.15.63:0/1356809341 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:21:31.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.176+0000 7f53a5a00640 1 --2- 172.21.15.63:0/1356809341 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f53a0159bd0 0x7f53a0141230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:21:31.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.176+0000 7f539fe00640 1 --2- 172.21.15.63:0/1356809341 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f53a0153c00 0x7f53a01458f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:21:31.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.176+0000 7f539fe00640 1 -- 172.21.15.63:0/1356809341 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f53a0159bd0 msgr2=0x7f53a0141230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:21:31.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.176+0000 7f539fe00640 1 --2- 172.21.15.63:0/1356809341 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f53a0159bd0 0x7f53a0141230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:21:31.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.176+0000 7f539fe00640 1 -- 172.21.15.63:0/1356809341 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53a00cb250 msgr2=0x7f53a006e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:21:31.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.176+0000 7f539fe00640 1 --2- 172.21.15.63:0/1356809341 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53a00cb250 0x7f53a006e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:21:31.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.176+0000 7f539fe00640 1 -- 172.21.15.63:0/1356809341 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53a0147f60 con 0x7f53a0153c00 2024-05-21T01:21:31.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.176+0000 7f539fe00640 1 --2- 172.21.15.63:0/1356809341 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f53a0153c00 0x7f53a01458f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f538c00e8a0 tx=0x7f538c00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:21:31.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.176+0000 7f539cc00640 1 -- 172.21.15.63:0/1356809341 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f538c017070 con 0x7f53a0153c00 2024-05-21T01:21:31.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.176+0000 7f539cc00640 1 -- 172.21.15.63:0/1356809341 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f538c00c940 con 0x7f53a0153c00 2024-05-21T01:21:31.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.176+0000 7f539cc00640 1 -- 172.21.15.63:0/1356809341 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f538c00ccf0 con 0x7f53a0153c00 2024-05-21T01:21:31.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.176+0000 7f53a7a00640 1 -- 172.21.15.63:0/1356809341 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53a0148240 con 0x7f53a0153c00 2024-05-21T01:21:31.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.176+0000 7f53a7a00640 1 -- 172.21.15.63:0/1356809341 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53a0148800 con 0x7f53a0153c00 2024-05-21T01:21:31.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.176+0000 7f539cc00640 1 -- 172.21.15.63:0/1356809341 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7f538c01a070 con 0x7f53a0153c00 2024-05-21T01:21:31.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.180+0000 7f539cc00640 1 --2- 172.21.15.63:0/1356809341 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f538006f400 0x7f53800718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:21:31.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.180+0000 7f539cc00640 1 -- 172.21.15.63:0/1356809341 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f538c08f8e0 con 0x7f53a0153c00 2024-05-21T01:21:31.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.180+0000 7f53aae1f000 1 Processor -- start 2024-05-21T01:21:31.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.180+0000 7f53a5000640 1 --2- 172.21.15.63:0/1356809341 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f538006f400 0x7f53800718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:21:31.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.180+0000 7f53aae1f000 1 -- start start 2024-05-21T01:21:31.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.180+0000 7f53aae1f000 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557eb71e1130 0x557eb71aabc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:21:31.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.180+0000 7f53aae1f000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557eb71ab100 0x557eb71e5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:21:31.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.180+0000 7f53a5000640 1 --2- 172.21.15.63:0/1356809341 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f538006f400 0x7f53800718c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5394001910 tx=0x7f5394009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:21:31.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.180+0000 7f53aae1f000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557eb71e6100 0x557eb71e64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:21:31.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.180+0000 7f53aae1f000 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x557eb7000740 con 0x557eb71e1130 2024-05-21T01:21:31.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.180+0000 7f53aae1f000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x557eb6ff02e0 con 0x557eb71e6100 2024-05-21T01:21:31.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.180+0000 7f53aae1f000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x557eb6ff4320 con 0x557eb71ab100 2024-05-21T01:21:31.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.180+0000 7f53a5000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557eb71e1130 0x557eb71aabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:21:31.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.180+0000 7f53a5000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557eb71e1130 0x557eb71aabc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33190/0 (socket says 172.21.15.63:33190) 2024-05-21T01:21:31.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.180+0000 7f53a5000640 1 -- 172.21.15.63:0/3697604909 learned_addr learned my addr 172.21.15.63:0/3697604909 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:21:31.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.180+0000 7f539fe00640 1 --2- 172.21.15.63:0/3697604909 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557eb71ab100 0x557eb71e5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:21:31.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.180+0000 7f53a5a00640 1 --2- 172.21.15.63:0/3697604909 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557eb71e6100 0x557eb71e64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:21:31.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.180+0000 7f53a5000640 1 -- 172.21.15.63:0/3697604909 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557eb71ab100 msgr2=0x557eb71e5bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:21:31.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.180+0000 7f53a5000640 1 --2- 172.21.15.63:0/3697604909 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557eb71ab100 0x557eb71e5bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:21:31.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.180+0000 7f53a5000640 1 -- 172.21.15.63:0/3697604909 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557eb71e6100 msgr2=0x557eb71e64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:21:31.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.180+0000 7f53a5000640 1 --2- 172.21.15.63:0/3697604909 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557eb71e6100 0x557eb71e64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:21:31.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.180+0000 7f53a5000640 1 -- 172.21.15.63:0/3697604909 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557eb6f92490 con 0x557eb71e1130 2024-05-21T01:21:31.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.180+0000 7f53a5000640 1 --2- 172.21.15.63:0/3697604909 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557eb71e1130 0x557eb71aabc0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f539400fb40 tx=0x7f5394000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47623790e4d492bc server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:21:31.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.180+0000 7f5391600640 1 -- 172.21.15.63:0/3697604909 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5394025070 con 0x557eb71e1130 2024-05-21T01:21:31.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.180+0000 7f5391600640 1 -- 172.21.15.63:0/3697604909 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5394015d70 con 0x557eb71e1130 2024-05-21T01:21:31.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.180+0000 7f5391600640 1 -- 172.21.15.63:0/3697604909 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5394020600 con 0x557eb71e1130 2024-05-21T01:21:31.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.184+0000 7f53aae1f000 1 -- 172.21.15.63:0/3697604909 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557eb71e1130 msgr2=0x557eb71aabc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:21:31.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.184+0000 7f53aae1f000 1 --2- 172.21.15.63:0/3697604909 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557eb71e1130 0x557eb71aabc0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f539400fb40 tx=0x7f5394000ee0 comp rx=0 tx=0).stop 2024-05-21T01:21:31.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.184+0000 7f53aae1f000 1 -- 172.21.15.63:0/3697604909 shutdown_connections 2024-05-21T01:21:31.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.184+0000 7f53aae1f000 1 --2- 172.21.15.63:0/3697604909 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557eb71e6100 0x557eb71e64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:21:31.185 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.184+0000 7f53aae1f000 1 --2- 172.21.15.63:0/3697604909 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557eb71ab100 0x557eb71e5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:21:31.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.184+0000 7f53aae1f000 1 --2- 172.21.15.63:0/3697604909 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557eb71e1130 0x557eb71aabc0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:21:31.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.184+0000 7f53aae1f000 1 -- 172.21.15.63:0/3697604909 >> 172.21.15.63:0/3697604909 conn(0x557eb708cd80 msgr2=0x557eb71e3980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:21:31.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.184+0000 7f53aae1f000 1 -- 172.21.15.63:0/3697604909 shutdown_connections 2024-05-21T01:21:31.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.184+0000 7f53aae1f000 1 -- 172.21.15.63:0/3697604909 wait complete. 2024-05-21T01:21:31.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.184+0000 7f53aae1f000 1 -- start start 2024-05-21T01:21:31.186 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.184+0000 7f53aae1f000 1 Processor -- start 2024-05-21T01:21:31.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.184+0000 7f53aae1f000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557eb71ab100 0x557eb71a9280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:21:31.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.184+0000 7f53aae1f000 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557eb71e1130 0x557eb71a97c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:21:31.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.184+0000 7f53aae1f000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557eb71e6100 0x557eb71ec960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:21:31.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.184+0000 7f53aae1f000 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x557eb6cbbb10 con 0x557eb71e1130 2024-05-21T01:21:31.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.184+0000 7f53aae1f000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x557eb6fac670 con 0x557eb71e6100 2024-05-21T01:21:31.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.184+0000 7f53aae1f000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x557eb6ff8950 con 0x557eb71ab100 2024-05-21T01:21:31.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.184+0000 7f53aae1f000 10 client.0 _ll_register_callbacks cb 0x557eb7190540 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-21T01:21:31.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.184+0000 7f539fe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557eb71e1130 0x557eb71a97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:21:31.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.184+0000 7f539fe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557eb71e1130 0x557eb71a97c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33198/0 (socket says 172.21.15.63:33198) 2024-05-21T01:21:31.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.184+0000 7f539fe00640 1 -- 172.21.15.63:0/603017037 learned_addr learned my addr 172.21.15.63:0/603017037 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:21:31.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.188+0000 7f53a5000640 1 --2- 172.21.15.63:0/603017037 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557eb71ab100 0x557eb71a9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:21:31.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.188+0000 7f53a5a00640 1 --2- 172.21.15.63:0/603017037 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557eb71e6100 0x557eb71ec960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:21:31.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.188+0000 7f539fe00640 1 -- 172.21.15.63:0/603017037 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557eb71ab100 msgr2=0x557eb71a9280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:21:31.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.188+0000 7f539fe00640 1 --2- 172.21.15.63:0/603017037 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557eb71ab100 0x557eb71a9280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:21:31.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.188+0000 7f539fe00640 1 -- 172.21.15.63:0/603017037 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557eb71e6100 msgr2=0x557eb71ec960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:21:31.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.188+0000 7f539fe00640 1 --2- 172.21.15.63:0/603017037 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557eb71e6100 0x557eb71ec960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:21:31.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.188+0000 7f539fe00640 1 -- 172.21.15.63:0/603017037 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557eb6fa5e40 con 0x557eb71e1130 2024-05-21T01:21:31.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.188+0000 7f539fe00640 1 --2- 172.21.15.63:0/603017037 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557eb71e1130 0x557eb71a97c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f538c00e870 tx=0x7f538c05c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62866431c01ff81d server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:21:31.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.188+0000 7f5386000640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-05-21T01:21:31.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.188+0000 7f5386000640 1 -- 172.21.15.63:0/603017037 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f538c021040 con 0x557eb71e1130 2024-05-21T01:21:31.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.188+0000 7f5386000640 1 -- 172.21.15.63:0/603017037 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f538c057770 con 0x557eb71e1130 2024-05-21T01:21:31.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.188+0000 7f53aae1f000 1 -- 172.21.15.63:0/603017037 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5394015d70 con 0x557eb71e1130 2024-05-21T01:21:31.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.188+0000 7f5386000640 1 -- 172.21.15.63:0/603017037 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f538c08de60 con 0x557eb71e1130 2024-05-21T01:21:31.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.188+0000 7f53aae1f000 10 client.4875 fetch_fsmap learned FSMap version 15 2024-05-21T01:21:31.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.188+0000 7f53aae1f000 1 -- 172.21.15.63:0/603017037 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x557eb7075890 con 0x557eb71e1130 2024-05-21T01:21:31.191 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.188+0000 7f5386000640 1 -- 172.21.15.63:0/603017037 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5394015d70 con 0x557eb71e1130 2024-05-21T01:21:31.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.188+0000 7f5386000640 1 -- 172.21.15.63:0/603017037 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 15) ==== 4752+0+0 (secure 0 0 0) 0x7f538c057970 con 0x557eb71e1130 2024-05-21T01:21:31.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.188+0000 7f53aae1f000 10 client.4875 fetch_fsmap finished waiting for FSMap version 15 2024-05-21T01:21:31.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.188+0000 7f53aae1f000 10 client.4875 resolve_mds: validated gid 4276 aka daemon mds.c 2024-05-21T01:21:31.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.188+0000 7f53aae1f000 20 client.4875 populate_metadata read hostname 'smithi063' 2024-05-21T01:21:31.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.188+0000 7f53aae1f000 1 --2- 172.21.15.63:0/603017037 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x557eb71ed370 0x557eb71ed780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:21:31.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.188+0000 7f53aae1f000 4 client.4875 mds_command: new command op to 4276 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-21T01:21:31.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.188+0000 7f53aae1f000 1 -- 172.21.15.63:0/603017037 --> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557eb6f8c7f0 con 0x557eb71ed370 2024-05-21T01:21:31.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.188+0000 7f53a5000640 1 --2- 172.21.15.63:0/603017037 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x557eb71ed370 0x557eb71ed780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:21:31.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.188+0000 7f53a5000640 1 --2- 172.21.15.63:0/603017037 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x557eb71ed370 0x557eb71ed780 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f9cf81556551592 server_cookie=9a4b3d7e9a3a2d86 in_seq=0 out_seq=0 2024-05-21T01:21:31.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.188+0000 7f5386000640 10 client.4875 ms_handle_connect on v2:172.21.15.63:6834/2892727989 2024-05-21T01:21:31.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.188+0000 7f5386000640 1 -- 172.21.15.63:0/603017037 <== mds.0 v2:172.21.15.63:6834/2892727989 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x557eb6f8c7f0 con 0x557eb71ed370 2024-05-21T01:21:31.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.188+0000 7f5386000640 10 client.4875 handle_command_reply: tid=0 2024-05-21T01:21:31.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.188+0000 7f53aae1f000 1 client.4875 shutdown 2024-05-21T01:21:31.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.188+0000 7f53aae1f000 1 -- 172.21.15.63:0/603017037 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557eb71e1130 msgr2=0x557eb71a97c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:21:31.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.188+0000 7f53aae1f000 1 --2- 172.21.15.63:0/603017037 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557eb71e1130 0x557eb71a97c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f538c00e870 tx=0x7f538c05c420 comp rx=0 tx=0).stop 2024-05-21T01:21:31.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.188+0000 7f53aae1f000 1 -- 172.21.15.63:0/603017037 shutdown_connections 2024-05-21T01:21:31.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.188+0000 7f53aae1f000 1 --2- 172.21.15.63:0/603017037 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x557eb71ed370 0x557eb71ed780 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:21:31.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.188+0000 7f53aae1f000 1 --2- 172.21.15.63:0/603017037 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557eb71e6100 0x557eb71ec960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:21:31.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.188+0000 7f53aae1f000 1 --2- 172.21.15.63:0/603017037 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557eb71e1130 0x557eb71a97c0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:21:31.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.188+0000 7f5386000640 0 client.4875 ms_handle_reset on v2:172.21.15.63:6834/2892727989 2024-05-21T01:21:31.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.188+0000 7f53aae1f000 1 --2- 172.21.15.63:0/603017037 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557eb71ab100 0x557eb71a9280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:21:31.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.188+0000 7f53aae1f000 1 -- 172.21.15.63:0/603017037 >> 172.21.15.63:0/603017037 conn(0x557eb708cd80 msgr2=0x557eb71aa330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:21:31.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.188+0000 7f53aae1f000 1 -- 172.21.15.63:0/603017037 shutdown_connections 2024-05-21T01:21:31.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.188+0000 7f53aae1f000 1 -- 172.21.15.63:0/603017037 wait complete. 2024-05-21T01:21:31.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.188+0000 7f53aae1f000 20 client.4875 trim_cache size 0 max 16384 2024-05-21T01:21:31.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.208+0000 7f53aae1f000 1 Processor -- start 2024-05-21T01:21:31.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.208+0000 7f53aae1f000 1 -- start start 2024-05-21T01:21:31.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.208+0000 7f53aae1f000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557eb71ab100 0x557eb71ec950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:21:31.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.208+0000 7f53aae1f000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557eb71e1130 0x557eb71ee790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:21:31.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.208+0000 7f53aae1f000 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557eb71e6100 0x557eb71eecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:21:31.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.208+0000 7f53aae1f000 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f53a0201940 con 0x557eb71e6100 2024-05-21T01:21:31.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.208+0000 7f53aae1f000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f53a01f92e0 con 0x557eb71e1130 2024-05-21T01:21:31.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.208+0000 7f53aae1f000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f53a0140480 con 0x557eb71ab100 2024-05-21T01:21:31.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.208+0000 7f53a5a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557eb71e6100 0x557eb71eecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:21:31.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.208+0000 7f53a5a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557eb71e6100 0x557eb71eecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33212/0 (socket says 172.21.15.63:33212) 2024-05-21T01:21:31.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.208+0000 7f53a5a00640 1 -- 172.21.15.63:0/4194045797 learned_addr learned my addr 172.21.15.63:0/4194045797 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:21:31.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.208+0000 7f539fe00640 1 --2- 172.21.15.63:0/4194045797 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557eb71e1130 0x557eb71ee790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:21:31.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.208+0000 7f53a5000640 1 --2- 172.21.15.63:0/4194045797 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557eb71ab100 0x557eb71ec950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:21:31.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.208+0000 7f53a5a00640 1 -- 172.21.15.63:0/4194045797 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557eb71ab100 msgr2=0x557eb71ec950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:21:31.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.208+0000 7f53a5a00640 1 --2- 172.21.15.63:0/4194045797 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557eb71ab100 0x557eb71ec950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:21:31.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.208+0000 7f53a5a00640 1 -- 172.21.15.63:0/4194045797 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557eb71e1130 msgr2=0x557eb71ee790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:21:31.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.208+0000 7f53a5a00640 1 --2- 172.21.15.63:0/4194045797 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557eb71e1130 0x557eb71ee790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:21:31.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.208+0000 7f53a5a00640 1 -- 172.21.15.63:0/4194045797 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557eb704cda0 con 0x557eb71e6100 2024-05-21T01:21:31.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.208+0000 7f53a5a00640 1 --2- 172.21.15.63:0/4194045797 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557eb71e6100 0x557eb71eecd0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f539801a620 tx=0x7f53980a7070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da731bc00c7cb610 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:21:31.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.208+0000 7f5390c00640 1 -- 172.21.15.63:0/4194045797 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53980a56c0 con 0x557eb71e6100 2024-05-21T01:21:31.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.208+0000 7f5390c00640 1 -- 172.21.15.63:0/4194045797 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53980c6070 con 0x557eb71e6100 2024-05-21T01:21:31.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.208+0000 7f5390c00640 1 -- 172.21.15.63:0/4194045797 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53980a5a80 con 0x557eb71e6100 2024-05-21T01:21:31.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.212+0000 7f53aae1f000 1 -- 172.21.15.63:0/4194045797 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557eb71e6100 msgr2=0x557eb71eecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:21:31.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.212+0000 7f53aae1f000 1 --2- 172.21.15.63:0/4194045797 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557eb71e6100 0x557eb71eecd0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f539801a620 tx=0x7f53980a7070 comp rx=0 tx=0).stop 2024-05-21T01:21:31.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.212+0000 7f53aae1f000 1 -- 172.21.15.63:0/4194045797 shutdown_connections 2024-05-21T01:21:31.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.212+0000 7f53aae1f000 1 --2- 172.21.15.63:0/4194045797 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557eb71e6100 0x557eb71eecd0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:21:31.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.212+0000 7f53aae1f000 1 --2- 172.21.15.63:0/4194045797 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557eb71e1130 0x557eb71ee790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:21:31.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.212+0000 7f53aae1f000 1 --2- 172.21.15.63:0/4194045797 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557eb71ab100 0x557eb71ec950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:21:31.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.212+0000 7f53aae1f000 1 -- 172.21.15.63:0/4194045797 >> 172.21.15.63:0/4194045797 conn(0x557eb708cd80 msgr2=0x557eb71df970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:21:31.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.212+0000 7f53aae1f000 1 -- 172.21.15.63:0/4194045797 shutdown_connections 2024-05-21T01:21:31.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.212+0000 7f53aae1f000 1 -- 172.21.15.63:0/4194045797 wait complete. 2024-05-21T01:21:31.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.212+0000 7f53aae1f000 1 -- start start 2024-05-21T01:21:31.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.212+0000 7f53aae1f000 1 Processor -- start 2024-05-21T01:21:31.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.212+0000 7f53aae1f000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557eb71ab100 0x557eb71e8c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:21:31.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.212+0000 7f53aae1f000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557eb71e1130 0x557eb71e91c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:21:31.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.212+0000 7f53aae1f000 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557eb71e6100 0x557eb71e9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:21:31.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.212+0000 7f53aae1f000 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x557eb6fec0e0 con 0x557eb71e6100 2024-05-21T01:21:31.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.212+0000 7f53aae1f000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x557eb7075400 con 0x557eb71e1130 2024-05-21T01:21:31.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.212+0000 7f53aae1f000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x557eb6f893e0 con 0x557eb71ab100 2024-05-21T01:21:31.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.212+0000 7f53aae1f000 10 client.0 _ll_register_callbacks cb 0x7f538c05bcc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-21T01:21:31.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.212+0000 7f53a5a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557eb71e6100 0x557eb71e9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:21:31.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.212+0000 7f53a5a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557eb71e6100 0x557eb71e9700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33218/0 (socket says 172.21.15.63:33218) 2024-05-21T01:21:31.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.212+0000 7f53a5a00640 1 -- 172.21.15.63:0/3646571854 learned_addr learned my addr 172.21.15.63:0/3646571854 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:21:31.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.212+0000 7f539fe00640 1 --2- 172.21.15.63:0/3646571854 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557eb71e1130 0x557eb71e91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:21:31.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.212+0000 7f53a5000640 1 --2- 172.21.15.63:0/3646571854 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557eb71ab100 0x557eb71e8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:21:31.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.212+0000 7f53a5a00640 1 -- 172.21.15.63:0/3646571854 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557eb71ab100 msgr2=0x557eb71e8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:21:31.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.212+0000 7f53a5a00640 1 --2- 172.21.15.63:0/3646571854 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557eb71ab100 0x557eb71e8c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:21:31.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.212+0000 7f53a5a00640 1 -- 172.21.15.63:0/3646571854 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557eb71e1130 msgr2=0x557eb71e91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:21:31.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.212+0000 7f53a5a00640 1 --2- 172.21.15.63:0/3646571854 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557eb71e1130 0x557eb71e91c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:21:31.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.212+0000 7f53a5a00640 1 -- 172.21.15.63:0/3646571854 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557eb6f84f40 con 0x557eb71e6100 2024-05-21T01:21:31.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.212+0000 7f53a5a00640 1 --2- 172.21.15.63:0/3646571854 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557eb71e6100 0x557eb71e9700 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f539801c460 tx=0x7f539801b230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=520654bf7333d897 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:21:31.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.212+0000 7f5386000640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-05-21T01:21:31.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.212+0000 7f5386000640 1 -- 172.21.15.63:0/3646571854 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53980ce030 con 0x557eb71e6100 2024-05-21T01:21:31.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.212+0000 7f5386000640 1 -- 172.21.15.63:0/3646571854 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f53980091d0 con 0x557eb71e6100 2024-05-21T01:21:31.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.212+0000 7f53aae1f000 1 -- 172.21.15.63:0/3646571854 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f53980c6070 con 0x557eb71e6100 2024-05-21T01:21:31.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.212+0000 7f5386000640 1 -- 172.21.15.63:0/3646571854 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f53980da050 con 0x557eb71e6100 2024-05-21T01:21:31.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.212+0000 7f53aae1f000 10 client.4881 fetch_fsmap learned FSMap version 15 2024-05-21T01:21:31.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.212+0000 7f53aae1f000 1 -- 172.21.15.63:0/3646571854 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x557eb6f97f80 con 0x557eb71e6100 2024-05-21T01:21:31.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.212+0000 7f5386000640 1 -- 172.21.15.63:0/3646571854 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53980c6070 con 0x557eb71e6100 2024-05-21T01:21:31.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.216+0000 7f5386000640 1 -- 172.21.15.63:0/3646571854 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 15) ==== 4752+0+0 (secure 0 0 0) 0x7f53980dd020 con 0x557eb71e6100 2024-05-21T01:21:31.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.216+0000 7f53aae1f000 10 client.4881 fetch_fsmap finished waiting for FSMap version 15 2024-05-21T01:21:31.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.216+0000 7f53aae1f000 10 client.4881 resolve_mds: validated gid 4276 aka daemon mds.c 2024-05-21T01:21:31.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.216+0000 7f53aae1f000 20 client.4881 populate_metadata read hostname 'smithi063' 2024-05-21T01:21:31.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.216+0000 7f53aae1f000 1 --2- 172.21.15.63:0/3646571854 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x557eb7265200 0x557eb72675f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:21:31.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.216+0000 7f53aae1f000 4 client.4881 mds_command: new command op to 4276 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}] 2024-05-21T01:21:31.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.216+0000 7f53aae1f000 1 -- 172.21.15.63:0/3646571854 --> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}) -- 0x557eb6fcde60 con 0x557eb7265200 2024-05-21T01:21:31.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.216+0000 7f53a5000640 1 --2- 172.21.15.63:0/3646571854 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x557eb7265200 0x557eb72675f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:21:31.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.216+0000 7f53a5000640 1 --2- 172.21.15.63:0/3646571854 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x557eb7265200 0x557eb72675f0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1921e79c9d52a5d1 server_cookie=e55bec6dd6921d8d in_seq=0 out_seq=0 2024-05-21T01:21:31.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.216+0000 7f5386000640 10 client.4881 ms_handle_connect on v2:172.21.15.63:6834/2892727989 2024-05-21T01:21:31.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.216+0000 7f5386000640 1 -- 172.21.15.63:0/3646571854 <== mds.0 v2:172.21.15.63:6834/2892727989 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x557eb6fcde60 con 0x557eb7265200 2024-05-21T01:21:31.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.216+0000 7f5386000640 10 client.4881 handle_command_reply: tid=0 2024-05-21T01:21:31.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.216+0000 7f53aae1f000 1 client.4881 shutdown 2024-05-21T01:21:31.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.220+0000 7f53aae1f000 1 -- 172.21.15.63:0/3646571854 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557eb71e6100 msgr2=0x557eb71e9700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:21:31.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.220+0000 7f53aae1f000 1 --2- 172.21.15.63:0/3646571854 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557eb71e6100 0x557eb71e9700 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f539801c460 tx=0x7f539801b230 comp rx=0 tx=0).stop 2024-05-21T01:21:31.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.220+0000 7f53aae1f000 1 -- 172.21.15.63:0/3646571854 shutdown_connections 2024-05-21T01:21:31.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.220+0000 7f53aae1f000 1 --2- 172.21.15.63:0/3646571854 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x557eb7265200 0x557eb72675f0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:21:31.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.220+0000 7f53aae1f000 1 --2- 172.21.15.63:0/3646571854 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x557eb71e6100 0x557eb71e9700 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:21:31.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.220+0000 7f53aae1f000 1 --2- 172.21.15.63:0/3646571854 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557eb71e1130 0x557eb71e91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:21:31.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.220+0000 7f5386000640 0 client.4881 ms_handle_reset on v2:172.21.15.63:6834/2892727989 2024-05-21T01:21:31.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.220+0000 7f53aae1f000 1 --2- 172.21.15.63:0/3646571854 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x557eb71ab100 0x557eb71e8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:21:31.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.220+0000 7f53aae1f000 1 -- 172.21.15.63:0/3646571854 >> 172.21.15.63:0/3646571854 conn(0x557eb708cd80 msgr2=0x557eb71e0200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:21:31.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.220+0000 7f53aae1f000 1 -- 172.21.15.63:0/3646571854 shutdown_connections 2024-05-21T01:21:31.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.220+0000 7f53aae1f000 1 -- 172.21.15.63:0/3646571854 wait complete. 2024-05-21T01:21:31.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.220+0000 7f53aae1f000 20 client.4881 trim_cache size 0 max 16384 2024-05-21T01:21:31.222 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-05-21T01:21:31.222 INFO:teuthology.orchestra.run.smithi063.stdout: "epoch": 15, 2024-05-21T01:21:31.222 INFO:teuthology.orchestra.run.smithi063.stdout: "leader": 4276, 2024-05-21T01:21:31.222 INFO:teuthology.orchestra.run.smithi063.stdout: "set_version": 6, 2024-05-21T01:21:31.222 INFO:teuthology.orchestra.run.smithi063.stdout: "sets": { 2024-05-21T01:21:31.222 INFO:teuthology.orchestra.run.smithi063.stdout: "6603b2e4": { 2024-05-21T01:21:31.222 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 6, 2024-05-21T01:21:31.222 INFO:teuthology.orchestra.run.smithi063.stdout: "age_ref": 0.0, 2024-05-21T01:21:31.222 INFO:teuthology.orchestra.run.smithi063.stdout: "state": { 2024-05-21T01:21:31.222 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "QUIESCED", 2024-05-21T01:21:31.223 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 0.0 2024-05-21T01:21:31.223 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-05-21T01:21:31.223 INFO:teuthology.orchestra.run.smithi063.stdout: "timeout": 90.0, 2024-05-21T01:21:31.223 INFO:teuthology.orchestra.run.smithi063.stdout: "expiration": 150.0, 2024-05-21T01:21:31.223 INFO:teuthology.orchestra.run.smithi063.stdout: "members": { 2024-05-21T01:21:31.223 INFO:teuthology.orchestra.run.smithi063.stdout: "file:/": { 2024-05-21T01:21:31.223 INFO:teuthology.orchestra.run.smithi063.stdout: "excluded": false, 2024-05-21T01:21:31.223 INFO:teuthology.orchestra.run.smithi063.stdout: "state": { 2024-05-21T01:21:31.223 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "QUIESCED", 2024-05-21T01:21:31.223 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 0.0 2024-05-21T01:21:31.223 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-05-21T01:21:31.223 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-05-21T01:21:31.224 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-05-21T01:21:31.224 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-05-21T01:21:31.224 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-05-21T01:21:31.224 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-05-21T01:21:31.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.220+0000 7f53a7a00640 1 -- 172.21.15.63:0/1356809341 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f538006f400 msgr2=0x7f53800718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:21:31.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.220+0000 7f53a7a00640 1 --2- 172.21.15.63:0/1356809341 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f538006f400 0x7f53800718c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5394001910 tx=0x7f5394009040 comp rx=0 tx=0).stop 2024-05-21T01:21:31.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.220+0000 7f53a7a00640 1 -- 172.21.15.63:0/1356809341 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f53a0153c00 msgr2=0x7f53a01458f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:21:31.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.220+0000 7f53a7a00640 1 --2- 172.21.15.63:0/1356809341 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f53a0153c00 0x7f53a01458f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f538c00e8a0 tx=0x7f538c00ed60 comp rx=0 tx=0).stop 2024-05-21T01:21:31.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.220+0000 7f53a7a00640 1 -- 172.21.15.63:0/1356809341 shutdown_connections 2024-05-21T01:21:31.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.220+0000 7f53a7a00640 1 --2- 172.21.15.63:0/1356809341 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f538006f400 0x7f53800718c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:21:31.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.220+0000 7f53a7a00640 1 --2- 172.21.15.63:0/1356809341 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f53a0159bd0 0x7f53a0141230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:21:31.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.220+0000 7f53a7a00640 1 --2- 172.21.15.63:0/1356809341 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f53a0153c00 0x7f53a01458f0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:21:31.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.220+0000 7f53a7a00640 1 --2- 172.21.15.63:0/1356809341 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53a00cb250 0x7f53a006e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:21:31.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.220+0000 7f53a7a00640 1 -- 172.21.15.63:0/1356809341 >> 172.21.15.63:0/1356809341 conn(0x7f53a0068290 msgr2=0x7f53a0158a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:21:31.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.220+0000 7f53a7a00640 1 -- 172.21.15.63:0/1356809341 shutdown_connections 2024-05-21T01:21:31.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:21:31.220+0000 7f53a7a00640 1 -- 172.21.15.63:0/1356809341 wait complete. 2024-05-21T01:21:31.239 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '6603b2e4', quiesce took 0.6 seconds. Will release after: 29.4 2024-05-21T01:21:56.307 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-21T01:21:56.312 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-21T01:22:00.641 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-21T01:22:00.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:00.872+0000 7ff21a800640 1 Processor -- start 2024-05-21T01:22:00.875 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:00.872+0000 7ff21a800640 1 -- start start 2024-05-21T01:22:00.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:00.876+0000 7ff21a800640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff214153ce0 0x7ff214070d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:22:00.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:00.876+0000 7ff21a800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff214159960 0x7ff21415d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:22:00.877 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:00.876+0000 7ff21a800640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff21415ddf0 con 0x7ff2140c9a90 2024-05-21T01:22:00.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:00.876+0000 7ff21a800640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7ff2141540c0 con 0x7ff214153ce0 2024-05-21T01:22:00.878 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:00.876+0000 7ff21a800640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7ff2140c6590 con 0x7ff214159960 2024-05-21T01:22:00.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:00.876+0000 7ff219400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff214153ce0 0x7ff214070d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:22:00.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:00.876+0000 7ff219e00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7ff2140c9a90 0x7ff2140c82a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:56424/0 (socket says 172.21.15.63:56424) 2024-05-21T01:22:00.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:00.876+0000 7ff219e00640 1 -- 172.21.15.63:0/2770806642 learned_addr learned my addr 172.21.15.63:0/2770806642 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-05-21T01:22:00.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:00.876+0000 7ff218a00640 1 --2- 172.21.15.63:0/2770806642 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff214159960 0x7ff21415d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:22:00.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:00.876+0000 7ff213e00640 1 -- 172.21.15.63:0/2770806642 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 153067664 0 0) 0x7ff21415ddf0 con 0x7ff2140c9a90 2024-05-21T01:22:00.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:00.876+0000 7ff213e00640 1 -- 172.21.15.63:0/2770806642 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff1fc003530 con 0x7ff2140c9a90 2024-05-21T01:22:00.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:00.876+0000 7ff219400640 1 -- 172.21.15.63:0/2770806642 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff214159960 msgr2=0x7ff21415d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:22:00.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:00.876+0000 7ff219400640 1 --2- 172.21.15.63:0/2770806642 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff214159960 0x7ff21415d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:22:00.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:00.876+0000 7ff219400640 1 -- 172.21.15.63:0/2770806642 >> v1:172.21.15.63:6789/0 conn(0x7ff2140c9a90 legacy=0x7ff2140c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:22:00.879 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:00.876+0000 7ff219400640 1 -- 172.21.15.63:0/2770806642 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff21415d0d0 con 0x7ff214153ce0 2024-05-21T01:22:00.883 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:00.880+0000 7ff219400640 1 --2- 172.21.15.63:0/2770806642 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff214153ce0 0x7ff214070d60 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff2080097c0 tx=0x7ff20801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf751d6665e9586b server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:22:00.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:00.880+0000 7ff213e00640 1 -- 172.21.15.63:0/2770806642 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2080b0070 con 0x7ff214153ce0 2024-05-21T01:22:00.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:00.880+0000 7ff213e00640 1 -- 172.21.15.63:0/2770806642 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2080ab600 con 0x7ff214153ce0 2024-05-21T01:22:00.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:00.880+0000 7ff213e00640 1 -- 172.21.15.63:0/2770806642 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2080ab9b0 con 0x7ff214153ce0 2024-05-21T01:22:00.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:00.884+0000 7ff21a800640 1 -- 172.21.15.63:0/2770806642 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff214153ce0 msgr2=0x7ff214070d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:22:00.884 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:00.884+0000 7ff21a800640 1 --2- 172.21.15.63:0/2770806642 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff214153ce0 0x7ff214070d60 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff2080097c0 tx=0x7ff20801c4a0 comp rx=0 tx=0).stop 2024-05-21T01:22:00.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:00.884+0000 7ff21a800640 1 -- 172.21.15.63:0/2770806642 shutdown_connections 2024-05-21T01:22:00.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:00.884+0000 7ff21a800640 1 --2- 172.21.15.63:0/2770806642 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff214159960 0x7ff21415d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:22:00.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:00.884+0000 7ff21a800640 1 --2- 172.21.15.63:0/2770806642 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff214153ce0 0x7ff214070d60 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:22:00.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:00.884+0000 7ff21a800640 1 -- 172.21.15.63:0/2770806642 >> 172.21.15.63:0/2770806642 conn(0x7ff21406caa0 msgr2=0x7ff214068290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:22:00.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:00.884+0000 7ff21a800640 1 -- 172.21.15.63:0/2770806642 shutdown_connections 2024-05-21T01:22:00.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:00.884+0000 7ff21a800640 1 -- 172.21.15.63:0/2770806642 wait complete. 2024-05-21T01:22:00.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:00.884+0000 7ff21a800640 1 Processor -- start 2024-05-21T01:22:00.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:00.884+0000 7ff21a800640 1 -- start start 2024-05-21T01:22:00.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:00.888+0000 7ff21a800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2140c9a90 0x7ff214143ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:22:00.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:00.888+0000 7ff21a800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff214153ce0 0x7ff2141464b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:22:00.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:00.888+0000 7ff21a800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff214159960 0x7ff2141469f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:22:00.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:00.888+0000 7ff21a800640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff2140c6da0 con 0x7ff2140c9a90 2024-05-21T01:22:00.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:00.888+0000 7ff21a800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7ff2140712a0 con 0x7ff214159960 2024-05-21T01:22:00.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:00.888+0000 7ff21a800640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7ff2140c89b0 con 0x7ff214153ce0 2024-05-21T01:22:00.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:00.888+0000 7ff219400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2140c9a90 0x7ff214143ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:22:00.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:00.888+0000 7ff219400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2140c9a90 0x7ff214143ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47726/0 (socket says 172.21.15.63:47726) 2024-05-21T01:22:00.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:00.888+0000 7ff219400640 1 -- 172.21.15.63:0/4107051459 learned_addr learned my addr 172.21.15.63:0/4107051459 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:22:00.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:00.888+0000 7ff218a00640 1 --2- 172.21.15.63:0/4107051459 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff214153ce0 0x7ff2141464b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:22:00.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:00.888+0000 7ff219e00640 1 --2- 172.21.15.63:0/4107051459 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff214159960 0x7ff2141469f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:22:00.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:00.888+0000 7ff219400640 1 -- 172.21.15.63:0/4107051459 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff214153ce0 msgr2=0x7ff2141464b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:22:00.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:00.888+0000 7ff219400640 1 --2- 172.21.15.63:0/4107051459 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff214153ce0 0x7ff2141464b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:22:00.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:00.888+0000 7ff219400640 1 -- 172.21.15.63:0/4107051459 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff214159960 msgr2=0x7ff2141469f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:22:00.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:00.888+0000 7ff219400640 1 --2- 172.21.15.63:0/4107051459 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff214159960 0x7ff2141469f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:22:00.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:00.888+0000 7ff219400640 1 -- 172.21.15.63:0/4107051459 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff214145d20 con 0x7ff2140c9a90 2024-05-21T01:22:00.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:00.888+0000 7ff219400640 1 --2- 172.21.15.63:0/4107051459 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2140c9a90 0x7ff214143ea0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff208000c10 tx=0x7ff208019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:22:00.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:00.888+0000 7ff211600640 1 -- 172.21.15.63:0/4107051459 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2080b0040 con 0x7ff2140c9a90 2024-05-21T01:22:00.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:00.888+0000 7ff211600640 1 -- 172.21.15.63:0/4107051459 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2080bb070 con 0x7ff2140c9a90 2024-05-21T01:22:00.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:00.888+0000 7ff211600640 1 -- 172.21.15.63:0/4107051459 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff208006e20 con 0x7ff2140c9a90 2024-05-21T01:22:00.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:00.888+0000 7ff21a800640 1 -- 172.21.15.63:0/4107051459 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2141f3790 con 0x7ff2140c9a90 2024-05-21T01:22:00.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:00.888+0000 7ff21a800640 1 -- 172.21.15.63:0/4107051459 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2141f3a30 con 0x7ff2140c9a90 2024-05-21T01:22:00.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:00.892+0000 7ff21a800640 1 -- 172.21.15.63:0/4107051459 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff21406c0c0 con 0x7ff2140c9a90 2024-05-21T01:22:00.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:00.892+0000 7ff211600640 1 -- 172.21.15.63:0/4107051459 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7ff2080b3070 con 0x7ff2140c9a90 2024-05-21T01:22:00.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:00.896+0000 7ff211600640 1 --2- 172.21.15.63:0/4107051459 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7ff1f406f430 0x7ff1f40718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:22:00.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:00.896+0000 7ff211600640 1 -- 172.21.15.63:0/4107051459 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7ff208129c80 con 0x7ff2140c9a90 2024-05-21T01:22:00.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:00.896+0000 7ff218a00640 1 --2- 172.21.15.63:0/4107051459 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7ff1f406f430 0x7ff1f40718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:22:00.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:00.896+0000 7ff218a00640 1 --2- 172.21.15.63:0/4107051459 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7ff1f406f430 0x7ff1f40718f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff2140ca220 tx=0x7ff200009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:22:00.903 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:00.900+0000 7ff211600640 1 -- 172.21.15.63:0/4107051459 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7ff208016090 con 0x7ff2140c9a90 2024-05-21T01:22:01.309 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.308+0000 7ff21a800640 1 -- 172.21.15.63:0/4107051459 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff214157310 con 0x7ff2140c9a90 2024-05-21T01:22:01.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.308+0000 7ff211600640 1 -- 172.21.15.63:0/4107051459 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+6876 (secure 0 0 0) 0x7ff2080f6220 con 0x7ff2140c9a90 2024-05-21T01:22:01.310 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-05-21T01:22:01.311 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6839/3045714273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6837","nonce":3045714273},{"type":"v1","addr":"172.21.15.131:6839","nonce":3045714273}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/2978367338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":2978367338},{"type":"v1","addr":"172.21.15.131:6835","nonce":2978367338}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/3005995321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6835","nonce":3005995321},{"type":"v1","addr":"172.21.15.63:6837","nonce":3005995321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-21T01:19:53.915775+0000","modified":"2024-05-21T01:20:31.724475+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4276,"mds_1":4270,"mds_2":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"e","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.63:6833/574189772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":574189772},{"type":"v1","addr":"172.21.15.63:6833","nonce":574189772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4270":{"gid":4270,"name":"f","rank":1,"incarnation":10,"state":"up:active","state_seq":11,"addr":"172.21.15.131:6838/3071941741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":3071941741},{"type":"v1","addr":"172.21.15.131:6838","nonce":3071941741}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.63:6836/2892727989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":2892727989},{"type":"v1","addr":"172.21.15.63:6836","nonce":2892727989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4276,"qdb_cluster":[4267,4270,4276]},"id":1}]} 2024-05-21T01:22:01.311 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 15 2024-05-21T01:22:01.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.312+0000 7ff21a800640 1 -- 172.21.15.63:0/4107051459 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7ff1f406f430 msgr2=0x7ff1f40718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:22:01.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.312+0000 7ff21a800640 1 --2- 172.21.15.63:0/4107051459 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7ff1f406f430 0x7ff1f40718f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff2140ca220 tx=0x7ff200009190 comp rx=0 tx=0).stop 2024-05-21T01:22:01.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.312+0000 7ff21a800640 1 -- 172.21.15.63:0/4107051459 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2140c9a90 msgr2=0x7ff214143ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:22:01.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.312+0000 7ff21a800640 1 --2- 172.21.15.63:0/4107051459 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2140c9a90 0x7ff214143ea0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff208000c10 tx=0x7ff208019240 comp rx=0 tx=0).stop 2024-05-21T01:22:01.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.312+0000 7ff21a800640 1 -- 172.21.15.63:0/4107051459 shutdown_connections 2024-05-21T01:22:01.313 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.312+0000 7ff21a800640 1 --2- 172.21.15.63:0/4107051459 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7ff1f406f430 0x7ff1f40718f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:22:01.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.312+0000 7ff21a800640 1 --2- 172.21.15.63:0/4107051459 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff214159960 0x7ff2141469f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:22:01.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.312+0000 7ff21a800640 1 --2- 172.21.15.63:0/4107051459 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff214153ce0 0x7ff2141464b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:22:01.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.312+0000 7ff21a800640 1 --2- 172.21.15.63:0/4107051459 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff2140c9a90 0x7ff214143ea0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:22:01.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.312+0000 7ff21a800640 1 -- 172.21.15.63:0/4107051459 >> 172.21.15.63:0/4107051459 conn(0x7ff21406caa0 msgr2=0x7ff214152590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:22:01.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.312+0000 7ff21a800640 1 -- 172.21.15.63:0/4107051459 shutdown_connections 2024-05-21T01:22:01.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.312+0000 7ff21a800640 1 -- 172.21.15.63:0/4107051459 wait complete. 2024-05-21T01:22:01.343 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4276 quiesce db --set-id 6603b2e4 --release --await' 2024-05-21T01:22:01.343 DEBUG:teuthology.orchestra.run.smithi063:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4276 quiesce db --set-id 6603b2e4 --release --await 2024-05-21T01:22:01.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.588+0000 7effda000640 1 Processor -- start 2024-05-21T01:22:01.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.592+0000 7effda000640 1 -- start start 2024-05-21T01:22:01.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.592+0000 7effda000640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7effd4155ea0 0x7effd415c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:22:01.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.592+0000 7effda000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7effd40c9ec0 0x7effd40ca350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:22:01.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.592+0000 7effda000640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effd4156280 con 0x7effd40cb810 2024-05-21T01:22:01.594 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.592+0000 7effda000640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7effd406d830 con 0x7effd4155ea0 2024-05-21T01:22:01.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.592+0000 7effda000640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7effd40c8bf0 con 0x7effd40c9ec0 2024-05-21T01:22:01.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.592+0000 7effd8c00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7effd4155ea0 0x7effd415c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:22:01.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.592+0000 7effd8c00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7effd4155ea0 0x7effd415c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47732/0 (socket says 172.21.15.63:47732) 2024-05-21T01:22:01.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.592+0000 7effd8c00640 1 -- 172.21.15.63:0/197945588 learned_addr learned my addr 172.21.15.63:0/197945588 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:22:01.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.592+0000 7effd9600640 1 --2- 172.21.15.63:0/197945588 >> v2:172.21.15.131:3300/0 conn(0x7effd40c9ec0 0x7effd40ca350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:22:01.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.592+0000 7effd8c00640 1 -- 172.21.15.63:0/197945588 >> v2:172.21.15.131:3300/0 conn(0x7effd40c9ec0 msgr2=0x7effd40ca350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:22:01.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.592+0000 7effd8c00640 1 --2- 172.21.15.63:0/197945588 >> v2:172.21.15.131:3300/0 conn(0x7effd40c9ec0 0x7effd40ca350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:22:01.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.592+0000 7effd8c00640 1 -- 172.21.15.63:0/197945588 >> v1:172.21.15.63:6789/0 conn(0x7effd40cb810 legacy=0x7effd406d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:22:01.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.592+0000 7effd8c00640 1 -- 172.21.15.63:0/197945588 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effd40c8ed0 con 0x7effd4155ea0 2024-05-21T01:22:01.600 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.600+0000 7effd8c00640 1 --2- 172.21.15.63:0/197945588 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effd4155ea0 0x7effd415c5a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7effd415cc60 tx=0x7effc801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e71994cbe48d2628 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:22:01.600 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.600+0000 7effd3400640 1 -- 172.21.15.63:0/197945588 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effc80b0070 con 0x7effd4155ea0 2024-05-21T01:22:01.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.600+0000 7effd3400640 1 -- 172.21.15.63:0/197945588 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effc80ab600 con 0x7effd4155ea0 2024-05-21T01:22:01.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.600+0000 7effd3400640 1 -- 172.21.15.63:0/197945588 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effc80ab9d0 con 0x7effd4155ea0 2024-05-21T01:22:01.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.600+0000 7effda000640 1 -- 172.21.15.63:0/197945588 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effd4155ea0 msgr2=0x7effd415c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:22:01.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.600+0000 7effda000640 1 --2- 172.21.15.63:0/197945588 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effd4155ea0 0x7effd415c5a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7effd415cc60 tx=0x7effc801c520 comp rx=0 tx=0).stop 2024-05-21T01:22:01.601 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.600+0000 7effda000640 1 -- 172.21.15.63:0/197945588 shutdown_connections 2024-05-21T01:22:01.602 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.600+0000 7effda000640 1 --2- 172.21.15.63:0/197945588 >> v2:172.21.15.131:3300/0 conn(0x7effd40c9ec0 0x7effd40ca350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:22:01.602 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.600+0000 7effda000640 1 --2- 172.21.15.63:0/197945588 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effd4155ea0 0x7effd415c5a0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:22:01.602 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.600+0000 7effda000640 1 -- 172.21.15.63:0/197945588 >> 172.21.15.63:0/197945588 conn(0x7effd40cacf0 msgr2=0x7effd40cb100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:22:01.602 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.600+0000 7effda000640 1 -- 172.21.15.63:0/197945588 shutdown_connections 2024-05-21T01:22:01.602 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.600+0000 7effda000640 1 -- 172.21.15.63:0/197945588 wait complete. 2024-05-21T01:22:01.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.604+0000 7effda000640 1 Processor -- start 2024-05-21T01:22:01.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.604+0000 7effda000640 1 -- start start 2024-05-21T01:22:01.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.604+0000 7effda000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7effd40c9ec0 0x7effd415bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:22:01.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.604+0000 7effda000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7effd40cb810 0x7effd4146d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:22:01.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.604+0000 7effda000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effd4155ea0 0x7effd4147250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:22:01.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.604+0000 7effda000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7effd40723e0 con 0x7effd4155ea0 2024-05-21T01:22:01.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.604+0000 7effda000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7effd4072260 con 0x7effd40cb810 2024-05-21T01:22:01.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.604+0000 7effda000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7effd4168c30 con 0x7effd40c9ec0 2024-05-21T01:22:01.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.604+0000 7effd9600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effd4155ea0 0x7effd4147250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:22:01.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.604+0000 7effd8c00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7effd40c9ec0 0x7effd415bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:22:01.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.604+0000 7effd9600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effd4155ea0 0x7effd4147250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47748/0 (socket says 172.21.15.63:47748) 2024-05-21T01:22:01.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.604+0000 7effd9600640 1 -- 172.21.15.63:0/2618535893 learned_addr learned my addr 172.21.15.63:0/2618535893 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:22:01.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.604+0000 7effd3e00640 1 --2- 172.21.15.63:0/2618535893 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7effd40cb810 0x7effd4146d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:22:01.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.604+0000 7effd9600640 1 -- 172.21.15.63:0/2618535893 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7effd40c9ec0 msgr2=0x7effd415bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:22:01.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.604+0000 7effd9600640 1 --2- 172.21.15.63:0/2618535893 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7effd40c9ec0 0x7effd415bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:22:01.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.604+0000 7effd9600640 1 -- 172.21.15.63:0/2618535893 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7effd40cb810 msgr2=0x7effd4146d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:22:01.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.604+0000 7effd9600640 1 --2- 172.21.15.63:0/2618535893 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7effd40cb810 0x7effd4146d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:22:01.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.604+0000 7effd9600640 1 -- 172.21.15.63:0/2618535893 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effd4148e30 con 0x7effd4155ea0 2024-05-21T01:22:01.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.604+0000 7effd9600640 1 --2- 172.21.15.63:0/2618535893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effd4155ea0 0x7effd4147250 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7effcc00efc0 tx=0x7effcc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:22:01.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.604+0000 7effd0c00640 1 -- 172.21.15.63:0/2618535893 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effcc018020 con 0x7effd4155ea0 2024-05-21T01:22:01.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.608+0000 7effd0c00640 1 -- 172.21.15.63:0/2618535893 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effcc014480 con 0x7effd4155ea0 2024-05-21T01:22:01.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.608+0000 7effd0c00640 1 -- 172.21.15.63:0/2618535893 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effcc014870 con 0x7effd4155ea0 2024-05-21T01:22:01.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.608+0000 7effda000640 1 -- 172.21.15.63:0/2618535893 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effd4149110 con 0x7effd4155ea0 2024-05-21T01:22:01.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.608+0000 7effda000640 1 -- 172.21.15.63:0/2618535893 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effd415c880 con 0x7effd4155ea0 2024-05-21T01:22:01.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.612+0000 7effd0c00640 1 -- 172.21.15.63:0/2618535893 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7effcc01b020 con 0x7effd4155ea0 2024-05-21T01:22:01.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.612+0000 7effdeaee000 1 Processor -- start 2024-05-21T01:22:01.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.612+0000 7effdeaee000 1 -- start start 2024-05-21T01:22:01.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.612+0000 7effd0c00640 1 --2- 172.21.15.63:0/2618535893 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7effb406f400 0x7effb40718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:22:01.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.612+0000 7effd0c00640 1 -- 172.21.15.63:0/2618535893 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7effcc08fff0 con 0x7effd4155ea0 2024-05-21T01:22:01.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.612+0000 7effd3e00640 1 --2- 172.21.15.63:0/2618535893 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7effb406f400 0x7effb40718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:22:01.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.612+0000 7effdeaee000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556a151beb90 0x556a15188390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:22:01.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.612+0000 7effdeaee000 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x556a151888d0 0x556a151c3620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:22:01.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.612+0000 7effdeaee000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556a151c3b60 0x556a151c3f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:22:01.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.612+0000 7effdeaee000 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x556a14fdd8a0 con 0x556a151888d0 2024-05-21T01:22:01.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.612+0000 7effdeaee000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x556a14fcd440 con 0x556a151beb90 2024-05-21T01:22:01.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.612+0000 7effdeaee000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x556a14fd1480 con 0x556a151c3b60 2024-05-21T01:22:01.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.612+0000 7effd8c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556a151beb90 0x556a15188390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:22:01.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.612+0000 7effd3e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x556a151888d0 0x556a151c3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:22:01.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.612+0000 7effd9600640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556a151c3b60 0x556a151c3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:22:01.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.612+0000 7effd8c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556a151beb90 0x556a15188390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.63:59838/0 (socket says 172.21.15.63:59838) 2024-05-21T01:22:01.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.612+0000 7effd8c00640 1 -- 172.21.15.63:0/1791554606 learned_addr learned my addr 172.21.15.63:0/1791554606 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:22:01.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.612+0000 7effd3e00640 1 --2- 172.21.15.63:0/2618535893 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7effb406f400 0x7effb40718c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7effd4147ad0 tx=0x7effc0007e40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:22:01.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.612+0000 7effd3e00640 1 -- 172.21.15.63:0/1791554606 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556a151c3b60 msgr2=0x556a151c3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:22:01.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.612+0000 7effd3e00640 1 --2- 172.21.15.63:0/1791554606 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556a151c3b60 0x556a151c3f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:22:01.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.612+0000 7effd3e00640 1 -- 172.21.15.63:0/1791554606 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556a151beb90 msgr2=0x556a15188390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:22:01.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.612+0000 7effd3e00640 1 --2- 172.21.15.63:0/1791554606 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556a151beb90 0x556a15188390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:22:01.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.612+0000 7effd3e00640 1 -- 172.21.15.63:0/1791554606 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a15079370 con 0x556a151888d0 2024-05-21T01:22:01.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.616+0000 7effd3e00640 1 --2- 172.21.15.63:0/1791554606 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x556a151888d0 0x556a151c3620 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7effd4149cb0 tx=0x7effc001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eab1174c763421d server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:22:01.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.616+0000 7effc5600640 1 -- 172.21.15.63:0/1791554606 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effc0016ad0 con 0x556a151888d0 2024-05-21T01:22:01.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.616+0000 7effc5600640 1 -- 172.21.15.63:0/1791554606 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effc0024070 con 0x556a151888d0 2024-05-21T01:22:01.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.616+0000 7effc5600640 1 -- 172.21.15.63:0/1791554606 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effc001f410 con 0x556a151888d0 2024-05-21T01:22:01.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.616+0000 7effdeaee000 1 -- 172.21.15.63:0/1791554606 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x556a151888d0 msgr2=0x556a151c3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:22:01.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.616+0000 7effdeaee000 1 --2- 172.21.15.63:0/1791554606 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x556a151888d0 0x556a151c3620 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7effd4149cb0 tx=0x7effc001a000 comp rx=0 tx=0).stop 2024-05-21T01:22:01.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.616+0000 7effdeaee000 1 -- 172.21.15.63:0/1791554606 shutdown_connections 2024-05-21T01:22:01.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.616+0000 7effdeaee000 1 --2- 172.21.15.63:0/1791554606 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556a151c3b60 0x556a151c3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:22:01.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.616+0000 7effdeaee000 1 --2- 172.21.15.63:0/1791554606 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x556a151888d0 0x556a151c3620 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:22:01.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.616+0000 7effdeaee000 1 --2- 172.21.15.63:0/1791554606 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556a151beb90 0x556a15188390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:22:01.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.616+0000 7effdeaee000 1 -- 172.21.15.63:0/1791554606 >> 172.21.15.63:0/1791554606 conn(0x556a1506af90 msgr2=0x556a151c13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:22:01.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.616+0000 7effdeaee000 1 -- 172.21.15.63:0/1791554606 shutdown_connections 2024-05-21T01:22:01.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.616+0000 7effdeaee000 1 -- 172.21.15.63:0/1791554606 wait complete. 2024-05-21T01:22:01.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.616+0000 7effdeaee000 1 -- start start 2024-05-21T01:22:01.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.616+0000 7effdeaee000 1 Processor -- start 2024-05-21T01:22:01.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.620+0000 7effdeaee000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556a151888d0 0x556a151bd730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:22:01.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.620+0000 7effdeaee000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556a151beb90 0x556a151bdc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:22:01.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.620+0000 7effdeaee000 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x556a151c3b60 0x556a151c93b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:22:01.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.620+0000 7effdeaee000 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x556a14f76170 con 0x556a151c3b60 2024-05-21T01:22:01.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.620+0000 7effdeaee000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x556a14f744d0 con 0x556a151888d0 2024-05-21T01:22:01.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.620+0000 7effdeaee000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x556a14fd5ab0 con 0x556a151beb90 2024-05-21T01:22:01.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.620+0000 7effdeaee000 10 client.0 _ll_register_callbacks cb 0x556a14f6fee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-21T01:22:01.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.620+0000 7effd8c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556a151888d0 0x556a151bd730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:22:01.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.620+0000 7effd3e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556a151beb90 0x556a151bdc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:22:01.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.620+0000 7effd8c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556a151888d0 0x556a151bd730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.63:59848/0 (socket says 172.21.15.63:59848) 2024-05-21T01:22:01.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.620+0000 7effd8c00640 1 -- 172.21.15.63:0/820975766 learned_addr learned my addr 172.21.15.63:0/820975766 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:22:01.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.620+0000 7effd9600640 1 --2- 172.21.15.63:0/820975766 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x556a151c3b60 0x556a151c93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:22:01.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.620+0000 7effd8c00640 1 -- 172.21.15.63:0/820975766 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556a151beb90 msgr2=0x556a151bdc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:22:01.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.620+0000 7effd8c00640 1 --2- 172.21.15.63:0/820975766 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556a151beb90 0x556a151bdc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:22:01.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.620+0000 7effd8c00640 1 -- 172.21.15.63:0/820975766 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x556a151c3b60 msgr2=0x556a151c93b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:22:01.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.620+0000 7effd8c00640 1 --2- 172.21.15.63:0/820975766 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x556a151c3b60 0x556a151c93b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:22:01.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.620+0000 7effd8c00640 1 -- 172.21.15.63:0/820975766 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a15017260 con 0x556a151888d0 2024-05-21T01:22:01.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.620+0000 7effd8c00640 1 --2- 172.21.15.63:0/820975766 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556a151888d0 0x556a151bd730 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7effc8097df0 tx=0x7effc801ad60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c77c104a2635f080 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:22:01.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.620+0000 7effba000640 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2024-05-21T01:22:01.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.620+0000 7effba000640 1 -- 172.21.15.63:0/820975766 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effc80bb030 con 0x556a151888d0 2024-05-21T01:22:01.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.620+0000 7effba000640 1 -- 172.21.15.63:0/820975766 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7effc80ab6b0 con 0x556a151888d0 2024-05-21T01:22:01.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.620+0000 7effdeaee000 1 -- 172.21.15.63:0/820975766 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7effc0024070 con 0x556a151888d0 2024-05-21T01:22:01.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.620+0000 7effba000640 1 -- 172.21.15.63:0/820975766 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7effc80c7050 con 0x556a151888d0 2024-05-21T01:22:01.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.620+0000 7effdeaee000 10 client.4969 fetch_fsmap learned FSMap version 15 2024-05-21T01:22:01.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.620+0000 7effdeaee000 1 -- 172.21.15.63:0/820975766 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x556a14f746e0 con 0x556a151888d0 2024-05-21T01:22:01.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.620+0000 7effba000640 1 -- 172.21.15.63:0/820975766 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effc0024070 con 0x556a151888d0 2024-05-21T01:22:01.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.624+0000 7effba000640 1 -- 172.21.15.63:0/820975766 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 15) ==== 4752+0+0 (secure 0 0 0) 0x7effc80ca020 con 0x556a151888d0 2024-05-21T01:22:01.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.624+0000 7effdeaee000 10 client.4969 fetch_fsmap finished waiting for FSMap version 15 2024-05-21T01:22:01.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.624+0000 7effdeaee000 10 client.4969 resolve_mds: validated gid 4276 aka daemon mds.c 2024-05-21T01:22:01.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.624+0000 7effdeaee000 20 client.4969 populate_metadata read hostname 'smithi063' 2024-05-21T01:22:01.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.624+0000 7effdeaee000 1 --2- 172.21.15.63:0/820975766 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x556a151ca150 0x556a151ca560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:22:01.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.624+0000 7effdeaee000 4 client.4969 mds_command: new command op to 4276 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-21T01:22:01.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.624+0000 7effdeaee000 1 -- 172.21.15.63:0/820975766 --> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556a14f69060 con 0x556a151ca150 2024-05-21T01:22:01.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.624+0000 7effd3e00640 1 --2- 172.21.15.63:0/820975766 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x556a151ca150 0x556a151ca560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:22:01.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.624+0000 7effd3e00640 1 --2- 172.21.15.63:0/820975766 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x556a151ca150 0x556a151ca560 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a0889d404ff7e65b server_cookie=2f20bad15f0fe8b3 in_seq=0 out_seq=0 2024-05-21T01:22:01.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.624+0000 7effba000640 10 client.4969 ms_handle_connect on v2:172.21.15.63:6834/2892727989 2024-05-21T01:22:01.627 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.624+0000 7effba000640 1 -- 172.21.15.63:0/820975766 <== mds.0 v2:172.21.15.63:6834/2892727989 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x556a14f69060 con 0x556a151ca150 2024-05-21T01:22:01.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.624+0000 7effba000640 10 client.4969 handle_command_reply: tid=0 2024-05-21T01:22:01.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.624+0000 7effdeaee000 1 client.4969 shutdown 2024-05-21T01:22:01.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.624+0000 7effdeaee000 1 -- 172.21.15.63:0/820975766 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556a151888d0 msgr2=0x556a151bd730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:22:01.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.624+0000 7effdeaee000 1 --2- 172.21.15.63:0/820975766 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556a151888d0 0x556a151bd730 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7effc8097df0 tx=0x7effc801ad60 comp rx=0 tx=0).stop 2024-05-21T01:22:01.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.624+0000 7effdeaee000 1 -- 172.21.15.63:0/820975766 shutdown_connections 2024-05-21T01:22:01.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.624+0000 7effdeaee000 1 --2- 172.21.15.63:0/820975766 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x556a151ca150 0x556a151ca560 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:22:01.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.624+0000 7effba000640 0 client.4969 ms_handle_reset on v2:172.21.15.63:6834/2892727989 2024-05-21T01:22:01.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.624+0000 7effdeaee000 1 --2- 172.21.15.63:0/820975766 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x556a151c3b60 0x556a151c93b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:22:01.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.624+0000 7effdeaee000 1 --2- 172.21.15.63:0/820975766 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556a151beb90 0x556a151bdc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:22:01.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.624+0000 7effdeaee000 1 --2- 172.21.15.63:0/820975766 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556a151888d0 0x556a151bd730 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:22:01.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.624+0000 7effdeaee000 1 -- 172.21.15.63:0/820975766 >> 172.21.15.63:0/820975766 conn(0x556a1506af90 msgr2=0x556a15187b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:22:01.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.624+0000 7effdeaee000 1 -- 172.21.15.63:0/820975766 shutdown_connections 2024-05-21T01:22:01.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.624+0000 7effdeaee000 1 -- 172.21.15.63:0/820975766 wait complete. 2024-05-21T01:22:01.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.624+0000 7effdeaee000 20 client.4969 trim_cache size 0 max 16384 2024-05-21T01:22:01.663 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.660+0000 7effdeaee000 1 Processor -- start 2024-05-21T01:22:01.663 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.660+0000 7effdeaee000 1 -- start start 2024-05-21T01:22:01.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.664+0000 7effdeaee000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556a151888d0 0x556a151defc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:22:01.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.664+0000 7effdeaee000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556a151beb90 0x556a151df500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:22:01.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.664+0000 7effdeaee000 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x556a151c3b60 0x556a151cb570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:22:01.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.664+0000 7effdeaee000 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7effd4201870 con 0x556a151c3b60 2024-05-21T01:22:01.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.664+0000 7effdeaee000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7effd41f8df0 con 0x556a151888d0 2024-05-21T01:22:01.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.664+0000 7effdeaee000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7effd4201220 con 0x556a151beb90 2024-05-21T01:22:01.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.664+0000 7effd8c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556a151888d0 0x556a151defc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:22:01.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.664+0000 7effd8c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556a151888d0 0x556a151defc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.63:59858/0 (socket says 172.21.15.63:59858) 2024-05-21T01:22:01.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.664+0000 7effd3e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556a151beb90 0x556a151df500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:22:01.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.664+0000 7effd9600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x556a151c3b60 0x556a151cb570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:22:01.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.664+0000 7effd3e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556a151beb90 0x556a151df500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.63:58804/0 (socket says 172.21.15.63:58804) 2024-05-21T01:22:01.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.664+0000 7effd3e00640 1 -- 172.21.15.63:0/3445142938 learned_addr learned my addr 172.21.15.63:0/3445142938 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:22:01.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.664+0000 7effd3e00640 1 -- 172.21.15.63:0/3445142938 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556a151888d0 msgr2=0x556a151defc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:22:01.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.664+0000 7effd3e00640 1 --2- 172.21.15.63:0/3445142938 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556a151888d0 0x556a151defc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:22:01.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.664+0000 7effd3e00640 1 -- 172.21.15.63:0/3445142938 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x556a151c3b60 msgr2=0x556a151cb570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:22:01.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.664+0000 7effd3e00640 1 --2- 172.21.15.63:0/3445142938 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x556a151c3b60 0x556a151cb570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:22:01.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.664+0000 7effd3e00640 1 -- 172.21.15.63:0/3445142938 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a15052cf0 con 0x556a151beb90 2024-05-21T01:22:01.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.664+0000 7effd8c00640 1 --2- 172.21.15.63:0/3445142938 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556a151888d0 0x556a151defc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-21T01:22:01.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.664+0000 7effd3e00640 1 --2- 172.21.15.63:0/3445142938 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556a151beb90 0x556a151df500 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7effc001a040 tx=0x7effc0009040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c365404bcb2e913d server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:22:01.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.664+0000 7effc4c00640 1 -- 172.21.15.63:0/3445142938 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effc00345a0 con 0x556a151beb90 2024-05-21T01:22:01.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.664+0000 7effc4c00640 1 -- 172.21.15.63:0/3445142938 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effc0024040 con 0x556a151beb90 2024-05-21T01:22:01.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.664+0000 7effc4c00640 1 -- 172.21.15.63:0/3445142938 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effc0034960 con 0x556a151beb90 2024-05-21T01:22:01.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.664+0000 7effdeaee000 1 -- 172.21.15.63:0/3445142938 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556a151beb90 msgr2=0x556a151df500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:22:01.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.664+0000 7effdeaee000 1 --2- 172.21.15.63:0/3445142938 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556a151beb90 0x556a151df500 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7effc001a040 tx=0x7effc0009040 comp rx=0 tx=0).stop 2024-05-21T01:22:01.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.664+0000 7effdeaee000 1 -- 172.21.15.63:0/3445142938 shutdown_connections 2024-05-21T01:22:01.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.664+0000 7effdeaee000 1 --2- 172.21.15.63:0/3445142938 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x556a151c3b60 0x556a151cb570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:22:01.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.664+0000 7effdeaee000 1 --2- 172.21.15.63:0/3445142938 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556a151beb90 0x556a151df500 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:22:01.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.664+0000 7effdeaee000 1 --2- 172.21.15.63:0/3445142938 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556a151888d0 0x556a151defc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:22:01.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.664+0000 7effdeaee000 1 -- 172.21.15.63:0/3445142938 >> 172.21.15.63:0/3445142938 conn(0x556a1506af90 msgr2=0x556a1517f0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:22:01.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.664+0000 7effdeaee000 1 -- 172.21.15.63:0/3445142938 shutdown_connections 2024-05-21T01:22:01.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.664+0000 7effdeaee000 1 -- 172.21.15.63:0/3445142938 wait complete. 2024-05-21T01:22:01.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.668+0000 7effdeaee000 1 -- start start 2024-05-21T01:22:01.669 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.668+0000 7effdeaee000 1 Processor -- start 2024-05-21T01:22:01.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.668+0000 7effdeaee000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556a151888d0 0x556a151df350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:22:01.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.668+0000 7effdeaee000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556a151beb90 0x556a151cb790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:22:01.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.668+0000 7effdeaee000 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x556a151c3b60 0x556a151cbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:22:01.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.668+0000 7effdeaee000 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x556a14fc95f0 con 0x556a151c3b60 2024-05-21T01:22:01.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.668+0000 7effdeaee000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x556a15052860 con 0x556a151888d0 2024-05-21T01:22:01.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.668+0000 7effdeaee000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x556a14f65c50 con 0x556a151beb90 2024-05-21T01:22:01.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.668+0000 7effdeaee000 10 client.0 _ll_register_callbacks cb 0x7effc80096f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-21T01:22:01.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.668+0000 7effd9600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x556a151c3b60 0x556a151cbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:22:01.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.668+0000 7effd9600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x556a151c3b60 0x556a151cbcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47786/0 (socket says 172.21.15.63:47786) 2024-05-21T01:22:01.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.668+0000 7effd9600640 1 -- 172.21.15.63:0/3549816440 learned_addr learned my addr 172.21.15.63:0/3549816440 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:22:01.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.668+0000 7effd3e00640 1 --2- 172.21.15.63:0/3549816440 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556a151beb90 0x556a151cb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:22:01.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.668+0000 7effd8c00640 1 --2- 172.21.15.63:0/3549816440 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556a151888d0 0x556a151df350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:22:01.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.668+0000 7effd9600640 1 -- 172.21.15.63:0/3549816440 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556a151beb90 msgr2=0x556a151cb790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:22:01.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.668+0000 7effd9600640 1 --2- 172.21.15.63:0/3549816440 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556a151beb90 0x556a151cb790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:22:01.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.668+0000 7effd9600640 1 -- 172.21.15.63:0/3549816440 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556a151888d0 msgr2=0x556a151df350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:22:01.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.668+0000 7effd9600640 1 --2- 172.21.15.63:0/3549816440 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556a151888d0 0x556a151df350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:22:01.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.668+0000 7effd9600640 1 -- 172.21.15.63:0/3549816440 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a14f7fca0 con 0x556a151c3b60 2024-05-21T01:22:01.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.668+0000 7effd9600640 1 --2- 172.21.15.63:0/3549816440 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x556a151c3b60 0x556a151cbcd0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7effcc08e170 tx=0x7effcc0070e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9feb08d3ff7778dc server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:22:01.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.668+0000 7effba000640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-05-21T01:22:01.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.668+0000 7effba000640 1 -- 172.21.15.63:0/3549816440 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effcc0607e0 con 0x556a151c3b60 2024-05-21T01:22:01.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.668+0000 7effba000640 1 -- 172.21.15.63:0/3549816440 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7effcc057e50 con 0x556a151c3b60 2024-05-21T01:22:01.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.672+0000 7effdeaee000 1 -- 172.21.15.63:0/3549816440 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7effc0024040 con 0x556a151c3b60 2024-05-21T01:22:01.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.672+0000 7effba000640 1 -- 172.21.15.63:0/3549816440 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7effcc065290 con 0x556a151c3b60 2024-05-21T01:22:01.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.672+0000 7effdeaee000 10 client.4911 fetch_fsmap learned FSMap version 15 2024-05-21T01:22:01.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.672+0000 7effdeaee000 1 -- 172.21.15.63:0/3549816440 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x556a14f649c0 con 0x556a151c3b60 2024-05-21T01:22:01.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.672+0000 7effba000640 1 -- 172.21.15.63:0/3549816440 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effc0024040 con 0x556a151c3b60 2024-05-21T01:22:01.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.672+0000 7effba000640 1 -- 172.21.15.63:0/3549816440 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 15) ==== 4752+0+0 (secure 0 0 0) 0x7effcc05b1b0 con 0x556a151c3b60 2024-05-21T01:22:01.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.672+0000 7effdeaee000 10 client.4911 fetch_fsmap finished waiting for FSMap version 15 2024-05-21T01:22:01.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.672+0000 7effdeaee000 10 client.4911 resolve_mds: validated gid 4276 aka daemon mds.c 2024-05-21T01:22:01.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.672+0000 7effdeaee000 20 client.4911 populate_metadata read hostname 'smithi063' 2024-05-21T01:22:01.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.672+0000 7effdeaee000 1 --2- 172.21.15.63:0/3549816440 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x556a15183540 0x556a15183950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:22:01.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.672+0000 7effdeaee000 4 client.4911 mds_command: new command op to 4276 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "6603b2e4", "release": true, "await": true}] 2024-05-21T01:22:01.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.672+0000 7effdeaee000 1 -- 172.21.15.63:0/3549816440 --> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] -- command(tid 0: {"prefix": "quiesce db", "set_id": "6603b2e4", "release": true, "await": true}) -- 0x556a14fdf7f0 con 0x556a15183540 2024-05-21T01:22:01.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.672+0000 7effd8c00640 1 --2- 172.21.15.63:0/3549816440 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x556a15183540 0x556a15183950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:22:01.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.672+0000 7effd8c00640 1 --2- 172.21.15.63:0/3549816440 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x556a15183540 0x556a15183950 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c8f61fcb896db1f3 server_cookie=905976f701bf2802 in_seq=0 out_seq=0 2024-05-21T01:22:01.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.672+0000 7effba000640 10 client.4911 ms_handle_connect on v2:172.21.15.63:6834/2892727989 2024-05-21T01:22:01.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.672+0000 7effba000640 1 -- 172.21.15.63:0/3549816440 <== mds.0 v2:172.21.15.63:6834/2892727989 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x556a14fdf7f0 con 0x556a15183540 2024-05-21T01:22:01.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.672+0000 7effba000640 10 client.4911 handle_command_reply: tid=0 2024-05-21T01:22:01.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.672+0000 7effdeaee000 1 client.4911 shutdown 2024-05-21T01:22:01.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.672+0000 7effdeaee000 1 -- 172.21.15.63:0/3549816440 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x556a151c3b60 msgr2=0x556a151cbcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:22:01.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.672+0000 7effdeaee000 1 --2- 172.21.15.63:0/3549816440 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x556a151c3b60 0x556a151cbcd0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7effcc08e170 tx=0x7effcc0070e0 comp rx=0 tx=0).stop 2024-05-21T01:22:01.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.676+0000 7effdeaee000 1 -- 172.21.15.63:0/3549816440 shutdown_connections 2024-05-21T01:22:01.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.676+0000 7effdeaee000 1 --2- 172.21.15.63:0/3549816440 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x556a15183540 0x556a15183950 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:22:01.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.676+0000 7effdeaee000 1 --2- 172.21.15.63:0/3549816440 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x556a151c3b60 0x556a151cbcd0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:22:01.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.676+0000 7effdeaee000 1 --2- 172.21.15.63:0/3549816440 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x556a151beb90 0x556a151cb790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:22:01.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.676+0000 7effba000640 0 client.4911 ms_handle_reset on v2:172.21.15.63:6834/2892727989 2024-05-21T01:22:01.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.676+0000 7effdeaee000 1 --2- 172.21.15.63:0/3549816440 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556a151888d0 0x556a151df350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:22:01.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.676+0000 7effdeaee000 1 -- 172.21.15.63:0/3549816440 >> 172.21.15.63:0/3549816440 conn(0x556a1506af90 msgr2=0x556a151c9180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:22:01.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.676+0000 7effdeaee000 1 -- 172.21.15.63:0/3549816440 shutdown_connections 2024-05-21T01:22:01.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.676+0000 7effdeaee000 1 -- 172.21.15.63:0/3549816440 wait complete. 2024-05-21T01:22:01.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.676+0000 7effdeaee000 20 client.4911 trim_cache size 0 max 16384 2024-05-21T01:22:01.678 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-05-21T01:22:01.678 INFO:teuthology.orchestra.run.smithi063.stdout: "epoch": 15, 2024-05-21T01:22:01.678 INFO:teuthology.orchestra.run.smithi063.stdout: "leader": 4276, 2024-05-21T01:22:01.678 INFO:teuthology.orchestra.run.smithi063.stdout: "set_version": 8, 2024-05-21T01:22:01.678 INFO:teuthology.orchestra.run.smithi063.stdout: "sets": { 2024-05-21T01:22:01.678 INFO:teuthology.orchestra.run.smithi063.stdout: "6603b2e4": { 2024-05-21T01:22:01.678 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 8, 2024-05-21T01:22:01.678 INFO:teuthology.orchestra.run.smithi063.stdout: "age_ref": 0.0, 2024-05-21T01:22:01.678 INFO:teuthology.orchestra.run.smithi063.stdout: "state": { 2024-05-21T01:22:01.678 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "RELEASED", 2024-05-21T01:22:01.678 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 0.0 2024-05-21T01:22:01.678 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-05-21T01:22:01.679 INFO:teuthology.orchestra.run.smithi063.stdout: "timeout": 90.0, 2024-05-21T01:22:01.679 INFO:teuthology.orchestra.run.smithi063.stdout: "expiration": 150.0, 2024-05-21T01:22:01.679 INFO:teuthology.orchestra.run.smithi063.stdout: "members": { 2024-05-21T01:22:01.679 INFO:teuthology.orchestra.run.smithi063.stdout: "file:/": { 2024-05-21T01:22:01.679 INFO:teuthology.orchestra.run.smithi063.stdout: "excluded": false, 2024-05-21T01:22:01.679 INFO:teuthology.orchestra.run.smithi063.stdout: "state": { 2024-05-21T01:22:01.679 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "RELEASED", 2024-05-21T01:22:01.679 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 0.0 2024-05-21T01:22:01.679 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-05-21T01:22:01.679 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-05-21T01:22:01.679 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-05-21T01:22:01.679 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-05-21T01:22:01.679 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-05-21T01:22:01.679 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-05-21T01:22:01.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.676+0000 7effda000640 1 -- 172.21.15.63:0/2618535893 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7effb406f400 msgr2=0x7effb40718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:22:01.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.676+0000 7effda000640 1 --2- 172.21.15.63:0/2618535893 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7effb406f400 0x7effb40718c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7effd4147ad0 tx=0x7effc0007e40 comp rx=0 tx=0).stop 2024-05-21T01:22:01.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.676+0000 7effda000640 1 -- 172.21.15.63:0/2618535893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effd4155ea0 msgr2=0x7effd4147250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:22:01.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.676+0000 7effda000640 1 --2- 172.21.15.63:0/2618535893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effd4155ea0 0x7effd4147250 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7effcc00efc0 tx=0x7effcc00c490 comp rx=0 tx=0).stop 2024-05-21T01:22:01.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.676+0000 7effda000640 1 -- 172.21.15.63:0/2618535893 shutdown_connections 2024-05-21T01:22:01.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.676+0000 7effda000640 1 --2- 172.21.15.63:0/2618535893 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7effb406f400 0x7effb40718c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:22:01.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.676+0000 7effda000640 1 --2- 172.21.15.63:0/2618535893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effd4155ea0 0x7effd4147250 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:22:01.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.676+0000 7effda000640 1 --2- 172.21.15.63:0/2618535893 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7effd40cb810 0x7effd4146d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:22:01.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.676+0000 7effda000640 1 --2- 172.21.15.63:0/2618535893 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7effd40c9ec0 0x7effd415bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:22:01.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.676+0000 7effda000640 1 -- 172.21.15.63:0/2618535893 >> 172.21.15.63:0/2618535893 conn(0x7effd40cacf0 msgr2=0x7effd40725c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:22:01.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.676+0000 7effda000640 1 -- 172.21.15.63:0/2618535893 shutdown_connections 2024-05-21T01:22:01.681 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:22:01.676+0000 7effda000640 1 -- 172.21.15.63:0/2618535893 wait complete. 2024-05-21T01:22:01.707 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '6603b2e4', total seconds elapsed: 31.1 2024-05-21T01:22:09.291 INFO:tasks.workunit.client.0.smithi063.stderr:Updating files: 64% (7856/12271) Updating files: 65% (7977/12271) Updating files: 66% (8099/12271) Updating files: 67% (8222/12271) Updating files: 68% (8345/12271) Updating files: 69% (8467/12271) Updating files: 70% (8590/12271) Updating files: 71% (8713/12271) Updating files: 72% (8836/12271) Updating files: 73% (8958/12271) Updating files: 74% (9081/12271) Updating files: 75% (9204/12271) Updating files: 76% (9326/12271) Updating files: 77% (9449/12271) Updating files: 78% (9572/12271) Updating files: 79% (9695/12271) Updating files: 80% (9817/12271) Updating files: 81% (9940/12271) Updating files: 82% (10063/12271) Updating files: 83% (10185/12271) Updating files: 84% (10308/12271) Updating files: 85% (10431/12271) Updating files: 86% (10554/12271) Updating files: 87% (10676/12271) Updating files: 88% (10799/12271) Updating files: 89% (10922/12271) Updating files: 90% (11044/12271) Updating files: 91% (11167/12271) Updating files: 92% (11290/12271) Updating files: 93% (11413/12271) Updating files: 94% (11535/12271) Updating files: 95% (11658/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-05-21T01:22:10.011 INFO:tasks.workunit.client.0.smithi063.stderr:Note: switching to '0051ea03417a66dbfd5a17ea02c9049bcda16863'. 2024-05-21T01:22:10.011 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-05-21T01:22:10.011 INFO:tasks.workunit.client.0.smithi063.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-05-21T01:22:10.011 INFO:tasks.workunit.client.0.smithi063.stderr:changes and commit them, and you can discard any commits you make in this 2024-05-21T01:22:10.011 INFO:tasks.workunit.client.0.smithi063.stderr:state without impacting any branches by switching back to a branch. 2024-05-21T01:22:10.011 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-05-21T01:22:10.012 INFO:tasks.workunit.client.0.smithi063.stderr:If you want to create a new branch to retain commits you create, you may 2024-05-21T01:22:10.012 INFO:tasks.workunit.client.0.smithi063.stderr:do so (now or later) by using -c with the switch command. Example: 2024-05-21T01:22:10.012 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-05-21T01:22:10.012 INFO:tasks.workunit.client.0.smithi063.stderr: git switch -c 2024-05-21T01:22:10.012 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-05-21T01:22:10.012 INFO:tasks.workunit.client.0.smithi063.stderr:Or undo this operation with: 2024-05-21T01:22:10.012 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-05-21T01:22:10.012 INFO:tasks.workunit.client.0.smithi063.stderr: git switch - 2024-05-21T01:22:10.012 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-05-21T01:22:10.012 INFO:tasks.workunit.client.0.smithi063.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-05-21T01:22:10.012 INFO:tasks.workunit.client.0.smithi063.stderr: 2024-05-21T01:22:10.012 INFO:tasks.workunit.client.0.smithi063.stderr:HEAD is now at 0051ea03417 mds/quiesce: don't force a remote authpin for the quiesce lock 2024-05-21T01:22:10.024 DEBUG:teuthology.orchestra.run.smithi063:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-05-21T01:22:10.033 INFO:tasks.workunit.client.0.smithi063.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-05-21T01:22:10.036 INFO:tasks.workunit.client.0.smithi063.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-21T01:22:10.036 INFO:tasks.workunit.client.0.smithi063.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-05-21T01:22:10.825 INFO:tasks.workunit.client.0.smithi063.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-05-21T01:22:10.911 INFO:tasks.workunit.client.0.smithi063.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-05-21T01:22:10.968 INFO:tasks.workunit.client.0.smithi063.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-21T01:22:10.970 INFO:tasks.workunit.client.0.smithi063.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-21T01:22:10.970 INFO:tasks.workunit.client.0.smithi063.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-05-21T01:22:11.024 INFO:tasks.workunit.client.0.smithi063.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-21T01:22:11.030 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-05-21T01:22:11.031 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-05-21T01:22:11.084 INFO:tasks.workunit:Running workunits matching suites/iozone.sh on client.0... 2024-05-21T01:22:11.085 INFO:tasks.workunit:Running workunit suites/iozone.sh... 2024-05-21T01:22:11.085 DEBUG:teuthology.orchestra.run.smithi063:workunit test suites/iozone.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0051ea03417a66dbfd5a17ea02c9049bcda16863 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/iozone.sh 2024-05-21T01:22:11.144 INFO:tasks.workunit.client.0.smithi063.stderr:+ iozone -c -e -s 1024M -r 16K -t 1 -F f1 -i 0 -i 1 2024-05-21T01:22:11.231 INFO:tasks.workunit.client.0.smithi063.stdout: Iozone: Performance Test of File I/O 2024-05-21T01:22:11.231 INFO:tasks.workunit.client.0.smithi063.stdout: Version $Revision: 3.489 $ 2024-05-21T01:22:11.231 INFO:tasks.workunit.client.0.smithi063.stdout: Compiled for 64 bit mode. 2024-05-21T01:22:11.231 INFO:tasks.workunit.client.0.smithi063.stdout: Build: linux-AMD64 2024-05-21T01:22:11.231 INFO:tasks.workunit.client.0.smithi063.stdout: 2024-05-21T01:22:11.231 INFO:tasks.workunit.client.0.smithi063.stdout: Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins 2024-05-21T01:22:11.231 INFO:tasks.workunit.client.0.smithi063.stdout: Al Slater, Scott Rhine, Mike Wisner, Ken Goss 2024-05-21T01:22:11.232 INFO:tasks.workunit.client.0.smithi063.stdout: Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, 2024-05-21T01:22:11.232 INFO:tasks.workunit.client.0.smithi063.stdout: Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, 2024-05-21T01:22:11.232 INFO:tasks.workunit.client.0.smithi063.stdout: Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, 2024-05-21T01:22:11.232 INFO:tasks.workunit.client.0.smithi063.stdout: Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, 2024-05-21T01:22:11.232 INFO:tasks.workunit.client.0.smithi063.stdout: Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, 2024-05-21T01:22:11.232 INFO:tasks.workunit.client.0.smithi063.stdout: Vangel Bojaxhi, Ben England, Vikentsi Lapa, 2024-05-21T01:22:11.232 INFO:tasks.workunit.client.0.smithi063.stdout: Alexey Skidanov, Sudhir Kumar. 2024-05-21T01:22:11.232 INFO:tasks.workunit.client.0.smithi063.stdout: 2024-05-21T01:22:11.232 INFO:tasks.workunit.client.0.smithi063.stdout: Run began: Tue May 21 01:22:11 2024 2024-05-21T01:22:11.232 INFO:tasks.workunit.client.0.smithi063.stdout: 2024-05-21T01:22:11.232 INFO:tasks.workunit.client.0.smithi063.stdout: Include close in write timing 2024-05-21T01:22:11.232 INFO:tasks.workunit.client.0.smithi063.stdout: Include fsync in write timing 2024-05-21T01:22:11.232 INFO:tasks.workunit.client.0.smithi063.stdout: File size set to 1048576 kB 2024-05-21T01:22:11.232 INFO:tasks.workunit.client.0.smithi063.stdout: Record Size 16 kB 2024-05-21T01:22:11.233 INFO:tasks.workunit.client.0.smithi063.stdout: Command line used: iozone -c -e -s 1024M -r 16K -t 1 -F f1 -i 0 -i 1 2024-05-21T01:22:11.233 INFO:tasks.workunit.client.0.smithi063.stdout: Output is in kBytes/sec 2024-05-21T01:22:11.233 INFO:tasks.workunit.client.0.smithi063.stdout: Time Resolution = 0.000001 seconds. 2024-05-21T01:22:11.233 INFO:tasks.workunit.client.0.smithi063.stdout: Processor cache size set to 1024 kBytes. 2024-05-21T01:22:11.233 INFO:tasks.workunit.client.0.smithi063.stdout: Processor cache line size set to 32 bytes. 2024-05-21T01:22:11.233 INFO:tasks.workunit.client.0.smithi063.stdout: File stride size set to 17 * record size. 2024-05-21T01:22:11.233 INFO:tasks.workunit.client.0.smithi063.stdout: Throughput test with 1 process 2024-05-21T01:22:11.233 INFO:tasks.workunit.client.0.smithi063.stdout: Each process writes a 1048576 kByte file in 16 kByte records 2024-05-21T01:22:19.871 INFO:tasks.workunit.client.0.smithi063.stdout: 2024-05-21T01:22:19.871 INFO:tasks.workunit.client.0.smithi063.stdout: Children see throughput for 1 initial writers = 121409.37 kB/sec 2024-05-21T01:22:19.871 INFO:tasks.workunit.client.0.smithi063.stdout: Parent sees throughput for 1 initial writers = 121403.98 kB/sec 2024-05-21T01:22:19.872 INFO:tasks.workunit.client.0.smithi063.stdout: Min throughput per process = 121409.37 kB/sec 2024-05-21T01:22:19.872 INFO:tasks.workunit.client.0.smithi063.stdout: Max throughput per process = 121409.37 kB/sec 2024-05-21T01:22:19.872 INFO:tasks.workunit.client.0.smithi063.stdout: Avg throughput per process = 121409.37 kB/sec 2024-05-21T01:22:19.872 INFO:tasks.workunit.client.0.smithi063.stdout: Min xfer = 1048576.00 kB 2024-05-21T01:22:26.365 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-21T01:22:26.369 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-21T01:22:29.438 INFO:tasks.workunit.client.0.smithi063.stdout: 2024-05-21T01:22:29.438 INFO:tasks.workunit.client.0.smithi063.stdout: Children see throughput for 1 rewriters = 175854.91 kB/sec 2024-05-21T01:22:29.438 INFO:tasks.workunit.client.0.smithi063.stdout: Parent sees throughput for 1 rewriters = 175840.95 kB/sec 2024-05-21T01:22:29.439 INFO:tasks.workunit.client.0.smithi063.stdout: Min throughput per process = 175854.91 kB/sec 2024-05-21T01:22:29.439 INFO:tasks.workunit.client.0.smithi063.stdout: Max throughput per process = 175854.91 kB/sec 2024-05-21T01:22:29.439 INFO:tasks.workunit.client.0.smithi063.stdout: Avg throughput per process = 175854.91 kB/sec 2024-05-21T01:22:29.439 INFO:tasks.workunit.client.0.smithi063.stdout: Min xfer = 1048576.00 kB 2024-05-21T01:22:32.810 INFO:tasks.workunit.client.0.smithi063.stdout: 2024-05-21T01:22:32.810 INFO:tasks.workunit.client.0.smithi063.stdout: Children see throughput for 1 readers = 3521108.25 kB/sec 2024-05-21T01:22:32.810 INFO:tasks.workunit.client.0.smithi063.stdout: Parent sees throughput for 1 readers = 3515796.69 kB/sec 2024-05-21T01:22:32.811 INFO:tasks.workunit.client.0.smithi063.stdout: Min throughput per process = 3521108.25 kB/sec 2024-05-21T01:22:32.811 INFO:tasks.workunit.client.0.smithi063.stdout: Max throughput per process = 3521108.25 kB/sec 2024-05-21T01:22:32.811 INFO:tasks.workunit.client.0.smithi063.stdout: Avg throughput per process = 3521108.25 kB/sec 2024-05-21T01:22:32.811 INFO:tasks.workunit.client.0.smithi063.stdout: Min xfer = 1048576.00 kB 2024-05-21T01:22:35.312 INFO:tasks.workunit.client.0.smithi063.stdout: 2024-05-21T01:22:35.313 INFO:tasks.workunit.client.0.smithi063.stdout: Children see throughput for 1 re-readers = 2785986.25 kB/sec 2024-05-21T01:22:35.313 INFO:tasks.workunit.client.0.smithi063.stdout: Parent sees throughput for 1 re-readers = 2782350.20 kB/sec 2024-05-21T01:22:35.313 INFO:tasks.workunit.client.0.smithi063.stdout: Min throughput per process = 2785986.25 kB/sec 2024-05-21T01:22:35.313 INFO:tasks.workunit.client.0.smithi063.stdout: Max throughput per process = 2785986.25 kB/sec 2024-05-21T01:22:35.313 INFO:tasks.workunit.client.0.smithi063.stdout: Avg throughput per process = 2785986.25 kB/sec 2024-05-21T01:22:35.313 INFO:tasks.workunit.client.0.smithi063.stdout: Min xfer = 1048576.00 kB 2024-05-21T01:22:41.818 INFO:tasks.workunit.client.0.smithi063.stdout: 2024-05-21T01:22:41.818 INFO:tasks.workunit.client.0.smithi063.stdout: 2024-05-21T01:22:41.818 INFO:tasks.workunit.client.0.smithi063.stdout: 2024-05-21T01:22:41.818 INFO:tasks.workunit.client.0.smithi063.stdout:iozone test complete. 2024-05-21T01:22:41.818 INFO:tasks.workunit.client.0.smithi063.stderr:+ iozone -c -e -s 1024M -r 1M -t 1 -F f2 -i 0 -i 1 2024-05-21T01:22:41.886 INFO:tasks.workunit.client.0.smithi063.stdout: Iozone: Performance Test of File I/O 2024-05-21T01:22:41.886 INFO:tasks.workunit.client.0.smithi063.stdout: Version $Revision: 3.489 $ 2024-05-21T01:22:41.886 INFO:tasks.workunit.client.0.smithi063.stdout: Compiled for 64 bit mode. 2024-05-21T01:22:41.886 INFO:tasks.workunit.client.0.smithi063.stdout: Build: linux-AMD64 2024-05-21T01:22:41.886 INFO:tasks.workunit.client.0.smithi063.stdout: 2024-05-21T01:22:41.886 INFO:tasks.workunit.client.0.smithi063.stdout: Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins 2024-05-21T01:22:41.886 INFO:tasks.workunit.client.0.smithi063.stdout: Al Slater, Scott Rhine, Mike Wisner, Ken Goss 2024-05-21T01:22:41.886 INFO:tasks.workunit.client.0.smithi063.stdout: Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, 2024-05-21T01:22:41.886 INFO:tasks.workunit.client.0.smithi063.stdout: Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, 2024-05-21T01:22:41.887 INFO:tasks.workunit.client.0.smithi063.stdout: Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, 2024-05-21T01:22:41.887 INFO:tasks.workunit.client.0.smithi063.stdout: Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, 2024-05-21T01:22:41.887 INFO:tasks.workunit.client.0.smithi063.stdout: Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, 2024-05-21T01:22:41.887 INFO:tasks.workunit.client.0.smithi063.stdout: Vangel Bojaxhi, Ben England, Vikentsi Lapa, 2024-05-21T01:22:41.887 INFO:tasks.workunit.client.0.smithi063.stdout: Alexey Skidanov, Sudhir Kumar. 2024-05-21T01:22:41.887 INFO:tasks.workunit.client.0.smithi063.stdout: 2024-05-21T01:22:41.887 INFO:tasks.workunit.client.0.smithi063.stdout: Run began: Tue May 21 01:22:41 2024 2024-05-21T01:22:41.887 INFO:tasks.workunit.client.0.smithi063.stdout: 2024-05-21T01:22:41.887 INFO:tasks.workunit.client.0.smithi063.stdout: Include close in write timing 2024-05-21T01:22:41.887 INFO:tasks.workunit.client.0.smithi063.stdout: Include fsync in write timing 2024-05-21T01:22:41.887 INFO:tasks.workunit.client.0.smithi063.stdout: File size set to 1048576 kB 2024-05-21T01:22:41.887 INFO:tasks.workunit.client.0.smithi063.stdout: Record Size 1024 kB 2024-05-21T01:22:41.887 INFO:tasks.workunit.client.0.smithi063.stdout: Command line used: iozone -c -e -s 1024M -r 1M -t 1 -F f2 -i 0 -i 1 2024-05-21T01:22:41.888 INFO:tasks.workunit.client.0.smithi063.stdout: Output is in kBytes/sec 2024-05-21T01:22:41.888 INFO:tasks.workunit.client.0.smithi063.stdout: Time Resolution = 0.000001 seconds. 2024-05-21T01:22:41.888 INFO:tasks.workunit.client.0.smithi063.stdout: Processor cache size set to 1024 kBytes. 2024-05-21T01:22:41.888 INFO:tasks.workunit.client.0.smithi063.stdout: Processor cache line size set to 32 bytes. 2024-05-21T01:22:41.888 INFO:tasks.workunit.client.0.smithi063.stdout: File stride size set to 17 * record size. 2024-05-21T01:22:41.888 INFO:tasks.workunit.client.0.smithi063.stdout: Throughput test with 1 process 2024-05-21T01:22:41.888 INFO:tasks.workunit.client.0.smithi063.stdout: Each process writes a 1048576 kByte file in 1024 kByte records 2024-05-21T01:22:48.963 INFO:tasks.workunit.client.0.smithi063.stdout: 2024-05-21T01:22:48.963 INFO:tasks.workunit.client.0.smithi063.stdout: Children see throughput for 1 initial writers = 149108.81 kB/sec 2024-05-21T01:22:48.963 INFO:tasks.workunit.client.0.smithi063.stdout: Parent sees throughput for 1 initial writers = 149096.48 kB/sec 2024-05-21T01:22:48.963 INFO:tasks.workunit.client.0.smithi063.stdout: Min throughput per process = 149108.81 kB/sec 2024-05-21T01:22:48.963 INFO:tasks.workunit.client.0.smithi063.stdout: Max throughput per process = 149108.81 kB/sec 2024-05-21T01:22:48.963 INFO:tasks.workunit.client.0.smithi063.stdout: Avg throughput per process = 149108.81 kB/sec 2024-05-21T01:22:48.963 INFO:tasks.workunit.client.0.smithi063.stdout: Min xfer = 1048576.00 kB 2024-05-21T01:22:56.426 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-21T01:22:56.431 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-21T01:22:56.474 INFO:tasks.workunit.client.0.smithi063.stdout: 2024-05-21T01:22:56.474 INFO:tasks.workunit.client.0.smithi063.stdout: Children see throughput for 1 rewriters = 194927.53 kB/sec 2024-05-21T01:22:56.474 INFO:tasks.workunit.client.0.smithi063.stdout: Parent sees throughput for 1 rewriters = 194910.07 kB/sec 2024-05-21T01:22:56.474 INFO:tasks.workunit.client.0.smithi063.stdout: Min throughput per process = 194927.53 kB/sec 2024-05-21T01:22:56.474 INFO:tasks.workunit.client.0.smithi063.stdout: Max throughput per process = 194927.53 kB/sec 2024-05-21T01:22:56.474 INFO:tasks.workunit.client.0.smithi063.stdout: Avg throughput per process = 194927.53 kB/sec 2024-05-21T01:22:56.474 INFO:tasks.workunit.client.0.smithi063.stdout: Min xfer = 1048576.00 kB 2024-05-21T01:22:59.940 INFO:tasks.workunit.client.0.smithi063.stdout: 2024-05-21T01:22:59.940 INFO:tasks.workunit.client.0.smithi063.stdout: Children see throughput for 1 readers = 5400744.50 kB/sec 2024-05-21T01:22:59.941 INFO:tasks.workunit.client.0.smithi063.stdout: Parent sees throughput for 1 readers = 5385184.12 kB/sec 2024-05-21T01:22:59.941 INFO:tasks.workunit.client.0.smithi063.stdout: Min throughput per process = 5400744.50 kB/sec 2024-05-21T01:22:59.941 INFO:tasks.workunit.client.0.smithi063.stdout: Max throughput per process = 5400744.50 kB/sec 2024-05-21T01:22:59.941 INFO:tasks.workunit.client.0.smithi063.stdout: Avg throughput per process = 5400744.50 kB/sec 2024-05-21T01:22:59.941 INFO:tasks.workunit.client.0.smithi063.stdout: Min xfer = 1048576.00 kB 2024-05-21T01:23:02.302 INFO:tasks.workunit.client.0.smithi063.stdout: 2024-05-21T01:23:02.303 INFO:tasks.workunit.client.0.smithi063.stdout: Children see throughput for 1 re-readers = 3704180.25 kB/sec 2024-05-21T01:23:02.303 INFO:tasks.workunit.client.0.smithi063.stdout: Parent sees throughput for 1 re-readers = 3696829.01 kB/sec 2024-05-21T01:23:02.303 INFO:tasks.workunit.client.0.smithi063.stdout: Min throughput per process = 3704180.25 kB/sec 2024-05-21T01:23:02.303 INFO:tasks.workunit.client.0.smithi063.stdout: Max throughput per process = 3704180.25 kB/sec 2024-05-21T01:23:02.303 INFO:tasks.workunit.client.0.smithi063.stdout: Avg throughput per process = 3704180.25 kB/sec 2024-05-21T01:23:02.303 INFO:tasks.workunit.client.0.smithi063.stdout: Min xfer = 1048576.00 kB 2024-05-21T01:23:08.702 INFO:tasks.workunit.client.0.smithi063.stdout: 2024-05-21T01:23:08.702 INFO:tasks.workunit.client.0.smithi063.stdout: 2024-05-21T01:23:08.702 INFO:tasks.workunit.client.0.smithi063.stdout: 2024-05-21T01:23:08.702 INFO:tasks.workunit.client.0.smithi063.stdout:iozone test complete. 2024-05-21T01:23:08.703 INFO:tasks.workunit.client.0.smithi063.stderr:+ iozone -c -e -s 10240M -r 1M -t 1 -F f3 -i 0 -i 1 2024-05-21T01:23:08.774 INFO:tasks.workunit.client.0.smithi063.stdout: Iozone: Performance Test of File I/O 2024-05-21T01:23:08.774 INFO:tasks.workunit.client.0.smithi063.stdout: Version $Revision: 3.489 $ 2024-05-21T01:23:08.774 INFO:tasks.workunit.client.0.smithi063.stdout: Compiled for 64 bit mode. 2024-05-21T01:23:08.774 INFO:tasks.workunit.client.0.smithi063.stdout: Build: linux-AMD64 2024-05-21T01:23:08.774 INFO:tasks.workunit.client.0.smithi063.stdout: 2024-05-21T01:23:08.774 INFO:tasks.workunit.client.0.smithi063.stdout: Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins 2024-05-21T01:23:08.774 INFO:tasks.workunit.client.0.smithi063.stdout: Al Slater, Scott Rhine, Mike Wisner, Ken Goss 2024-05-21T01:23:08.775 INFO:tasks.workunit.client.0.smithi063.stdout: Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, 2024-05-21T01:23:08.775 INFO:tasks.workunit.client.0.smithi063.stdout: Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, 2024-05-21T01:23:08.775 INFO:tasks.workunit.client.0.smithi063.stdout: Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, 2024-05-21T01:23:08.775 INFO:tasks.workunit.client.0.smithi063.stdout: Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, 2024-05-21T01:23:08.775 INFO:tasks.workunit.client.0.smithi063.stdout: Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, 2024-05-21T01:23:08.775 INFO:tasks.workunit.client.0.smithi063.stdout: Vangel Bojaxhi, Ben England, Vikentsi Lapa, 2024-05-21T01:23:08.775 INFO:tasks.workunit.client.0.smithi063.stdout: Alexey Skidanov, Sudhir Kumar. 2024-05-21T01:23:08.775 INFO:tasks.workunit.client.0.smithi063.stdout: 2024-05-21T01:23:08.775 INFO:tasks.workunit.client.0.smithi063.stdout: Run began: Tue May 21 01:23:08 2024 2024-05-21T01:23:08.775 INFO:tasks.workunit.client.0.smithi063.stdout: 2024-05-21T01:23:08.775 INFO:tasks.workunit.client.0.smithi063.stdout: Include close in write timing 2024-05-21T01:23:08.775 INFO:tasks.workunit.client.0.smithi063.stdout: Include fsync in write timing 2024-05-21T01:23:08.775 INFO:tasks.workunit.client.0.smithi063.stdout: File size set to 10485760 kB 2024-05-21T01:23:08.775 INFO:tasks.workunit.client.0.smithi063.stdout: Record Size 1024 kB 2024-05-21T01:23:08.776 INFO:tasks.workunit.client.0.smithi063.stdout: Command line used: iozone -c -e -s 10240M -r 1M -t 1 -F f3 -i 0 -i 1 2024-05-21T01:23:08.776 INFO:tasks.workunit.client.0.smithi063.stdout: Output is in kBytes/sec 2024-05-21T01:23:08.776 INFO:tasks.workunit.client.0.smithi063.stdout: Time Resolution = 0.000001 seconds. 2024-05-21T01:23:08.776 INFO:tasks.workunit.client.0.smithi063.stdout: Processor cache size set to 1024 kBytes. 2024-05-21T01:23:08.776 INFO:tasks.workunit.client.0.smithi063.stdout: Processor cache line size set to 32 bytes. 2024-05-21T01:23:08.776 INFO:tasks.workunit.client.0.smithi063.stdout: File stride size set to 17 * record size. 2024-05-21T01:23:08.776 INFO:tasks.workunit.client.0.smithi063.stdout: Throughput test with 1 process 2024-05-21T01:23:08.776 INFO:tasks.workunit.client.0.smithi063.stdout: Each process writes a 10485760 kByte file in 1024 kByte records 2024-05-21T01:23:26.724 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-21T01:23:26.727 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-21T01:23:53.137 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 19.8 2024-05-21T01:23:53.137 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-21T01:23:53.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:53.371+0000 7fb082c00640 1 Processor -- start 2024-05-21T01:23:53.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:53.371+0000 7fb082c00640 1 -- start start 2024-05-21T01:23:53.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:53.371+0000 7fb082c00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb07c0cf790 0x7fb07c0c69a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:23:53.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:53.371+0000 7fb082c00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb07c0cfb70 0x7fb07c153b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:23:53.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:53.371+0000 7fb082c00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fb07c0ca810 0x7fb07c154080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:23:53.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:53.371+0000 7fb082c00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7fb07c0c8be0 con 0x7fb07c0cfb70 2024-05-21T01:23:53.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:53.371+0000 7fb082c00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fb07c0c8e80 con 0x7fb07c0ca810 2024-05-21T01:23:53.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:53.371+0000 7fb082c00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fb07c0c9160 con 0x7fb07c0cf790 2024-05-21T01:23:53.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:53.375+0000 7fb080c00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fb07c0ca810 0x7fb07c154080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:23:53.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:53.375+0000 7fb080c00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fb07c0ca810 0x7fb07c154080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.63:41134/0 (socket says 172.21.15.63:41134) 2024-05-21T01:23:53.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:53.375+0000 7fb080c00640 1 -- 172.21.15.63:0/2116519859 learned_addr learned my addr 172.21.15.63:0/2116519859 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:23:53.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:53.375+0000 7fb07b400640 1 --2- 172.21.15.63:0/2116519859 >> v2:172.21.15.63:3300/0 conn(0x7fb07c0cfb70 0x7fb07c153b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:23:53.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:53.375+0000 7fb07be00640 1 --2- 172.21.15.63:0/2116519859 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb07c0cf790 0x7fb07c0c69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:23:53.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:53.375+0000 7fb080c00640 1 -- 172.21.15.63:0/2116519859 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb07c0cf790 msgr2=0x7fb07c0c69a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:23:53.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:53.375+0000 7fb080c00640 1 --2- 172.21.15.63:0/2116519859 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb07c0cf790 0x7fb07c0c69a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:23:53.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:53.375+0000 7fb080c00640 1 -- 172.21.15.63:0/2116519859 >> v2:172.21.15.63:3300/0 conn(0x7fb07c0cfb70 msgr2=0x7fb07c153b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:23:53.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:53.375+0000 7fb080c00640 1 --2- 172.21.15.63:0/2116519859 >> v2:172.21.15.63:3300/0 conn(0x7fb07c0cfb70 0x7fb07c153b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:23:53.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:53.375+0000 7fb080c00640 1 -- 172.21.15.63:0/2116519859 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb07c0c9440 con 0x7fb07c0ca810 2024-05-21T01:23:53.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:53.379+0000 7fb080c00640 1 --2- 172.21.15.63:0/2116519859 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb07c0ca810 0x7fb07c154080 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb07c0d0680 tx=0x7fb07401c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1da330bb131c68c1 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:23:53.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:53.379+0000 7fb07aa00640 1 -- 172.21.15.63:0/2116519859 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0740b0070 con 0x7fb07c0ca810 2024-05-21T01:23:53.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:53.379+0000 7fb07aa00640 1 -- 172.21.15.63:0/2116519859 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0740ab600 con 0x7fb07c0ca810 2024-05-21T01:23:53.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:53.379+0000 7fb07aa00640 1 -- 172.21.15.63:0/2116519859 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0740ab9d0 con 0x7fb07c0ca810 2024-05-21T01:23:53.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:53.379+0000 7fb082c00640 1 -- 172.21.15.63:0/2116519859 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb07c0ca810 msgr2=0x7fb07c154080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:23:53.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:53.379+0000 7fb082c00640 1 --2- 172.21.15.63:0/2116519859 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb07c0ca810 0x7fb07c154080 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb07c0d0680 tx=0x7fb07401c490 comp rx=0 tx=0).stop 2024-05-21T01:23:53.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:53.379+0000 7fb082c00640 1 -- 172.21.15.63:0/2116519859 shutdown_connections 2024-05-21T01:23:53.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:53.379+0000 7fb082c00640 1 --2- 172.21.15.63:0/2116519859 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb07c0ca810 0x7fb07c154080 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:23:53.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:53.379+0000 7fb082c00640 1 --2- 172.21.15.63:0/2116519859 >> v2:172.21.15.63:3300/0 conn(0x7fb07c0cfb70 0x7fb07c153b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:23:53.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:53.379+0000 7fb082c00640 1 --2- 172.21.15.63:0/2116519859 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb07c0cf790 0x7fb07c0c69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:23:53.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:53.379+0000 7fb082c00640 1 -- 172.21.15.63:0/2116519859 >> 172.21.15.63:0/2116519859 conn(0x7fb07c0735f0 msgr2=0x7fb07c073a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:23:53.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:53.383+0000 7fb082c00640 1 -- 172.21.15.63:0/2116519859 shutdown_connections 2024-05-21T01:23:53.385 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:53.383+0000 7fb082c00640 1 -- 172.21.15.63:0/2116519859 wait complete. 2024-05-21T01:23:53.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:53.383+0000 7fb082c00640 1 Processor -- start 2024-05-21T01:23:53.386 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:53.383+0000 7fb082c00640 1 -- start start 2024-05-21T01:23:53.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:53.383+0000 7fb082c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb07c0ca810 0x7fb07c15c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:23:53.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:53.383+0000 7fb082c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb07c0cf790 0x7fb07c06e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:23:53.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:53.383+0000 7fb082c00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb07c0cfb70 0x7fb07c150c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:23:53.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:53.383+0000 7fb082c00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fb07c15d6a0 con 0x7fb07c0cf790 2024-05-21T01:23:53.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:53.383+0000 7fb082c00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fb07c15d520 con 0x7fb07c0ca810 2024-05-21T01:23:53.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:53.383+0000 7fb082c00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fb07c15d820 con 0x7fb07c0cfb70 2024-05-21T01:23:53.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:53.383+0000 7fb07be00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb07c0ca810 0x7fb07c15c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:23:53.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:53.383+0000 7fb07be00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb07c0ca810 0x7fb07c15c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.63:41144/0 (socket says 172.21.15.63:41144) 2024-05-21T01:23:53.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:53.383+0000 7fb07be00640 1 -- 172.21.15.63:0/1447472603 learned_addr learned my addr 172.21.15.63:0/1447472603 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:23:53.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:53.383+0000 7fb080c00640 1 --2- 172.21.15.63:0/1447472603 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb07c0cfb70 0x7fb07c150c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:23:53.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:53.387+0000 7fb07be00640 1 -- 172.21.15.63:0/1447472603 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb07c0cfb70 msgr2=0x7fb07c150c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:23:53.388 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:53.387+0000 7fb07be00640 1 --2- 172.21.15.63:0/1447472603 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb07c0cfb70 0x7fb07c150c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:23:53.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:53.387+0000 7fb07be00640 1 -- 172.21.15.63:0/1447472603 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb07c0cf790 msgr2=0x7fb07c06e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:23:53.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:53.387+0000 7fb07be00640 1 --2- 172.21.15.63:0/1447472603 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb07c0cf790 0x7fb07c06e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:23:53.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:53.387+0000 7fb07be00640 1 -- 172.21.15.63:0/1447472603 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb07c15c860 con 0x7fb07c0ca810 2024-05-21T01:23:53.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:53.387+0000 7fb07be00640 1 --2- 172.21.15.63:0/1447472603 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb07c0ca810 0x7fb07c15c320 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb06c007e90 tx=0x7fb06c00e4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:23:53.389 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:53.387+0000 7fb073e00640 1 -- 172.21.15.63:0/1447472603 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb06c014620 con 0x7fb07c0ca810 2024-05-21T01:23:53.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:53.387+0000 7fb082c00640 1 -- 172.21.15.63:0/1447472603 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb07c163540 con 0x7fb07c0ca810 2024-05-21T01:23:53.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:53.387+0000 7fb082c00640 1 -- 172.21.15.63:0/1447472603 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb07c163af0 con 0x7fb07c0ca810 2024-05-21T01:23:53.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:53.387+0000 7fb073e00640 1 -- 172.21.15.63:0/1447472603 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb06c019070 con 0x7fb07c0ca810 2024-05-21T01:23:53.390 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:53.387+0000 7fb073e00640 1 -- 172.21.15.63:0/1447472603 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb06c014a00 con 0x7fb07c0ca810 2024-05-21T01:23:53.391 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:53.387+0000 7fb082c00640 1 -- 172.21.15.63:0/1447472603 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0540052a0 con 0x7fb07c0ca810 2024-05-21T01:23:53.393 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:53.391+0000 7fb073e00640 1 -- 172.21.15.63:0/1447472603 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7fb06c014ba0 con 0x7fb07c0ca810 2024-05-21T01:23:53.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:53.391+0000 7fb073e00640 1 --2- 172.21.15.63:0/1447472603 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fb05806f400 0x7fb0580718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:23:53.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:53.391+0000 7fb073e00640 1 -- 172.21.15.63:0/1447472603 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7fb06c090c50 con 0x7fb07c0ca810 2024-05-21T01:23:53.394 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:53.391+0000 7fb07b400640 1 --2- 172.21.15.63:0/1447472603 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fb05806f400 0x7fb0580718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:23:53.395 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:53.391+0000 7fb07b400640 1 --2- 172.21.15.63:0/1447472603 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fb05806f400 0x7fb0580718c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb064006aa0 tx=0x7fb064006a30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:23:53.414 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:53.411+0000 7fb073e00640 1 -- 172.21.15.63:0/1447472603 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fb06c05d8d0 con 0x7fb07c0ca810 2024-05-21T01:23:53.901 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:53.899+0000 7fb082c00640 1 -- 172.21.15.63:0/1447472603 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb054005590 con 0x7fb07c0ca810 2024-05-21T01:23:53.903 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:53.899+0000 7fb073e00640 1 -- 172.21.15.63:0/1447472603 <== mon.1 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+6876 (secure 0 0 0) 0x7fb06c05d1d0 con 0x7fb07c0ca810 2024-05-21T01:23:53.903 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-05-21T01:23:53.904 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6839/3045714273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6837","nonce":3045714273},{"type":"v1","addr":"172.21.15.131:6839","nonce":3045714273}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/2978367338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":2978367338},{"type":"v1","addr":"172.21.15.131:6835","nonce":2978367338}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/3005995321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6835","nonce":3005995321},{"type":"v1","addr":"172.21.15.63:6837","nonce":3005995321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-21T01:19:53.915775+0000","modified":"2024-05-21T01:20:31.724475+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4276,"mds_1":4270,"mds_2":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"e","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.63:6833/574189772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":574189772},{"type":"v1","addr":"172.21.15.63:6833","nonce":574189772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4270":{"gid":4270,"name":"f","rank":1,"incarnation":10,"state":"up:active","state_seq":11,"addr":"172.21.15.131:6838/3071941741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":3071941741},{"type":"v1","addr":"172.21.15.131:6838","nonce":3071941741}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.63:6836/2892727989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":2892727989},{"type":"v1","addr":"172.21.15.63:6836","nonce":2892727989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4276,"qdb_cluster":[4267,4270,4276]},"id":1}]} 2024-05-21T01:23:53.904 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 15 2024-05-21T01:23:53.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:53.903+0000 7fb082c00640 1 -- 172.21.15.63:0/1447472603 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fb05806f400 msgr2=0x7fb0580718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:23:53.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:53.903+0000 7fb082c00640 1 --2- 172.21.15.63:0/1447472603 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fb05806f400 0x7fb0580718c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb064006aa0 tx=0x7fb064006a30 comp rx=0 tx=0).stop 2024-05-21T01:23:53.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:53.903+0000 7fb082c00640 1 -- 172.21.15.63:0/1447472603 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb07c0ca810 msgr2=0x7fb07c15c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:23:53.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:53.903+0000 7fb082c00640 1 --2- 172.21.15.63:0/1447472603 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb07c0ca810 0x7fb07c15c320 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb06c007e90 tx=0x7fb06c00e4b0 comp rx=0 tx=0).stop 2024-05-21T01:23:53.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:53.907+0000 7fb082c00640 1 -- 172.21.15.63:0/1447472603 shutdown_connections 2024-05-21T01:23:53.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:53.907+0000 7fb082c00640 1 --2- 172.21.15.63:0/1447472603 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fb05806f400 0x7fb0580718c0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:23:53.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:53.907+0000 7fb082c00640 1 --2- 172.21.15.63:0/1447472603 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb07c0cfb70 0x7fb07c150c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:23:53.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:53.907+0000 7fb082c00640 1 --2- 172.21.15.63:0/1447472603 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb07c0cf790 0x7fb07c06e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:23:53.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:53.907+0000 7fb082c00640 1 --2- 172.21.15.63:0/1447472603 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb07c0ca810 0x7fb07c15c320 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:23:53.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:53.907+0000 7fb082c00640 1 -- 172.21.15.63:0/1447472603 >> 172.21.15.63:0/1447472603 conn(0x7fb07c0735f0 msgr2=0x7fb07c1514f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:23:53.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:53.907+0000 7fb082c00640 1 -- 172.21.15.63:0/1447472603 shutdown_connections 2024-05-21T01:23:53.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:53.907+0000 7fb082c00640 1 -- 172.21.15.63:0/1447472603 wait complete. 2024-05-21T01:23:53.935 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4276 quiesce db / --timeout 90 --expiration 139.8 --await-for 45.0' 2024-05-21T01:23:53.935 DEBUG:teuthology.orchestra.run.smithi063:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4276 quiesce db / --timeout 90 --expiration 139.8 --await-for 45.0 2024-05-21T01:23:54.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.167+0000 7f8718c00640 1 Processor -- start 2024-05-21T01:23:54.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.167+0000 7f8718c00640 1 -- start start 2024-05-21T01:23:54.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.167+0000 7f8718c00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f871406f4d0 0x7f87140c6850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:23:54.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.167+0000 7f8718c00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f871406f8b0 0x7f87140cd630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:23:54.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.167+0000 7f8718c00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87140cdf40 con 0x7f8714153a60 2024-05-21T01:23:54.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.167+0000 7f8718c00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f87140c6590 con 0x7f871406f4d0 2024-05-21T01:23:54.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.167+0000 7f8718c00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f871415b570 con 0x7f871406f8b0 2024-05-21T01:23:54.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.167+0000 7f8712800640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f8714153a60 0x7f871415ba00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:49720/0 (socket says 172.21.15.63:49720) 2024-05-21T01:23:54.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.167+0000 7f8712800640 1 -- 172.21.15.63:0/3984612475 learned_addr learned my addr 172.21.15.63:0/3984612475 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-05-21T01:23:54.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.167+0000 7f8711400640 1 --2- 172.21.15.63:0/3984612475 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f871406f8b0 0x7f87140cd630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:23:54.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.167+0000 7f8711e00640 1 --2- 172.21.15.63:0/3984612475 >> v2:172.21.15.131:3300/0 conn(0x7f871406f4d0 0x7f87140c6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:23:54.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.167+0000 7f8711400640 1 -- 172.21.15.63:0/3984612475 >> v2:172.21.15.131:3300/0 conn(0x7f871406f4d0 msgr2=0x7f87140c6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:23:54.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.167+0000 7f8711400640 1 --2- 172.21.15.63:0/3984612475 >> v2:172.21.15.131:3300/0 conn(0x7f871406f4d0 0x7f87140c6850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:23:54.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.167+0000 7f8711400640 1 -- 172.21.15.63:0/3984612475 >> v1:172.21.15.63:6789/0 conn(0x7f8714153a60 legacy=0x7f871415ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:23:54.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.167+0000 7f8710a00640 1 -- 172.21.15.63:0/3984612475 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 528827224 0 0) 0x7f87140cdf40 con 0x7f8714153a60 2024-05-21T01:23:54.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.167+0000 7f8711400640 1 -- 172.21.15.63:0/3984612475 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87140c6f00 con 0x7f871406f8b0 2024-05-21T01:23:54.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.167+0000 7f8711e00640 1 --2- 172.21.15.63:0/3984612475 >> v2:172.21.15.131:3300/0 conn(0x7f871406f4d0 0x7f87140c6850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-21T01:23:54.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.171+0000 7f8711400640 1 --2- 172.21.15.63:0/3984612475 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f871406f8b0 0x7f87140cd630 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f86fc0097c0 tx=0x7f86fc01c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fda92c1de47df100 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:23:54.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.171+0000 7f8710a00640 1 -- 172.21.15.63:0/3984612475 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86fc0aa600 con 0x7f871406f8b0 2024-05-21T01:23:54.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.171+0000 7f8710a00640 1 -- 172.21.15.63:0/3984612475 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86fc0af070 con 0x7f871406f8b0 2024-05-21T01:23:54.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.171+0000 7f8710a00640 1 -- 172.21.15.63:0/3984612475 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86fc0aa9c0 con 0x7f871406f8b0 2024-05-21T01:23:54.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.171+0000 7f8718c00640 1 -- 172.21.15.63:0/3984612475 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f871406f8b0 msgr2=0x7f87140cd630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:23:54.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.171+0000 7f8718c00640 1 --2- 172.21.15.63:0/3984612475 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f871406f8b0 0x7f87140cd630 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f86fc0097c0 tx=0x7f86fc01c4a0 comp rx=0 tx=0).stop 2024-05-21T01:23:54.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.171+0000 7f8718c00640 1 -- 172.21.15.63:0/3984612475 shutdown_connections 2024-05-21T01:23:54.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.171+0000 7f8718c00640 1 --2- 172.21.15.63:0/3984612475 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f871406f8b0 0x7f87140cd630 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:23:54.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.171+0000 7f8718c00640 1 --2- 172.21.15.63:0/3984612475 >> v2:172.21.15.131:3300/0 conn(0x7f871406f4d0 0x7f87140c6850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:23:54.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.171+0000 7f8718c00640 1 -- 172.21.15.63:0/3984612475 >> 172.21.15.63:0/3984612475 conn(0x7f8714068290 msgr2=0x7f87140686a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:23:54.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.171+0000 7f8718c00640 1 -- 172.21.15.63:0/3984612475 shutdown_connections 2024-05-21T01:23:54.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.171+0000 7f8718c00640 1 -- 172.21.15.63:0/3984612475 wait complete. 2024-05-21T01:23:54.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.175+0000 7f8718c00640 1 Processor -- start 2024-05-21T01:23:54.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.175+0000 7f8718c00640 1 -- start start 2024-05-21T01:23:54.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.175+0000 7f8718c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f871406f4d0 0x7f87141533f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:23:54.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.175+0000 7f8718c00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f871406f8b0 0x7f87140cba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:23:54.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.175+0000 7f8718c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8714153a60 0x7f87140cc980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:23:54.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.175+0000 7f8718c00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f87140cdb70 con 0x7f8714153a60 2024-05-21T01:23:54.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.175+0000 7f8718c00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f871415b200 con 0x7f871406f4d0 2024-05-21T01:23:54.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.175+0000 7f8718c00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f87141542c0 con 0x7f871406f8b0 2024-05-21T01:23:54.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.175+0000 7f8712800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8714153a60 0x7f87140cc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:23:54.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.175+0000 7f8711e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f871406f4d0 0x7f87141533f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:23:54.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.175+0000 7f8712800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8714153a60 0x7f87140cc980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35842/0 (socket says 172.21.15.63:35842) 2024-05-21T01:23:54.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.175+0000 7f8712800640 1 -- 172.21.15.63:0/1295741344 learned_addr learned my addr 172.21.15.63:0/1295741344 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:23:54.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.175+0000 7f8711400640 1 --2- 172.21.15.63:0/1295741344 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f871406f8b0 0x7f87140cba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:23:54.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.175+0000 7f8712800640 1 -- 172.21.15.63:0/1295741344 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f871406f8b0 msgr2=0x7f87140cba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:23:54.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.175+0000 7f8712800640 1 --2- 172.21.15.63:0/1295741344 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f871406f8b0 0x7f87140cba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:23:54.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.175+0000 7f8712800640 1 -- 172.21.15.63:0/1295741344 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f871406f4d0 msgr2=0x7f87141533f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:23:54.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.175+0000 7f8712800640 1 --2- 172.21.15.63:0/1295741344 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f871406f4d0 0x7f87141533f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:23:54.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.175+0000 7f8712800640 1 -- 172.21.15.63:0/1295741344 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8714076d50 con 0x7f8714153a60 2024-05-21T01:23:54.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.175+0000 7f8712800640 1 --2- 172.21.15.63:0/1295741344 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8714153a60 0x7f87140cc980 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f870400c3f0 tx=0x7f870400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:23:54.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.175+0000 7f870a000640 1 -- 172.21.15.63:0/1295741344 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87040074e0 con 0x7f8714153a60 2024-05-21T01:23:54.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.175+0000 7f8718c00640 1 -- 172.21.15.63:0/1295741344 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8714152cc0 con 0x7f8714153a60 2024-05-21T01:23:54.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.175+0000 7f8718c00640 1 -- 172.21.15.63:0/1295741344 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87141517f0 con 0x7f8714153a60 2024-05-21T01:23:54.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.175+0000 7f870a000640 1 -- 172.21.15.63:0/1295741344 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87040047f0 con 0x7f8714153a60 2024-05-21T01:23:54.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.175+0000 7f870a000640 1 -- 172.21.15.63:0/1295741344 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8704007680 con 0x7f8714153a60 2024-05-21T01:23:54.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.179+0000 7f870a000640 1 -- 172.21.15.63:0/1295741344 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7f8704011070 con 0x7f8714153a60 2024-05-21T01:23:54.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.179+0000 7f870a000640 1 --2- 172.21.15.63:0/1295741344 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f86f006f400 0x7f86f00718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:23:54.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.179+0000 7f870a000640 1 -- 172.21.15.63:0/1295741344 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f870408ee90 con 0x7f8714153a60 2024-05-21T01:23:54.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.179+0000 7f8711e00640 1 --2- 172.21.15.63:0/1295741344 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f86f006f400 0x7f86f00718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:23:54.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.179+0000 7f8711e00640 1 --2- 172.21.15.63:0/1295741344 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f86f006f400 0x7f86f00718c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f870c009bd0 tx=0x7f870c00b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:23:54.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.183+0000 7f871c142000 1 Processor -- start 2024-05-21T01:23:54.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.183+0000 7f871c142000 1 -- start start 2024-05-21T01:23:54.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.183+0000 7f871c142000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558713bd7130 0x558713ba0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:23:54.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.183+0000 7f871c142000 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558713ba1100 0x558713bdbbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:23:54.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.183+0000 7f871c142000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558713bdc100 0x558713bdc4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:23:54.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.183+0000 7f871c142000 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5587139f6740 con 0x558713ba1100 2024-05-21T01:23:54.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.183+0000 7f871c142000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5587139e62e0 con 0x558713bd7130 2024-05-21T01:23:54.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.183+0000 7f871c142000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5587139ea320 con 0x558713bdc100 2024-05-21T01:23:54.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.183+0000 7f8711400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558713ba1100 0x558713bdbbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:23:54.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.183+0000 7f8711400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558713ba1100 0x558713bdbbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35848/0 (socket says 172.21.15.63:35848) 2024-05-21T01:23:54.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.183+0000 7f8711400640 1 -- 172.21.15.63:0/3442948274 learned_addr learned my addr 172.21.15.63:0/3442948274 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:23:54.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.183+0000 7f8712800640 1 --2- 172.21.15.63:0/3442948274 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558713bdc100 0x558713bdc4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:23:54.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.183+0000 7f8711e00640 1 --2- 172.21.15.63:0/3442948274 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558713bd7130 0x558713ba0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:23:54.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.183+0000 7f8711400640 1 -- 172.21.15.63:0/3442948274 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558713bdc100 msgr2=0x558713bdc4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:23:54.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.183+0000 7f8711400640 1 --2- 172.21.15.63:0/3442948274 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558713bdc100 0x558713bdc4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:23:54.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.183+0000 7f8711400640 1 -- 172.21.15.63:0/3442948274 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558713bd7130 msgr2=0x558713ba0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:23:54.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.183+0000 7f8711400640 1 --2- 172.21.15.63:0/3442948274 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558713bd7130 0x558713ba0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:23:54.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.183+0000 7f8711400640 1 -- 172.21.15.63:0/3442948274 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558713988490 con 0x558713ba1100 2024-05-21T01:23:54.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.183+0000 7f8711400640 1 --2- 172.21.15.63:0/3442948274 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558713ba1100 0x558713bdbbc0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f86fc01c4e0 tx=0x7f86fc004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=867bd36fbcff8238 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:23:54.188 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.183+0000 7f8702a00640 1 -- 172.21.15.63:0/3442948274 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86fc0aa970 con 0x558713ba1100 2024-05-21T01:23:54.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.183+0000 7f8702a00640 1 -- 172.21.15.63:0/3442948274 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86fc0af040 con 0x558713ba1100 2024-05-21T01:23:54.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.183+0000 7f8702a00640 1 -- 172.21.15.63:0/3442948274 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86fc0aad10 con 0x558713ba1100 2024-05-21T01:23:54.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.187+0000 7f871c142000 1 -- 172.21.15.63:0/3442948274 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558713ba1100 msgr2=0x558713bdbbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:23:54.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.187+0000 7f871c142000 1 --2- 172.21.15.63:0/3442948274 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558713ba1100 0x558713bdbbc0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f86fc01c4e0 tx=0x7f86fc004740 comp rx=0 tx=0).stop 2024-05-21T01:23:54.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.187+0000 7f871c142000 1 -- 172.21.15.63:0/3442948274 shutdown_connections 2024-05-21T01:23:54.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.187+0000 7f871c142000 1 --2- 172.21.15.63:0/3442948274 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558713bdc100 0x558713bdc4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:23:54.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.187+0000 7f871c142000 1 --2- 172.21.15.63:0/3442948274 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558713ba1100 0x558713bdbbc0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:23:54.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.187+0000 7f871c142000 1 --2- 172.21.15.63:0/3442948274 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558713bd7130 0x558713ba0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:23:54.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.187+0000 7f871c142000 1 -- 172.21.15.63:0/3442948274 >> 172.21.15.63:0/3442948274 conn(0x558713a82d80 msgr2=0x558713bd9980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:23:54.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.187+0000 7f871c142000 1 -- 172.21.15.63:0/3442948274 shutdown_connections 2024-05-21T01:23:54.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.187+0000 7f871c142000 1 -- 172.21.15.63:0/3442948274 wait complete. 2024-05-21T01:23:54.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.187+0000 7f871c142000 1 -- start start 2024-05-21T01:23:54.190 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.187+0000 7f871c142000 1 Processor -- start 2024-05-21T01:23:54.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.187+0000 7f871c142000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558713ba1100 0x558713b9b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:23:54.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.187+0000 7f871c142000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558713bd7130 0x558713b9be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:23:54.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.187+0000 7f871c142000 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558713bdc100 0x558713b9c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:23:54.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.187+0000 7f871c142000 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5587136b1b10 con 0x558713bdc100 2024-05-21T01:23:54.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.187+0000 7f871c142000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5587139a2670 con 0x558713ba1100 2024-05-21T01:23:54.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.187+0000 7f871c142000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5587139ee950 con 0x558713bd7130 2024-05-21T01:23:54.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.187+0000 7f871c142000 10 client.0 _ll_register_callbacks cb 0x558713b86540 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-21T01:23:54.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.187+0000 7f8712800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558713bdc100 0x558713b9c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:23:54.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.187+0000 7f8712800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558713bdc100 0x558713b9c350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35852/0 (socket says 172.21.15.63:35852) 2024-05-21T01:23:54.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.187+0000 7f8712800640 1 -- 172.21.15.63:0/736525929 learned_addr learned my addr 172.21.15.63:0/736525929 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:23:54.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.187+0000 7f8711e00640 1 --2- 172.21.15.63:0/736525929 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558713ba1100 0x558713b9b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:23:54.193 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.187+0000 7f8711400640 1 --2- 172.21.15.63:0/736525929 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558713bd7130 0x558713b9be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:23:54.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.191+0000 7f8712800640 1 -- 172.21.15.63:0/736525929 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558713bd7130 msgr2=0x558713b9be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:23:54.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.191+0000 7f8712800640 1 --2- 172.21.15.63:0/736525929 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558713bd7130 0x558713b9be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:23:54.194 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.191+0000 7f8712800640 1 -- 172.21.15.63:0/736525929 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558713ba1100 msgr2=0x558713b9b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:23:54.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.191+0000 7f8712800640 1 --2- 172.21.15.63:0/736525929 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558713ba1100 0x558713b9b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:23:54.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.191+0000 7f8712800640 1 -- 172.21.15.63:0/736525929 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55871399be40 con 0x558713bdc100 2024-05-21T01:23:54.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.191+0000 7f8712800640 1 --2- 172.21.15.63:0/736525929 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558713bdc100 0x558713b9c350 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f87040585a0 tx=0x7f870405af00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ff9e9de80ebce73 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:23:54.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.191+0000 7f86f7400640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-05-21T01:23:54.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.191+0000 7f86f7400640 1 -- 172.21.15.63:0/736525929 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8704074020 con 0x558713bdc100 2024-05-21T01:23:54.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.191+0000 7f86f7400640 1 -- 172.21.15.63:0/736525929 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f8704004ba0 con 0x558713bdc100 2024-05-21T01:23:54.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.191+0000 7f871c142000 1 -- 172.21.15.63:0/736525929 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f86fc0af040 con 0x558713bdc100 2024-05-21T01:23:54.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.191+0000 7f86f7400640 1 -- 172.21.15.63:0/736525929 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f8704064050 con 0x558713bdc100 2024-05-21T01:23:54.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.191+0000 7f871c142000 10 client.4926 fetch_fsmap learned FSMap version 15 2024-05-21T01:23:54.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.191+0000 7f871c142000 1 -- 172.21.15.63:0/736525929 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x558713a6b890 con 0x558713bdc100 2024-05-21T01:23:54.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.191+0000 7f86f7400640 1 -- 172.21.15.63:0/736525929 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86fc0af040 con 0x558713bdc100 2024-05-21T01:23:54.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.191+0000 7f86f7400640 1 -- 172.21.15.63:0/736525929 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 15) ==== 4752+0+0 (secure 0 0 0) 0x7f870407a2b0 con 0x558713bdc100 2024-05-21T01:23:54.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.191+0000 7f871c142000 10 client.4926 fetch_fsmap finished waiting for FSMap version 15 2024-05-21T01:23:54.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.191+0000 7f871c142000 10 client.4926 resolve_mds: validated gid 4276 aka daemon mds.c 2024-05-21T01:23:54.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.191+0000 7f871c142000 20 client.4926 populate_metadata read hostname 'smithi063' 2024-05-21T01:23:54.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.191+0000 7f871c142000 1 --2- 172.21.15.63:0/736525929 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x558713bef8c0 0x558713bf1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:23:54.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.191+0000 7f871c142000 4 client.4926 mds_command: new command op to 4276 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-21T01:23:54.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.191+0000 7f871c142000 1 -- 172.21.15.63:0/736525929 --> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5587139827f0 con 0x558713bef8c0 2024-05-21T01:23:54.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.191+0000 7f8711e00640 1 --2- 172.21.15.63:0/736525929 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x558713bef8c0 0x558713bf1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:23:54.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.191+0000 7f8711e00640 1 --2- 172.21.15.63:0/736525929 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x558713bef8c0 0x558713bf1cb0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=81400eb7a40e77aa server_cookie=4ca903ed25debebd in_seq=0 out_seq=0 2024-05-21T01:23:54.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.191+0000 7f86f7400640 10 client.4926 ms_handle_connect on v2:172.21.15.63:6834/2892727989 2024-05-21T01:23:54.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.191+0000 7f86f7400640 1 -- 172.21.15.63:0/736525929 <== mds.0 v2:172.21.15.63:6834/2892727989 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x5587139827f0 con 0x558713bef8c0 2024-05-21T01:23:54.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.191+0000 7f86f7400640 10 client.4926 handle_command_reply: tid=0 2024-05-21T01:23:54.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.191+0000 7f871c142000 1 client.4926 shutdown 2024-05-21T01:23:54.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.191+0000 7f871c142000 1 -- 172.21.15.63:0/736525929 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558713bdc100 msgr2=0x558713b9c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:23:54.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.191+0000 7f871c142000 1 --2- 172.21.15.63:0/736525929 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558713bdc100 0x558713b9c350 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f87040585a0 tx=0x7f870405af00 comp rx=0 tx=0).stop 2024-05-21T01:23:54.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.191+0000 7f871c142000 1 -- 172.21.15.63:0/736525929 shutdown_connections 2024-05-21T01:23:54.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.191+0000 7f871c142000 1 --2- 172.21.15.63:0/736525929 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x558713bef8c0 0x558713bf1cb0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:23:54.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.191+0000 7f871c142000 1 --2- 172.21.15.63:0/736525929 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558713bdc100 0x558713b9c350 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:23:54.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.191+0000 7f871c142000 1 --2- 172.21.15.63:0/736525929 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558713bd7130 0x558713b9be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:23:54.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.191+0000 7f871c142000 1 --2- 172.21.15.63:0/736525929 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558713ba1100 0x558713b9b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:23:54.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.191+0000 7f871c142000 1 -- 172.21.15.63:0/736525929 >> 172.21.15.63:0/736525929 conn(0x558713a82d80 msgr2=0x558713ba0330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:23:54.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.191+0000 7f86f7400640 0 client.4926 ms_handle_reset on v2:172.21.15.63:6834/2892727989 2024-05-21T01:23:54.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.191+0000 7f871c142000 1 -- 172.21.15.63:0/736525929 shutdown_connections 2024-05-21T01:23:54.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.195+0000 7f871c142000 1 -- 172.21.15.63:0/736525929 wait complete. 2024-05-21T01:23:54.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.195+0000 7f871c142000 20 client.4926 trim_cache size 0 max 16384 2024-05-21T01:23:54.231 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.227+0000 7f871c142000 1 Processor -- start 2024-05-21T01:23:54.231 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.227+0000 7f871c142000 1 -- start start 2024-05-21T01:23:54.233 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.231+0000 7f871c142000 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558713ba1100 0x558713c50280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:23:54.233 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.231+0000 7f871c142000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558713bd7130 0x558713c507c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:23:54.233 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.231+0000 7f871c142000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558713bdc100 0x558713c50d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:23:54.233 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.231+0000 7f871c142000 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f86ec00ce20 con 0x558713ba1100 2024-05-21T01:23:54.233 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.231+0000 7f871c142000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f86ec00c0e0 con 0x558713bd7130 2024-05-21T01:23:54.233 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.231+0000 7f871c142000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f86ec00c750 con 0x558713bdc100 2024-05-21T01:23:54.233 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.231+0000 7f8711e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558713ba1100 0x558713c50280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:23:54.233 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.231+0000 7f8711e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558713ba1100 0x558713c50280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35856/0 (socket says 172.21.15.63:35856) 2024-05-21T01:23:54.233 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.231+0000 7f8711e00640 1 -- 172.21.15.63:0/710791200 learned_addr learned my addr 172.21.15.63:0/710791200 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:23:54.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.231+0000 7f8711400640 1 --2- 172.21.15.63:0/710791200 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558713bd7130 0x558713c507c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:23:54.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.231+0000 7f8712800640 1 --2- 172.21.15.63:0/710791200 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558713bdc100 0x558713c50d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:23:54.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.231+0000 7f8711e00640 1 -- 172.21.15.63:0/710791200 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558713bdc100 msgr2=0x558713c50d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:23:54.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.231+0000 7f8711e00640 1 --2- 172.21.15.63:0/710791200 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558713bdc100 0x558713c50d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:23:54.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.231+0000 7f8711e00640 1 -- 172.21.15.63:0/710791200 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558713bd7130 msgr2=0x558713c507c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:23:54.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.231+0000 7f8711e00640 1 --2- 172.21.15.63:0/710791200 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558713bd7130 0x558713c507c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:23:54.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.231+0000 7f8711e00640 1 -- 172.21.15.63:0/710791200 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558713a42da0 con 0x558713ba1100 2024-05-21T01:23:54.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.231+0000 7f8711e00640 1 --2- 172.21.15.63:0/710791200 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558713ba1100 0x558713c50280 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f870c003f90 tx=0x7f870c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef45af3552d0cd89 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:23:54.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.231+0000 7f8702000640 1 -- 172.21.15.63:0/710791200 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f870c031070 con 0x558713ba1100 2024-05-21T01:23:54.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.231+0000 7f8702000640 1 -- 172.21.15.63:0/710791200 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f870c02b4f0 con 0x558713ba1100 2024-05-21T01:23:54.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.231+0000 7f8702000640 1 -- 172.21.15.63:0/710791200 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f870c02b8a0 con 0x558713ba1100 2024-05-21T01:23:54.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.231+0000 7f871c142000 1 -- 172.21.15.63:0/710791200 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558713ba1100 msgr2=0x558713c50280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:23:54.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.231+0000 7f871c142000 1 --2- 172.21.15.63:0/710791200 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558713ba1100 0x558713c50280 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f870c003f90 tx=0x7f870c014000 comp rx=0 tx=0).stop 2024-05-21T01:23:54.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.231+0000 7f871c142000 1 -- 172.21.15.63:0/710791200 shutdown_connections 2024-05-21T01:23:54.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.231+0000 7f871c142000 1 --2- 172.21.15.63:0/710791200 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558713bdc100 0x558713c50d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:23:54.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.231+0000 7f871c142000 1 --2- 172.21.15.63:0/710791200 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558713bd7130 0x558713c507c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:23:54.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.231+0000 7f871c142000 1 --2- 172.21.15.63:0/710791200 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558713ba1100 0x558713c50280 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:23:54.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.231+0000 7f871c142000 1 -- 172.21.15.63:0/710791200 >> 172.21.15.63:0/710791200 conn(0x558713a82d80 msgr2=0x558713bdb440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:23:54.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.231+0000 7f871c142000 1 -- 172.21.15.63:0/710791200 shutdown_connections 2024-05-21T01:23:54.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.231+0000 7f871c142000 1 -- 172.21.15.63:0/710791200 wait complete. 2024-05-21T01:23:54.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.235+0000 7f871c142000 1 -- start start 2024-05-21T01:23:54.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.235+0000 7f871c142000 1 Processor -- start 2024-05-21T01:23:54.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.235+0000 7f871c142000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558713ba1100 0x558713c4e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:23:54.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.235+0000 7f871c142000 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558713bd7130 0x558713c4e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:23:54.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.235+0000 7f871c142000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558713bdc100 0x558713c4ef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:23:54.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.235+0000 7f871c142000 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5587139e20e0 con 0x558713bd7130 2024-05-21T01:23:54.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.235+0000 7f871c142000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x558713a6b400 con 0x558713ba1100 2024-05-21T01:23:54.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.235+0000 7f871c142000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55871397f3e0 con 0x558713bdc100 2024-05-21T01:23:54.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.235+0000 7f871c142000 10 client.0 _ll_register_callbacks cb 0x7f8704001120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-21T01:23:54.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.235+0000 7f8711400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558713bd7130 0x558713c4e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:23:54.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.235+0000 7f8711400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558713bd7130 0x558713c4e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35870/0 (socket says 172.21.15.63:35870) 2024-05-21T01:23:54.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.235+0000 7f8711e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558713ba1100 0x558713c4e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:23:54.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.235+0000 7f8711400640 1 -- 172.21.15.63:0/3152749566 learned_addr learned my addr 172.21.15.63:0/3152749566 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:23:54.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.235+0000 7f8712800640 1 --2- 172.21.15.63:0/3152749566 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558713bdc100 0x558713c4ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:23:54.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.235+0000 7f8711400640 1 -- 172.21.15.63:0/3152749566 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558713bdc100 msgr2=0x558713c4ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:23:54.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.235+0000 7f8711400640 1 --2- 172.21.15.63:0/3152749566 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558713bdc100 0x558713c4ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:23:54.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.235+0000 7f8711400640 1 -- 172.21.15.63:0/3152749566 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558713ba1100 msgr2=0x558713c4e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:23:54.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.235+0000 7f8711400640 1 --2- 172.21.15.63:0/3152749566 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558713ba1100 0x558713c4e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:23:54.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.235+0000 7f8711400640 1 -- 172.21.15.63:0/3152749566 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55871397af40 con 0x558713bd7130 2024-05-21T01:23:54.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.235+0000 7f8712800640 1 --2- 172.21.15.63:0/3152749566 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558713bdc100 0x558713c4ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T01:23:54.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.235+0000 7f8711400640 1 --2- 172.21.15.63:0/3152749566 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558713bd7130 0x558713c4e7a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f86fc008010 tx=0x7f86fc01ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1be26df0edf1327 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:23:54.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.235+0000 7f86f7400640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-05-21T01:23:54.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.235+0000 7f86f7400640 1 -- 172.21.15.63:0/3152749566 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86fc0ce060 con 0x558713bd7130 2024-05-21T01:23:54.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.235+0000 7f86f7400640 1 -- 172.21.15.63:0/3152749566 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f86fc0aa770 con 0x558713bd7130 2024-05-21T01:23:54.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.235+0000 7f871c142000 1 -- 172.21.15.63:0/3152749566 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f870c02b4f0 con 0x558713bd7130 2024-05-21T01:23:54.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.235+0000 7f86f7400640 1 -- 172.21.15.63:0/3152749566 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f86fc0aa990 con 0x558713bd7130 2024-05-21T01:23:54.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.235+0000 7f871c142000 10 client.4932 fetch_fsmap learned FSMap version 15 2024-05-21T01:23:54.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.235+0000 7f871c142000 1 -- 172.21.15.63:0/3152749566 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x55871398df80 con 0x558713bd7130 2024-05-21T01:23:54.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.235+0000 7f86f7400640 1 -- 172.21.15.63:0/3152749566 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f870c02b4f0 con 0x558713bd7130 2024-05-21T01:23:54.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.235+0000 7f86f7400640 1 -- 172.21.15.63:0/3152749566 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 15) ==== 4752+0+0 (secure 0 0 0) 0x7f86fc0aab30 con 0x558713bd7130 2024-05-21T01:23:54.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.239+0000 7f871c142000 10 client.4932 fetch_fsmap finished waiting for FSMap version 15 2024-05-21T01:23:54.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.239+0000 7f871c142000 10 client.4932 resolve_mds: validated gid 4276 aka daemon mds.c 2024-05-21T01:23:54.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.239+0000 7f871c142000 20 client.4932 populate_metadata read hostname 'smithi063' 2024-05-21T01:23:54.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.239+0000 7f871c142000 1 --2- 172.21.15.63:0/3152749566 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x558713c4f860 0x558713c4fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:23:54.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.239+0000 7f871c142000 4 client.4932 mds_command: new command op to 4276 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 139.8, "await_for": 45.0}] 2024-05-21T01:23:54.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.239+0000 7f871c142000 1 -- 172.21.15.63:0/3152749566 --> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 139.8, "await_for": 45.0}) -- 0x5587139c3e60 con 0x558713c4f860 2024-05-21T01:23:54.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.239+0000 7f8711e00640 1 --2- 172.21.15.63:0/3152749566 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x558713c4f860 0x558713c4fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:23:54.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.239+0000 7f8711e00640 1 --2- 172.21.15.63:0/3152749566 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x558713c4f860 0x558713c4fc70 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96f32a9a111acd3 server_cookie=653a690d26a5b4d6 in_seq=0 out_seq=0 2024-05-21T01:23:54.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.239+0000 7f86f7400640 10 client.4932 ms_handle_connect on v2:172.21.15.63:6834/2892727989 2024-05-21T01:23:54.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.275+0000 7f86f7400640 1 -- 172.21.15.63:0/3152749566 <== mds.0 v2:172.21.15.63:6834/2892727989 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x5587139c3e60 con 0x558713c4f860 2024-05-21T01:23:54.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.275+0000 7f86f7400640 10 client.4932 handle_command_reply: tid=0 2024-05-21T01:23:54.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.279+0000 7f871c142000 1 client.4932 shutdown 2024-05-21T01:23:54.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.279+0000 7f871c142000 1 -- 172.21.15.63:0/3152749566 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558713bd7130 msgr2=0x558713c4e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:23:54.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.279+0000 7f871c142000 1 --2- 172.21.15.63:0/3152749566 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558713bd7130 0x558713c4e7a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f86fc008010 tx=0x7f86fc01ace0 comp rx=0 tx=0).stop 2024-05-21T01:23:54.282 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.279+0000 7f871c142000 1 -- 172.21.15.63:0/3152749566 shutdown_connections 2024-05-21T01:23:54.282 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.279+0000 7f871c142000 1 --2- 172.21.15.63:0/3152749566 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x558713c4f860 0x558713c4fc70 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:23:54.282 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.279+0000 7f871c142000 1 --2- 172.21.15.63:0/3152749566 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x558713bdc100 0x558713c4ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:23:54.282 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.279+0000 7f871c142000 1 --2- 172.21.15.63:0/3152749566 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x558713bd7130 0x558713c4e7a0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:23:54.282 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.279+0000 7f871c142000 1 --2- 172.21.15.63:0/3152749566 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558713ba1100 0x558713c4e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:23:54.282 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.279+0000 7f871c142000 1 -- 172.21.15.63:0/3152749566 >> 172.21.15.63:0/3152749566 conn(0x558713a82d80 msgr2=0x558713bdb850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:23:54.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.279+0000 7f86f7400640 0 client.4932 ms_handle_reset on v2:172.21.15.63:6834/2892727989 2024-05-21T01:23:54.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.279+0000 7f871c142000 1 -- 172.21.15.63:0/3152749566 shutdown_connections 2024-05-21T01:23:54.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.279+0000 7f871c142000 1 -- 172.21.15.63:0/3152749566 wait complete. 2024-05-21T01:23:54.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.279+0000 7f871c142000 20 client.4932 trim_cache size 0 max 16384 2024-05-21T01:23:54.283 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-05-21T01:23:54.283 INFO:teuthology.orchestra.run.smithi063.stdout: "epoch": 15, 2024-05-21T01:23:54.283 INFO:teuthology.orchestra.run.smithi063.stdout: "leader": 4276, 2024-05-21T01:23:54.284 INFO:teuthology.orchestra.run.smithi063.stdout: "set_version": 10, 2024-05-21T01:23:54.284 INFO:teuthology.orchestra.run.smithi063.stdout: "sets": { 2024-05-21T01:23:54.284 INFO:teuthology.orchestra.run.smithi063.stdout: "35433fa7": { 2024-05-21T01:23:54.284 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 10, 2024-05-21T01:23:54.284 INFO:teuthology.orchestra.run.smithi063.stdout: "age_ref": 0.0, 2024-05-21T01:23:54.284 INFO:teuthology.orchestra.run.smithi063.stdout: "state": { 2024-05-21T01:23:54.284 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "QUIESCED", 2024-05-21T01:23:54.284 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 0.0 2024-05-21T01:23:54.284 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-05-21T01:23:54.284 INFO:teuthology.orchestra.run.smithi063.stdout: "timeout": 90.0, 2024-05-21T01:23:54.284 INFO:teuthology.orchestra.run.smithi063.stdout: "expiration": 139.8, 2024-05-21T01:23:54.284 INFO:teuthology.orchestra.run.smithi063.stdout: "members": { 2024-05-21T01:23:54.284 INFO:teuthology.orchestra.run.smithi063.stdout: "file:/": { 2024-05-21T01:23:54.284 INFO:teuthology.orchestra.run.smithi063.stdout: "excluded": false, 2024-05-21T01:23:54.284 INFO:teuthology.orchestra.run.smithi063.stdout: "state": { 2024-05-21T01:23:54.285 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "QUIESCED", 2024-05-21T01:23:54.285 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 0.0 2024-05-21T01:23:54.285 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-05-21T01:23:54.285 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-05-21T01:23:54.285 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-05-21T01:23:54.285 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-05-21T01:23:54.285 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-05-21T01:23:54.285 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-05-21T01:23:54.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.291+0000 7f8718c00640 1 -- 172.21.15.63:0/1295741344 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f86f006f400 msgr2=0x7f86f00718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:23:54.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.291+0000 7f8718c00640 1 --2- 172.21.15.63:0/1295741344 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f86f006f400 0x7f86f00718c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f870c009bd0 tx=0x7f870c00b040 comp rx=0 tx=0).stop 2024-05-21T01:23:54.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.291+0000 7f8718c00640 1 -- 172.21.15.63:0/1295741344 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8714153a60 msgr2=0x7f87140cc980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:23:54.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.291+0000 7f8718c00640 1 --2- 172.21.15.63:0/1295741344 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8714153a60 0x7f87140cc980 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f870400c3f0 tx=0x7f870400c8b0 comp rx=0 tx=0).stop 2024-05-21T01:23:54.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.291+0000 7f8718c00640 1 -- 172.21.15.63:0/1295741344 shutdown_connections 2024-05-21T01:23:54.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.291+0000 7f8718c00640 1 --2- 172.21.15.63:0/1295741344 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f86f006f400 0x7f86f00718c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:23:54.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.291+0000 7f8718c00640 1 --2- 172.21.15.63:0/1295741344 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8714153a60 0x7f87140cc980 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:23:54.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.291+0000 7f8718c00640 1 --2- 172.21.15.63:0/1295741344 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f871406f8b0 0x7f87140cba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:23:54.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.291+0000 7f8718c00640 1 --2- 172.21.15.63:0/1295741344 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f871406f4d0 0x7f87141533f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:23:54.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.291+0000 7f8718c00640 1 -- 172.21.15.63:0/1295741344 >> 172.21.15.63:0/1295741344 conn(0x7f8714068290 msgr2=0x7f871414cad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:23:54.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.291+0000 7f8718c00640 1 -- 172.21.15.63:0/1295741344 shutdown_connections 2024-05-21T01:23:54.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:23:54.291+0000 7f8718c00640 1 -- 172.21.15.63:0/1295741344 wait complete. 2024-05-21T01:23:54.336 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '35433fa7', quiesce took 1.2 seconds. Will release after: 18.6 2024-05-21T01:23:56.887 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-21T01:23:56.892 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-21T01:24:08.646 INFO:tasks.workunit.client.0.smithi063.stdout: 2024-05-21T01:24:08.647 INFO:tasks.workunit.client.0.smithi063.stdout: Children see throughput for 1 initial writers = 175279.28 kB/sec 2024-05-21T01:24:08.647 INFO:tasks.workunit.client.0.smithi063.stdout: Parent sees throughput for 1 initial writers = 175277.62 kB/sec 2024-05-21T01:24:08.647 INFO:tasks.workunit.client.0.smithi063.stdout: Min throughput per process = 175279.28 kB/sec 2024-05-21T01:24:08.647 INFO:tasks.workunit.client.0.smithi063.stdout: Max throughput per process = 175279.28 kB/sec 2024-05-21T01:24:08.647 INFO:tasks.workunit.client.0.smithi063.stdout: Avg throughput per process = 175279.28 kB/sec 2024-05-21T01:24:08.647 INFO:tasks.workunit.client.0.smithi063.stdout: Min xfer = 10485760.00 kB 2024-05-21T01:24:12.937 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-21T01:24:13.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.087+0000 7fcc4e200640 1 Processor -- start 2024-05-21T01:24:13.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.087+0000 7fcc4e200640 1 -- start start 2024-05-21T01:24:13.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.091+0000 7fcc4e200640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fcc4806f9b0 0x7fcc48152a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:24:13.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.091+0000 7fcc4e200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcc4815ce40 0x7fcc48152f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:24:13.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.091+0000 7fcc4e200640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc48072550 con 0x7fcc4806f5d0 2024-05-21T01:24:13.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.091+0000 7fcc4e200640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fcc48159100 con 0x7fcc4806f9b0 2024-05-21T01:24:13.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.091+0000 7fcc4e200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fcc481593e0 con 0x7fcc4815ce40 2024-05-21T01:24:13.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.091+0000 7fcc47e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcc4815ce40 0x7fcc48152f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:24:13.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.091+0000 7fcc3ea00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fcc4806f9b0 0x7fcc48152a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:24:13.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.091+0000 7fcc47e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcc4815ce40 0x7fcc48152f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.63:36706/0 (socket says 172.21.15.63:36706) 2024-05-21T01:24:13.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.091+0000 7fcc47e00640 1 -- 172.21.15.63:0/222608183 learned_addr learned my addr 172.21.15.63:0/222608183 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:24:13.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.091+0000 7fcc47e00640 1 -- 172.21.15.63:0/222608183 >> v2:172.21.15.131:3300/0 conn(0x7fcc4806f9b0 msgr2=0x7fcc48152a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:24:13.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.091+0000 7fcc47e00640 1 --2- 172.21.15.63:0/222608183 >> v2:172.21.15.131:3300/0 conn(0x7fcc4806f9b0 0x7fcc48152a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:24:13.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.091+0000 7fcc47e00640 1 -- 172.21.15.63:0/222608183 >> v1:172.21.15.131:6789/0 conn(0x7fcc4806f5d0 legacy=0x7fcc480c8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:24:13.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.091+0000 7fcc47e00640 1 -- 172.21.15.63:0/222608183 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc481596c0 con 0x7fcc4815ce40 2024-05-21T01:24:13.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.091+0000 7fcc3ea00640 1 --2- 172.21.15.63:0/222608183 >> v2:172.21.15.131:3300/0 conn(0x7fcc4806f9b0 0x7fcc48152a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-21T01:24:13.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.095+0000 7fcc47e00640 1 --2- 172.21.15.63:0/222608183 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcc4815ce40 0x7fcc48152f80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fcc40009e50 tx=0x7fcc4001ca30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46d437fe9200ba51 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:24:13.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.095+0000 7fcc46a00640 1 -- 172.21.15.63:0/222608183 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc400a57f0 con 0x7fcc4815ce40 2024-05-21T01:24:13.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.095+0000 7fcc46a00640 1 -- 172.21.15.63:0/222608183 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc400a5990 con 0x7fcc4815ce40 2024-05-21T01:24:13.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.095+0000 7fcc46a00640 1 -- 172.21.15.63:0/222608183 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc400a5d60 con 0x7fcc4815ce40 2024-05-21T01:24:13.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.095+0000 7fcc4e200640 1 -- 172.21.15.63:0/222608183 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcc4815ce40 msgr2=0x7fcc48152f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:24:13.097 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.095+0000 7fcc4e200640 1 --2- 172.21.15.63:0/222608183 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcc4815ce40 0x7fcc48152f80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fcc40009e50 tx=0x7fcc4001ca30 comp rx=0 tx=0).stop 2024-05-21T01:24:13.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.095+0000 7fcc4e200640 1 -- 172.21.15.63:0/222608183 shutdown_connections 2024-05-21T01:24:13.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.095+0000 7fcc4e200640 1 --2- 172.21.15.63:0/222608183 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcc4815ce40 0x7fcc48152f80 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:24:13.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.095+0000 7fcc4e200640 1 --2- 172.21.15.63:0/222608183 >> v2:172.21.15.131:3300/0 conn(0x7fcc4806f9b0 0x7fcc48152a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:24:13.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.095+0000 7fcc4e200640 1 -- 172.21.15.63:0/222608183 >> 172.21.15.63:0/222608183 conn(0x7fcc48068460 msgr2=0x7fcc48068870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:24:13.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.095+0000 7fcc4e200640 1 -- 172.21.15.63:0/222608183 shutdown_connections 2024-05-21T01:24:13.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.095+0000 7fcc4e200640 1 -- 172.21.15.63:0/222608183 wait complete. 2024-05-21T01:24:13.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.095+0000 7fcc4e200640 1 Processor -- start 2024-05-21T01:24:13.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.095+0000 7fcc4e200640 1 -- start start 2024-05-21T01:24:13.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.099+0000 7fcc4e200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcc4806f5d0 0x7fcc48143d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:24:13.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.099+0000 7fcc4e200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc4806f9b0 0x7fcc48157d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:24:13.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.099+0000 7fcc4e200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcc4815ce40 0x7fcc48158250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:24:13.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.099+0000 7fcc4e200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fcc481658a0 con 0x7fcc4815ce40 2024-05-21T01:24:13.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.099+0000 7fcc4e200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fcc48165720 con 0x7fcc4806f9b0 2024-05-21T01:24:13.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.099+0000 7fcc4e200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fcc48165a20 con 0x7fcc4806f5d0 2024-05-21T01:24:13.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.099+0000 7fcc47e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcc4815ce40 0x7fcc48158250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:24:13.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.099+0000 7fcc47e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcc4815ce40 0x7fcc48158250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42726/0 (socket says 172.21.15.63:42726) 2024-05-21T01:24:13.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.099+0000 7fcc47e00640 1 -- 172.21.15.63:0/34567470 learned_addr learned my addr 172.21.15.63:0/34567470 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:24:13.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.099+0000 7fcc3ea00640 1 --2- 172.21.15.63:0/34567470 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc4806f9b0 0x7fcc48157d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:24:13.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.099+0000 7fcc47400640 1 --2- 172.21.15.63:0/34567470 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcc4806f5d0 0x7fcc48143d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:24:13.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.099+0000 7fcc47e00640 1 -- 172.21.15.63:0/34567470 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcc4806f5d0 msgr2=0x7fcc48143d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:24:13.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.099+0000 7fcc47e00640 1 --2- 172.21.15.63:0/34567470 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcc4806f5d0 0x7fcc48143d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:24:13.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.099+0000 7fcc47e00640 1 -- 172.21.15.63:0/34567470 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc4806f9b0 msgr2=0x7fcc48157d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:24:13.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.099+0000 7fcc47e00640 1 --2- 172.21.15.63:0/34567470 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc4806f9b0 0x7fcc48157d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:24:13.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.099+0000 7fcc47e00640 1 -- 172.21.15.63:0/34567470 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc48156a40 con 0x7fcc4815ce40 2024-05-21T01:24:13.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.099+0000 7fcc47e00640 1 --2- 172.21.15.63:0/34567470 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcc4815ce40 0x7fcc48158250 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fcc400af040 tx=0x7fcc400197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:24:13.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.099+0000 7fcc3fe00640 1 -- 172.21.15.63:0/34567470 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc400b8440 con 0x7fcc4815ce40 2024-05-21T01:24:13.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.099+0000 7fcc3fe00640 1 -- 172.21.15.63:0/34567470 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc400b85e0 con 0x7fcc4815ce40 2024-05-21T01:24:13.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.099+0000 7fcc4e200640 1 -- 172.21.15.63:0/34567470 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc48146940 con 0x7fcc4815ce40 2024-05-21T01:24:13.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.099+0000 7fcc3fe00640 1 -- 172.21.15.63:0/34567470 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc400b89b0 con 0x7fcc4815ce40 2024-05-21T01:24:13.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.099+0000 7fcc4e200640 1 -- 172.21.15.63:0/34567470 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc48146ee0 con 0x7fcc4815ce40 2024-05-21T01:24:13.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.099+0000 7fcc4e200640 1 -- 172.21.15.63:0/34567470 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc480507f0 con 0x7fcc4815ce40 2024-05-21T01:24:13.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.103+0000 7fcc3fe00640 1 -- 172.21.15.63:0/34567470 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7fcc400c1020 con 0x7fcc4815ce40 2024-05-21T01:24:13.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.103+0000 7fcc3fe00640 1 --2- 172.21.15.63:0/34567470 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fcc2406f400 0x7fcc240718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:24:13.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.103+0000 7fcc3fe00640 1 -- 172.21.15.63:0/34567470 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7fcc4012a730 con 0x7fcc4815ce40 2024-05-21T01:24:13.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.103+0000 7fcc47400640 1 --2- 172.21.15.63:0/34567470 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fcc2406f400 0x7fcc240718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:24:13.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.103+0000 7fcc47400640 1 --2- 172.21.15.63:0/34567470 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fcc2406f400 0x7fcc240718c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fcc38007fd0 tx=0x7fcc38009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:24:13.108 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.107+0000 7fcc3fe00640 1 -- 172.21.15.63:0/34567470 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fcc48156a40 con 0x7fcc4815ce40 2024-05-21T01:24:13.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.307+0000 7fcc4e200640 1 -- 172.21.15.63:0/34567470 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcc48076130 con 0x7fcc4815ce40 2024-05-21T01:24:13.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.307+0000 7fcc3fe00640 1 -- 172.21.15.63:0/34567470 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+6876 (secure 0 0 0) 0x7fcc40016620 con 0x7fcc4815ce40 2024-05-21T01:24:13.311 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-05-21T01:24:13.311 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6839/3045714273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6837","nonce":3045714273},{"type":"v1","addr":"172.21.15.131:6839","nonce":3045714273}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/2978367338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":2978367338},{"type":"v1","addr":"172.21.15.131:6835","nonce":2978367338}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/3005995321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6835","nonce":3005995321},{"type":"v1","addr":"172.21.15.63:6837","nonce":3005995321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-21T01:19:53.915775+0000","modified":"2024-05-21T01:20:31.724475+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4276,"mds_1":4270,"mds_2":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"e","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.63:6833/574189772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":574189772},{"type":"v1","addr":"172.21.15.63:6833","nonce":574189772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4270":{"gid":4270,"name":"f","rank":1,"incarnation":10,"state":"up:active","state_seq":11,"addr":"172.21.15.131:6838/3071941741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":3071941741},{"type":"v1","addr":"172.21.15.131:6838","nonce":3071941741}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.63:6836/2892727989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":2892727989},{"type":"v1","addr":"172.21.15.63:6836","nonce":2892727989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4276,"qdb_cluster":[4267,4270,4276]},"id":1}]} 2024-05-21T01:24:13.312 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 15 2024-05-21T01:24:13.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.311+0000 7fcc4e200640 1 -- 172.21.15.63:0/34567470 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fcc2406f400 msgr2=0x7fcc240718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:24:13.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.311+0000 7fcc4e200640 1 --2- 172.21.15.63:0/34567470 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fcc2406f400 0x7fcc240718c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fcc38007fd0 tx=0x7fcc38009040 comp rx=0 tx=0).stop 2024-05-21T01:24:13.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.311+0000 7fcc4e200640 1 -- 172.21.15.63:0/34567470 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcc4815ce40 msgr2=0x7fcc48158250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:24:13.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.311+0000 7fcc4e200640 1 --2- 172.21.15.63:0/34567470 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcc4815ce40 0x7fcc48158250 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fcc400af040 tx=0x7fcc400197d0 comp rx=0 tx=0).stop 2024-05-21T01:24:13.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.311+0000 7fcc4e200640 1 -- 172.21.15.63:0/34567470 shutdown_connections 2024-05-21T01:24:13.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.311+0000 7fcc4e200640 1 --2- 172.21.15.63:0/34567470 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fcc2406f400 0x7fcc240718c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:24:13.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.311+0000 7fcc4e200640 1 --2- 172.21.15.63:0/34567470 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcc4815ce40 0x7fcc48158250 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:24:13.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.311+0000 7fcc4e200640 1 --2- 172.21.15.63:0/34567470 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc4806f9b0 0x7fcc48157d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:24:13.315 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.311+0000 7fcc4e200640 1 --2- 172.21.15.63:0/34567470 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcc4806f5d0 0x7fcc48143d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:24:13.315 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.311+0000 7fcc4e200640 1 -- 172.21.15.63:0/34567470 >> 172.21.15.63:0/34567470 conn(0x7fcc48068460 msgr2=0x7fcc48071da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:24:13.315 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.311+0000 7fcc4e200640 1 -- 172.21.15.63:0/34567470 shutdown_connections 2024-05-21T01:24:13.315 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.311+0000 7fcc4e200640 1 -- 172.21.15.63:0/34567470 wait complete. 2024-05-21T01:24:13.333 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4276 quiesce db --set-id 35433fa7 --release --await' 2024-05-21T01:24:13.334 DEBUG:teuthology.orchestra.run.smithi063:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4276 quiesce db --set-id 35433fa7 --release --await 2024-05-21T01:24:13.482 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.479+0000 7f8779800640 1 Processor -- start 2024-05-21T01:24:13.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.479+0000 7f8779800640 1 -- start start 2024-05-21T01:24:13.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.479+0000 7f8779800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f87740cc700 0x7f8774155e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:24:13.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.479+0000 7f8779800640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f87740ccae0 0x7f8774156350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:24:13.483 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.479+0000 7f8779800640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87740b4a00 con 0x7f87740b5aa0 2024-05-21T01:24:13.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.479+0000 7f8779800640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f87740b47b0 con 0x7f87740ccae0 2024-05-21T01:24:13.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.479+0000 7f8779800640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f87740b4ce0 con 0x7f87740cc700 2024-05-21T01:24:13.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.479+0000 7f876a000640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f87740ccae0 0x7f8774156350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:24:13.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.479+0000 7f876a000640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f87740ccae0 0x7f8774156350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42736/0 (socket says 172.21.15.63:42736) 2024-05-21T01:24:13.484 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.479+0000 7f876a000640 1 -- 172.21.15.63:0/2185782918 learned_addr learned my addr 172.21.15.63:0/2185782918 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:24:13.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.483+0000 7f8772a00640 1 --2- 172.21.15.63:0/2185782918 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f87740cc700 0x7f8774155e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:24:13.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.483+0000 7f876a000640 1 -- 172.21.15.63:0/2185782918 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f87740cc700 msgr2=0x7f8774155e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:24:13.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.483+0000 7f876a000640 1 --2- 172.21.15.63:0/2185782918 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f87740cc700 0x7f8774155e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:24:13.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.483+0000 7f876a000640 1 -- 172.21.15.63:0/2185782918 >> v1:172.21.15.131:6789/0 conn(0x7f87740b5aa0 legacy=0x7f87740b5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:24:13.485 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.483+0000 7f876a000640 1 -- 172.21.15.63:0/2185782918 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87740b4fc0 con 0x7f87740ccae0 2024-05-21T01:24:13.487 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.483+0000 7f876a000640 1 --2- 172.21.15.63:0/2185782918 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f87740ccae0 0x7f8774156350 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f875c009870 tx=0x7f875c01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc7e4bff3d68d6f5 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:24:13.487 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.483+0000 7f8772000640 1 -- 172.21.15.63:0/2185782918 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f875c0ab650 con 0x7f87740ccae0 2024-05-21T01:24:13.487 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.483+0000 7f8772000640 1 -- 172.21.15.63:0/2185782918 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f875c0b0070 con 0x7f87740ccae0 2024-05-21T01:24:13.487 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.483+0000 7f8772000640 1 -- 172.21.15.63:0/2185782918 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f875c0aba10 con 0x7f87740ccae0 2024-05-21T01:24:13.488 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.487+0000 7f8779800640 1 -- 172.21.15.63:0/2185782918 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f87740ccae0 msgr2=0x7f8774156350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:24:13.488 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.487+0000 7f8779800640 1 --2- 172.21.15.63:0/2185782918 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f87740ccae0 0x7f8774156350 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f875c009870 tx=0x7f875c01c560 comp rx=0 tx=0).stop 2024-05-21T01:24:13.488 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.487+0000 7f8779800640 1 -- 172.21.15.63:0/2185782918 shutdown_connections 2024-05-21T01:24:13.488 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.487+0000 7f8779800640 1 --2- 172.21.15.63:0/2185782918 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f87740ccae0 0x7f8774156350 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:24:13.488 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.487+0000 7f8779800640 1 --2- 172.21.15.63:0/2185782918 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f87740cc700 0x7f8774155e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:24:13.489 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.487+0000 7f8779800640 1 -- 172.21.15.63:0/2185782918 >> 172.21.15.63:0/2185782918 conn(0x7f8774068290 msgr2=0x7f87740686a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:24:13.489 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.487+0000 7f8779800640 1 -- 172.21.15.63:0/2185782918 shutdown_connections 2024-05-21T01:24:13.489 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.487+0000 7f8779800640 1 -- 172.21.15.63:0/2185782918 wait complete. 2024-05-21T01:24:13.490 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.487+0000 7f8779800640 1 Processor -- start 2024-05-21T01:24:13.490 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.487+0000 7f8779800640 1 -- start start 2024-05-21T01:24:13.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.487+0000 7f8779800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f87740b5aa0 0x7f87741f85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:24:13.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.487+0000 7f8779800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f87740cc700 0x7f87740c94e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:24:13.491 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.487+0000 7f8779800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f87740ccae0 0x7f877415af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:24:13.492 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.487+0000 7f8779800640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f87740d20a0 con 0x7f87740cc700 2024-05-21T01:24:13.492 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.487+0000 7f8779800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f87740d1f20 con 0x7f87740b5aa0 2024-05-21T01:24:13.492 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.487+0000 7f8779800640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f8774168920 con 0x7f87740ccae0 2024-05-21T01:24:13.492 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.487+0000 7f876a000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f87740cc700 0x7f87740c94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:24:13.492 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.487+0000 7f876a000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f87740cc700 0x7f87740c94e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42748/0 (socket says 172.21.15.63:42748) 2024-05-21T01:24:13.492 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.487+0000 7f876a000640 1 -- 172.21.15.63:0/3895667298 learned_addr learned my addr 172.21.15.63:0/3895667298 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:24:13.492 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.487+0000 7f8772a00640 1 --2- 172.21.15.63:0/3895667298 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f87740b5aa0 0x7f87741f85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:24:13.492 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.487+0000 7f8773400640 1 --2- 172.21.15.63:0/3895667298 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f87740ccae0 0x7f877415af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:24:13.492 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.487+0000 7f876a000640 1 -- 172.21.15.63:0/3895667298 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f87740ccae0 msgr2=0x7f877415af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:24:13.492 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.487+0000 7f876a000640 1 --2- 172.21.15.63:0/3895667298 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f87740ccae0 0x7f877415af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:24:13.492 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.487+0000 7f876a000640 1 -- 172.21.15.63:0/3895667298 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f87740b5aa0 msgr2=0x7f87741f85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:24:13.492 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.487+0000 7f876a000640 1 --2- 172.21.15.63:0/3895667298 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f87740b5aa0 0x7f87741f85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:24:13.492 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.487+0000 7f876a000640 1 -- 172.21.15.63:0/3895667298 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8774156b80 con 0x7f87740cc700 2024-05-21T01:24:13.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.487+0000 7f8772a00640 1 --2- 172.21.15.63:0/3895667298 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f87740b5aa0 0x7f87741f85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T01:24:13.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.487+0000 7f876a000640 1 --2- 172.21.15.63:0/3895667298 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f87740cc700 0x7f87740c94e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f875c01a190 tx=0x7f875c019300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:24:13.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.491+0000 7f876b400640 1 -- 172.21.15.63:0/3895667298 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f875c0abe60 con 0x7f87740cc700 2024-05-21T01:24:13.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.491+0000 7f876b400640 1 -- 172.21.15.63:0/3895667298 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f875c0c06a0 con 0x7f87740cc700 2024-05-21T01:24:13.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.491+0000 7f876b400640 1 -- 172.21.15.63:0/3895667298 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f875c0c0a90 con 0x7f87740cc700 2024-05-21T01:24:13.493 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.491+0000 7f8779800640 1 -- 172.21.15.63:0/3895667298 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8774156e60 con 0x7f87740cc700 2024-05-21T01:24:13.494 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.491+0000 7f8779800640 1 -- 172.21.15.63:0/3895667298 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f877415aa20 con 0x7f87740cc700 2024-05-21T01:24:13.495 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.491+0000 7f876b400640 1 -- 172.21.15.63:0/3895667298 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7f875c0b5400 con 0x7f87740cc700 2024-05-21T01:24:13.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.495+0000 7f876b400640 1 --2- 172.21.15.63:0/3895667298 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f875006f430 0x7f87500718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:24:13.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.495+0000 7f876b400640 1 -- 172.21.15.63:0/3895667298 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f875c12a2f0 con 0x7f87740cc700 2024-05-21T01:24:13.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.495+0000 7f877cc36000 1 Processor -- start 2024-05-21T01:24:13.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.495+0000 7f877cc36000 1 -- start start 2024-05-21T01:24:13.496 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.495+0000 7f8772a00640 1 --2- 172.21.15.63:0/3895667298 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f875006f430 0x7f87500718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:24:13.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.495+0000 7f877cc36000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562f49960b90 0x562f4992a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:24:13.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.495+0000 7f877cc36000 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562f4992a8d0 0x562f49965620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:24:13.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.495+0000 7f877cc36000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f49965b60 0x562f49965f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:24:13.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.495+0000 7f877cc36000 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x562f4977f8a0 con 0x562f4992a8d0 2024-05-21T01:24:13.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.495+0000 7f877cc36000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x562f4976f440 con 0x562f49965b60 2024-05-21T01:24:13.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.495+0000 7f877cc36000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x562f49773480 con 0x562f49960b90 2024-05-21T01:24:13.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.495+0000 7f8772a00640 1 --2- 172.21.15.63:0/3895667298 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f875006f430 0x7f87500718f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8764009bb0 tx=0x7f8764008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:24:13.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.495+0000 7f876a000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562f4992a8d0 0x562f49965620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:24:13.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.495+0000 7f876a000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562f4992a8d0 0x562f49965620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42754/0 (socket says 172.21.15.63:42754) 2024-05-21T01:24:13.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.495+0000 7f876a000640 1 -- 172.21.15.63:0/585484923 learned_addr learned my addr 172.21.15.63:0/585484923 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:24:13.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.495+0000 7f8772a00640 1 --2- 172.21.15.63:0/585484923 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562f49960b90 0x562f4992a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:24:13.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.495+0000 7f8773400640 1 --2- 172.21.15.63:0/585484923 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f49965b60 0x562f49965f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:24:13.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.495+0000 7f876a000640 1 -- 172.21.15.63:0/585484923 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562f49960b90 msgr2=0x562f4992a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:24:13.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.495+0000 7f876a000640 1 --2- 172.21.15.63:0/585484923 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562f49960b90 0x562f4992a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:24:13.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.495+0000 7f876a000640 1 -- 172.21.15.63:0/585484923 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f49965b60 msgr2=0x562f49965f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:24:13.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.495+0000 7f876a000640 1 --2- 172.21.15.63:0/585484923 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f49965b60 0x562f49965f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:24:13.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.495+0000 7f876a000640 1 -- 172.21.15.63:0/585484923 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f4981b370 con 0x562f4992a8d0 2024-05-21T01:24:13.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.495+0000 7f876a000640 1 --2- 172.21.15.63:0/585484923 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562f4992a8d0 0x562f49965620 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f875c0f2cc0 tx=0x7f875c0f6020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e3f4f77c3fbaa9 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:24:13.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.495+0000 7f8763400640 1 -- 172.21.15.63:0/585484923 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f875c0f6dd0 con 0x562f4992a8d0 2024-05-21T01:24:13.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.495+0000 7f8763400640 1 -- 172.21.15.63:0/585484923 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f875c0b0030 con 0x562f4992a8d0 2024-05-21T01:24:13.500 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.495+0000 7f8763400640 1 -- 172.21.15.63:0/585484923 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f875c0f66d0 con 0x562f4992a8d0 2024-05-21T01:24:13.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.495+0000 7f877cc36000 1 -- 172.21.15.63:0/585484923 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562f4992a8d0 msgr2=0x562f49965620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:24:13.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.495+0000 7f877cc36000 1 --2- 172.21.15.63:0/585484923 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562f4992a8d0 0x562f49965620 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f875c0f2cc0 tx=0x7f875c0f6020 comp rx=0 tx=0).stop 2024-05-21T01:24:13.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.495+0000 7f877cc36000 1 -- 172.21.15.63:0/585484923 shutdown_connections 2024-05-21T01:24:13.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.495+0000 7f877cc36000 1 --2- 172.21.15.63:0/585484923 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f49965b60 0x562f49965f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:24:13.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.495+0000 7f877cc36000 1 --2- 172.21.15.63:0/585484923 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562f4992a8d0 0x562f49965620 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:24:13.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.495+0000 7f877cc36000 1 --2- 172.21.15.63:0/585484923 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562f49960b90 0x562f4992a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:24:13.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.495+0000 7f877cc36000 1 -- 172.21.15.63:0/585484923 >> 172.21.15.63:0/585484923 conn(0x562f4980cf90 msgr2=0x562f499633e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:24:13.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.495+0000 7f877cc36000 1 -- 172.21.15.63:0/585484923 shutdown_connections 2024-05-21T01:24:13.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.495+0000 7f877cc36000 1 -- 172.21.15.63:0/585484923 wait complete. 2024-05-21T01:24:13.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.499+0000 7f877cc36000 1 -- start start 2024-05-21T01:24:13.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.499+0000 7f877cc36000 1 Processor -- start 2024-05-21T01:24:13.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.499+0000 7f877cc36000 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562f4992a8d0 0x562f4995f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:24:13.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.499+0000 7f877cc36000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f49960b90 0x562f4995fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:24:13.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.499+0000 7f877cc36000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562f49965b60 0x562f4996b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:24:13.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.499+0000 7f877cc36000 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x562f49777ab0 con 0x562f4992a8d0 2024-05-21T01:24:13.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.499+0000 7f877cc36000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x562f4977f8a0 con 0x562f49960b90 2024-05-21T01:24:13.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.499+0000 7f877cc36000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x562f4976f440 con 0x562f49965b60 2024-05-21T01:24:13.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.499+0000 7f877cc36000 10 client.0 _ll_register_callbacks cb 0x562f49711ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-21T01:24:13.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.499+0000 7f8772a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562f4992a8d0 0x562f4995f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:24:13.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.499+0000 7f8772a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562f4992a8d0 0x562f4995f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42756/0 (socket says 172.21.15.63:42756) 2024-05-21T01:24:13.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.499+0000 7f8772a00640 1 -- 172.21.15.63:0/2422670575 learned_addr learned my addr 172.21.15.63:0/2422670575 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:24:13.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.499+0000 7f876a000640 1 --2- 172.21.15.63:0/2422670575 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f49960b90 0x562f4995fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:24:13.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.499+0000 7f8773400640 1 --2- 172.21.15.63:0/2422670575 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562f49965b60 0x562f4996b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:24:13.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.499+0000 7f8772a00640 1 -- 172.21.15.63:0/2422670575 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562f49965b60 msgr2=0x562f4996b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:24:13.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.499+0000 7f8772a00640 1 --2- 172.21.15.63:0/2422670575 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562f49965b60 0x562f4996b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:24:13.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.499+0000 7f8772a00640 1 -- 172.21.15.63:0/2422670575 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f49960b90 msgr2=0x562f4995fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:24:13.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.499+0000 7f8772a00640 1 --2- 172.21.15.63:0/2422670575 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f49960b90 0x562f4995fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:24:13.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.499+0000 7f8772a00640 1 -- 172.21.15.63:0/2422670575 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f497b9260 con 0x562f4992a8d0 2024-05-21T01:24:13.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.499+0000 7f8773400640 1 --2- 172.21.15.63:0/2422670575 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562f49965b60 0x562f4996b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T01:24:13.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.499+0000 7f8772a00640 1 --2- 172.21.15.63:0/2422670575 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562f4992a8d0 0x562f4995f730 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f87640043b0 tx=0x7f87640046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6098962880f3cc89 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:24:13.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.499+0000 7f8757e00640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-05-21T01:24:13.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.499+0000 7f8757e00640 1 -- 172.21.15.63:0/2422670575 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87640044a0 con 0x562f4992a8d0 2024-05-21T01:24:13.505 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.499+0000 7f8757e00640 1 -- 172.21.15.63:0/2422670575 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f8764015690 con 0x562f4992a8d0 2024-05-21T01:24:13.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.499+0000 7f877cc36000 1 -- 172.21.15.63:0/2422670575 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f875c0b0030 con 0x562f4992a8d0 2024-05-21T01:24:13.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.499+0000 7f8757e00640 1 -- 172.21.15.63:0/2422670575 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f8764030050 con 0x562f4992a8d0 2024-05-21T01:24:13.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.499+0000 7f877cc36000 10 client.4947 fetch_fsmap learned FSMap version 15 2024-05-21T01:24:13.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.499+0000 7f877cc36000 1 -- 172.21.15.63:0/2422670575 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x562f497166e0 con 0x562f4992a8d0 2024-05-21T01:24:13.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.499+0000 7f8757e00640 1 -- 172.21.15.63:0/2422670575 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f875c0b0030 con 0x562f4992a8d0 2024-05-21T01:24:13.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.499+0000 7f8757e00640 1 -- 172.21.15.63:0/2422670575 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 15) ==== 4752+0+0 (secure 0 0 0) 0x7f8764033020 con 0x562f4992a8d0 2024-05-21T01:24:13.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.499+0000 7f877cc36000 10 client.4947 fetch_fsmap finished waiting for FSMap version 15 2024-05-21T01:24:13.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.499+0000 7f877cc36000 10 client.4947 resolve_mds: validated gid 4276 aka daemon mds.c 2024-05-21T01:24:13.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.499+0000 7f877cc36000 20 client.4947 populate_metadata read hostname 'smithi063' 2024-05-21T01:24:13.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.499+0000 7f877cc36000 1 --2- 172.21.15.63:0/2422670575 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x562f4996c120 0x562f4996c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:24:13.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.499+0000 7f877cc36000 4 client.4947 mds_command: new command op to 4276 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-21T01:24:13.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.499+0000 7f877cc36000 1 -- 172.21.15.63:0/2422670575 --> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562f4970b060 con 0x562f4996c120 2024-05-21T01:24:13.506 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.499+0000 7f876a000640 1 --2- 172.21.15.63:0/2422670575 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x562f4996c120 0x562f4996c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:24:13.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.499+0000 7f876a000640 1 --2- 172.21.15.63:0/2422670575 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x562f4996c120 0x562f4996c530 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb4863bbadf8d5a4 server_cookie=83ab091f951e1435 in_seq=0 out_seq=0 2024-05-21T01:24:13.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.499+0000 7f8757e00640 10 client.4947 ms_handle_connect on v2:172.21.15.63:6834/2892727989 2024-05-21T01:24:13.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.503+0000 7f8757e00640 1 -- 172.21.15.63:0/2422670575 <== mds.0 v2:172.21.15.63:6834/2892727989 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x562f4970b060 con 0x562f4996c120 2024-05-21T01:24:13.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.503+0000 7f8757e00640 10 client.4947 handle_command_reply: tid=0 2024-05-21T01:24:13.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.503+0000 7f877cc36000 1 client.4947 shutdown 2024-05-21T01:24:13.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.503+0000 7f877cc36000 1 -- 172.21.15.63:0/2422670575 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562f4992a8d0 msgr2=0x562f4995f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:24:13.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.503+0000 7f877cc36000 1 --2- 172.21.15.63:0/2422670575 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562f4992a8d0 0x562f4995f730 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f87640043b0 tx=0x7f87640046d0 comp rx=0 tx=0).stop 2024-05-21T01:24:13.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.503+0000 7f877cc36000 1 -- 172.21.15.63:0/2422670575 shutdown_connections 2024-05-21T01:24:13.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.503+0000 7f877cc36000 1 --2- 172.21.15.63:0/2422670575 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x562f4996c120 0x562f4996c530 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:24:13.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.503+0000 7f877cc36000 1 --2- 172.21.15.63:0/2422670575 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562f49965b60 0x562f4996b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:24:13.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.503+0000 7f877cc36000 1 --2- 172.21.15.63:0/2422670575 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f49960b90 0x562f4995fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:24:13.508 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.503+0000 7f877cc36000 1 --2- 172.21.15.63:0/2422670575 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562f4992a8d0 0x562f4995f730 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:24:13.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.503+0000 7f877cc36000 1 -- 172.21.15.63:0/2422670575 >> 172.21.15.63:0/2422670575 conn(0x562f4980cf90 msgr2=0x562f49929b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:24:13.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.503+0000 7f8757e00640 0 client.4947 ms_handle_reset on v2:172.21.15.63:6834/2892727989 2024-05-21T01:24:13.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.503+0000 7f877cc36000 1 -- 172.21.15.63:0/2422670575 shutdown_connections 2024-05-21T01:24:13.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.503+0000 7f877cc36000 1 -- 172.21.15.63:0/2422670575 wait complete. 2024-05-21T01:24:13.509 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.503+0000 7f877cc36000 20 client.4947 trim_cache size 0 max 16384 2024-05-21T01:24:13.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.519+0000 7f877cc36000 1 Processor -- start 2024-05-21T01:24:13.523 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.519+0000 7f877cc36000 1 -- start start 2024-05-21T01:24:13.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.519+0000 7f877cc36000 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562f4992a8d0 0x562f499213e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:24:13.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.519+0000 7f877cc36000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f49960b90 0x562f49921920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:24:13.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.519+0000 7f877cc36000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562f49965b60 0x562f4997fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:24:13.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.519+0000 7f877cc36000 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f87742011b0 con 0x562f4992a8d0 2024-05-21T01:24:13.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.519+0000 7f877cc36000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f877414c2a0 con 0x562f49960b90 2024-05-21T01:24:13.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.519+0000 7f877cc36000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f8774200c30 con 0x562f49965b60 2024-05-21T01:24:13.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.519+0000 7f8772a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562f4992a8d0 0x562f499213e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:24:13.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.519+0000 7f8772a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562f4992a8d0 0x562f499213e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42770/0 (socket says 172.21.15.63:42770) 2024-05-21T01:24:13.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.519+0000 7f8772a00640 1 -- 172.21.15.63:0/275920399 learned_addr learned my addr 172.21.15.63:0/275920399 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:24:13.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.523+0000 7f876a000640 1 --2- 172.21.15.63:0/275920399 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f49960b90 0x562f49921920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:24:13.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.523+0000 7f8773400640 1 --2- 172.21.15.63:0/275920399 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562f49965b60 0x562f4997fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:24:13.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.523+0000 7f8772a00640 1 -- 172.21.15.63:0/275920399 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562f49965b60 msgr2=0x562f4997fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:24:13.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.523+0000 7f8772a00640 1 --2- 172.21.15.63:0/275920399 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562f49965b60 0x562f4997fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:24:13.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.523+0000 7f8772a00640 1 -- 172.21.15.63:0/275920399 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f49960b90 msgr2=0x562f49921920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:24:13.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.523+0000 7f8772a00640 1 --2- 172.21.15.63:0/275920399 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f49960b90 0x562f49921920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:24:13.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.523+0000 7f8772a00640 1 -- 172.21.15.63:0/275920399 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f497f4cf0 con 0x562f4992a8d0 2024-05-21T01:24:13.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.523+0000 7f8772a00640 1 --2- 172.21.15.63:0/275920399 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562f4992a8d0 0x562f499213e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f876400d0c0 tx=0x7f8764022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cb6df12a104fcaa server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:24:13.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.523+0000 7f8762a00640 1 -- 172.21.15.63:0/275920399 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87640044a0 con 0x562f4992a8d0 2024-05-21T01:24:13.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.523+0000 7f8762a00640 1 -- 172.21.15.63:0/275920399 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8764028070 con 0x562f4992a8d0 2024-05-21T01:24:13.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.523+0000 7f8762a00640 1 -- 172.21.15.63:0/275920399 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8764004030 con 0x562f4992a8d0 2024-05-21T01:24:13.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.523+0000 7f877cc36000 1 -- 172.21.15.63:0/275920399 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562f4992a8d0 msgr2=0x562f499213e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:24:13.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.523+0000 7f877cc36000 1 --2- 172.21.15.63:0/275920399 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562f4992a8d0 0x562f499213e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f876400d0c0 tx=0x7f8764022000 comp rx=0 tx=0).stop 2024-05-21T01:24:13.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.523+0000 7f877cc36000 1 -- 172.21.15.63:0/275920399 shutdown_connections 2024-05-21T01:24:13.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.523+0000 7f877cc36000 1 --2- 172.21.15.63:0/275920399 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562f49965b60 0x562f4997fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:24:13.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.523+0000 7f877cc36000 1 --2- 172.21.15.63:0/275920399 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f49960b90 0x562f49921920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:24:13.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.523+0000 7f877cc36000 1 --2- 172.21.15.63:0/275920399 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562f4992a8d0 0x562f499213e0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:24:13.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.523+0000 7f877cc36000 1 -- 172.21.15.63:0/275920399 >> 172.21.15.63:0/275920399 conn(0x562f4980cf90 msgr2=0x562f4996b390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:24:13.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.523+0000 7f877cc36000 1 -- 172.21.15.63:0/275920399 shutdown_connections 2024-05-21T01:24:13.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.523+0000 7f877cc36000 1 -- 172.21.15.63:0/275920399 wait complete. 2024-05-21T01:24:13.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.523+0000 7f877cc36000 1 -- start start 2024-05-21T01:24:13.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.523+0000 7f877cc36000 1 Processor -- start 2024-05-21T01:24:13.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.523+0000 7f877cc36000 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562f4992a8d0 0x562f49920fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:24:13.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.523+0000 7f877cc36000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562f49960b90 0x562f499214f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:24:13.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.523+0000 7f877cc36000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f49965b60 0x562f499265c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:24:13.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.523+0000 7f877cc36000 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x562f4976b5f0 con 0x562f4992a8d0 2024-05-21T01:24:13.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.523+0000 7f877cc36000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x562f497f4860 con 0x562f49965b60 2024-05-21T01:24:13.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.523+0000 7f877cc36000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x562f49707c50 con 0x562f49960b90 2024-05-21T01:24:13.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.523+0000 7f877cc36000 10 client.0 _ll_register_callbacks cb 0x7f8764019040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-21T01:24:13.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.523+0000 7f8772a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562f4992a8d0 0x562f49920fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:24:13.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.523+0000 7f8772a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562f4992a8d0 0x562f49920fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:42778/0 (socket says 172.21.15.63:42778) 2024-05-21T01:24:13.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.523+0000 7f8772a00640 1 -- 172.21.15.63:0/2547193115 learned_addr learned my addr 172.21.15.63:0/2547193115 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:24:13.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.523+0000 7f876a000640 1 --2- 172.21.15.63:0/2547193115 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562f49960b90 0x562f499214f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:24:13.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.523+0000 7f8773400640 1 --2- 172.21.15.63:0/2547193115 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f49965b60 0x562f499265c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:24:13.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.523+0000 7f8772a00640 1 -- 172.21.15.63:0/2547193115 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562f49960b90 msgr2=0x562f499214f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:24:13.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.523+0000 7f8772a00640 1 --2- 172.21.15.63:0/2547193115 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562f49960b90 0x562f499214f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:24:13.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.523+0000 7f8772a00640 1 -- 172.21.15.63:0/2547193115 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f49965b60 msgr2=0x562f499265c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:24:13.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.523+0000 7f8772a00640 1 --2- 172.21.15.63:0/2547193115 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f49965b60 0x562f499265c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:24:13.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.523+0000 7f8772a00640 1 -- 172.21.15.63:0/2547193115 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f49721ca0 con 0x562f4992a8d0 2024-05-21T01:24:13.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.523+0000 7f8773400640 1 --2- 172.21.15.63:0/2547193115 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f49965b60 0x562f499265c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T01:24:13.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.527+0000 7f8772a00640 1 --2- 172.21.15.63:0/2547193115 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562f4992a8d0 0x562f49920fb0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f876400d0c0 tx=0x7f8764015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72e9f9eef28c9fb server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:24:13.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.527+0000 7f8757e00640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-05-21T01:24:13.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.527+0000 7f8757e00640 1 -- 172.21.15.63:0/2547193115 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8764015bc0 con 0x562f4992a8d0 2024-05-21T01:24:13.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.527+0000 7f8757e00640 1 -- 172.21.15.63:0/2547193115 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f876400f040 con 0x562f4992a8d0 2024-05-21T01:24:13.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.527+0000 7f877cc36000 1 -- 172.21.15.63:0/2547193115 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8764028070 con 0x562f4992a8d0 2024-05-21T01:24:13.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.527+0000 7f8757e00640 1 -- 172.21.15.63:0/2547193115 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f8764015d60 con 0x562f4992a8d0 2024-05-21T01:24:13.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.527+0000 7f877cc36000 10 client.4953 fetch_fsmap learned FSMap version 15 2024-05-21T01:24:13.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.527+0000 7f877cc36000 1 -- 172.21.15.63:0/2547193115 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x562f497069c0 con 0x562f4992a8d0 2024-05-21T01:24:13.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.527+0000 7f8757e00640 1 -- 172.21.15.63:0/2547193115 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8764028070 con 0x562f4992a8d0 2024-05-21T01:24:13.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.527+0000 7f8757e00640 1 -- 172.21.15.63:0/2547193115 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 15) ==== 4752+0+0 (secure 0 0 0) 0x7f876403d070 con 0x562f4992a8d0 2024-05-21T01:24:13.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.527+0000 7f877cc36000 10 client.4953 fetch_fsmap finished waiting for FSMap version 15 2024-05-21T01:24:13.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.527+0000 7f877cc36000 10 client.4953 resolve_mds: validated gid 4276 aka daemon mds.c 2024-05-21T01:24:13.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.527+0000 7f877cc36000 20 client.4953 populate_metadata read hostname 'smithi063' 2024-05-21T01:24:13.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.527+0000 7f877cc36000 1 --2- 172.21.15.63:0/2547193115 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x562f49926b00 0x562f49926ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:24:13.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.527+0000 7f877cc36000 4 client.4953 mds_command: new command op to 4276 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "35433fa7", "release": true, "await": true}] 2024-05-21T01:24:13.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.527+0000 7f877cc36000 1 -- 172.21.15.63:0/2547193115 --> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] -- command(tid 0: {"prefix": "quiesce db", "set_id": "35433fa7", "release": true, "await": true}) -- 0x562f497817f0 con 0x562f49926b00 2024-05-21T01:24:13.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.527+0000 7f876a000640 1 --2- 172.21.15.63:0/2547193115 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x562f49926b00 0x562f49926ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:24:13.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.527+0000 7f876a000640 1 --2- 172.21.15.63:0/2547193115 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x562f49926b00 0x562f49926ee0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff2496eef9d3c5ef server_cookie=51a079d7b6bdd91e in_seq=0 out_seq=0 2024-05-21T01:24:13.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.527+0000 7f8757e00640 10 client.4953 ms_handle_connect on v2:172.21.15.63:6834/2892727989 2024-05-21T01:24:13.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.527+0000 7f8757e00640 1 -- 172.21.15.63:0/2547193115 <== mds.0 v2:172.21.15.63:6834/2892727989 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x562f497817f0 con 0x562f49926b00 2024-05-21T01:24:13.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.527+0000 7f8757e00640 10 client.4953 handle_command_reply: tid=0 2024-05-21T01:24:13.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.527+0000 7f877cc36000 1 client.4953 shutdown 2024-05-21T01:24:13.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.527+0000 7f877cc36000 1 -- 172.21.15.63:0/2547193115 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562f4992a8d0 msgr2=0x562f49920fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:24:13.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.527+0000 7f877cc36000 1 --2- 172.21.15.63:0/2547193115 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562f4992a8d0 0x562f49920fb0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f876400d0c0 tx=0x7f8764015000 comp rx=0 tx=0).stop 2024-05-21T01:24:13.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.527+0000 7f877cc36000 1 -- 172.21.15.63:0/2547193115 shutdown_connections 2024-05-21T01:24:13.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.527+0000 7f877cc36000 1 --2- 172.21.15.63:0/2547193115 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x562f49926b00 0x562f49926ee0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:24:13.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.527+0000 7f877cc36000 1 --2- 172.21.15.63:0/2547193115 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f49965b60 0x562f499265c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:24:13.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.527+0000 7f877cc36000 1 --2- 172.21.15.63:0/2547193115 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x562f49960b90 0x562f499214f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:24:13.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.527+0000 7f877cc36000 1 --2- 172.21.15.63:0/2547193115 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x562f4992a8d0 0x562f49920fb0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:24:13.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.527+0000 7f8757e00640 0 client.4953 ms_handle_reset on v2:172.21.15.63:6834/2892727989 2024-05-21T01:24:13.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.527+0000 7f877cc36000 1 -- 172.21.15.63:0/2547193115 >> 172.21.15.63:0/2547193115 conn(0x562f4980cf90 msgr2=0x562f49964bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:24:13.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.527+0000 7f877cc36000 1 -- 172.21.15.63:0/2547193115 shutdown_connections 2024-05-21T01:24:13.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.527+0000 7f877cc36000 1 -- 172.21.15.63:0/2547193115 wait complete. 2024-05-21T01:24:13.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.527+0000 7f877cc36000 20 client.4953 trim_cache size 0 max 16384 2024-05-21T01:24:13.535 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-05-21T01:24:13.535 INFO:teuthology.orchestra.run.smithi063.stdout: "epoch": 15, 2024-05-21T01:24:13.535 INFO:teuthology.orchestra.run.smithi063.stdout: "leader": 4276, 2024-05-21T01:24:13.535 INFO:teuthology.orchestra.run.smithi063.stdout: "set_version": 12, 2024-05-21T01:24:13.535 INFO:teuthology.orchestra.run.smithi063.stdout: "sets": { 2024-05-21T01:24:13.535 INFO:teuthology.orchestra.run.smithi063.stdout: "35433fa7": { 2024-05-21T01:24:13.536 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 12, 2024-05-21T01:24:13.536 INFO:teuthology.orchestra.run.smithi063.stdout: "age_ref": 0.0, 2024-05-21T01:24:13.536 INFO:teuthology.orchestra.run.smithi063.stdout: "state": { 2024-05-21T01:24:13.536 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "RELEASED", 2024-05-21T01:24:13.536 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 0.0 2024-05-21T01:24:13.536 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-05-21T01:24:13.536 INFO:teuthology.orchestra.run.smithi063.stdout: "timeout": 90.0, 2024-05-21T01:24:13.536 INFO:teuthology.orchestra.run.smithi063.stdout: "expiration": 139.8, 2024-05-21T01:24:13.536 INFO:teuthology.orchestra.run.smithi063.stdout: "members": { 2024-05-21T01:24:13.536 INFO:teuthology.orchestra.run.smithi063.stdout: "file:/": { 2024-05-21T01:24:13.536 INFO:teuthology.orchestra.run.smithi063.stdout: "excluded": false, 2024-05-21T01:24:13.536 INFO:teuthology.orchestra.run.smithi063.stdout: "state": { 2024-05-21T01:24:13.536 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "RELEASED", 2024-05-21T01:24:13.536 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 0.0 2024-05-21T01:24:13.537 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-05-21T01:24:13.537 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-05-21T01:24:13.537 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-05-21T01:24:13.537 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-05-21T01:24:13.537 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-05-21T01:24:13.537 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-05-21T01:24:13.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.531+0000 7f8779800640 1 -- 172.21.15.63:0/3895667298 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f875006f430 msgr2=0x7f87500718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:24:13.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.531+0000 7f8779800640 1 --2- 172.21.15.63:0/3895667298 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f875006f430 0x7f87500718f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8764009bb0 tx=0x7f8764008040 comp rx=0 tx=0).stop 2024-05-21T01:24:13.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.531+0000 7f8779800640 1 -- 172.21.15.63:0/3895667298 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f87740cc700 msgr2=0x7f87740c94e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:24:13.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.531+0000 7f8779800640 1 --2- 172.21.15.63:0/3895667298 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f87740cc700 0x7f87740c94e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f875c01a190 tx=0x7f875c019300 comp rx=0 tx=0).stop 2024-05-21T01:24:13.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.531+0000 7f8779800640 1 -- 172.21.15.63:0/3895667298 shutdown_connections 2024-05-21T01:24:13.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.531+0000 7f8779800640 1 --2- 172.21.15.63:0/3895667298 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f875006f430 0x7f87500718f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:24:13.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.531+0000 7f8779800640 1 --2- 172.21.15.63:0/3895667298 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f87740ccae0 0x7f877415af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:24:13.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.531+0000 7f8779800640 1 --2- 172.21.15.63:0/3895667298 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f87740cc700 0x7f87740c94e0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:24:13.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.531+0000 7f8779800640 1 --2- 172.21.15.63:0/3895667298 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f87740b5aa0 0x7f87741f85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:24:13.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.531+0000 7f8779800640 1 -- 172.21.15.63:0/3895667298 >> 172.21.15.63:0/3895667298 conn(0x7f8774068290 msgr2=0x7f8774154e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:24:13.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.531+0000 7f8779800640 1 -- 172.21.15.63:0/3895667298 shutdown_connections 2024-05-21T01:24:13.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:13.531+0000 7f8779800640 1 -- 172.21.15.63:0/3895667298 wait complete. 2024-05-21T01:24:13.553 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '35433fa7', total seconds elapsed: 20.4 2024-05-21T01:24:26.968 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-21T01:24:26.984 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-21T01:24:50.326 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 13.6 2024-05-21T01:24:50.326 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-21T01:24:50.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:50.606+0000 7f81d8000640 1 Processor -- start 2024-05-21T01:24:50.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:50.606+0000 7f81d8000640 1 -- start start 2024-05-21T01:24:50.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:50.606+0000 7f81d8000640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f81d00cd560 0x7f81d0164320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:24:50.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:50.606+0000 7f81d8000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f81d00cd940 0x7f81d015a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:24:50.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:50.606+0000 7f81d8000640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81d00720f0 con 0x7f81d00c7cf0 2024-05-21T01:24:50.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:50.606+0000 7f81d8000640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f81d0071ec0 con 0x7f81d00cd560 2024-05-21T01:24:50.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:50.606+0000 7f81d8000640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f81d0072990 con 0x7f81d00cd940 2024-05-21T01:24:50.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:50.606+0000 7f81d6000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f81d00cd940 0x7f81d015a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:24:50.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:50.606+0000 7f81d6000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f81d00cd940 0x7f81d015a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.63:56874/0 (socket says 172.21.15.63:56874) 2024-05-21T01:24:50.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:50.606+0000 7f81d6000640 1 -- 172.21.15.63:0/720675553 learned_addr learned my addr 172.21.15.63:0/720675553 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:24:50.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:50.610+0000 7f81d6000640 1 -- 172.21.15.63:0/720675553 >> v2:172.21.15.63:3300/0 conn(0x7f81d00cd560 msgr2=0x7f81d0164320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:24:50.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:50.610+0000 7f81d6000640 1 --2- 172.21.15.63:0/720675553 >> v2:172.21.15.63:3300/0 conn(0x7f81d00cd560 0x7f81d0164320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:24:50.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:50.610+0000 7f81d6000640 1 -- 172.21.15.63:0/720675553 >> v1:172.21.15.131:6789/0 conn(0x7f81d00c7cf0 legacy=0x7f81d0161e60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-21T01:24:50.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:50.610+0000 7f81d6000640 1 -- 172.21.15.63:0/720675553 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81d00723d0 con 0x7f81d00cd940 2024-05-21T01:24:50.622 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:50.618+0000 7f81d6000640 1 --2- 172.21.15.63:0/720675553 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81d00cd940 0x7f81d015a010 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f81c8009e50 tx=0x7f81c801c930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd3139a6e0c07f1 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:24:50.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:50.618+0000 7f81cfe00640 1 -- 172.21.15.63:0/720675553 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81c80a57b0 con 0x7f81d00cd940 2024-05-21T01:24:50.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:50.622+0000 7f81cfe00640 1 -- 172.21.15.63:0/720675553 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81c80a5950 con 0x7f81d00cd940 2024-05-21T01:24:50.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:50.622+0000 7f81cfe00640 1 -- 172.21.15.63:0/720675553 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81c80a5d20 con 0x7f81d00cd940 2024-05-21T01:24:50.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:50.626+0000 7f81d8000640 1 -- 172.21.15.63:0/720675553 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81d00cd940 msgr2=0x7f81d015a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:24:50.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:50.626+0000 7f81d8000640 1 --2- 172.21.15.63:0/720675553 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81d00cd940 0x7f81d015a010 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f81c8009e50 tx=0x7f81c801c930 comp rx=0 tx=0).stop 2024-05-21T01:24:50.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:50.626+0000 7f81d8000640 1 -- 172.21.15.63:0/720675553 shutdown_connections 2024-05-21T01:24:50.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:50.626+0000 7f81d8000640 1 --2- 172.21.15.63:0/720675553 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81d00cd940 0x7f81d015a010 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:24:50.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:50.626+0000 7f81d8000640 1 --2- 172.21.15.63:0/720675553 >> v2:172.21.15.63:3300/0 conn(0x7f81d00cd560 0x7f81d0164320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:24:50.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:50.626+0000 7f81d8000640 1 -- 172.21.15.63:0/720675553 >> 172.21.15.63:0/720675553 conn(0x7f81d0068460 msgr2=0x7f81d0068870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:24:50.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:50.626+0000 7f81d8000640 1 -- 172.21.15.63:0/720675553 shutdown_connections 2024-05-21T01:24:50.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:50.626+0000 7f81d8000640 1 -- 172.21.15.63:0/720675553 wait complete. 2024-05-21T01:24:50.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:50.630+0000 7f81d8000640 1 Processor -- start 2024-05-21T01:24:50.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:50.630+0000 7f81d8000640 1 -- start start 2024-05-21T01:24:50.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:50.634+0000 7f81d8000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81d00c7cf0 0x7f81d00c6e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:24:50.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:50.634+0000 7f81d8000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f81d00cd560 0x7f81d00cc760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:24:50.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:50.634+0000 7f81d8000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f81d00cd940 0x7f81d00ccca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:24:50.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:50.634+0000 7f81d5600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81d00c7cf0 0x7f81d00c6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:24:50.637 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:50.634+0000 7f81d5600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81d00c7cf0 0x7f81d00c6e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.63:56884/0 (socket says 172.21.15.63:56884) 2024-05-21T01:24:50.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:50.634+0000 7f81d4c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f81d00cd560 0x7f81d00cc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:24:50.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:50.634+0000 7f81d8000640 1 -- 172.21.15.63:0/1390264184 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f81d015a8e0 con 0x7f81d00cd560 2024-05-21T01:24:50.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:50.634+0000 7f81d8000640 1 -- 172.21.15.63:0/1390264184 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f81d015a760 con 0x7f81d00c7cf0 2024-05-21T01:24:50.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:50.634+0000 7f81d8000640 1 -- 172.21.15.63:0/1390264184 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f81d015aa60 con 0x7f81d00cd940 2024-05-21T01:24:50.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:50.634+0000 7f81d5600640 1 -- 172.21.15.63:0/1390264184 learned_addr learned my addr 172.21.15.63:0/1390264184 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:24:50.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:50.634+0000 7f81d6000640 1 --2- 172.21.15.63:0/1390264184 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f81d00cd940 0x7f81d00ccca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:24:50.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:50.634+0000 7f81d6000640 1 -- 172.21.15.63:0/1390264184 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81d00c7cf0 msgr2=0x7f81d00c6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:24:50.638 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:50.634+0000 7f81d6000640 1 --2- 172.21.15.63:0/1390264184 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81d00c7cf0 0x7f81d00c6e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:24:50.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:50.634+0000 7f81d6000640 1 -- 172.21.15.63:0/1390264184 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f81d00cd560 msgr2=0x7f81d00cc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:24:50.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:50.634+0000 7f81d6000640 1 --2- 172.21.15.63:0/1390264184 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f81d00cd560 0x7f81d00cc760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:24:50.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:50.634+0000 7f81d6000640 1 -- 172.21.15.63:0/1390264184 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81d00c4a40 con 0x7f81d00cd940 2024-05-21T01:24:50.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:50.634+0000 7f81d6000640 1 --2- 172.21.15.63:0/1390264184 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f81d00cd940 0x7f81d00ccca0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f81d0073760 tx=0x7f81c80196d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:24:50.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:50.638+0000 7f81cd600640 1 -- 172.21.15.63:0/1390264184 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81c80bc030 con 0x7f81d00cd940 2024-05-21T01:24:50.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:50.638+0000 7f81d8000640 1 -- 172.21.15.63:0/1390264184 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81d00c5ba0 con 0x7f81d00cd940 2024-05-21T01:24:50.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:50.638+0000 7f81d8000640 1 -- 172.21.15.63:0/1390264184 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f81d00c6140 con 0x7f81d00cd940 2024-05-21T01:24:50.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:50.638+0000 7f81cd600640 1 -- 172.21.15.63:0/1390264184 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81c80b8680 con 0x7f81d00cd940 2024-05-21T01:24:50.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:50.638+0000 7f81cd600640 1 -- 172.21.15.63:0/1390264184 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81c80b8a50 con 0x7f81d00cd940 2024-05-21T01:24:50.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:50.638+0000 7f81d8000640 1 -- 172.21.15.63:0/1390264184 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81d00507f0 con 0x7f81d00cd940 2024-05-21T01:24:50.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:50.642+0000 7f81cd600640 1 -- 172.21.15.63:0/1390264184 <== mon.2 v2:172.21.15.131:3301/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7f81c80bf070 con 0x7f81d00cd940 2024-05-21T01:24:50.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:50.642+0000 7f81cd600640 1 --2- 172.21.15.63:0/1390264184 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f81b006f400 0x7f81b00718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:24:50.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:50.642+0000 7f81cd600640 1 -- 172.21.15.63:0/1390264184 <== mon.2 v2:172.21.15.131:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f81c8129e50 con 0x7f81d00cd940 2024-05-21T01:24:50.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:50.646+0000 7f81d5600640 1 --2- 172.21.15.63:0/1390264184 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f81b006f400 0x7f81b00718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:24:50.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:50.646+0000 7f81d5600640 1 --2- 172.21.15.63:0/1390264184 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f81b006f400 0x7f81b00718c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f81c4009a50 tx=0x7f81c4009210 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:24:50.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:50.650+0000 7f81cd600640 1 -- 172.21.15.63:0/1390264184 <== mon.2 v2:172.21.15.131:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f81c80c7020 con 0x7f81d00cd940 2024-05-21T01:24:50.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:50.978+0000 7f81d8000640 1 -- 172.21.15.63:0/1390264184 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f81d014c3f0 con 0x7f81d00cd940 2024-05-21T01:24:50.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:50.978+0000 7f81cd600640 1 -- 172.21.15.63:0/1390264184 <== mon.2 v2:172.21.15.131:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+6876 (secure 0 0 0) 0x7f81c80165e0 con 0x7f81d00cd940 2024-05-21T01:24:50.983 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-05-21T01:24:50.983 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6839/3045714273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6837","nonce":3045714273},{"type":"v1","addr":"172.21.15.131:6839","nonce":3045714273}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/2978367338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":2978367338},{"type":"v1","addr":"172.21.15.131:6835","nonce":2978367338}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/3005995321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6835","nonce":3005995321},{"type":"v1","addr":"172.21.15.63:6837","nonce":3005995321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-21T01:19:53.915775+0000","modified":"2024-05-21T01:20:31.724475+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4276,"mds_1":4270,"mds_2":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"e","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.63:6833/574189772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":574189772},{"type":"v1","addr":"172.21.15.63:6833","nonce":574189772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4270":{"gid":4270,"name":"f","rank":1,"incarnation":10,"state":"up:active","state_seq":11,"addr":"172.21.15.131:6838/3071941741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":3071941741},{"type":"v1","addr":"172.21.15.131:6838","nonce":3071941741}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.63:6836/2892727989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":2892727989},{"type":"v1","addr":"172.21.15.63:6836","nonce":2892727989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4276,"qdb_cluster":[4267,4270,4276]},"id":1}]} 2024-05-21T01:24:50.984 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 15 2024-05-21T01:24:50.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:50.982+0000 7f81d8000640 1 -- 172.21.15.63:0/1390264184 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f81b006f400 msgr2=0x7f81b00718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:24:50.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:50.982+0000 7f81d8000640 1 --2- 172.21.15.63:0/1390264184 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f81b006f400 0x7f81b00718c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f81c4009a50 tx=0x7f81c4009210 comp rx=0 tx=0).stop 2024-05-21T01:24:50.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:50.982+0000 7f81d8000640 1 -- 172.21.15.63:0/1390264184 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f81d00cd940 msgr2=0x7f81d00ccca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:24:50.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:50.982+0000 7f81d8000640 1 --2- 172.21.15.63:0/1390264184 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f81d00cd940 0x7f81d00ccca0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f81d0073760 tx=0x7f81c80196d0 comp rx=0 tx=0).stop 2024-05-21T01:24:50.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:50.982+0000 7f81d8000640 1 -- 172.21.15.63:0/1390264184 shutdown_connections 2024-05-21T01:24:50.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:50.982+0000 7f81d8000640 1 --2- 172.21.15.63:0/1390264184 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f81b006f400 0x7f81b00718c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:24:50.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:50.982+0000 7f81d8000640 1 --2- 172.21.15.63:0/1390264184 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f81d00cd940 0x7f81d00ccca0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:24:50.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:50.982+0000 7f81d8000640 1 --2- 172.21.15.63:0/1390264184 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f81d00cd560 0x7f81d00cc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:24:50.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:50.982+0000 7f81d8000640 1 --2- 172.21.15.63:0/1390264184 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81d00c7cf0 0x7f81d00c6e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:24:50.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:50.982+0000 7f81d8000640 1 -- 172.21.15.63:0/1390264184 >> 172.21.15.63:0/1390264184 conn(0x7f81d0068460 msgr2=0x7f81d014c910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:24:50.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:50.982+0000 7f81d8000640 1 -- 172.21.15.63:0/1390264184 shutdown_connections 2024-05-21T01:24:50.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:50.982+0000 7f81d8000640 1 -- 172.21.15.63:0/1390264184 wait complete. 2024-05-21T01:24:51.022 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4276 quiesce db / --timeout 90 --expiration 133.6 --await-for 45.0' 2024-05-21T01:24:51.022 DEBUG:teuthology.orchestra.run.smithi063:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4276 quiesce db / --timeout 90 --expiration 133.6 --await-for 45.0 2024-05-21T01:24:51.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.214+0000 7fc21a800640 1 Processor -- start 2024-05-21T01:24:51.220 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.214+0000 7fc21a800640 1 -- start start 2024-05-21T01:24:51.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.218+0000 7fc21a800640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fc2140ca440 0x7fc21415bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:24:51.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.218+0000 7fc21a800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc21406ce80 0x7fc214072a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:24:51.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.218+0000 7fc21a800640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc21415c980 con 0x7fc21406e810 2024-05-21T01:24:51.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.218+0000 7fc21a800640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fc21406d310 con 0x7fc2140ca440 2024-05-21T01:24:51.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.218+0000 7fc21a800640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fc21415c0e0 con 0x7fc21406ce80 2024-05-21T01:24:51.221 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.218+0000 7fc218a00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fc21406e810 0x7fc21406fc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37594/0 (socket says 172.21.15.63:37594) 2024-05-21T01:24:51.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.218+0000 7fc218a00640 1 -- 172.21.15.63:0/3555232136 learned_addr learned my addr 172.21.15.63:0/3555232136 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-05-21T01:24:51.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.218+0000 7fc219400640 1 --2- 172.21.15.63:0/3555232136 >> v2:172.21.15.131:3300/0 conn(0x7fc2140ca440 0x7fc21415bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:24:51.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.218+0000 7fc219e00640 1 --2- 172.21.15.63:0/3555232136 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc21406ce80 0x7fc214072a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:24:51.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.218+0000 7fc213e00640 1 -- 172.21.15.63:0/3555232136 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3329542788 0 0) 0x7fc21415c980 con 0x7fc21406e810 2024-05-21T01:24:51.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.218+0000 7fc213e00640 1 -- 172.21.15.63:0/3555232136 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc1fc003530 con 0x7fc21406e810 2024-05-21T01:24:51.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.218+0000 7fc213e00640 1 -- 172.21.15.63:0/3555232136 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3609746937 0 0) 0x7fc1fc003530 con 0x7fc21406e810 2024-05-21T01:24:51.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.218+0000 7fc219e00640 1 -- 172.21.15.63:0/3555232136 >> v2:172.21.15.131:3300/0 conn(0x7fc2140ca440 msgr2=0x7fc21415bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:24:51.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.218+0000 7fc219e00640 1 --2- 172.21.15.63:0/3555232136 >> v2:172.21.15.131:3300/0 conn(0x7fc2140ca440 0x7fc21415bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:24:51.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.218+0000 7fc219e00640 1 -- 172.21.15.63:0/3555232136 >> v1:172.21.15.63:6789/0 conn(0x7fc21406e810 legacy=0x7fc21406fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:24:51.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.218+0000 7fc219e00640 1 -- 172.21.15.63:0/3555232136 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc21415c3c0 con 0x7fc21406ce80 2024-05-21T01:24:51.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.222+0000 7fc219e00640 1 --2- 172.21.15.63:0/3555232136 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc21406ce80 0x7fc214072a00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc20c009d90 tx=0x7fc20c01f080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d41f8df676c796d4 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:24:51.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.222+0000 7fc213e00640 1 -- 172.21.15.63:0/3555232136 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc20c0b5070 con 0x7fc21406ce80 2024-05-21T01:24:51.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.222+0000 7fc213e00640 1 -- 172.21.15.63:0/3555232136 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc20c0a8bd0 con 0x7fc21406ce80 2024-05-21T01:24:51.225 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.222+0000 7fc213e00640 1 -- 172.21.15.63:0/3555232136 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc200001700 con 0x7fc21406ce80 2024-05-21T01:24:51.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.222+0000 7fc21a800640 1 -- 172.21.15.63:0/3555232136 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc21406ce80 msgr2=0x7fc214072a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:24:51.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.222+0000 7fc21a800640 1 --2- 172.21.15.63:0/3555232136 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc21406ce80 0x7fc214072a00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc20c009d90 tx=0x7fc20c01f080 comp rx=0 tx=0).stop 2024-05-21T01:24:51.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.222+0000 7fc21a800640 1 -- 172.21.15.63:0/3555232136 shutdown_connections 2024-05-21T01:24:51.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.222+0000 7fc21a800640 1 --2- 172.21.15.63:0/3555232136 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc21406ce80 0x7fc214072a00 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:24:51.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.222+0000 7fc21a800640 1 --2- 172.21.15.63:0/3555232136 >> v2:172.21.15.131:3300/0 conn(0x7fc2140ca440 0x7fc21415bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:24:51.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.222+0000 7fc21a800640 1 -- 172.21.15.63:0/3555232136 >> 172.21.15.63:0/3555232136 conn(0x7fc214068690 msgr2=0x7fc2140ce020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:24:51.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.222+0000 7fc21a800640 1 -- 172.21.15.63:0/3555232136 shutdown_connections 2024-05-21T01:24:51.226 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.222+0000 7fc21a800640 1 -- 172.21.15.63:0/3555232136 wait complete. 2024-05-21T01:24:51.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.226+0000 7fc21a800640 1 Processor -- start 2024-05-21T01:24:51.228 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.226+0000 7fc21a800640 1 -- start start 2024-05-21T01:24:51.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.226+0000 7fc21a800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc21406ce80 0x7fc2141552c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:24:51.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.226+0000 7fc21a800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc21406e810 0x7fc2141539b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:24:51.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.226+0000 7fc21a800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc2140ca440 0x7fc214153ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:24:51.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.226+0000 7fc21a800640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fc2140724e0 con 0x7fc21406ce80 2024-05-21T01:24:51.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.226+0000 7fc21a800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fc214072200 con 0x7fc2140ca440 2024-05-21T01:24:51.230 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.226+0000 7fc21a800640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fc2140ca820 con 0x7fc21406e810 2024-05-21T01:24:51.231 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.226+0000 7fc219400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc21406ce80 0x7fc2141552c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:24:51.231 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.226+0000 7fc219400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc21406ce80 0x7fc2141552c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53572/0 (socket says 172.21.15.63:53572) 2024-05-21T01:24:51.231 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.226+0000 7fc219400640 1 -- 172.21.15.63:0/95268752 learned_addr learned my addr 172.21.15.63:0/95268752 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:24:51.231 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.226+0000 7fc218a00640 1 --2- 172.21.15.63:0/95268752 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc21406e810 0x7fc2141539b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:24:51.231 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.226+0000 7fc219e00640 1 --2- 172.21.15.63:0/95268752 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc2140ca440 0x7fc214153ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:24:51.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.226+0000 7fc219400640 1 -- 172.21.15.63:0/95268752 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc21406e810 msgr2=0x7fc2141539b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:24:51.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.226+0000 7fc219400640 1 --2- 172.21.15.63:0/95268752 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc21406e810 0x7fc2141539b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:24:51.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.226+0000 7fc219400640 1 -- 172.21.15.63:0/95268752 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc2140ca440 msgr2=0x7fc214153ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:24:51.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.226+0000 7fc219400640 1 --2- 172.21.15.63:0/95268752 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc2140ca440 0x7fc214153ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:24:51.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.226+0000 7fc219400640 1 -- 172.21.15.63:0/95268752 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2141f20d0 con 0x7fc21406ce80 2024-05-21T01:24:51.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.226+0000 7fc219400640 1 --2- 172.21.15.63:0/95268752 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc21406ce80 0x7fc2141552c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fc20800e8a0 tx=0x7fc20800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:24:51.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.226+0000 7fc211600640 1 -- 172.21.15.63:0/95268752 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc208017070 con 0x7fc21406ce80 2024-05-21T01:24:51.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.226+0000 7fc21a800640 1 -- 172.21.15.63:0/95268752 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2141f2390 con 0x7fc21406ce80 2024-05-21T01:24:51.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.226+0000 7fc211600640 1 -- 172.21.15.63:0/95268752 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc20800c940 con 0x7fc21406ce80 2024-05-21T01:24:51.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.226+0000 7fc211600640 1 -- 172.21.15.63:0/95268752 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc20800ccf0 con 0x7fc21406ce80 2024-05-21T01:24:51.232 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.230+0000 7fc21a800640 1 -- 172.21.15.63:0/95268752 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc214152ed0 con 0x7fc21406ce80 2024-05-21T01:24:51.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.234+0000 7fc21f20f000 1 Processor -- start 2024-05-21T01:24:51.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.234+0000 7fc21f20f000 1 -- start start 2024-05-21T01:24:51.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.234+0000 7fc211600640 1 -- 172.21.15.63:0/95268752 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7fc20801a070 con 0x7fc21406ce80 2024-05-21T01:24:51.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.234+0000 7fc21f20f000 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a5572e0130 0x55a5572a9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:24:51.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.234+0000 7fc211600640 1 --2- 172.21.15.63:0/95268752 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fc1f406f430 0x7fc1f40718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:24:51.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.234+0000 7fc21f20f000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a5572aa100 0x55a5572e4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:24:51.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.234+0000 7fc21f20f000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a5572e5100 0x55a5572e54e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:24:51.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.234+0000 7fc21f20f000 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55a5570ff740 con 0x55a5572e0130 2024-05-21T01:24:51.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.234+0000 7fc21f20f000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55a5570ef2e0 con 0x55a5572e5100 2024-05-21T01:24:51.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.234+0000 7fc21f20f000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55a5570f3320 con 0x55a5572aa100 2024-05-21T01:24:51.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.234+0000 7fc211600640 1 -- 172.21.15.63:0/95268752 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7fc20808f520 con 0x7fc21406ce80 2024-05-21T01:24:51.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.234+0000 7fc219e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a5572e0130 0x55a5572a9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:24:51.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.234+0000 7fc219e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a5572e0130 0x55a5572a9bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53578/0 (socket says 172.21.15.63:53578) 2024-05-21T01:24:51.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.234+0000 7fc219e00640 1 -- 172.21.15.63:0/3912140821 learned_addr learned my addr 172.21.15.63:0/3912140821 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:24:51.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.234+0000 7fc219e00640 1 --2- 172.21.15.63:0/3912140821 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a5572e5100 0x55a5572e54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:24:51.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.234+0000 7fc219400640 1 --2- 172.21.15.63:0/95268752 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fc1f406f430 0x7fc1f40718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:24:51.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.234+0000 7fc218a00640 1 --2- 172.21.15.63:0/3912140821 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a5572aa100 0x55a5572e4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:24:51.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.234+0000 7fc219e00640 1 -- 172.21.15.63:0/3912140821 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a5572aa100 msgr2=0x55a5572e4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:24:51.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.234+0000 7fc219e00640 1 --2- 172.21.15.63:0/3912140821 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a5572aa100 0x55a5572e4bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:24:51.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.234+0000 7fc219e00640 1 -- 172.21.15.63:0/3912140821 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a5572e5100 msgr2=0x55a5572e54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:24:51.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.234+0000 7fc219e00640 1 --2- 172.21.15.63:0/3912140821 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a5572e5100 0x55a5572e54e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:24:51.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.234+0000 7fc219e00640 1 -- 172.21.15.63:0/3912140821 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a557091490 con 0x55a5572e0130 2024-05-21T01:24:51.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.234+0000 7fc219e00640 1 --2- 172.21.15.63:0/3912140821 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a5572e0130 0x55a5572a9bc0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc20c01f920 tx=0x7fc20c004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2260aedd69964aa server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:24:51.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.238+0000 7fc219400640 1 --2- 172.21.15.63:0/95268752 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fc1f406f430 0x7fc1f40718f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc208057fb0 tx=0x7fc20800eef0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:24:51.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.238+0000 7fc206000640 1 -- 172.21.15.63:0/3912140821 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc20c0b5040 con 0x55a5572e0130 2024-05-21T01:24:51.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.238+0000 7fc206000640 1 -- 172.21.15.63:0/3912140821 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc20c0c5070 con 0x55a5572e0130 2024-05-21T01:24:51.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.238+0000 7fc206000640 1 -- 172.21.15.63:0/3912140821 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc20c003dc0 con 0x55a5572e0130 2024-05-21T01:24:51.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.238+0000 7fc21f20f000 1 -- 172.21.15.63:0/3912140821 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a5572e0130 msgr2=0x55a5572a9bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:24:51.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.238+0000 7fc21f20f000 1 --2- 172.21.15.63:0/3912140821 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a5572e0130 0x55a5572a9bc0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc20c01f920 tx=0x7fc20c004ac0 comp rx=0 tx=0).stop 2024-05-21T01:24:51.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.238+0000 7fc21f20f000 1 -- 172.21.15.63:0/3912140821 shutdown_connections 2024-05-21T01:24:51.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.238+0000 7fc21f20f000 1 --2- 172.21.15.63:0/3912140821 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a5572e5100 0x55a5572e54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:24:51.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.238+0000 7fc21f20f000 1 --2- 172.21.15.63:0/3912140821 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a5572aa100 0x55a5572e4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:24:51.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.238+0000 7fc21f20f000 1 --2- 172.21.15.63:0/3912140821 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a5572e0130 0x55a5572a9bc0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:24:51.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.238+0000 7fc21f20f000 1 -- 172.21.15.63:0/3912140821 >> 172.21.15.63:0/3912140821 conn(0x55a55718bd80 msgr2=0x55a5572e2980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:24:51.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.238+0000 7fc21f20f000 1 -- 172.21.15.63:0/3912140821 shutdown_connections 2024-05-21T01:24:51.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.238+0000 7fc21f20f000 1 -- 172.21.15.63:0/3912140821 wait complete. 2024-05-21T01:24:51.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.238+0000 7fc21f20f000 1 -- start start 2024-05-21T01:24:51.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.238+0000 7fc21f20f000 1 Processor -- start 2024-05-21T01:24:51.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.238+0000 7fc21f20f000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a5572aa100 0x55a5572a8280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:24:51.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.238+0000 7fc21f20f000 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a5572e0130 0x55a5572a87c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:24:51.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.238+0000 7fc21f20f000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a5572e5100 0x55a5572eb960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:24:51.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.238+0000 7fc21f20f000 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55a556dbab10 con 0x55a5572e0130 2024-05-21T01:24:51.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.238+0000 7fc21f20f000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55a5570ab670 con 0x55a5572aa100 2024-05-21T01:24:51.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.238+0000 7fc21f20f000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55a5570f7950 con 0x55a5572e5100 2024-05-21T01:24:51.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.238+0000 7fc21f20f000 10 client.0 _ll_register_callbacks cb 0x55a55728f540 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-21T01:24:51.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.238+0000 7fc218a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a5572e0130 0x55a5572a87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:24:51.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.238+0000 7fc219e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a5572aa100 0x55a5572a8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:24:51.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.238+0000 7fc218a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a5572e0130 0x55a5572a87c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53584/0 (socket says 172.21.15.63:53584) 2024-05-21T01:24:51.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.238+0000 7fc218a00640 1 -- 172.21.15.63:0/945916431 learned_addr learned my addr 172.21.15.63:0/945916431 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:24:51.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.238+0000 7fc219e00640 1 --2- 172.21.15.63:0/945916431 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a5572e5100 0x55a5572eb960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:24:51.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.242+0000 7fc218a00640 1 -- 172.21.15.63:0/945916431 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a5572e5100 msgr2=0x55a5572eb960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:24:51.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.242+0000 7fc218a00640 1 --2- 172.21.15.63:0/945916431 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a5572e5100 0x55a5572eb960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:24:51.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.242+0000 7fc218a00640 1 -- 172.21.15.63:0/945916431 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a5572aa100 msgr2=0x55a5572a8280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:24:51.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.242+0000 7fc218a00640 1 --2- 172.21.15.63:0/945916431 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a5572aa100 0x55a5572a8280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:24:51.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.242+0000 7fc218a00640 1 -- 172.21.15.63:0/945916431 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5570a4e40 con 0x55a5572e0130 2024-05-21T01:24:51.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.242+0000 7fc218a00640 1 --2- 172.21.15.63:0/945916431 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a5572e0130 0x55a5572a87c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc200012610 tx=0x7fc200012ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9164b2c58e991e45 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:24:51.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.242+0000 7fc1faa00640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-05-21T01:24:51.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.242+0000 7fc1faa00640 1 -- 172.21.15.63:0/945916431 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc200019070 con 0x55a5572e0130 2024-05-21T01:24:51.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.242+0000 7fc21f20f000 1 -- 172.21.15.63:0/945916431 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc20c0c5070 con 0x55a5572e0130 2024-05-21T01:24:51.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.242+0000 7fc1faa00640 1 -- 172.21.15.63:0/945916431 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7fc200014730 con 0x55a5572e0130 2024-05-21T01:24:51.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.242+0000 7fc1faa00640 1 -- 172.21.15.63:0/945916431 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7fc200024050 con 0x55a5572e0130 2024-05-21T01:24:51.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.242+0000 7fc21f20f000 10 client.4968 fetch_fsmap learned FSMap version 15 2024-05-21T01:24:51.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.242+0000 7fc21f20f000 1 -- 172.21.15.63:0/945916431 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x55a557174890 con 0x55a5572e0130 2024-05-21T01:24:51.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.242+0000 7fc1faa00640 1 -- 172.21.15.63:0/945916431 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc20c0c5070 con 0x55a5572e0130 2024-05-21T01:24:51.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.242+0000 7fc1faa00640 1 -- 172.21.15.63:0/945916431 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 15) ==== 4752+0+0 (secure 0 0 0) 0x7fc200027020 con 0x55a5572e0130 2024-05-21T01:24:51.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.242+0000 7fc21f20f000 10 client.4968 fetch_fsmap finished waiting for FSMap version 15 2024-05-21T01:24:51.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.242+0000 7fc21f20f000 10 client.4968 resolve_mds: validated gid 4276 aka daemon mds.c 2024-05-21T01:24:51.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.242+0000 7fc21f20f000 20 client.4968 populate_metadata read hostname 'smithi063' 2024-05-21T01:24:51.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.242+0000 7fc21f20f000 1 --2- 172.21.15.63:0/945916431 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x55a5572ec370 0x55a5572ec750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:24:51.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.242+0000 7fc21f20f000 4 client.4968 mds_command: new command op to 4276 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-21T01:24:51.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.242+0000 7fc21f20f000 1 -- 172.21.15.63:0/945916431 --> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a55708b7f0 con 0x55a5572ec370 2024-05-21T01:24:51.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.242+0000 7fc219e00640 1 --2- 172.21.15.63:0/945916431 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x55a5572ec370 0x55a5572ec750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:24:51.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.242+0000 7fc219e00640 1 --2- 172.21.15.63:0/945916431 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x55a5572ec370 0x55a5572ec750 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e5953247b5f1d6d server_cookie=eb0d68624e4e1591 in_seq=0 out_seq=0 2024-05-21T01:24:51.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.242+0000 7fc1faa00640 10 client.4968 ms_handle_connect on v2:172.21.15.63:6834/2892727989 2024-05-21T01:24:51.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.246+0000 7fc1faa00640 1 -- 172.21.15.63:0/945916431 <== mds.0 v2:172.21.15.63:6834/2892727989 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x55a55708b7f0 con 0x55a5572ec370 2024-05-21T01:24:51.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.246+0000 7fc1faa00640 10 client.4968 handle_command_reply: tid=0 2024-05-21T01:24:51.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.246+0000 7fc21f20f000 1 client.4968 shutdown 2024-05-21T01:24:51.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.246+0000 7fc21f20f000 1 -- 172.21.15.63:0/945916431 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a5572e0130 msgr2=0x55a5572a87c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:24:51.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.246+0000 7fc21f20f000 1 --2- 172.21.15.63:0/945916431 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a5572e0130 0x55a5572a87c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc200012610 tx=0x7fc200012ad0 comp rx=0 tx=0).stop 2024-05-21T01:24:51.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.246+0000 7fc21f20f000 1 -- 172.21.15.63:0/945916431 shutdown_connections 2024-05-21T01:24:51.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.246+0000 7fc21f20f000 1 --2- 172.21.15.63:0/945916431 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x55a5572ec370 0x55a5572ec750 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:24:51.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.246+0000 7fc21f20f000 1 --2- 172.21.15.63:0/945916431 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a5572e5100 0x55a5572eb960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:24:51.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.246+0000 7fc21f20f000 1 --2- 172.21.15.63:0/945916431 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a5572e0130 0x55a5572a87c0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:24:51.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.246+0000 7fc21f20f000 1 --2- 172.21.15.63:0/945916431 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a5572aa100 0x55a5572a8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:24:51.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.246+0000 7fc1faa00640 0 client.4968 ms_handle_reset on v2:172.21.15.63:6834/2892727989 2024-05-21T01:24:51.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.246+0000 7fc21f20f000 1 -- 172.21.15.63:0/945916431 >> 172.21.15.63:0/945916431 conn(0x55a55718bd80 msgr2=0x55a5572a9330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:24:51.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.246+0000 7fc21f20f000 1 -- 172.21.15.63:0/945916431 shutdown_connections 2024-05-21T01:24:51.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.246+0000 7fc21f20f000 1 -- 172.21.15.63:0/945916431 wait complete. 2024-05-21T01:24:51.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.246+0000 7fc21f20f000 20 client.4968 trim_cache size 0 max 16384 2024-05-21T01:24:51.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.274+0000 7fc21f20f000 1 Processor -- start 2024-05-21T01:24:51.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.278+0000 7fc21f20f000 1 -- start start 2024-05-21T01:24:51.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.278+0000 7fc21f20f000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a5572aa100 0x55a5572eb740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:24:51.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.278+0000 7fc21f20f000 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a5572e0130 0x55a5572ed760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:24:51.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.278+0000 7fc21f20f000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a5572e5100 0x55a5572edca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:24:51.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.278+0000 7fc21f20f000 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fc2141fe310 con 0x55a5572e0130 2024-05-21T01:24:51.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.278+0000 7fc21f20f000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fc21414d800 con 0x55a5572e5100 2024-05-21T01:24:51.281 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.278+0000 7fc21f20f000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fc2141fdcf0 con 0x55a5572aa100 2024-05-21T01:24:51.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.278+0000 7fc218a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a5572e0130 0x55a5572ed760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:24:51.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.278+0000 7fc219e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a5572aa100 0x55a5572eb740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:24:51.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.278+0000 7fc218a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a5572e0130 0x55a5572ed760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53586/0 (socket says 172.21.15.63:53586) 2024-05-21T01:24:51.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.278+0000 7fc218a00640 1 -- 172.21.15.63:0/2322930884 learned_addr learned my addr 172.21.15.63:0/2322930884 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:24:51.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.278+0000 7fc219e00640 1 --2- 172.21.15.63:0/2322930884 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a5572e5100 0x55a5572edca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:24:51.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.278+0000 7fc218a00640 1 -- 172.21.15.63:0/2322930884 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a5572aa100 msgr2=0x55a5572eb740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:24:51.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.278+0000 7fc218a00640 1 --2- 172.21.15.63:0/2322930884 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a5572aa100 0x55a5572eb740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:24:51.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.278+0000 7fc218a00640 1 -- 172.21.15.63:0/2322930884 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a5572e5100 msgr2=0x55a5572edca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:24:51.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.278+0000 7fc218a00640 1 --2- 172.21.15.63:0/2322930884 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a5572e5100 0x55a5572edca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:24:51.283 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.278+0000 7fc218a00640 1 -- 172.21.15.63:0/2322930884 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a55714bda0 con 0x55a5572e0130 2024-05-21T01:24:51.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.278+0000 7fc219e00640 1 --2- 172.21.15.63:0/2322930884 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a5572e5100 0x55a5572edca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T01:24:51.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.278+0000 7fc218a00640 1 --2- 172.21.15.63:0/2322930884 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a5572e0130 0x55a5572ed760 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc2000010d0 tx=0x7fc200016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22b3460e44ac10f0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:24:51.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.278+0000 7fc205600640 1 -- 172.21.15.63:0/2322930884 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc20002d070 con 0x55a5572e0130 2024-05-21T01:24:51.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.278+0000 7fc205600640 1 -- 172.21.15.63:0/2322930884 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc200012330 con 0x55a5572e0130 2024-05-21T01:24:51.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.278+0000 7fc205600640 1 -- 172.21.15.63:0/2322930884 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc200019030 con 0x55a5572e0130 2024-05-21T01:24:51.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.278+0000 7fc21f20f000 1 -- 172.21.15.63:0/2322930884 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a5572e0130 msgr2=0x55a5572ed760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:24:51.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.278+0000 7fc21f20f000 1 --2- 172.21.15.63:0/2322930884 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a5572e0130 0x55a5572ed760 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc2000010d0 tx=0x7fc200016000 comp rx=0 tx=0).stop 2024-05-21T01:24:51.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.278+0000 7fc21f20f000 1 -- 172.21.15.63:0/2322930884 shutdown_connections 2024-05-21T01:24:51.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.278+0000 7fc21f20f000 1 --2- 172.21.15.63:0/2322930884 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a5572e5100 0x55a5572edca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:24:51.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.278+0000 7fc21f20f000 1 --2- 172.21.15.63:0/2322930884 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a5572e0130 0x55a5572ed760 secure :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc2000010d0 tx=0x7fc200016000 comp rx=0 tx=0).stop 2024-05-21T01:24:51.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.278+0000 7fc21f20f000 1 --2- 172.21.15.63:0/2322930884 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a5572aa100 0x55a5572eb740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:24:51.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.282+0000 7fc21f20f000 1 -- 172.21.15.63:0/2322930884 >> 172.21.15.63:0/2322930884 conn(0x55a55718bd80 msgr2=0x55a5572de970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:24:51.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.282+0000 7fc21f20f000 1 -- 172.21.15.63:0/2322930884 shutdown_connections 2024-05-21T01:24:51.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.282+0000 7fc21f20f000 1 -- 172.21.15.63:0/2322930884 wait complete. 2024-05-21T01:24:51.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.282+0000 7fc21f20f000 1 -- start start 2024-05-21T01:24:51.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.282+0000 7fc21f20f000 1 Processor -- start 2024-05-21T01:24:51.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.282+0000 7fc21f20f000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a5572aa100 0x55a5572e7c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:24:51.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.282+0000 7fc21f20f000 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a5572e5100 0x55a5572e81c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:24:51.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.282+0000 7fc21f20f000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a5572e8700 0x55a5572e8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:24:51.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.282+0000 7fc21f20f000 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55a5570eb0e0 con 0x55a5572e5100 2024-05-21T01:24:51.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.282+0000 7fc21f20f000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55a557174400 con 0x55a5572aa100 2024-05-21T01:24:51.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.282+0000 7fc21f20f000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55a5570883e0 con 0x55a5572e8700 2024-05-21T01:24:51.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.282+0000 7fc21f20f000 10 client.0 _ll_register_callbacks cb 0x7fc200001710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-21T01:24:51.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.282+0000 7fc218a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a5572e5100 0x55a5572e81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:24:51.288 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.282+0000 7fc219e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a5572aa100 0x55a5572e7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:24:51.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.282+0000 7fc218a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a5572e5100 0x55a5572e81c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:53598/0 (socket says 172.21.15.63:53598) 2024-05-21T01:24:51.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.282+0000 7fc218a00640 1 -- 172.21.15.63:0/3763199021 learned_addr learned my addr 172.21.15.63:0/3763199021 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:24:51.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.282+0000 7fc219e00640 1 --2- 172.21.15.63:0/3763199021 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a5572e8700 0x55a5572e8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:24:51.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.286+0000 7fc218a00640 1 -- 172.21.15.63:0/3763199021 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a5572e8700 msgr2=0x55a5572e8ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:24:51.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.286+0000 7fc218a00640 1 --2- 172.21.15.63:0/3763199021 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a5572e8700 0x55a5572e8ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:24:51.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.286+0000 7fc218a00640 1 -- 172.21.15.63:0/3763199021 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a5572aa100 msgr2=0x55a5572e7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:24:51.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.286+0000 7fc218a00640 1 --2- 172.21.15.63:0/3763199021 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a5572aa100 0x55a5572e7c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:24:51.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.286+0000 7fc218a00640 1 -- 172.21.15.63:0/3763199021 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a557083f40 con 0x55a5572e5100 2024-05-21T01:24:51.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.286+0000 7fc218a00640 1 --2- 172.21.15.63:0/3763199021 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a5572e5100 0x55a5572e81c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fc200014cc0 tx=0x7fc200000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c84f945e9ff09cc6 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:24:51.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.286+0000 7fc1faa00640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-05-21T01:24:51.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.286+0000 7fc1faa00640 1 -- 172.21.15.63:0/3763199021 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc200036060 con 0x55a5572e5100 2024-05-21T01:24:51.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.286+0000 7fc1faa00640 1 -- 172.21.15.63:0/3763199021 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7fc2000147b0 con 0x55a5572e5100 2024-05-21T01:24:51.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.286+0000 7fc21f20f000 1 -- 172.21.15.63:0/3763199021 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc200012330 con 0x55a5572e5100 2024-05-21T01:24:51.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.286+0000 7fc1faa00640 1 -- 172.21.15.63:0/3763199021 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7fc20003c050 con 0x55a5572e5100 2024-05-21T01:24:51.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.286+0000 7fc21f20f000 10 client.4974 fetch_fsmap learned FSMap version 15 2024-05-21T01:24:51.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.286+0000 7fc21f20f000 1 -- 172.21.15.63:0/3763199021 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x55a557096f80 con 0x55a5572e5100 2024-05-21T01:24:51.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.286+0000 7fc1faa00640 1 -- 172.21.15.63:0/3763199021 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc200012330 con 0x55a5572e5100 2024-05-21T01:24:51.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.286+0000 7fc1faa00640 1 -- 172.21.15.63:0/3763199021 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 15) ==== 4752+0+0 (secure 0 0 0) 0x7fc20003f020 con 0x55a5572e5100 2024-05-21T01:24:51.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.286+0000 7fc21f20f000 10 client.4974 fetch_fsmap finished waiting for FSMap version 15 2024-05-21T01:24:51.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.286+0000 7fc21f20f000 10 client.4974 resolve_mds: validated gid 4276 aka daemon mds.c 2024-05-21T01:24:51.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.286+0000 7fc21f20f000 20 client.4974 populate_metadata read hostname 'smithi063' 2024-05-21T01:24:51.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.286+0000 7fc21f20f000 1 --2- 172.21.15.63:0/3763199021 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x55a5572e9020 0x55a55736ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:24:51.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.286+0000 7fc21f20f000 4 client.4974 mds_command: new command op to 4276 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 133.6, "await_for": 45.0}] 2024-05-21T01:24:51.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.286+0000 7fc21f20f000 1 -- 172.21.15.63:0/3763199021 --> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 133.6, "await_for": 45.0}) -- 0x55a5570cce60 con 0x55a5572e9020 2024-05-21T01:24:51.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.286+0000 7fc219e00640 1 --2- 172.21.15.63:0/3763199021 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x55a5572e9020 0x55a55736ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:24:51.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.286+0000 7fc219e00640 1 --2- 172.21.15.63:0/3763199021 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x55a5572e9020 0x55a55736ea20 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=744798d83feab79a server_cookie=e41ae29731bc80c3 in_seq=0 out_seq=0 2024-05-21T01:24:51.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.286+0000 7fc1faa00640 10 client.4974 ms_handle_connect on v2:172.21.15.63:6834/2892727989 2024-05-21T01:24:51.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.294+0000 7fc1faa00640 1 -- 172.21.15.63:0/3763199021 <== mds.0 v2:172.21.15.63:6834/2892727989 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x55a5570cce60 con 0x55a5572e9020 2024-05-21T01:24:51.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.294+0000 7fc1faa00640 10 client.4974 handle_command_reply: tid=0 2024-05-21T01:24:51.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.294+0000 7fc21f20f000 1 client.4974 shutdown 2024-05-21T01:24:51.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.294+0000 7fc21f20f000 1 -- 172.21.15.63:0/3763199021 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a5572e5100 msgr2=0x55a5572e81c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:24:51.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.294+0000 7fc21f20f000 1 --2- 172.21.15.63:0/3763199021 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a5572e5100 0x55a5572e81c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fc200014cc0 tx=0x7fc200000ee0 comp rx=0 tx=0).stop 2024-05-21T01:24:51.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.298+0000 7fc21f20f000 1 -- 172.21.15.63:0/3763199021 shutdown_connections 2024-05-21T01:24:51.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.298+0000 7fc21f20f000 1 --2- 172.21.15.63:0/3763199021 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x55a5572e9020 0x55a55736ea20 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:24:51.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.298+0000 7fc21f20f000 1 --2- 172.21.15.63:0/3763199021 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55a5572e8700 0x55a5572e8ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:24:51.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.298+0000 7fc21f20f000 1 --2- 172.21.15.63:0/3763199021 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55a5572e5100 0x55a5572e81c0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:24:51.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.298+0000 7fc21f20f000 1 --2- 172.21.15.63:0/3763199021 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a5572aa100 0x55a5572e7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:24:51.300 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.298+0000 7fc21f20f000 1 -- 172.21.15.63:0/3763199021 >> 172.21.15.63:0/3763199021 conn(0x55a55718bd80 msgr2=0x55a5572df200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:24:51.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.298+0000 7fc1faa00640 0 client.4974 ms_handle_reset on v2:172.21.15.63:6834/2892727989 2024-05-21T01:24:51.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.298+0000 7fc21f20f000 1 -- 172.21.15.63:0/3763199021 shutdown_connections 2024-05-21T01:24:51.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.298+0000 7fc21f20f000 1 -- 172.21.15.63:0/3763199021 wait complete. 2024-05-21T01:24:51.301 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.298+0000 7fc21f20f000 20 client.4974 trim_cache size 0 max 16384 2024-05-21T01:24:51.302 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-05-21T01:24:51.302 INFO:teuthology.orchestra.run.smithi063.stdout: "epoch": 15, 2024-05-21T01:24:51.302 INFO:teuthology.orchestra.run.smithi063.stdout: "leader": 4276, 2024-05-21T01:24:51.302 INFO:teuthology.orchestra.run.smithi063.stdout: "set_version": 14, 2024-05-21T01:24:51.302 INFO:teuthology.orchestra.run.smithi063.stdout: "sets": { 2024-05-21T01:24:51.302 INFO:teuthology.orchestra.run.smithi063.stdout: "54903989": { 2024-05-21T01:24:51.302 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 14, 2024-05-21T01:24:51.302 INFO:teuthology.orchestra.run.smithi063.stdout: "age_ref": 0.0, 2024-05-21T01:24:51.302 INFO:teuthology.orchestra.run.smithi063.stdout: "state": { 2024-05-21T01:24:51.302 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "QUIESCED", 2024-05-21T01:24:51.302 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 0.0 2024-05-21T01:24:51.302 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-05-21T01:24:51.303 INFO:teuthology.orchestra.run.smithi063.stdout: "timeout": 90.0, 2024-05-21T01:24:51.303 INFO:teuthology.orchestra.run.smithi063.stdout: "expiration": 133.6, 2024-05-21T01:24:51.303 INFO:teuthology.orchestra.run.smithi063.stdout: "members": { 2024-05-21T01:24:51.303 INFO:teuthology.orchestra.run.smithi063.stdout: "file:/": { 2024-05-21T01:24:51.303 INFO:teuthology.orchestra.run.smithi063.stdout: "excluded": false, 2024-05-21T01:24:51.303 INFO:teuthology.orchestra.run.smithi063.stdout: "state": { 2024-05-21T01:24:51.303 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "QUIESCED", 2024-05-21T01:24:51.303 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 0.0 2024-05-21T01:24:51.303 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-05-21T01:24:51.303 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-05-21T01:24:51.303 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-05-21T01:24:51.303 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-05-21T01:24:51.303 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-05-21T01:24:51.303 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-05-21T01:24:51.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.298+0000 7fc21a800640 1 -- 172.21.15.63:0/95268752 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fc1f406f430 msgr2=0x7fc1f40718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:24:51.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.298+0000 7fc21a800640 1 --2- 172.21.15.63:0/95268752 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fc1f406f430 0x7fc1f40718f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc208057fb0 tx=0x7fc20800eef0 comp rx=0 tx=0).stop 2024-05-21T01:24:51.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.298+0000 7fc21a800640 1 -- 172.21.15.63:0/95268752 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc21406ce80 msgr2=0x7fc2141552c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:24:51.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.298+0000 7fc21a800640 1 --2- 172.21.15.63:0/95268752 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc21406ce80 0x7fc2141552c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fc20800e8a0 tx=0x7fc20800eca0 comp rx=0 tx=0).stop 2024-05-21T01:24:51.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.298+0000 7fc21a800640 1 -- 172.21.15.63:0/95268752 shutdown_connections 2024-05-21T01:24:51.304 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.298+0000 7fc21a800640 1 --2- 172.21.15.63:0/95268752 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fc1f406f430 0x7fc1f40718f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:24:51.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.298+0000 7fc21a800640 1 --2- 172.21.15.63:0/95268752 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc2140ca440 0x7fc214153ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:24:51.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.298+0000 7fc21a800640 1 --2- 172.21.15.63:0/95268752 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc21406e810 0x7fc2141539b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:24:51.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.298+0000 7fc21a800640 1 --2- 172.21.15.63:0/95268752 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc21406ce80 0x7fc2141552c0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:24:51.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.298+0000 7fc21a800640 1 -- 172.21.15.63:0/95268752 >> 172.21.15.63:0/95268752 conn(0x7fc214068690 msgr2=0x7fc21415ac30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:24:51.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.298+0000 7fc21a800640 1 -- 172.21.15.63:0/95268752 shutdown_connections 2024-05-21T01:24:51.305 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:24:51.298+0000 7fc21a800640 1 -- 172.21.15.63:0/95268752 wait complete. 2024-05-21T01:24:51.326 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '54903989', quiesce took 1.0 seconds. Will release after: 12.6 2024-05-21T01:24:57.075 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-21T01:24:57.081 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-21T01:25:03.927 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-21T01:25:04.162 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:04.158+0000 7fe1f2e00640 1 Processor -- start 2024-05-21T01:25:04.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:04.158+0000 7fe1f2e00640 1 -- start start 2024-05-21T01:25:04.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:04.162+0000 7fe1f2e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fe1ec155d00 0x7fe1ec06d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:04.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:04.162+0000 7fe1f2e00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1ec072920 con 0x7fe1ec0731b0 2024-05-21T01:25:04.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:04.162+0000 7fe1f2e00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1ec15be60 con 0x7fe1ec073cf0 2024-05-21T01:25:04.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:04.162+0000 7fe1f2e00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fe1ec15cd30 con 0x7fe1ec155d00 2024-05-21T01:25:04.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:04.162+0000 7fe1e3400640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fe1ec073cf0 0x7fe1ec15c620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.63:53950/0 (socket says 172.21.15.63:53950) 2024-05-21T01:25:04.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:04.162+0000 7fe1e3400640 1 -- 172.21.15.63:0/3490426099 learned_addr learned my addr 172.21.15.63:0/3490426099 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-05-21T01:25:04.166 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:04.162+0000 7fe1ebe00640 1 --2- 172.21.15.63:0/3490426099 >> v2:172.21.15.131:3300/0 conn(0x7fe1ec155d00 0x7fe1ec06d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:04.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:04.162+0000 7fe1ebe00640 1 -- 172.21.15.63:0/3490426099 >> v1:172.21.15.131:6789/0 conn(0x7fe1ec073cf0 legacy=0x7fe1ec15c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:25:04.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:04.162+0000 7fe1ebe00640 1 -- 172.21.15.63:0/3490426099 >> v1:172.21.15.63:6789/0 conn(0x7fe1ec0731b0 legacy=0x7fe1ec1666d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:25:04.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:04.162+0000 7fe1ebe00640 1 -- 172.21.15.63:0/3490426099 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1ec074310 con 0x7fe1ec155d00 2024-05-21T01:25:04.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:04.166+0000 7fe1ebe00640 1 --2- 172.21.15.63:0/3490426099 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe1ec155d00 0x7fe1ec06d4f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc009d90 tx=0x7fe1dc01f150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a27282878de7c57d server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:25:04.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:04.166+0000 7fe1eb400640 1 -- 172.21.15.63:0/3490426099 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1dc0b4070 con 0x7fe1ec155d00 2024-05-21T01:25:04.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:04.166+0000 7fe1eb400640 1 -- 172.21.15.63:0/3490426099 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1dc0af600 con 0x7fe1ec155d00 2024-05-21T01:25:04.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:04.166+0000 7fe1eb400640 1 -- 172.21.15.63:0/3490426099 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1dc0af9d0 con 0x7fe1ec155d00 2024-05-21T01:25:04.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:04.166+0000 7fe1f2e00640 1 -- 172.21.15.63:0/3490426099 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe1ec155d00 msgr2=0x7fe1ec06d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:25:04.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:04.166+0000 7fe1f2e00640 1 --2- 172.21.15.63:0/3490426099 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe1ec155d00 0x7fe1ec06d4f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc009d90 tx=0x7fe1dc01f150 comp rx=0 tx=0).stop 2024-05-21T01:25:04.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:04.166+0000 7fe1f2e00640 1 -- 172.21.15.63:0/3490426099 shutdown_connections 2024-05-21T01:25:04.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:04.166+0000 7fe1f2e00640 1 --2- 172.21.15.63:0/3490426099 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe1ec155d00 0x7fe1ec06d4f0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:04.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:04.166+0000 7fe1f2e00640 1 -- 172.21.15.63:0/3490426099 >> 172.21.15.63:0/3490426099 conn(0x7fe1ec0cae00 msgr2=0x7fe1ec0cb210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:25:04.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:04.170+0000 7fe1f2e00640 1 -- 172.21.15.63:0/3490426099 shutdown_connections 2024-05-21T01:25:04.173 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:04.170+0000 7fe1f2e00640 1 -- 172.21.15.63:0/3490426099 wait complete. 2024-05-21T01:25:04.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:04.170+0000 7fe1f2e00640 1 Processor -- start 2024-05-21T01:25:04.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:04.170+0000 7fe1f2e00640 1 -- start start 2024-05-21T01:25:04.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:04.174+0000 7fe1f2e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe1ec0731b0 0x7fe1ec1f17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:04.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:04.174+0000 7fe1f2e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1ec073cf0 0x7fe1ec15fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:04.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:04.174+0000 7fe1f2e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe1ec155d00 0x7fe1ec15cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:04.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:04.174+0000 7fe1f2e00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe1ec0748d0 con 0x7fe1ec073cf0 2024-05-21T01:25:04.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:04.174+0000 7fe1f2e00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fe1ec15c100 con 0x7fe1ec0731b0 2024-05-21T01:25:04.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:04.174+0000 7fe1f2e00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fe1ec0725e0 con 0x7fe1ec155d00 2024-05-21T01:25:04.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:04.174+0000 7fe1ebe00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe1ec0731b0 0x7fe1ec1f17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:04.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:04.174+0000 7fe1ebe00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe1ec0731b0 0x7fe1ec1f17b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.63:42296/0 (socket says 172.21.15.63:42296) 2024-05-21T01:25:04.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:04.174+0000 7fe1ebe00640 1 -- 172.21.15.63:0/1715341458 learned_addr learned my addr 172.21.15.63:0/1715341458 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:25:04.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:04.174+0000 7fe1e3400640 1 --2- 172.21.15.63:0/1715341458 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1ec073cf0 0x7fe1ec15fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:04.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:04.174+0000 7fe1ebe00640 1 -- 172.21.15.63:0/1715341458 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe1ec155d00 msgr2=0x7fe1ec15cf10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-21T01:25:04.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:04.174+0000 7fe1ebe00640 1 --2- 172.21.15.63:0/1715341458 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe1ec155d00 0x7fe1ec15cf10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:04.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:04.174+0000 7fe1ebe00640 1 -- 172.21.15.63:0/1715341458 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1ec073cf0 msgr2=0x7fe1ec15fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:25:04.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:04.174+0000 7fe1ebe00640 1 --2- 172.21.15.63:0/1715341458 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1ec073cf0 0x7fe1ec15fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:04.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:04.174+0000 7fe1ebe00640 1 -- 172.21.15.63:0/1715341458 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1ec15f380 con 0x7fe1ec0731b0 2024-05-21T01:25:04.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:04.174+0000 7fe1e3400640 1 --2- 172.21.15.63:0/1715341458 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1ec073cf0 0x7fe1ec15fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T01:25:04.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:04.174+0000 7fe1ebe00640 1 --2- 172.21.15.63:0/1715341458 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe1ec0731b0 0x7fe1ec1f17b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc01bd60 tx=0x7fe1dc01bef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:25:04.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:04.174+0000 7fe1e8c00640 1 -- 172.21.15.63:0/1715341458 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1dc0b4040 con 0x7fe1ec0731b0 2024-05-21T01:25:04.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:04.174+0000 7fe1f2e00640 1 -- 172.21.15.63:0/1715341458 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1ec15f660 con 0x7fe1ec0731b0 2024-05-21T01:25:04.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:04.174+0000 7fe1f2e00640 1 -- 172.21.15.63:0/1715341458 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1ec1f4f50 con 0x7fe1ec0731b0 2024-05-21T01:25:04.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:04.174+0000 7fe1e8c00640 1 -- 172.21.15.63:0/1715341458 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1dc0c1070 con 0x7fe1ec0731b0 2024-05-21T01:25:04.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:04.174+0000 7fe1e8c00640 1 -- 172.21.15.63:0/1715341458 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1dc0ba690 con 0x7fe1ec0731b0 2024-05-21T01:25:04.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:04.174+0000 7fe1f2e00640 1 -- 172.21.15.63:0/1715341458 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1c40052a0 con 0x7fe1ec0731b0 2024-05-21T01:25:04.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:04.178+0000 7fe1e8c00640 1 -- 172.21.15.63:0/1715341458 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7fe1dc0ba830 con 0x7fe1ec0731b0 2024-05-21T01:25:04.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:04.178+0000 7fe1e8c00640 1 --2- 172.21.15.63:0/1715341458 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fe1c806f400 0x7fe1c80718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:04.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:04.178+0000 7fe1e8c00640 1 -- 172.21.15.63:0/1715341458 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7fe1dc12ec90 con 0x7fe1ec0731b0 2024-05-21T01:25:04.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:04.178+0000 7fe1e3400640 1 --2- 172.21.15.63:0/1715341458 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fe1c806f400 0x7fe1c80718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:04.183 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:04.178+0000 7fe1e3400640 1 --2- 172.21.15.63:0/1715341458 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fe1c806f400 0x7fe1c80718c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec15b490 tx=0x7fe1d4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:25:04.189 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:04.186+0000 7fe1e8c00640 1 -- 172.21.15.63:0/1715341458 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fe1dc018cb0 con 0x7fe1ec0731b0 2024-05-21T01:25:04.733 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:04.726+0000 7fe1f2e00640 1 -- 172.21.15.63:0/1715341458 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe1c4005590 con 0x7fe1ec0731b0 2024-05-21T01:25:04.738 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-05-21T01:25:04.738 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6839/3045714273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6837","nonce":3045714273},{"type":"v1","addr":"172.21.15.131:6839","nonce":3045714273}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/2978367338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":2978367338},{"type":"v1","addr":"172.21.15.131:6835","nonce":2978367338}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/3005995321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6835","nonce":3005995321},{"type":"v1","addr":"172.21.15.63:6837","nonce":3005995321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-21T01:19:53.915775+0000","modified":"2024-05-21T01:20:31.724475+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4276,"mds_1":4270,"mds_2":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"e","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.63:6833/574189772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":574189772},{"type":"v1","addr":"172.21.15.63:6833","nonce":574189772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4270":{"gid":4270,"name":"f","rank":1,"incarnation":10,"state":"up:active","state_seq":11,"addr":"172.21.15.131:6838/3071941741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":3071941741},{"type":"v1","addr":"172.21.15.131:6838","nonce":3071941741}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.63:6836/2892727989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":2892727989},{"type":"v1","addr":"172.21.15.63:6836","nonce":2892727989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4276,"qdb_cluster":[4267,4270,4276]},"id":1}]} 2024-05-21T01:25:04.738 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 15 2024-05-21T01:25:04.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:04.730+0000 7fe1e8c00640 1 -- 172.21.15.63:0/1715341458 <== mon.1 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+6876 (secure 0 0 0) 0x7fe1dc0fb770 con 0x7fe1ec0731b0 2024-05-21T01:25:04.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:04.738+0000 7fe1f2e00640 1 -- 172.21.15.63:0/1715341458 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fe1c806f400 msgr2=0x7fe1c80718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:25:04.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:04.738+0000 7fe1f2e00640 1 --2- 172.21.15.63:0/1715341458 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fe1c806f400 0x7fe1c80718c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec15b490 tx=0x7fe1d4009040 comp rx=0 tx=0).stop 2024-05-21T01:25:04.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:04.738+0000 7fe1f2e00640 1 -- 172.21.15.63:0/1715341458 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe1ec0731b0 msgr2=0x7fe1ec1f17b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:25:04.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:04.738+0000 7fe1f2e00640 1 --2- 172.21.15.63:0/1715341458 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe1ec0731b0 0x7fe1ec1f17b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc01bd60 tx=0x7fe1dc01bef0 comp rx=0 tx=0).stop 2024-05-21T01:25:04.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:04.738+0000 7fe1f2e00640 1 -- 172.21.15.63:0/1715341458 shutdown_connections 2024-05-21T01:25:04.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:04.738+0000 7fe1f2e00640 1 --2- 172.21.15.63:0/1715341458 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fe1c806f400 0x7fe1c80718c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:04.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:04.738+0000 7fe1f2e00640 1 --2- 172.21.15.63:0/1715341458 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe1ec155d00 0x7fe1ec15cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:04.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:04.738+0000 7fe1f2e00640 1 --2- 172.21.15.63:0/1715341458 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1ec073cf0 0x7fe1ec15fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:04.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:04.738+0000 7fe1f2e00640 1 --2- 172.21.15.63:0/1715341458 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe1ec0731b0 0x7fe1ec1f17b0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:04.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:04.738+0000 7fe1f2e00640 1 -- 172.21.15.63:0/1715341458 >> 172.21.15.63:0/1715341458 conn(0x7fe1ec0cae00 msgr2=0x7fe1ec0c77d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:25:04.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:04.738+0000 7fe1f2e00640 1 -- 172.21.15.63:0/1715341458 shutdown_connections 2024-05-21T01:25:04.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:04.738+0000 7fe1f2e00640 1 -- 172.21.15.63:0/1715341458 wait complete. 2024-05-21T01:25:04.813 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4276 quiesce db --set-id 54903989 --release --await' 2024-05-21T01:25:04.814 DEBUG:teuthology.orchestra.run.smithi063:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4276 quiesce db --set-id 54903989 --release --await 2024-05-21T01:25:05.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.062+0000 7f06e3e00640 1 Processor -- start 2024-05-21T01:25:05.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.062+0000 7f06e3e00640 1 -- start start 2024-05-21T01:25:05.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.066+0000 7f06e3e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f06e4152200 0x7f06e406e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:05.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.066+0000 7f06e3e00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06e4072130 con 0x7f06e406c700 2024-05-21T01:25:05.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.066+0000 7f06e3e00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06e4072410 con 0x7f06e406cae0 2024-05-21T01:25:05.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.066+0000 7f06e3e00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f06e40726f0 con 0x7f06e4152200 2024-05-21T01:25:05.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.066+0000 7f06e2a00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f06e406c700 0x7f06e4151af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:55218/0 (socket says 172.21.15.63:55218) 2024-05-21T01:25:05.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.066+0000 7f06e2a00640 1 -- 172.21.15.63:0/1631293412 learned_addr learned my addr 172.21.15.63:0/1631293412 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-05-21T01:25:05.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.066+0000 7f06e2000640 1 --2- 172.21.15.63:0/1631293412 >> v2:172.21.15.131:3300/0 conn(0x7f06e4152200 0x7f06e406e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:05.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.066+0000 7f06e1600640 1 -- 172.21.15.63:0/1631293412 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2063791731 0 0) 0x7f06e4072410 con 0x7f06e406cae0 2024-05-21T01:25:05.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.066+0000 7f06e1600640 1 -- 172.21.15.63:0/1631293412 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f06c8003530 con 0x7f06e406cae0 2024-05-21T01:25:05.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.066+0000 7f06e1600640 1 -- 172.21.15.63:0/1631293412 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3292903514 0 0) 0x7f06e4072130 con 0x7f06e406c700 2024-05-21T01:25:05.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.066+0000 7f06e1600640 1 -- 172.21.15.63:0/1631293412 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f06e4072410 con 0x7f06e406c700 2024-05-21T01:25:05.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.066+0000 7f06e1600640 1 -- 172.21.15.63:0/1631293412 <== mon.1 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1526933967 0 0) 0x7f06c8003530 con 0x7f06e406cae0 2024-05-21T01:25:05.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.066+0000 7f06e1600640 1 -- 172.21.15.63:0/1631293412 >> v2:172.21.15.131:3300/0 conn(0x7f06e4152200 msgr2=0x7f06e406e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:25:05.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.066+0000 7f06e1600640 1 --2- 172.21.15.63:0/1631293412 >> v2:172.21.15.131:3300/0 conn(0x7f06e4152200 0x7f06e406e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:05.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.066+0000 7f06e1600640 1 -- 172.21.15.63:0/1631293412 >> v1:172.21.15.63:6789/0 conn(0x7f06e406c700 legacy=0x7f06e4151af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:25:05.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.066+0000 7f06e1600640 1 -- 172.21.15.63:0/1631293412 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06e406d8d0 con 0x7f06e406cae0 2024-05-21T01:25:05.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.066+0000 7f06e1600640 1 -- 172.21.15.63:0/1631293412 <== mon.1 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 466403955 0 0) 0x7f06dc001a80 con 0x7f06e406cae0 2024-05-21T01:25:05.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.066+0000 7f06e2000640 1 --2- 172.21.15.63:0/1631293412 >> v2:172.21.15.131:3300/0 conn(0x7f06e4152200 0x7f06e406e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-21T01:25:05.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.066+0000 7f06e1600640 1 -- 172.21.15.63:0/1631293412 >> v1:172.21.15.131:6789/0 conn(0x7f06e406cae0 legacy=0x7f06e4162590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:25:05.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.066+0000 7f06e1600640 1 --2- 172.21.15.63:0/1631293412 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f06c8003bf0 0x7f06c8003fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:05.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.066+0000 7f06e1600640 1 --2- 172.21.15.63:0/1631293412 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f06c8004810 0x7f06c8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:05.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.066+0000 7f06e1600640 1 --2- 172.21.15.63:0/1631293412 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f06c80051d0 0x7f06c80059a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:05.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.066+0000 7f06e1600640 1 -- 172.21.15.63:0/1631293412 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f06e40726f0 con 0x7f06c80051d0 2024-05-21T01:25:05.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.066+0000 7f06e1600640 1 -- 172.21.15.63:0/1631293412 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f06c80060f0 con 0x7f06c8004810 2024-05-21T01:25:05.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.066+0000 7f06e1600640 1 -- 172.21.15.63:0/1631293412 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f06c80062f0 con 0x7f06c8003bf0 2024-05-21T01:25:05.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.066+0000 7f06e3400640 1 --2- 172.21.15.63:0/1631293412 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f06c80051d0 0x7f06c80059a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:05.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.066+0000 7f06e2000640 1 --2- 172.21.15.63:0/1631293412 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f06c8004810 0x7f06c8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:05.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.066+0000 7f06e2a00640 1 --2- 172.21.15.63:0/1631293412 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f06c8003bf0 0x7f06c8003fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:05.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.066+0000 7f06e3400640 1 -- 172.21.15.63:0/1631293412 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f06c8003bf0 msgr2=0x7f06c8003fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:25:05.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.066+0000 7f06e3400640 1 --2- 172.21.15.63:0/1631293412 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f06c8003bf0 0x7f06c8003fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:05.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.066+0000 7f06e3400640 1 -- 172.21.15.63:0/1631293412 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f06c8004810 msgr2=0x7f06c8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:25:05.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.066+0000 7f06e3400640 1 --2- 172.21.15.63:0/1631293412 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f06c8004810 0x7f06c8004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:05.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.066+0000 7f06e3400640 1 -- 172.21.15.63:0/1631293412 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06c8003530 con 0x7f06c80051d0 2024-05-21T01:25:05.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.066+0000 7f06e2000640 1 --2- 172.21.15.63:0/1631293412 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f06c8004810 0x7f06c8004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-21T01:25:05.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.070+0000 7f06e3400640 1 -- 172.21.15.63:0/1631293412 reap_dead start 2024-05-21T01:25:05.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.074+0000 7f06e3400640 1 --2- 172.21.15.63:0/1631293412 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f06c80051d0 0x7f06c80059a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f06dc00c490 tx=0x7f06dc01f4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18b82966626bc623 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:25:05.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.074+0000 7f06e1600640 1 -- 172.21.15.63:0/1631293412 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d4009880 con 0x7f06c80051d0 2024-05-21T01:25:05.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.074+0000 7f06e1600640 1 -- 172.21.15.63:0/1631293412 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06dc0af640 con 0x7f06c80051d0 2024-05-21T01:25:05.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.074+0000 7f06e1600640 1 -- 172.21.15.63:0/1631293412 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06dc00c0e0 con 0x7f06c80051d0 2024-05-21T01:25:05.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.074+0000 7f06e3e00640 1 -- 172.21.15.63:0/1631293412 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f06c80051d0 msgr2=0x7f06c80059a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:25:05.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.074+0000 7f06e3e00640 1 --2- 172.21.15.63:0/1631293412 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f06c80051d0 0x7f06c80059a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f06dc00c490 tx=0x7f06dc01f4e0 comp rx=0 tx=0).stop 2024-05-21T01:25:05.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.074+0000 7f06e3e00640 1 -- 172.21.15.63:0/1631293412 shutdown_connections 2024-05-21T01:25:05.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.074+0000 7f06e3e00640 1 --2- 172.21.15.63:0/1631293412 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f06c80051d0 0x7f06c80059a0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:05.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.074+0000 7f06e3e00640 1 -- 172.21.15.63:0/1631293412 >> 172.21.15.63:0/1631293412 conn(0x7f06e406f0c0 msgr2=0x7f06e406f4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:25:05.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.074+0000 7f06e3e00640 1 -- 172.21.15.63:0/1631293412 shutdown_connections 2024-05-21T01:25:05.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.074+0000 7f06e3e00640 1 -- 172.21.15.63:0/1631293412 wait complete. 2024-05-21T01:25:05.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.078+0000 7f06e3e00640 1 Processor -- start 2024-05-21T01:25:05.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.078+0000 7f06e3e00640 1 -- start start 2024-05-21T01:25:05.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.078+0000 7f06e3e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f06c80051d0 0x7f06e40cce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:05.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.078+0000 7f06e3e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f06e41dfd10 0x7f06e40cd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:05.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.078+0000 7f06e3e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f06e41458c0 0x7f06e4145d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:05.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.078+0000 7f06e3e00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f06e406d230 con 0x7f06c80051d0 2024-05-21T01:25:05.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.078+0000 7f06e3e00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f06e406de90 con 0x7f06e41458c0 2024-05-21T01:25:05.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.078+0000 7f06e3e00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f06e406d3b0 con 0x7f06e41dfd10 2024-05-21T01:25:05.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.078+0000 7f06e2a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f06c80051d0 0x7f06e40cce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:05.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.078+0000 7f06e2a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f06c80051d0 0x7f06e40cce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35276/0 (socket says 172.21.15.63:35276) 2024-05-21T01:25:05.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.078+0000 7f06e2a00640 1 -- 172.21.15.63:0/4084683809 learned_addr learned my addr 172.21.15.63:0/4084683809 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:25:05.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.078+0000 7f06e3400640 1 --2- 172.21.15.63:0/4084683809 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f06e41458c0 0x7f06e4145d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:05.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.078+0000 7f06e2000640 1 --2- 172.21.15.63:0/4084683809 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f06e41dfd10 0x7f06e40cd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:05.084 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.078+0000 7f06e2a00640 1 -- 172.21.15.63:0/4084683809 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f06e41dfd10 msgr2=0x7f06e40cd3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:25:05.084 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.078+0000 7f06e2a00640 1 --2- 172.21.15.63:0/4084683809 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f06e41dfd10 0x7f06e40cd3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:05.084 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.078+0000 7f06e2a00640 1 -- 172.21.15.63:0/4084683809 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f06e41458c0 msgr2=0x7f06e4145d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:25:05.084 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.078+0000 7f06e2a00640 1 --2- 172.21.15.63:0/4084683809 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f06e41458c0 0x7f06e4145d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:05.084 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.078+0000 7f06e2a00640 1 -- 172.21.15.63:0/4084683809 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06e40cb960 con 0x7f06c80051d0 2024-05-21T01:25:05.084 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.078+0000 7f06e2a00640 1 --2- 172.21.15.63:0/4084683809 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f06c80051d0 0x7f06e40cce60 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f06d000d840 tx=0x7f06d000dc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:25:05.084 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.082+0000 7f06daa00640 1 -- 172.21.15.63:0/4084683809 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d0004c10 con 0x7f06c80051d0 2024-05-21T01:25:05.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.082+0000 7f06daa00640 1 -- 172.21.15.63:0/4084683809 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06d0015020 con 0x7f06c80051d0 2024-05-21T01:25:05.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.082+0000 7f06daa00640 1 -- 172.21.15.63:0/4084683809 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d000b800 con 0x7f06c80051d0 2024-05-21T01:25:05.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.082+0000 7f06e3e00640 1 -- 172.21.15.63:0/4084683809 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06e41e0700 con 0x7f06c80051d0 2024-05-21T01:25:05.085 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.082+0000 7f06e3e00640 1 -- 172.21.15.63:0/4084683809 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06e40cc940 con 0x7f06c80051d0 2024-05-21T01:25:05.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.086+0000 7f06daa00640 1 -- 172.21.15.63:0/4084683809 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7f06d000b9a0 con 0x7f06c80051d0 2024-05-21T01:25:05.088 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.086+0000 7f06ecfe5000 1 Processor -- start 2024-05-21T01:25:05.089 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.086+0000 7f06daa00640 1 --2- 172.21.15.63:0/4084683809 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f06c406f400 0x7f06c40718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:05.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.086+0000 7f06daa00640 1 -- 172.21.15.63:0/4084683809 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f06d008faa0 con 0x7f06c80051d0 2024-05-21T01:25:05.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.086+0000 7f06ecfe5000 1 -- start start 2024-05-21T01:25:05.090 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.086+0000 7f06e3400640 1 --2- 172.21.15.63:0/4084683809 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f06c406f400 0x7f06c40718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:05.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.086+0000 7f06e3400640 1 --2- 172.21.15.63:0/4084683809 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f06c406f400 0x7f06c40718c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f06c80060c0 tx=0x7f06e40c76a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:25:05.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.090+0000 7f06ecfe5000 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ed7a4c4b90 0x55ed7a48e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:05.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.090+0000 7f06ecfe5000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ed7a48e8d0 0x55ed7a4c9620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:05.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.090+0000 7f06ecfe5000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ed7a4c9b60 0x55ed7a4c9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:05.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.090+0000 7f06ecfe5000 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55ed7a2e38a0 con 0x55ed7a4c4b90 2024-05-21T01:25:05.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.090+0000 7f06ecfe5000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55ed7a2d3440 con 0x55ed7a4c9b60 2024-05-21T01:25:05.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.090+0000 7f06ecfe5000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55ed7a2d7480 con 0x55ed7a48e8d0 2024-05-21T01:25:05.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.090+0000 7f06e3400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ed7a4c9b60 0x55ed7a4c9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:05.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.090+0000 7f06e2000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ed7a48e8d0 0x55ed7a4c9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:05.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.090+0000 7f06e3400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ed7a4c9b60 0x55ed7a4c9f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.63:42324/0 (socket says 172.21.15.63:42324) 2024-05-21T01:25:05.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.090+0000 7f06e3400640 1 -- 172.21.15.63:0/1868652016 learned_addr learned my addr 172.21.15.63:0/1868652016 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:25:05.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.090+0000 7f06e2a00640 1 --2- 172.21.15.63:0/1868652016 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ed7a4c4b90 0x55ed7a48e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:05.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.090+0000 7f06e3400640 1 -- 172.21.15.63:0/1868652016 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ed7a48e8d0 msgr2=0x55ed7a4c9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:25:05.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.090+0000 7f06e3400640 1 --2- 172.21.15.63:0/1868652016 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ed7a48e8d0 0x55ed7a4c9620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:05.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.090+0000 7f06e3400640 1 -- 172.21.15.63:0/1868652016 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ed7a4c4b90 msgr2=0x55ed7a48e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:25:05.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.090+0000 7f06e3400640 1 --2- 172.21.15.63:0/1868652016 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ed7a4c4b90 0x55ed7a48e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:05.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.090+0000 7f06e3400640 1 -- 172.21.15.63:0/1868652016 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed7a37f370 con 0x55ed7a4c9b60 2024-05-21T01:25:05.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.090+0000 7f06e3400640 1 --2- 172.21.15.63:0/1868652016 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ed7a4c9b60 0x55ed7a4c9f40 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f06dc01dbe0 tx=0x7f06e4157cd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55429a1dba1f44ba server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:25:05.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.090+0000 7f06cf400640 1 -- 172.21.15.63:0/1868652016 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06dc0c8070 con 0x55ed7a4c9b60 2024-05-21T01:25:05.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.090+0000 7f06cf400640 1 -- 172.21.15.63:0/1868652016 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06dc0afb10 con 0x55ed7a4c9b60 2024-05-21T01:25:05.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.090+0000 7f06cf400640 1 -- 172.21.15.63:0/1868652016 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06dc0c4440 con 0x55ed7a4c9b60 2024-05-21T01:25:05.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.090+0000 7f06ecfe5000 1 -- 172.21.15.63:0/1868652016 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ed7a4c9b60 msgr2=0x55ed7a4c9f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:25:05.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.090+0000 7f06ecfe5000 1 --2- 172.21.15.63:0/1868652016 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ed7a4c9b60 0x55ed7a4c9f40 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f06dc01dbe0 tx=0x7f06e4157cd0 comp rx=0 tx=0).stop 2024-05-21T01:25:05.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.090+0000 7f06ecfe5000 1 -- 172.21.15.63:0/1868652016 shutdown_connections 2024-05-21T01:25:05.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.090+0000 7f06ecfe5000 1 --2- 172.21.15.63:0/1868652016 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ed7a4c9b60 0x55ed7a4c9f40 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:05.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.090+0000 7f06ecfe5000 1 --2- 172.21.15.63:0/1868652016 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ed7a48e8d0 0x55ed7a4c9620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:05.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.090+0000 7f06ecfe5000 1 --2- 172.21.15.63:0/1868652016 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ed7a4c4b90 0x55ed7a48e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:05.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.090+0000 7f06ecfe5000 1 -- 172.21.15.63:0/1868652016 >> 172.21.15.63:0/1868652016 conn(0x55ed7a370f90 msgr2=0x55ed7a4c73e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:25:05.095 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.090+0000 7f06ecfe5000 1 -- 172.21.15.63:0/1868652016 shutdown_connections 2024-05-21T01:25:05.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.090+0000 7f06ecfe5000 1 -- 172.21.15.63:0/1868652016 wait complete. 2024-05-21T01:25:05.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.094+0000 7f06ecfe5000 1 -- start start 2024-05-21T01:25:05.096 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.094+0000 7f06ecfe5000 1 Processor -- start 2024-05-21T01:25:05.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.094+0000 7f06ecfe5000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ed7a48e8d0 0x55ed7a4c3730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:05.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.094+0000 7f06ecfe5000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ed7a4c4b90 0x55ed7a4c3c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:05.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.094+0000 7f06ecfe5000 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ed7a4c9b60 0x55ed7a4cf3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:05.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.094+0000 7f06ecfe5000 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55ed7a27c170 con 0x55ed7a4c9b60 2024-05-21T01:25:05.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.094+0000 7f06ecfe5000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55ed7a27a4d0 con 0x55ed7a4c4b90 2024-05-21T01:25:05.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.094+0000 7f06ecfe5000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55ed7a2dbab0 con 0x55ed7a48e8d0 2024-05-21T01:25:05.098 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.094+0000 7f06ecfe5000 10 client.0 _ll_register_callbacks cb 0x55ed7a275ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-21T01:25:05.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.094+0000 7f06e2000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ed7a4c4b90 0x55ed7a4c3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:05.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.094+0000 7f06e2a00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ed7a48e8d0 0x55ed7a4c3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:05.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.094+0000 7f06e2000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ed7a4c4b90 0x55ed7a4c3c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.63:42328/0 (socket says 172.21.15.63:42328) 2024-05-21T01:25:05.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.094+0000 7f06e2000640 1 -- 172.21.15.63:0/2381275344 learned_addr learned my addr 172.21.15.63:0/2381275344 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:25:05.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.094+0000 7f06e3400640 1 --2- 172.21.15.63:0/2381275344 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ed7a4c9b60 0x55ed7a4cf3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:05.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.094+0000 7f06e2000640 1 -- 172.21.15.63:0/2381275344 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ed7a48e8d0 msgr2=0x55ed7a4c3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:25:05.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.094+0000 7f06e2000640 1 --2- 172.21.15.63:0/2381275344 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ed7a48e8d0 0x55ed7a4c3730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:05.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.094+0000 7f06e2000640 1 -- 172.21.15.63:0/2381275344 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ed7a4c9b60 msgr2=0x55ed7a4cf3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:25:05.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.094+0000 7f06e2000640 1 --2- 172.21.15.63:0/2381275344 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ed7a4c9b60 0x55ed7a4cf3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:05.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.094+0000 7f06e2000640 1 -- 172.21.15.63:0/2381275344 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed7a31d260 con 0x55ed7a4c4b90 2024-05-21T01:25:05.099 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.094+0000 7f06e3400640 1 --2- 172.21.15.63:0/2381275344 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ed7a4c9b60 0x55ed7a4cf3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T01:25:05.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.094+0000 7f06e2000640 1 --2- 172.21.15.63:0/2381275344 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ed7a4c4b90 0x55ed7a4c3c70 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f06d4015a40 tx=0x7f06d4015a70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb59487a57e87046 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:25:05.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.094+0000 7f06c3e00640 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2024-05-21T01:25:05.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.098+0000 7f06c3e00640 1 -- 172.21.15.63:0/2381275344 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d4004240 con 0x55ed7a4c4b90 2024-05-21T01:25:05.100 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.098+0000 7f06c3e00640 1 -- 172.21.15.63:0/2381275344 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f06d400f040 con 0x55ed7a4c4b90 2024-05-21T01:25:05.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.098+0000 7f06ecfe5000 1 -- 172.21.15.63:0/2381275344 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f06dc0afb10 con 0x55ed7a4c4b90 2024-05-21T01:25:05.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.098+0000 7f06c3e00640 1 -- 172.21.15.63:0/2381275344 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f06d40043e0 con 0x55ed7a4c4b90 2024-05-21T01:25:05.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.098+0000 7f06ecfe5000 10 client.5071 fetch_fsmap learned FSMap version 15 2024-05-21T01:25:05.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.098+0000 7f06ecfe5000 1 -- 172.21.15.63:0/2381275344 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x55ed7a27a6e0 con 0x55ed7a4c4b90 2024-05-21T01:25:05.101 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.098+0000 7f06c3e00640 1 -- 172.21.15.63:0/2381275344 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06dc0afb10 con 0x55ed7a4c4b90 2024-05-21T01:25:05.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.098+0000 7f06c3e00640 1 -- 172.21.15.63:0/2381275344 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 15) ==== 4752+0+0 (secure 0 0 0) 0x7f06d4027050 con 0x55ed7a4c4b90 2024-05-21T01:25:05.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.098+0000 7f06ecfe5000 10 client.5071 fetch_fsmap finished waiting for FSMap version 15 2024-05-21T01:25:05.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.098+0000 7f06ecfe5000 10 client.5071 resolve_mds: validated gid 4276 aka daemon mds.c 2024-05-21T01:25:05.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.098+0000 7f06ecfe5000 20 client.5071 populate_metadata read hostname 'smithi063' 2024-05-21T01:25:05.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.098+0000 7f06ecfe5000 1 --2- 172.21.15.63:0/2381275344 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x55ed7a4d0120 0x55ed7a4d0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:05.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.098+0000 7f06ecfe5000 4 client.5071 mds_command: new command op to 4276 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-21T01:25:05.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.098+0000 7f06ecfe5000 1 -- 172.21.15.63:0/2381275344 --> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ed7a26f060 con 0x55ed7a4d0120 2024-05-21T01:25:05.102 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.098+0000 7f06e2a00640 1 --2- 172.21.15.63:0/2381275344 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x55ed7a4d0120 0x55ed7a4d0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:05.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.098+0000 7f06e2a00640 1 --2- 172.21.15.63:0/2381275344 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x55ed7a4d0120 0x55ed7a4d0530 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94294b4675773966 server_cookie=c546390f7582c7d3 in_seq=0 out_seq=0 2024-05-21T01:25:05.103 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.098+0000 7f06c3e00640 10 client.5071 ms_handle_connect on v2:172.21.15.63:6834/2892727989 2024-05-21T01:25:05.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.102+0000 7f06c3e00640 1 -- 172.21.15.63:0/2381275344 <== mds.0 v2:172.21.15.63:6834/2892727989 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x55ed7a26f060 con 0x55ed7a4d0120 2024-05-21T01:25:05.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.102+0000 7f06c3e00640 10 client.5071 handle_command_reply: tid=0 2024-05-21T01:25:05.104 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.102+0000 7f06ecfe5000 1 client.5071 shutdown 2024-05-21T01:25:05.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.102+0000 7f06ecfe5000 1 -- 172.21.15.63:0/2381275344 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ed7a4c4b90 msgr2=0x55ed7a4c3c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:25:05.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.102+0000 7f06ecfe5000 1 --2- 172.21.15.63:0/2381275344 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ed7a4c4b90 0x55ed7a4c3c70 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f06d4015a40 tx=0x7f06d4015a70 comp rx=0 tx=0).stop 2024-05-21T01:25:05.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.102+0000 7f06ecfe5000 1 -- 172.21.15.63:0/2381275344 shutdown_connections 2024-05-21T01:25:05.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.102+0000 7f06ecfe5000 1 --2- 172.21.15.63:0/2381275344 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x55ed7a4d0120 0x55ed7a4d0530 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:05.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.102+0000 7f06ecfe5000 1 --2- 172.21.15.63:0/2381275344 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ed7a4c9b60 0x55ed7a4cf3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:05.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.102+0000 7f06ecfe5000 1 --2- 172.21.15.63:0/2381275344 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ed7a4c4b90 0x55ed7a4c3c70 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:05.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.102+0000 7f06ecfe5000 1 --2- 172.21.15.63:0/2381275344 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ed7a48e8d0 0x55ed7a4c3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:05.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.102+0000 7f06ecfe5000 1 -- 172.21.15.63:0/2381275344 >> 172.21.15.63:0/2381275344 conn(0x55ed7a370f90 msgr2=0x55ed7a48db00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:25:05.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.102+0000 7f06c3e00640 0 client.5071 ms_handle_reset on v2:172.21.15.63:6834/2892727989 2024-05-21T01:25:05.105 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.102+0000 7f06ecfe5000 1 -- 172.21.15.63:0/2381275344 shutdown_connections 2024-05-21T01:25:05.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.102+0000 7f06ecfe5000 1 -- 172.21.15.63:0/2381275344 wait complete. 2024-05-21T01:25:05.106 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.102+0000 7f06ecfe5000 20 client.5071 trim_cache size 0 max 16384 2024-05-21T01:25:05.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.134+0000 7f06ecfe5000 1 Processor -- start 2024-05-21T01:25:05.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.134+0000 7f06ecfe5000 1 -- start start 2024-05-21T01:25:05.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.138+0000 7f06ecfe5000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ed7a48e8d0 0x55ed7a4c8f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:05.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.138+0000 7f06ecfe5000 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ed7a4c4b90 0x55ed7a4c9460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:05.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.138+0000 7f06ecfe5000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ed7a4c9b60 0x55ed7a4d1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:05.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.138+0000 7f06ecfe5000 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f06e41fe9b0 con 0x55ed7a4c4b90 2024-05-21T01:25:05.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.138+0000 7f06ecfe5000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f06e41fde10 con 0x55ed7a4c9b60 2024-05-21T01:25:05.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.138+0000 7f06ecfe5000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f06e41fe360 con 0x55ed7a48e8d0 2024-05-21T01:25:05.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.138+0000 7f06e2a00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ed7a48e8d0 0x55ed7a4c8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:05.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.138+0000 7f06e2a00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ed7a48e8d0 0x55ed7a4c8f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.63:52066/0 (socket says 172.21.15.63:52066) 2024-05-21T01:25:05.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.138+0000 7f06e3400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ed7a4c9b60 0x55ed7a4d1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:05.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.138+0000 7f06e2a00640 1 -- 172.21.15.63:0/3026929713 learned_addr learned my addr 172.21.15.63:0/3026929713 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:25:05.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.138+0000 7f06e2000640 1 --2- 172.21.15.63:0/3026929713 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ed7a4c4b90 0x55ed7a4c9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:05.142 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.138+0000 7f06e2a00640 1 -- 172.21.15.63:0/3026929713 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ed7a4c9b60 msgr2=0x55ed7a4d1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:25:05.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.138+0000 7f06e2a00640 1 --2- 172.21.15.63:0/3026929713 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ed7a4c9b60 0x55ed7a4d1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:05.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.138+0000 7f06e2a00640 1 -- 172.21.15.63:0/3026929713 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ed7a4c4b90 msgr2=0x55ed7a4c9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:25:05.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.138+0000 7f06e2a00640 1 --2- 172.21.15.63:0/3026929713 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ed7a4c4b90 0x55ed7a4c9460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:05.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.138+0000 7f06e2a00640 1 -- 172.21.15.63:0/3026929713 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed7a358cf0 con 0x55ed7a48e8d0 2024-05-21T01:25:05.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.138+0000 7f06e3400640 1 --2- 172.21.15.63:0/3026929713 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ed7a4c9b60 0x55ed7a4d1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-21T01:25:05.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.138+0000 7f06e2a00640 1 --2- 172.21.15.63:0/3026929713 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ed7a48e8d0 0x55ed7a4c8f20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f06d0058500 tx=0x7f06d0000f70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e65296f6d746656 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:25:05.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.138+0000 7f06cea00640 1 -- 172.21.15.63:0/3026929713 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d0014040 con 0x55ed7a48e8d0 2024-05-21T01:25:05.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.138+0000 7f06cea00640 1 -- 172.21.15.63:0/3026929713 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06d00602c0 con 0x55ed7a48e8d0 2024-05-21T01:25:05.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.138+0000 7f06cea00640 1 -- 172.21.15.63:0/3026929713 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d0064ce0 con 0x55ed7a48e8d0 2024-05-21T01:25:05.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.138+0000 7f06ecfe5000 1 -- 172.21.15.63:0/3026929713 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ed7a48e8d0 msgr2=0x55ed7a4c8f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:25:05.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.138+0000 7f06ecfe5000 1 --2- 172.21.15.63:0/3026929713 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ed7a48e8d0 0x55ed7a4c8f20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f06d0058500 tx=0x7f06d0000f70 comp rx=0 tx=0).stop 2024-05-21T01:25:05.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.138+0000 7f06ecfe5000 1 -- 172.21.15.63:0/3026929713 shutdown_connections 2024-05-21T01:25:05.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.138+0000 7f06ecfe5000 1 --2- 172.21.15.63:0/3026929713 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ed7a4c9b60 0x55ed7a4d1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:05.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.138+0000 7f06ecfe5000 1 --2- 172.21.15.63:0/3026929713 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ed7a4c4b90 0x55ed7a4c9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:05.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.138+0000 7f06ecfe5000 1 --2- 172.21.15.63:0/3026929713 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ed7a48e8d0 0x55ed7a4c8f20 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:05.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.138+0000 7f06ecfe5000 1 -- 172.21.15.63:0/3026929713 >> 172.21.15.63:0/3026929713 conn(0x55ed7a370f90 msgr2=0x55ed7a4cf390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:25:05.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.138+0000 7f06ecfe5000 1 -- 172.21.15.63:0/3026929713 shutdown_connections 2024-05-21T01:25:05.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.138+0000 7f06ecfe5000 1 -- 172.21.15.63:0/3026929713 wait complete. 2024-05-21T01:25:05.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.142+0000 7f06ecfe5000 1 -- start start 2024-05-21T01:25:05.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.142+0000 7f06ecfe5000 1 Processor -- start 2024-05-21T01:25:05.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.142+0000 7f06ecfe5000 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ed7a48e8d0 0x55ed7a4d1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:05.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.142+0000 7f06ecfe5000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ed7a4c4b90 0x55ed7a489510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:05.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.142+0000 7f06ecfe5000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ed7a4c9b60 0x55ed7a489a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:05.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.142+0000 7f06ecfe5000 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55ed7a2cf5f0 con 0x55ed7a48e8d0 2024-05-21T01:25:05.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.142+0000 7f06ecfe5000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55ed7a358860 con 0x55ed7a4c4b90 2024-05-21T01:25:05.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.142+0000 7f06ecfe5000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55ed7a26bc50 con 0x55ed7a4c9b60 2024-05-21T01:25:05.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.142+0000 7f06ecfe5000 10 client.0 _ll_register_callbacks cb 0x7f06d4015650 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-21T01:25:05.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.142+0000 7f06e2000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ed7a4c4b90 0x55ed7a489510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:05.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.142+0000 7f06e2a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ed7a48e8d0 0x55ed7a4d1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:05.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.142+0000 7f06e2a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ed7a48e8d0 0x55ed7a4d1940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35316/0 (socket says 172.21.15.63:35316) 2024-05-21T01:25:05.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.142+0000 7f06e2a00640 1 -- 172.21.15.63:0/1239267545 learned_addr learned my addr 172.21.15.63:0/1239267545 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:25:05.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.142+0000 7f06e2a00640 1 -- 172.21.15.63:0/1239267545 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ed7a4c9b60 msgr2=0x55ed7a489a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:25:05.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.142+0000 7f06e2a00640 1 --2- 172.21.15.63:0/1239267545 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ed7a4c9b60 0x55ed7a489a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:05.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.142+0000 7f06e2a00640 1 -- 172.21.15.63:0/1239267545 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ed7a4c4b90 msgr2=0x55ed7a489510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:25:05.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.142+0000 7f06e2a00640 1 --2- 172.21.15.63:0/1239267545 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ed7a4c4b90 0x55ed7a489510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:05.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.142+0000 7f06e2a00640 1 -- 172.21.15.63:0/1239267545 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed7a285ca0 con 0x55ed7a48e8d0 2024-05-21T01:25:05.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.142+0000 7f06e2a00640 1 --2- 172.21.15.63:0/1239267545 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ed7a48e8d0 0x55ed7a4d1940 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f06d00049d0 tx=0x7f06d001c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d034110353c51b91 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:25:05.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.142+0000 7f06c3e00640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-05-21T01:25:05.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.142+0000 7f06c3e00640 1 -- 172.21.15.63:0/1239267545 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d0064ce0 con 0x55ed7a48e8d0 2024-05-21T01:25:05.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.142+0000 7f06c3e00640 1 -- 172.21.15.63:0/1239267545 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f06d008dc40 con 0x55ed7a48e8d0 2024-05-21T01:25:05.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.142+0000 7f06ecfe5000 1 -- 172.21.15.63:0/1239267545 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f06d00602c0 con 0x55ed7a48e8d0 2024-05-21T01:25:05.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.142+0000 7f06c3e00640 1 -- 172.21.15.63:0/1239267545 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f06d00581a0 con 0x55ed7a48e8d0 2024-05-21T01:25:05.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.142+0000 7f06ecfe5000 10 client.4992 fetch_fsmap learned FSMap version 15 2024-05-21T01:25:05.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.142+0000 7f06ecfe5000 1 -- 172.21.15.63:0/1239267545 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x55ed7a26a9c0 con 0x55ed7a48e8d0 2024-05-21T01:25:05.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.142+0000 7f06c3e00640 1 -- 172.21.15.63:0/1239267545 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06d00602c0 con 0x55ed7a48e8d0 2024-05-21T01:25:05.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.146+0000 7f06c3e00640 1 -- 172.21.15.63:0/1239267545 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 15) ==== 4752+0+0 (secure 0 0 0) 0x7f06d000bc90 con 0x55ed7a48e8d0 2024-05-21T01:25:05.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.146+0000 7f06ecfe5000 10 client.4992 fetch_fsmap finished waiting for FSMap version 15 2024-05-21T01:25:05.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.146+0000 7f06ecfe5000 10 client.4992 resolve_mds: validated gid 4276 aka daemon mds.c 2024-05-21T01:25:05.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.146+0000 7f06ecfe5000 20 client.4992 populate_metadata read hostname 'smithi063' 2024-05-21T01:25:05.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.146+0000 7f06ecfe5000 1 --2- 172.21.15.63:0/1239267545 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x55ed7a548e60 0x55ed7a54b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:05.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.146+0000 7f06ecfe5000 4 client.4992 mds_command: new command op to 4276 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "54903989", "release": true, "await": true}] 2024-05-21T01:25:05.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.146+0000 7f06ecfe5000 1 -- 172.21.15.63:0/1239267545 --> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] -- command(tid 0: {"prefix": "quiesce db", "set_id": "54903989", "release": true, "await": true}) -- 0x55ed7a2e57f0 con 0x55ed7a548e60 2024-05-21T01:25:05.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.146+0000 7f06e2000640 1 --2- 172.21.15.63:0/1239267545 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x55ed7a548e60 0x55ed7a54b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:05.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.146+0000 7f06c3e00640 10 client.4992 ms_handle_connect on v2:172.21.15.63:6834/2892727989 2024-05-21T01:25:05.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.146+0000 7f06e2000640 1 --2- 172.21.15.63:0/1239267545 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x55ed7a548e60 0x55ed7a54b250 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d7a19140020dbab server_cookie=287d11f03455ac34 in_seq=0 out_seq=0 2024-05-21T01:25:05.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.146+0000 7f06c3e00640 1 -- 172.21.15.63:0/1239267545 <== mds.0 v2:172.21.15.63:6834/2892727989 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x55ed7a2e57f0 con 0x55ed7a548e60 2024-05-21T01:25:05.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.146+0000 7f06c3e00640 10 client.4992 handle_command_reply: tid=0 2024-05-21T01:25:05.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.146+0000 7f06ecfe5000 1 client.4992 shutdown 2024-05-21T01:25:05.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.146+0000 7f06ecfe5000 1 -- 172.21.15.63:0/1239267545 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ed7a48e8d0 msgr2=0x55ed7a4d1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:25:05.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.146+0000 7f06ecfe5000 1 --2- 172.21.15.63:0/1239267545 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ed7a48e8d0 0x55ed7a4d1940 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f06d00049d0 tx=0x7f06d001c040 comp rx=0 tx=0).stop 2024-05-21T01:25:05.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.146+0000 7f06ecfe5000 1 -- 172.21.15.63:0/1239267545 shutdown_connections 2024-05-21T01:25:05.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.146+0000 7f06ecfe5000 1 --2- 172.21.15.63:0/1239267545 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x55ed7a548e60 0x55ed7a54b250 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:05.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.146+0000 7f06ecfe5000 1 --2- 172.21.15.63:0/1239267545 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ed7a4c9b60 0x55ed7a489a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:05.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.146+0000 7f06ecfe5000 1 --2- 172.21.15.63:0/1239267545 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ed7a4c4b90 0x55ed7a489510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:05.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.146+0000 7f06ecfe5000 1 --2- 172.21.15.63:0/1239267545 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ed7a48e8d0 0x55ed7a4d1940 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:05.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.146+0000 7f06ecfe5000 1 -- 172.21.15.63:0/1239267545 >> 172.21.15.63:0/1239267545 conn(0x55ed7a370f90 msgr2=0x55ed7a4cdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:25:05.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.146+0000 7f06c3e00640 0 client.4992 ms_handle_reset on v2:172.21.15.63:6834/2892727989 2024-05-21T01:25:05.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.146+0000 7f06ecfe5000 1 -- 172.21.15.63:0/1239267545 shutdown_connections 2024-05-21T01:25:05.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.146+0000 7f06ecfe5000 1 -- 172.21.15.63:0/1239267545 wait complete. 2024-05-21T01:25:05.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.146+0000 7f06ecfe5000 20 client.4992 trim_cache size 0 max 16384 2024-05-21T01:25:05.152 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-05-21T01:25:05.153 INFO:teuthology.orchestra.run.smithi063.stdout: "epoch": 15, 2024-05-21T01:25:05.153 INFO:teuthology.orchestra.run.smithi063.stdout: "leader": 4276, 2024-05-21T01:25:05.153 INFO:teuthology.orchestra.run.smithi063.stdout: "set_version": 16, 2024-05-21T01:25:05.153 INFO:teuthology.orchestra.run.smithi063.stdout: "sets": { 2024-05-21T01:25:05.153 INFO:teuthology.orchestra.run.smithi063.stdout: "54903989": { 2024-05-21T01:25:05.153 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 16, 2024-05-21T01:25:05.153 INFO:teuthology.orchestra.run.smithi063.stdout: "age_ref": 0.0, 2024-05-21T01:25:05.153 INFO:teuthology.orchestra.run.smithi063.stdout: "state": { 2024-05-21T01:25:05.153 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "RELEASED", 2024-05-21T01:25:05.153 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 0.0 2024-05-21T01:25:05.153 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-05-21T01:25:05.153 INFO:teuthology.orchestra.run.smithi063.stdout: "timeout": 90.0, 2024-05-21T01:25:05.153 INFO:teuthology.orchestra.run.smithi063.stdout: "expiration": 133.6, 2024-05-21T01:25:05.153 INFO:teuthology.orchestra.run.smithi063.stdout: "members": { 2024-05-21T01:25:05.154 INFO:teuthology.orchestra.run.smithi063.stdout: "file:/": { 2024-05-21T01:25:05.154 INFO:teuthology.orchestra.run.smithi063.stdout: "excluded": false, 2024-05-21T01:25:05.154 INFO:teuthology.orchestra.run.smithi063.stdout: "state": { 2024-05-21T01:25:05.154 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "RELEASED", 2024-05-21T01:25:05.154 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 0.0 2024-05-21T01:25:05.154 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-05-21T01:25:05.154 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-05-21T01:25:05.154 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-05-21T01:25:05.154 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-05-21T01:25:05.154 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-05-21T01:25:05.154 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-05-21T01:25:05.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.150+0000 7f06e3e00640 1 -- 172.21.15.63:0/4084683809 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f06c406f400 msgr2=0x7f06c40718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:25:05.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.150+0000 7f06e3e00640 1 --2- 172.21.15.63:0/4084683809 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f06c406f400 0x7f06c40718c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f06c80060c0 tx=0x7f06e40c76a0 comp rx=0 tx=0).stop 2024-05-21T01:25:05.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.150+0000 7f06e3e00640 1 -- 172.21.15.63:0/4084683809 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f06c80051d0 msgr2=0x7f06e40cce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:25:05.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.150+0000 7f06e3e00640 1 --2- 172.21.15.63:0/4084683809 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f06c80051d0 0x7f06e40cce60 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f06d000d840 tx=0x7f06d000dc40 comp rx=0 tx=0).stop 2024-05-21T01:25:05.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.150+0000 7f06e3e00640 1 -- 172.21.15.63:0/4084683809 shutdown_connections 2024-05-21T01:25:05.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.150+0000 7f06e3e00640 1 --2- 172.21.15.63:0/4084683809 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f06c406f400 0x7f06c40718c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:05.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.150+0000 7f06e3e00640 1 --2- 172.21.15.63:0/4084683809 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f06e41458c0 0x7f06e4145d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:05.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.150+0000 7f06e3e00640 1 --2- 172.21.15.63:0/4084683809 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f06e41dfd10 0x7f06e40cd3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:05.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.150+0000 7f06e3e00640 1 --2- 172.21.15.63:0/4084683809 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f06c80051d0 0x7f06e40cce60 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:05.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.150+0000 7f06e3e00640 1 -- 172.21.15.63:0/4084683809 >> 172.21.15.63:0/4084683809 conn(0x7f06e406f0c0 msgr2=0x7f06e41e2f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:25:05.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.150+0000 7f06e3e00640 1 -- 172.21.15.63:0/4084683809 shutdown_connections 2024-05-21T01:25:05.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:05.150+0000 7f06e3e00640 1 -- 172.21.15.63:0/4084683809 wait complete. 2024-05-21T01:25:05.180 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '54903989', total seconds elapsed: 14.9 2024-05-21T01:25:23.521 INFO:tasks.workunit.client.0.smithi063.stdout: 2024-05-21T01:25:23.521 INFO:tasks.workunit.client.0.smithi063.stdout: Children see throughput for 1 rewriters = 144957.36 kB/sec 2024-05-21T01:25:23.521 INFO:tasks.workunit.client.0.smithi063.stdout: Parent sees throughput for 1 rewriters = 144955.76 kB/sec 2024-05-21T01:25:23.521 INFO:tasks.workunit.client.0.smithi063.stdout: Min throughput per process = 144957.36 kB/sec 2024-05-21T01:25:23.521 INFO:tasks.workunit.client.0.smithi063.stdout: Max throughput per process = 144957.36 kB/sec 2024-05-21T01:25:23.521 INFO:tasks.workunit.client.0.smithi063.stdout: Avg throughput per process = 144957.36 kB/sec 2024-05-21T01:25:23.521 INFO:tasks.workunit.client.0.smithi063.stdout: Min xfer = 10485760.00 kB 2024-05-21T01:25:27.191 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-21T01:25:27.195 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-21T01:25:30.438 INFO:tasks.quiescer.fs.[cephfs]:Total duration (52.0) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-05-21T01:25:30.438 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 26.0 2024-05-21T01:25:30.438 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-21T01:25:30.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:30.638+0000 7ff846200640 1 Processor -- start 2024-05-21T01:25:30.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:30.638+0000 7ff846200640 1 -- start start 2024-05-21T01:25:30.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:30.642+0000 7ff846200640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff8400737f0 0x7ff840073c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:30.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:30.642+0000 7ff846200640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8400ca5f0 con 0x7ff840153d70 2024-05-21T01:25:30.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:30.642+0000 7ff846200640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8400ca8d0 con 0x7ff84015a5b0 2024-05-21T01:25:30.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:30.642+0000 7ff846200640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7ff8400cb450 con 0x7ff8400737f0 2024-05-21T01:25:30.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:30.642+0000 7ff837e00640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7ff84015a5b0 0x7ff8400c6910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.63:40914/0 (socket says 172.21.15.63:40914) 2024-05-21T01:25:30.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:30.642+0000 7ff837e00640 1 -- 172.21.15.63:0/617216518 learned_addr learned my addr 172.21.15.63:0/617216518 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-05-21T01:25:30.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:30.642+0000 7ff83fe00640 1 --2- 172.21.15.63:0/617216518 >> v2:172.21.15.131:3300/0 conn(0x7ff8400737f0 0x7ff840073c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:30.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:30.642+0000 7ff83ea00640 1 -- 172.21.15.63:0/617216518 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 229251694 0 0) 0x7ff8400ca8d0 con 0x7ff84015a5b0 2024-05-21T01:25:30.648 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:30.642+0000 7ff83ea00640 1 -- 172.21.15.63:0/617216518 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff824003530 con 0x7ff84015a5b0 2024-05-21T01:25:30.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:30.642+0000 7ff83fe00640 1 -- 172.21.15.63:0/617216518 >> v1:172.21.15.131:6789/0 conn(0x7ff84015a5b0 legacy=0x7ff8400c6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:25:30.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:30.642+0000 7ff83ea00640 1 -- 172.21.15.63:0/617216518 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3328259192 0 0) 0x7ff8400ca5f0 con 0x7ff840153d70 2024-05-21T01:25:30.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:30.642+0000 7ff83fe00640 1 -- 172.21.15.63:0/617216518 >> v1:172.21.15.63:6789/0 conn(0x7ff840153d70 legacy=0x7ff8400cb6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:25:30.649 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:30.642+0000 7ff83fe00640 1 -- 172.21.15.63:0/617216518 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8400cabb0 con 0x7ff8400737f0 2024-05-21T01:25:30.650 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:30.646+0000 7ff83fe00640 1 --2- 172.21.15.63:0/617216518 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff8400737f0 0x7ff840073c00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff838009d90 tx=0x7ff83801c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3fd5fdfc74d46544 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:25:30.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:30.646+0000 7ff83ea00640 1 -- 172.21.15.63:0/617216518 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8380b2070 con 0x7ff8400737f0 2024-05-21T01:25:30.651 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:30.646+0000 7ff83ea00640 1 -- 172.21.15.63:0/617216518 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8380a59c0 con 0x7ff8400737f0 2024-05-21T01:25:30.652 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:30.646+0000 7ff83ea00640 1 -- 172.21.15.63:0/617216518 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8380a5d70 con 0x7ff8400737f0 2024-05-21T01:25:30.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:30.650+0000 7ff846200640 1 -- 172.21.15.63:0/617216518 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff8400737f0 msgr2=0x7ff840073c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:25:30.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:30.650+0000 7ff846200640 1 --2- 172.21.15.63:0/617216518 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff8400737f0 0x7ff840073c00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff838009d90 tx=0x7ff83801c8e0 comp rx=0 tx=0).stop 2024-05-21T01:25:30.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:30.650+0000 7ff846200640 1 -- 172.21.15.63:0/617216518 shutdown_connections 2024-05-21T01:25:30.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:30.650+0000 7ff846200640 1 --2- 172.21.15.63:0/617216518 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff8400737f0 0x7ff840073c00 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:30.654 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:30.650+0000 7ff846200640 1 -- 172.21.15.63:0/617216518 >> 172.21.15.63:0/617216518 conn(0x7ff8400cbf10 msgr2=0x7ff8400cc320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:25:30.654 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:30.650+0000 7ff846200640 1 -- 172.21.15.63:0/617216518 shutdown_connections 2024-05-21T01:25:30.654 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:30.650+0000 7ff846200640 1 -- 172.21.15.63:0/617216518 wait complete. 2024-05-21T01:25:30.655 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:30.650+0000 7ff846200640 1 Processor -- start 2024-05-21T01:25:30.655 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:30.650+0000 7ff846200640 1 -- start start 2024-05-21T01:25:30.656 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:30.654+0000 7ff846200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8400737f0 0x7ff840151bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:30.656 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:30.654+0000 7ff846200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff840153d70 0x7ff840142670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:30.656 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:30.654+0000 7ff846200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff84015a5b0 0x7ff840142bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:30.656 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:30.654+0000 7ff846200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff840154150 con 0x7ff8400737f0 2024-05-21T01:25:30.657 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:30.654+0000 7ff846200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7ff840074140 con 0x7ff84015a5b0 2024-05-21T01:25:30.657 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:30.654+0000 7ff846200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7ff8400c7020 con 0x7ff840153d70 2024-05-21T01:25:30.657 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:30.654+0000 7ff83f400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8400737f0 0x7ff840151bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:30.657 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:30.654+0000 7ff83f400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8400737f0 0x7ff840151bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38134/0 (socket says 172.21.15.63:38134) 2024-05-21T01:25:30.657 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:30.654+0000 7ff83f400640 1 -- 172.21.15.63:0/3237169661 learned_addr learned my addr 172.21.15.63:0/3237169661 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:25:30.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:30.654+0000 7ff83fe00640 1 --2- 172.21.15.63:0/3237169661 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff84015a5b0 0x7ff840142bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:30.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:30.654+0000 7ff837e00640 1 --2- 172.21.15.63:0/3237169661 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff840153d70 0x7ff840142670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:30.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:30.654+0000 7ff83f400640 1 -- 172.21.15.63:0/3237169661 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff840153d70 msgr2=0x7ff840142670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:25:30.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:30.654+0000 7ff83f400640 1 --2- 172.21.15.63:0/3237169661 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff840153d70 0x7ff840142670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:30.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:30.654+0000 7ff83f400640 1 -- 172.21.15.63:0/3237169661 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff84015a5b0 msgr2=0x7ff840142bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:25:30.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:30.654+0000 7ff83f400640 1 --2- 172.21.15.63:0/3237169661 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff84015a5b0 0x7ff840142bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:30.658 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:30.654+0000 7ff83f400640 1 -- 172.21.15.63:0/3237169661 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8401f47b0 con 0x7ff8400737f0 2024-05-21T01:25:30.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:30.654+0000 7ff83f400640 1 --2- 172.21.15.63:0/3237169661 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8400737f0 0x7ff840151bf0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ff83000c400 tx=0x7ff83000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:25:30.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:30.654+0000 7ff837400640 1 -- 172.21.15.63:0/3237169661 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff830017070 con 0x7ff8400737f0 2024-05-21T01:25:30.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:30.654+0000 7ff837400640 1 -- 172.21.15.63:0/3237169661 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff830003600 con 0x7ff8400737f0 2024-05-21T01:25:30.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:30.654+0000 7ff846200640 1 -- 172.21.15.63:0/3237169661 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff840152130 con 0x7ff8400737f0 2024-05-21T01:25:30.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:30.654+0000 7ff837400640 1 -- 172.21.15.63:0/3237169661 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8300039f0 con 0x7ff8400737f0 2024-05-21T01:25:30.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:30.654+0000 7ff846200640 1 -- 172.21.15.63:0/3237169661 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8401f4a30 con 0x7ff8400737f0 2024-05-21T01:25:30.659 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:30.654+0000 7ff846200640 1 -- 172.21.15.63:0/3237169661 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8400507f0 con 0x7ff8400737f0 2024-05-21T01:25:30.661 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:30.658+0000 7ff837400640 1 -- 172.21.15.63:0/3237169661 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7ff83001a070 con 0x7ff8400737f0 2024-05-21T01:25:30.662 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:30.658+0000 7ff837400640 1 --2- 172.21.15.63:0/3237169661 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7ff81c06f430 0x7ff81c0718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:30.662 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:30.658+0000 7ff837400640 1 -- 172.21.15.63:0/3237169661 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7ff83008ece0 con 0x7ff8400737f0 2024-05-21T01:25:30.663 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:30.658+0000 7ff837e00640 1 --2- 172.21.15.63:0/3237169661 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7ff81c06f430 0x7ff81c0718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:30.664 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:30.662+0000 7ff837e00640 1 --2- 172.21.15.63:0/3237169661 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7ff81c06f430 0x7ff81c0718f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff828007a70 tx=0x7ff828009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:25:30.666 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:30.662+0000 7ff837400640 1 -- 172.21.15.63:0/3237169661 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7ff830021020 con 0x7ff8400737f0 2024-05-21T01:25:30.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:30.946+0000 7ff846200640 1 -- 172.21.15.63:0/3237169661 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff840157450 con 0x7ff8400737f0 2024-05-21T01:25:30.950 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:30.946+0000 7ff837400640 1 -- 172.21.15.63:0/3237169661 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+6876 (secure 0 0 0) 0x7ff8401f47b0 con 0x7ff8400737f0 2024-05-21T01:25:30.951 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-05-21T01:25:30.951 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6839/3045714273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6837","nonce":3045714273},{"type":"v1","addr":"172.21.15.131:6839","nonce":3045714273}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/2978367338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":2978367338},{"type":"v1","addr":"172.21.15.131:6835","nonce":2978367338}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/3005995321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6835","nonce":3005995321},{"type":"v1","addr":"172.21.15.63:6837","nonce":3005995321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-21T01:19:53.915775+0000","modified":"2024-05-21T01:20:31.724475+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4276,"mds_1":4270,"mds_2":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"e","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.63:6833/574189772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":574189772},{"type":"v1","addr":"172.21.15.63:6833","nonce":574189772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4270":{"gid":4270,"name":"f","rank":1,"incarnation":10,"state":"up:active","state_seq":11,"addr":"172.21.15.131:6838/3071941741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":3071941741},{"type":"v1","addr":"172.21.15.131:6838","nonce":3071941741}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.63:6836/2892727989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":2892727989},{"type":"v1","addr":"172.21.15.63:6836","nonce":2892727989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4276,"qdb_cluster":[4267,4270,4276]},"id":1}]} 2024-05-21T01:25:30.951 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 15 2024-05-21T01:25:30.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:30.950+0000 7ff846200640 1 -- 172.21.15.63:0/3237169661 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7ff81c06f430 msgr2=0x7ff81c0718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:25:30.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:30.950+0000 7ff846200640 1 --2- 172.21.15.63:0/3237169661 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7ff81c06f430 0x7ff81c0718f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff828007a70 tx=0x7ff828009040 comp rx=0 tx=0).stop 2024-05-21T01:25:30.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:30.950+0000 7ff846200640 1 -- 172.21.15.63:0/3237169661 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8400737f0 msgr2=0x7ff840151bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:25:30.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:30.950+0000 7ff846200640 1 --2- 172.21.15.63:0/3237169661 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8400737f0 0x7ff840151bf0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ff83000c400 tx=0x7ff83000c8c0 comp rx=0 tx=0).stop 2024-05-21T01:25:30.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:30.950+0000 7ff846200640 1 -- 172.21.15.63:0/3237169661 shutdown_connections 2024-05-21T01:25:30.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:30.950+0000 7ff846200640 1 --2- 172.21.15.63:0/3237169661 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7ff81c06f430 0x7ff81c0718f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:30.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:30.950+0000 7ff846200640 1 --2- 172.21.15.63:0/3237169661 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff84015a5b0 0x7ff840142bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:30.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:30.950+0000 7ff846200640 1 --2- 172.21.15.63:0/3237169661 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff840153d70 0x7ff840142670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:30.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:30.950+0000 7ff846200640 1 --2- 172.21.15.63:0/3237169661 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8400737f0 0x7ff840151bf0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:30.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:30.950+0000 7ff846200640 1 -- 172.21.15.63:0/3237169661 >> 172.21.15.63:0/3237169661 conn(0x7ff8400cbf10 msgr2=0x7ff840144540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:25:30.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:30.950+0000 7ff846200640 1 -- 172.21.15.63:0/3237169661 shutdown_connections 2024-05-21T01:25:30.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:30.950+0000 7ff846200640 1 -- 172.21.15.63:0/3237169661 wait complete. 2024-05-21T01:25:30.979 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4276 quiesce db / --timeout 90 --expiration 146.0 --await-for 45.0' 2024-05-21T01:25:30.980 DEBUG:teuthology.orchestra.run.smithi063:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4276 quiesce db / --timeout 90 --expiration 146.0 --await-for 45.0 2024-05-21T01:25:31.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.190+0000 7f2f82400640 1 Processor -- start 2024-05-21T01:25:31.192 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.190+0000 7f2f82400640 1 -- start start 2024-05-21T01:25:31.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.190+0000 7f2f82400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f2f7c1537b0 0x7f2f7c06f620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:31.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.190+0000 7f2f82400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2f7c153b90 0x7f2f7c073ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:31.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.190+0000 7f2f82400640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f7c159db0 con 0x7f2f7c159920 2024-05-21T01:25:31.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.190+0000 7f2f82400640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f2f7c15a910 con 0x7f2f7c1537b0 2024-05-21T01:25:31.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.190+0000 7f2f82400640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f2f7c15a070 con 0x7f2f7c153b90 2024-05-21T01:25:31.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.190+0000 7f2f7be00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f2f7c159920 0x7f2f7c0c6c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:57726/0 (socket says 172.21.15.63:57726) 2024-05-21T01:25:31.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.190+0000 7f2f7be00640 1 -- 172.21.15.63:0/2976270097 learned_addr learned my addr 172.21.15.63:0/2976270097 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-05-21T01:25:31.195 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.190+0000 7f2f81a00640 1 --2- 172.21.15.63:0/2976270097 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2f7c153b90 0x7f2f7c073ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:31.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.190+0000 7f2f81000640 1 --2- 172.21.15.63:0/2976270097 >> v2:172.21.15.131:3300/0 conn(0x7f2f7c1537b0 0x7f2f7c06f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:31.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.190+0000 7f2f7b400640 1 -- 172.21.15.63:0/2976270097 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3671496599 0 0) 0x7f2f7c159db0 con 0x7f2f7c159920 2024-05-21T01:25:31.196 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.190+0000 7f2f7b400640 1 -- 172.21.15.63:0/2976270097 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f64003530 con 0x7f2f7c159920 2024-05-21T01:25:31.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.190+0000 7f2f7b400640 1 -- 172.21.15.63:0/2976270097 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1386094083 0 0) 0x7f2f64003530 con 0x7f2f7c159920 2024-05-21T01:25:31.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.190+0000 7f2f7b400640 1 -- 172.21.15.63:0/2976270097 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2f7c153b90 msgr2=0x7f2f7c073ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:25:31.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.190+0000 7f2f7b400640 1 --2- 172.21.15.63:0/2976270097 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2f7c153b90 0x7f2f7c073ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:31.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.190+0000 7f2f7b400640 1 -- 172.21.15.63:0/2976270097 >> v2:172.21.15.131:3300/0 conn(0x7f2f7c1537b0 msgr2=0x7f2f7c06f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:25:31.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.190+0000 7f2f7b400640 1 --2- 172.21.15.63:0/2976270097 >> v2:172.21.15.131:3300/0 conn(0x7f2f7c1537b0 0x7f2f7c06f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:31.197 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.190+0000 7f2f7b400640 1 -- 172.21.15.63:0/2976270097 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f7c15a350 con 0x7f2f7c159920 2024-05-21T01:25:31.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.190+0000 7f2f7b400640 1 -- 172.21.15.63:0/2976270097 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 466403955 0 0) 0x7f2f68001700 con 0x7f2f7c159920 2024-05-21T01:25:31.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.190+0000 7f2f7b400640 1 -- 172.21.15.63:0/2976270097 >> v1:172.21.15.63:6789/0 conn(0x7f2f7c159920 legacy=0x7f2f7c0c6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:25:31.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.190+0000 7f2f7b400640 1 --2- 172.21.15.63:0/2976270097 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2f640039c0 0x7f2f64003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:31.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.190+0000 7f2f7b400640 1 --2- 172.21.15.63:0/2976270097 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2f7c153b90 0x7f2f64004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:31.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.190+0000 7f2f7b400640 1 --2- 172.21.15.63:0/2976270097 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2f64004d50 0x7f2f640051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:31.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.190+0000 7f2f7b400640 1 -- 172.21.15.63:0/2976270097 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f2f7c15a910 con 0x7f2f64004d50 2024-05-21T01:25:31.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.190+0000 7f2f7b400640 1 -- 172.21.15.63:0/2976270097 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f2f7c15a070 con 0x7f2f640039c0 2024-05-21T01:25:31.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.190+0000 7f2f7b400640 1 -- 172.21.15.63:0/2976270097 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f2f6400b9d0 con 0x7f2f7c153b90 2024-05-21T01:25:31.198 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.194+0000 7f2f81000640 1 --2- 172.21.15.63:0/2976270097 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2f640039c0 0x7f2f64003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:31.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.194+0000 7f2f7be00640 1 --2- 172.21.15.63:0/2976270097 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2f7c153b90 0x7f2f64004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:31.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.194+0000 7f2f81a00640 1 --2- 172.21.15.63:0/2976270097 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2f64004d50 0x7f2f640051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:31.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.194+0000 7f2f81a00640 1 -- 172.21.15.63:0/2976270097 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2f7c153b90 msgr2=0x7f2f64004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:25:31.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.194+0000 7f2f81a00640 1 --2- 172.21.15.63:0/2976270097 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2f7c153b90 0x7f2f64004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:31.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.194+0000 7f2f81a00640 1 -- 172.21.15.63:0/2976270097 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2f640039c0 msgr2=0x7f2f64003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:25:31.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.194+0000 7f2f81a00640 1 --2- 172.21.15.63:0/2976270097 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2f640039c0 0x7f2f64003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:31.199 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.194+0000 7f2f81a00640 1 -- 172.21.15.63:0/2976270097 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f7c15a350 con 0x7f2f64004d50 2024-05-21T01:25:31.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.194+0000 7f2f81a00640 1 --2- 172.21.15.63:0/2976270097 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2f64004d50 0x7f2f640051d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2f74009fc0 tx=0x7f2f7401cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42a19737731825d7 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:25:31.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.198+0000 7f2f7b400640 1 -- 172.21.15.63:0/2976270097 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f740b2070 con 0x7f2f64004d50 2024-05-21T01:25:31.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.198+0000 7f2f7b400640 1 -- 172.21.15.63:0/2976270097 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f740a5c90 con 0x7f2f64004d50 2024-05-21T01:25:31.200 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.198+0000 7f2f7b400640 1 -- 172.21.15.63:0/2976270097 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f74009c10 con 0x7f2f64004d50 2024-05-21T01:25:31.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.198+0000 7f2f82400640 1 -- 172.21.15.63:0/2976270097 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2f64004d50 msgr2=0x7f2f640051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:25:31.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.198+0000 7f2f82400640 1 --2- 172.21.15.63:0/2976270097 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2f64004d50 0x7f2f640051d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2f74009fc0 tx=0x7f2f7401cc80 comp rx=0 tx=0).stop 2024-05-21T01:25:31.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.198+0000 7f2f81a00640 1 -- 172.21.15.63:0/2976270097 reap_dead start 2024-05-21T01:25:31.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.198+0000 7f2f82400640 1 -- 172.21.15.63:0/2976270097 shutdown_connections 2024-05-21T01:25:31.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.198+0000 7f2f82400640 1 -- 172.21.15.63:0/2976270097 >> 172.21.15.63:0/2976270097 conn(0x7f2f7c06c670 msgr2=0x7f2f7c06ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:25:31.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.198+0000 7f2f82400640 1 -- 172.21.15.63:0/2976270097 shutdown_connections 2024-05-21T01:25:31.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.198+0000 7f2f82400640 1 -- 172.21.15.63:0/2976270097 wait complete. 2024-05-21T01:25:31.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.198+0000 7f2f82400640 1 Processor -- start 2024-05-21T01:25:31.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.198+0000 7f2f82400640 1 -- start start 2024-05-21T01:25:31.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.202+0000 7f2f82400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2f64004d50 0x7f2f7c0cc720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:31.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.202+0000 7f2f82400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2f7c15d880 0x7f2f7c1ed690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:31.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.202+0000 7f2f82400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2f7c14e8c0 0x7f2f7c148f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:31.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.202+0000 7f2f82400640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f2f7c06fb60 con 0x7f2f64004d50 2024-05-21T01:25:31.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.202+0000 7f2f82400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f2f7c0739c0 con 0x7f2f7c14e8c0 2024-05-21T01:25:31.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.202+0000 7f2f82400640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f2f7c06fce0 con 0x7f2f7c15d880 2024-05-21T01:25:31.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.202+0000 7f2f81000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2f64004d50 0x7f2f7c0cc720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:31.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.202+0000 7f2f81000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2f64004d50 0x7f2f7c0cc720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38144/0 (socket says 172.21.15.63:38144) 2024-05-21T01:25:31.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.202+0000 7f2f81000640 1 -- 172.21.15.63:0/154440913 learned_addr learned my addr 172.21.15.63:0/154440913 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:25:31.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.202+0000 7f2f7be00640 1 --2- 172.21.15.63:0/154440913 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2f7c15d880 0x7f2f7c1ed690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:31.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.202+0000 7f2f81a00640 1 --2- 172.21.15.63:0/154440913 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2f7c14e8c0 0x7f2f7c148f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:31.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.202+0000 7f2f81000640 1 -- 172.21.15.63:0/154440913 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2f7c15d880 msgr2=0x7f2f7c1ed690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:25:31.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.202+0000 7f2f81000640 1 --2- 172.21.15.63:0/154440913 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2f7c15d880 0x7f2f7c1ed690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:31.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.202+0000 7f2f81000640 1 -- 172.21.15.63:0/154440913 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2f7c14e8c0 msgr2=0x7f2f7c148f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:25:31.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.202+0000 7f2f81000640 1 --2- 172.21.15.63:0/154440913 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2f7c14e8c0 0x7f2f7c148f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:31.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.202+0000 7f2f81000640 1 -- 172.21.15.63:0/154440913 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f7c1f0910 con 0x7f2f64004d50 2024-05-21T01:25:31.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.202+0000 7f2f81000640 1 --2- 172.21.15.63:0/154440913 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2f64004d50 0x7f2f7c0cc720 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f2f70011a30 tx=0x7f2f70011ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:25:31.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.202+0000 7f2f78c00640 1 -- 172.21.15.63:0/154440913 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f7000fb50 con 0x7f2f64004d50 2024-05-21T01:25:31.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.202+0000 7f2f78c00640 1 -- 172.21.15.63:0/154440913 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f7000fcf0 con 0x7f2f64004d50 2024-05-21T01:25:31.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.202+0000 7f2f78c00640 1 -- 172.21.15.63:0/154440913 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f7000fea0 con 0x7f2f64004d50 2024-05-21T01:25:31.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.202+0000 7f2f82400640 1 -- 172.21.15.63:0/154440913 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f7c1f0bf0 con 0x7f2f64004d50 2024-05-21T01:25:31.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.202+0000 7f2f82400640 1 -- 172.21.15.63:0/154440913 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f7c1f11b0 con 0x7f2f64004d50 2024-05-21T01:25:31.209 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.206+0000 7f2f78c00640 1 -- 172.21.15.63:0/154440913 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7f2f70012040 con 0x7f2f64004d50 2024-05-21T01:25:31.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.206+0000 7f2f86f3a000 1 Processor -- start 2024-05-21T01:25:31.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.206+0000 7f2f86f3a000 1 -- start start 2024-05-21T01:25:31.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.206+0000 7f2f78c00640 1 --2- 172.21.15.63:0/154440913 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f2f5c06f400 0x7f2f5c0718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:31.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.206+0000 7f2f78c00640 1 -- 172.21.15.63:0/154440913 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f2f7008fc90 con 0x7f2f64004d50 2024-05-21T01:25:31.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.206+0000 7f2f81a00640 1 --2- 172.21.15.63:0/154440913 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f2f5c06f400 0x7f2f5c0718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:31.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.206+0000 7f2f86f3a000 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5622b567d130 0x5622b5646bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:31.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.206+0000 7f2f86f3a000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5622b5647100 0x5622b5681bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:31.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.206+0000 7f2f86f3a000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5622b5682100 0x5622b56824e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:31.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.206+0000 7f2f86f3a000 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5622b549c740 con 0x5622b567d130 2024-05-21T01:25:31.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.206+0000 7f2f86f3a000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5622b548c2e0 con 0x5622b5647100 2024-05-21T01:25:31.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.206+0000 7f2f86f3a000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5622b5490320 con 0x5622b5682100 2024-05-21T01:25:31.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.206+0000 7f2f81000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5622b567d130 0x5622b5646bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:31.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.206+0000 7f2f81000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5622b567d130 0x5622b5646bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38148/0 (socket says 172.21.15.63:38148) 2024-05-21T01:25:31.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.206+0000 7f2f81000640 1 -- 172.21.15.63:0/2807247 learned_addr learned my addr 172.21.15.63:0/2807247 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:25:31.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.206+0000 7f2f7be00640 1 --2- 172.21.15.63:0/2807247 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5622b5647100 0x5622b5681bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:31.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.206+0000 7f2f81a00640 1 --2- 172.21.15.63:0/2807247 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5622b5682100 0x5622b56824e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:31.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.206+0000 7f2f81a00640 1 --2- 172.21.15.63:0/154440913 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f2f5c06f400 0x7f2f5c0718c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2f740af000 tx=0x7f2f74004ac0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:25:31.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.210+0000 7f2f81000640 1 -- 172.21.15.63:0/2807247 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5622b5682100 msgr2=0x5622b56824e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:25:31.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.210+0000 7f2f81000640 1 --2- 172.21.15.63:0/2807247 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5622b5682100 0x5622b56824e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:31.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.210+0000 7f2f81000640 1 -- 172.21.15.63:0/2807247 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5622b5647100 msgr2=0x5622b5681bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:25:31.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.210+0000 7f2f81000640 1 --2- 172.21.15.63:0/2807247 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5622b5647100 0x5622b5681bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:31.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.210+0000 7f2f81000640 1 -- 172.21.15.63:0/2807247 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622b542e490 con 0x5622b567d130 2024-05-21T01:25:31.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.210+0000 7f2f7be00640 1 --2- 172.21.15.63:0/2807247 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5622b5647100 0x5622b5681bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T01:25:31.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.210+0000 7f2f81000640 1 --2- 172.21.15.63:0/2807247 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5622b567d130 0x5622b5646bc0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f2f70023030 tx=0x7f2f7005be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29669cddf9ef9ff0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:25:31.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.210+0000 7f2f6d600640 1 -- 172.21.15.63:0/2807247 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f70022030 con 0x5622b567d130 2024-05-21T01:25:31.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.210+0000 7f2f6d600640 1 -- 172.21.15.63:0/2807247 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f7008b030 con 0x5622b567d130 2024-05-21T01:25:31.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.210+0000 7f2f6d600640 1 -- 172.21.15.63:0/2807247 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f7005c630 con 0x5622b567d130 2024-05-21T01:25:31.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.210+0000 7f2f86f3a000 1 -- 172.21.15.63:0/2807247 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5622b567d130 msgr2=0x5622b5646bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:25:31.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.210+0000 7f2f86f3a000 1 --2- 172.21.15.63:0/2807247 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5622b567d130 0x5622b5646bc0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f2f70023030 tx=0x7f2f7005be20 comp rx=0 tx=0).stop 2024-05-21T01:25:31.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.210+0000 7f2f86f3a000 1 -- 172.21.15.63:0/2807247 shutdown_connections 2024-05-21T01:25:31.216 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.210+0000 7f2f86f3a000 1 --2- 172.21.15.63:0/2807247 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5622b5682100 0x5622b56824e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:31.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.210+0000 7f2f86f3a000 1 --2- 172.21.15.63:0/2807247 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5622b5647100 0x5622b5681bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:31.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.210+0000 7f2f86f3a000 1 --2- 172.21.15.63:0/2807247 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5622b567d130 0x5622b5646bc0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:31.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.210+0000 7f2f86f3a000 1 -- 172.21.15.63:0/2807247 >> 172.21.15.63:0/2807247 conn(0x5622b5528d80 msgr2=0x5622b567f980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:25:31.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.210+0000 7f2f86f3a000 1 -- 172.21.15.63:0/2807247 shutdown_connections 2024-05-21T01:25:31.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.210+0000 7f2f86f3a000 1 -- 172.21.15.63:0/2807247 wait complete. 2024-05-21T01:25:31.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.210+0000 7f2f86f3a000 1 -- start start 2024-05-21T01:25:31.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.210+0000 7f2f86f3a000 1 Processor -- start 2024-05-21T01:25:31.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.210+0000 7f2f86f3a000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5622b5647100 0x5622b56418d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:31.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.210+0000 7f2f86f3a000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5622b567d130 0x5622b5641e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:31.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.210+0000 7f2f86f3a000 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5622b5682100 0x5622b5642350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:31.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.210+0000 7f2f86f3a000 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5622b5157b10 con 0x5622b5682100 2024-05-21T01:25:31.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.210+0000 7f2f86f3a000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5622b5448670 con 0x5622b567d130 2024-05-21T01:25:31.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.210+0000 7f2f86f3a000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5622b5494950 con 0x5622b5647100 2024-05-21T01:25:31.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.210+0000 7f2f86f3a000 10 client.0 _ll_register_callbacks cb 0x5622b562c540 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-21T01:25:31.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.210+0000 7f2f7be00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5622b567d130 0x5622b5641e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:31.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.210+0000 7f2f81a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5622b5682100 0x5622b5642350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:31.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.210+0000 7f2f7be00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5622b567d130 0x5622b5641e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.63:35254/0 (socket says 172.21.15.63:35254) 2024-05-21T01:25:31.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.210+0000 7f2f7be00640 1 -- 172.21.15.63:0/2615340498 learned_addr learned my addr 172.21.15.63:0/2615340498 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:25:31.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.214+0000 7f2f81000640 1 --2- 172.21.15.63:0/2615340498 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5622b5647100 0x5622b56418d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:31.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.214+0000 7f2f81a00640 1 -- 172.21.15.63:0/2615340498 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5622b5647100 msgr2=0x5622b56418d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:25:31.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.214+0000 7f2f81a00640 1 --2- 172.21.15.63:0/2615340498 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5622b5647100 0x5622b56418d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:31.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.214+0000 7f2f81a00640 1 -- 172.21.15.63:0/2615340498 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5622b567d130 msgr2=0x5622b5641e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:25:31.218 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.214+0000 7f2f81a00640 1 --2- 172.21.15.63:0/2615340498 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5622b567d130 0x5622b5641e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:31.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.214+0000 7f2f81a00640 1 -- 172.21.15.63:0/2615340498 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622b5441e40 con 0x5622b5682100 2024-05-21T01:25:31.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.214+0000 7f2f81a00640 1 --2- 172.21.15.63:0/2615340498 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5622b5682100 0x5622b5642350 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2f740ac000 tx=0x7f2f64005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b96c33df77d5287e server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:25:31.219 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.214+0000 7f2f62000640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-05-21T01:25:31.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.214+0000 7f2f62000640 1 -- 172.21.15.63:0/2615340498 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f740c8060 con 0x5622b5682100 2024-05-21T01:25:31.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.214+0000 7f2f86f3a000 1 -- 172.21.15.63:0/2615340498 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f7008b030 con 0x5622b5682100 2024-05-21T01:25:31.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.214+0000 7f2f62000640 1 -- 172.21.15.63:0/2615340498 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f2f74002040 con 0x5622b5682100 2024-05-21T01:25:31.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.214+0000 7f2f62000640 1 -- 172.21.15.63:0/2615340498 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f2f740ce050 con 0x5622b5682100 2024-05-21T01:25:31.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.214+0000 7f2f86f3a000 10 client.5010 fetch_fsmap learned FSMap version 15 2024-05-21T01:25:31.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.214+0000 7f2f86f3a000 1 -- 172.21.15.63:0/2615340498 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x5622b5511890 con 0x5622b5682100 2024-05-21T01:25:31.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.214+0000 7f2f62000640 1 -- 172.21.15.63:0/2615340498 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f7008b030 con 0x5622b5682100 2024-05-21T01:25:31.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.214+0000 7f2f62000640 1 -- 172.21.15.63:0/2615340498 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 15) ==== 4752+0+0 (secure 0 0 0) 0x7f2f740d1020 con 0x5622b5682100 2024-05-21T01:25:31.222 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.214+0000 7f2f86f3a000 10 client.5010 fetch_fsmap finished waiting for FSMap version 15 2024-05-21T01:25:31.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.214+0000 7f2f86f3a000 10 client.5010 resolve_mds: validated gid 4276 aka daemon mds.c 2024-05-21T01:25:31.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.214+0000 7f2f86f3a000 20 client.5010 populate_metadata read hostname 'smithi063' 2024-05-21T01:25:31.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.214+0000 7f2f86f3a000 1 --2- 172.21.15.63:0/2615340498 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x5622b56958c0 0x5622b5697cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:31.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.214+0000 7f2f86f3a000 4 client.5010 mds_command: new command op to 4276 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-21T01:25:31.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.214+0000 7f2f86f3a000 1 -- 172.21.15.63:0/2615340498 --> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5622b54287f0 con 0x5622b56958c0 2024-05-21T01:25:31.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.214+0000 7f2f81000640 1 --2- 172.21.15.63:0/2615340498 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x5622b56958c0 0x5622b5697cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:31.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.214+0000 7f2f81000640 1 --2- 172.21.15.63:0/2615340498 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x5622b56958c0 0x5622b5697cb0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=88e98273914327de server_cookie=2bf108390ae23bd9 in_seq=0 out_seq=0 2024-05-21T01:25:31.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.214+0000 7f2f62000640 10 client.5010 ms_handle_connect on v2:172.21.15.63:6834/2892727989 2024-05-21T01:25:31.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.214+0000 7f2f62000640 1 -- 172.21.15.63:0/2615340498 <== mds.0 v2:172.21.15.63:6834/2892727989 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x5622b54287f0 con 0x5622b56958c0 2024-05-21T01:25:31.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.214+0000 7f2f62000640 10 client.5010 handle_command_reply: tid=0 2024-05-21T01:25:31.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.214+0000 7f2f86f3a000 1 client.5010 shutdown 2024-05-21T01:25:31.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.214+0000 7f2f86f3a000 1 -- 172.21.15.63:0/2615340498 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5622b5682100 msgr2=0x5622b5642350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:25:31.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.214+0000 7f2f86f3a000 1 --2- 172.21.15.63:0/2615340498 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5622b5682100 0x5622b5642350 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2f740ac000 tx=0x7f2f64005840 comp rx=0 tx=0).stop 2024-05-21T01:25:31.223 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.214+0000 7f2f86f3a000 1 -- 172.21.15.63:0/2615340498 shutdown_connections 2024-05-21T01:25:31.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.214+0000 7f2f86f3a000 1 --2- 172.21.15.63:0/2615340498 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x5622b56958c0 0x5622b5697cb0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:31.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.214+0000 7f2f86f3a000 1 --2- 172.21.15.63:0/2615340498 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5622b5682100 0x5622b5642350 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:31.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.214+0000 7f2f86f3a000 1 --2- 172.21.15.63:0/2615340498 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5622b567d130 0x5622b5641e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:31.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.214+0000 7f2f86f3a000 1 --2- 172.21.15.63:0/2615340498 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5622b5647100 0x5622b56418d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:31.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.214+0000 7f2f86f3a000 1 -- 172.21.15.63:0/2615340498 >> 172.21.15.63:0/2615340498 conn(0x5622b5528d80 msgr2=0x5622b5646330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:25:31.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.214+0000 7f2f62000640 0 client.5010 ms_handle_reset on v2:172.21.15.63:6834/2892727989 2024-05-21T01:25:31.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.218+0000 7f2f86f3a000 1 -- 172.21.15.63:0/2615340498 shutdown_connections 2024-05-21T01:25:31.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.218+0000 7f2f86f3a000 1 -- 172.21.15.63:0/2615340498 wait complete. 2024-05-21T01:25:31.224 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.218+0000 7f2f86f3a000 20 client.5010 trim_cache size 0 max 16384 2024-05-21T01:25:31.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.250+0000 7f2f86f3a000 1 Processor -- start 2024-05-21T01:25:31.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.250+0000 7f2f86f3a000 1 -- start start 2024-05-21T01:25:31.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.254+0000 7f2f86f3a000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5622b5647100 0x5622b569b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:31.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.254+0000 7f2f86f3a000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5622b567d130 0x5622b567b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:31.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.254+0000 7f2f86f3a000 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5622b5682100 0x5622b567beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:31.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.254+0000 7f2f86f3a000 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f2f7c1fa5b0 con 0x5622b5682100 2024-05-21T01:25:31.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.254+0000 7f2f86f3a000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f2f7c1f9910 con 0x5622b567d130 2024-05-21T01:25:31.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.254+0000 7f2f86f3a000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f2f7c1f9f60 con 0x5622b5647100 2024-05-21T01:25:31.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.254+0000 7f2f81a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5622b5682100 0x5622b567beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:31.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.254+0000 7f2f81000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5622b5647100 0x5622b569b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:31.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.254+0000 7f2f81000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5622b5647100 0x5622b569b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.63:39742/0 (socket says 172.21.15.63:39742) 2024-05-21T01:25:31.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.254+0000 7f2f81000640 1 -- 172.21.15.63:0/707273984 learned_addr learned my addr 172.21.15.63:0/707273984 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:25:31.257 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.254+0000 7f2f81a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5622b5682100 0x5622b567beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38168/0 (socket says 172.21.15.63:38168) 2024-05-21T01:25:31.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.254+0000 7f2f7be00640 1 --2- 172.21.15.63:0/707273984 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5622b567d130 0x5622b567b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:31.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.254+0000 7f2f81a00640 1 -- 172.21.15.63:0/707273984 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5622b5647100 msgr2=0x5622b569b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:25:31.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.254+0000 7f2f81a00640 1 --2- 172.21.15.63:0/707273984 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5622b5647100 0x5622b569b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:31.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.254+0000 7f2f81a00640 1 -- 172.21.15.63:0/707273984 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5622b567d130 msgr2=0x5622b567b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:25:31.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.254+0000 7f2f81a00640 1 --2- 172.21.15.63:0/707273984 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5622b567d130 0x5622b567b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:31.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.254+0000 7f2f81a00640 1 -- 172.21.15.63:0/707273984 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622b54e8da0 con 0x5622b5682100 2024-05-21T01:25:31.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.254+0000 7f2f81a00640 1 --2- 172.21.15.63:0/707273984 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5622b5682100 0x5622b567beb0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f2f74002240 tx=0x7f2f740b9070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a6de1627e1b8bb server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:25:31.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.254+0000 7f2f6cc00640 1 -- 172.21.15.63:0/707273984 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f740b2040 con 0x5622b5682100 2024-05-21T01:25:31.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.254+0000 7f2f6cc00640 1 -- 172.21.15.63:0/707273984 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f74004400 con 0x5622b5682100 2024-05-21T01:25:31.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.254+0000 7f2f6cc00640 1 -- 172.21.15.63:0/707273984 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f740047f0 con 0x5622b5682100 2024-05-21T01:25:31.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.254+0000 7f2f86f3a000 1 -- 172.21.15.63:0/707273984 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5622b5682100 msgr2=0x5622b567beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:25:31.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.254+0000 7f2f86f3a000 1 --2- 172.21.15.63:0/707273984 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5622b5682100 0x5622b567beb0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f2f74002240 tx=0x7f2f740b9070 comp rx=0 tx=0).stop 2024-05-21T01:25:31.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.254+0000 7f2f86f3a000 1 -- 172.21.15.63:0/707273984 shutdown_connections 2024-05-21T01:25:31.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.254+0000 7f2f86f3a000 1 --2- 172.21.15.63:0/707273984 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5622b5682100 0x5622b567beb0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:31.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.254+0000 7f2f86f3a000 1 --2- 172.21.15.63:0/707273984 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5622b567d130 0x5622b567b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:31.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.254+0000 7f2f86f3a000 1 --2- 172.21.15.63:0/707273984 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5622b5647100 0x5622b569b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:31.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.254+0000 7f2f86f3a000 1 -- 172.21.15.63:0/707273984 >> 172.21.15.63:0/707273984 conn(0x5622b5528d80 msgr2=0x5622b567c820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:25:31.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.254+0000 7f2f86f3a000 1 -- 172.21.15.63:0/707273984 shutdown_connections 2024-05-21T01:25:31.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.254+0000 7f2f86f3a000 1 -- 172.21.15.63:0/707273984 wait complete. 2024-05-21T01:25:31.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.254+0000 7f2f86f3a000 1 -- start start 2024-05-21T01:25:31.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.254+0000 7f2f86f3a000 1 Processor -- start 2024-05-21T01:25:31.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.258+0000 7f2f86f3a000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5622b5647100 0x5622b56baf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:31.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.258+0000 7f2f86f3a000 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5622b567d130 0x5622b56bb450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:31.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.258+0000 7f2f86f3a000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5622b5682100 0x5622b56bb990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:31.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.258+0000 7f2f86f3a000 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5622b54880e0 con 0x5622b567d130 2024-05-21T01:25:31.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.258+0000 7f2f86f3a000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5622b5511400 con 0x5622b5682100 2024-05-21T01:25:31.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.258+0000 7f2f86f3a000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5622b54253e0 con 0x5622b5647100 2024-05-21T01:25:31.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.258+0000 7f2f86f3a000 10 client.0 _ll_register_callbacks cb 0x7f2f64003700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-21T01:25:31.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.258+0000 7f2f7be00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5622b567d130 0x5622b56bb450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:31.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.258+0000 7f2f7be00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5622b567d130 0x5622b56bb450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38170/0 (socket says 172.21.15.63:38170) 2024-05-21T01:25:31.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.258+0000 7f2f7be00640 1 -- 172.21.15.63:0/3576257011 learned_addr learned my addr 172.21.15.63:0/3576257011 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:25:31.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.258+0000 7f2f81000640 1 --2- 172.21.15.63:0/3576257011 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5622b5647100 0x5622b56baf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:31.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.258+0000 7f2f81a00640 1 --2- 172.21.15.63:0/3576257011 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5622b5682100 0x5622b56bb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:31.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.258+0000 7f2f7be00640 1 -- 172.21.15.63:0/3576257011 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5622b5647100 msgr2=0x5622b56baf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:25:31.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.258+0000 7f2f7be00640 1 --2- 172.21.15.63:0/3576257011 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5622b5647100 0x5622b56baf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:31.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.258+0000 7f2f7be00640 1 -- 172.21.15.63:0/3576257011 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5622b5682100 msgr2=0x5622b56bb990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:25:31.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.258+0000 7f2f7be00640 1 --2- 172.21.15.63:0/3576257011 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5622b5682100 0x5622b56bb990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:31.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.258+0000 7f2f7be00640 1 -- 172.21.15.63:0/3576257011 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622b5420f40 con 0x5622b567d130 2024-05-21T01:25:31.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.258+0000 7f2f7be00640 1 --2- 172.21.15.63:0/3576257011 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5622b567d130 0x5622b56bb450 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f2f680017e0 tx=0x7f2f68007550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53fb42105970e703 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:25:31.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.258+0000 7f2f62000640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-05-21T01:25:31.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.258+0000 7f2f62000640 1 -- 172.21.15.63:0/3576257011 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f68007740 con 0x5622b567d130 2024-05-21T01:25:31.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.258+0000 7f2f62000640 1 -- 172.21.15.63:0/3576257011 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f2f68010040 con 0x5622b567d130 2024-05-21T01:25:31.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.258+0000 7f2f86f3a000 1 -- 172.21.15.63:0/3576257011 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f74004400 con 0x5622b567d130 2024-05-21T01:25:31.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.258+0000 7f2f62000640 1 -- 172.21.15.63:0/3576257011 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f2f68017b20 con 0x5622b567d130 2024-05-21T01:25:31.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.258+0000 7f2f86f3a000 10 client.5016 fetch_fsmap learned FSMap version 15 2024-05-21T01:25:31.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.258+0000 7f2f86f3a000 1 -- 172.21.15.63:0/3576257011 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x5622b5433f80 con 0x5622b567d130 2024-05-21T01:25:31.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.258+0000 7f2f62000640 1 -- 172.21.15.63:0/3576257011 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f74004400 con 0x5622b567d130 2024-05-21T01:25:31.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.258+0000 7f2f62000640 1 -- 172.21.15.63:0/3576257011 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 15) ==== 4752+0+0 (secure 0 0 0) 0x7f2f6802b070 con 0x5622b567d130 2024-05-21T01:25:31.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.258+0000 7f2f86f3a000 10 client.5016 fetch_fsmap finished waiting for FSMap version 15 2024-05-21T01:25:31.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.258+0000 7f2f86f3a000 10 client.5016 resolve_mds: validated gid 4276 aka daemon mds.c 2024-05-21T01:25:31.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.258+0000 7f2f86f3a000 20 client.5016 populate_metadata read hostname 'smithi063' 2024-05-21T01:25:31.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.258+0000 7f2f86f3a000 1 --2- 172.21.15.63:0/3576257011 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x5622b5700dc0 0x5622b57031b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:31.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.258+0000 7f2f86f3a000 4 client.5016 mds_command: new command op to 4276 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 146.0, "await_for": 45.0}] 2024-05-21T01:25:31.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.258+0000 7f2f86f3a000 1 -- 172.21.15.63:0/3576257011 --> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 146.0, "await_for": 45.0}) -- 0x5622b5469e60 con 0x5622b5700dc0 2024-05-21T01:25:31.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.262+0000 7f2f81000640 1 --2- 172.21.15.63:0/3576257011 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x5622b5700dc0 0x5622b57031b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:31.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.262+0000 7f2f81000640 1 --2- 172.21.15.63:0/3576257011 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x5622b5700dc0 0x5622b57031b0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6206ffa5ead94322 server_cookie=3380c544482bcb6e in_seq=0 out_seq=0 2024-05-21T01:25:31.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.262+0000 7f2f62000640 10 client.5016 ms_handle_connect on v2:172.21.15.63:6834/2892727989 2024-05-21T01:25:31.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.274+0000 7f2f62000640 1 -- 172.21.15.63:0/3576257011 <== mds.0 v2:172.21.15.63:6834/2892727989 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x5622b5469e60 con 0x5622b5700dc0 2024-05-21T01:25:31.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.274+0000 7f2f62000640 10 client.5016 handle_command_reply: tid=0 2024-05-21T01:25:31.278 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.274+0000 7f2f86f3a000 1 client.5016 shutdown 2024-05-21T01:25:31.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.274+0000 7f2f86f3a000 1 -- 172.21.15.63:0/3576257011 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5622b567d130 msgr2=0x5622b56bb450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:25:31.279 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.274+0000 7f2f86f3a000 1 --2- 172.21.15.63:0/3576257011 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5622b567d130 0x5622b56bb450 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f2f680017e0 tx=0x7f2f68007550 comp rx=0 tx=0).stop 2024-05-21T01:25:31.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.274+0000 7f2f86f3a000 1 -- 172.21.15.63:0/3576257011 shutdown_connections 2024-05-21T01:25:31.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.274+0000 7f2f86f3a000 1 --2- 172.21.15.63:0/3576257011 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x5622b5700dc0 0x5622b57031b0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:31.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.274+0000 7f2f86f3a000 1 --2- 172.21.15.63:0/3576257011 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5622b5682100 0x5622b56bb990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:31.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.274+0000 7f2f86f3a000 1 --2- 172.21.15.63:0/3576257011 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5622b567d130 0x5622b56bb450 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:31.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.274+0000 7f2f86f3a000 1 --2- 172.21.15.63:0/3576257011 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5622b5647100 0x5622b56baf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:31.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.274+0000 7f2f62000640 0 client.5016 ms_handle_reset on v2:172.21.15.63:6834/2892727989 2024-05-21T01:25:31.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.274+0000 7f2f86f3a000 1 -- 172.21.15.63:0/3576257011 >> 172.21.15.63:0/3576257011 conn(0x5622b5528d80 msgr2=0x5622b567c610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:25:31.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.274+0000 7f2f86f3a000 1 -- 172.21.15.63:0/3576257011 shutdown_connections 2024-05-21T01:25:31.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.274+0000 7f2f86f3a000 1 -- 172.21.15.63:0/3576257011 wait complete. 2024-05-21T01:25:31.280 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.274+0000 7f2f86f3a000 20 client.5016 trim_cache size 0 max 16384 2024-05-21T01:25:31.281 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-05-21T01:25:31.281 INFO:teuthology.orchestra.run.smithi063.stdout: "epoch": 15, 2024-05-21T01:25:31.281 INFO:teuthology.orchestra.run.smithi063.stdout: "leader": 4276, 2024-05-21T01:25:31.281 INFO:teuthology.orchestra.run.smithi063.stdout: "set_version": 18, 2024-05-21T01:25:31.281 INFO:teuthology.orchestra.run.smithi063.stdout: "sets": { 2024-05-21T01:25:31.281 INFO:teuthology.orchestra.run.smithi063.stdout: "c699e4d7": { 2024-05-21T01:25:31.281 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 18, 2024-05-21T01:25:31.281 INFO:teuthology.orchestra.run.smithi063.stdout: "age_ref": 0.0, 2024-05-21T01:25:31.281 INFO:teuthology.orchestra.run.smithi063.stdout: "state": { 2024-05-21T01:25:31.281 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "QUIESCED", 2024-05-21T01:25:31.282 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 0.0 2024-05-21T01:25:31.282 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-05-21T01:25:31.282 INFO:teuthology.orchestra.run.smithi063.stdout: "timeout": 90.0, 2024-05-21T01:25:31.282 INFO:teuthology.orchestra.run.smithi063.stdout: "expiration": 146.0, 2024-05-21T01:25:31.282 INFO:teuthology.orchestra.run.smithi063.stdout: "members": { 2024-05-21T01:25:31.282 INFO:teuthology.orchestra.run.smithi063.stdout: "file:/": { 2024-05-21T01:25:31.282 INFO:teuthology.orchestra.run.smithi063.stdout: "excluded": false, 2024-05-21T01:25:31.282 INFO:teuthology.orchestra.run.smithi063.stdout: "state": { 2024-05-21T01:25:31.282 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "QUIESCED", 2024-05-21T01:25:31.282 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 0.0 2024-05-21T01:25:31.283 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-05-21T01:25:31.283 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-05-21T01:25:31.283 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-05-21T01:25:31.283 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-05-21T01:25:31.283 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-05-21T01:25:31.283 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-05-21T01:25:31.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.278+0000 7f2f82400640 1 -- 172.21.15.63:0/154440913 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f2f5c06f400 msgr2=0x7f2f5c0718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:25:31.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.278+0000 7f2f82400640 1 --2- 172.21.15.63:0/154440913 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f2f5c06f400 0x7f2f5c0718c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2f740af000 tx=0x7f2f74004ac0 comp rx=0 tx=0).stop 2024-05-21T01:25:31.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.278+0000 7f2f82400640 1 -- 172.21.15.63:0/154440913 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2f64004d50 msgr2=0x7f2f7c0cc720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:25:31.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.278+0000 7f2f82400640 1 --2- 172.21.15.63:0/154440913 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2f64004d50 0x7f2f7c0cc720 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f2f70011a30 tx=0x7f2f70011ef0 comp rx=0 tx=0).stop 2024-05-21T01:25:31.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.278+0000 7f2f82400640 1 -- 172.21.15.63:0/154440913 shutdown_connections 2024-05-21T01:25:31.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.278+0000 7f2f82400640 1 --2- 172.21.15.63:0/154440913 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f2f5c06f400 0x7f2f5c0718c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:31.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.278+0000 7f2f82400640 1 --2- 172.21.15.63:0/154440913 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2f7c14e8c0 0x7f2f7c148f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:31.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.278+0000 7f2f82400640 1 --2- 172.21.15.63:0/154440913 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2f7c15d880 0x7f2f7c1ed690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:31.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.278+0000 7f2f82400640 1 --2- 172.21.15.63:0/154440913 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2f64004d50 0x7f2f7c0cc720 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:31.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.278+0000 7f2f82400640 1 -- 172.21.15.63:0/154440913 >> 172.21.15.63:0/154440913 conn(0x7f2f7c06c670 msgr2=0x7f2f7c152390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:25:31.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.278+0000 7f2f82400640 1 -- 172.21.15.63:0/154440913 shutdown_connections 2024-05-21T01:25:31.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:31.278+0000 7f2f82400640 1 -- 172.21.15.63:0/154440913 wait complete. 2024-05-21T01:25:31.304 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'c699e4d7', quiesce took 0.9 seconds. Will release after: 25.1 2024-05-21T01:25:54.576 INFO:tasks.workunit.client.0.smithi063.stdout: 2024-05-21T01:25:54.576 INFO:tasks.workunit.client.0.smithi063.stdout: Children see throughput for 1 readers = 378201.38 kB/sec 2024-05-21T01:25:54.576 INFO:tasks.workunit.client.0.smithi063.stdout: Parent sees throughput for 1 readers = 378194.32 kB/sec 2024-05-21T01:25:54.576 INFO:tasks.workunit.client.0.smithi063.stdout: Min throughput per process = 378201.38 kB/sec 2024-05-21T01:25:54.576 INFO:tasks.workunit.client.0.smithi063.stdout: Max throughput per process = 378201.38 kB/sec 2024-05-21T01:25:54.576 INFO:tasks.workunit.client.0.smithi063.stdout: Avg throughput per process = 378201.38 kB/sec 2024-05-21T01:25:54.576 INFO:tasks.workunit.client.0.smithi063.stdout: Min xfer = 10485760.00 kB 2024-05-21T01:25:56.406 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-21T01:25:56.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.554+0000 7ff4c9c00640 1 Processor -- start 2024-05-21T01:25:56.558 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.554+0000 7ff4c9c00640 1 -- start start 2024-05-21T01:25:56.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.554+0000 7ff4c9c00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff4c406f5d0 0x7ff4c40c8a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:56.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.554+0000 7ff4c9c00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff4c406f9b0 0x7ff4c4152a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:56.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.554+0000 7ff4c9c00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4c4072550 con 0x7ff4c415ce40 2024-05-21T01:25:56.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.554+0000 7ff4c9c00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7ff4c4159100 con 0x7ff4c406f9b0 2024-05-21T01:25:56.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.554+0000 7ff4c9c00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7ff4c41593e0 con 0x7ff4c406f5d0 2024-05-21T01:25:56.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.558+0000 7ff4ba000640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff4c406f9b0 0x7ff4c4152a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:56.560 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.558+0000 7ff4ba000640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff4c406f9b0 0x7ff4c4152a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39892/0 (socket says 172.21.15.63:39892) 2024-05-21T01:25:56.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.558+0000 7ff4ba000640 1 -- 172.21.15.63:0/3990233634 learned_addr learned my addr 172.21.15.63:0/3990233634 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:25:56.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.558+0000 7ff4c2a00640 1 --2- 172.21.15.63:0/3990233634 >> v2:172.21.15.131:3300/0 conn(0x7ff4c406f5d0 0x7ff4c40c8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:56.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.558+0000 7ff4ba000640 1 -- 172.21.15.63:0/3990233634 >> v2:172.21.15.131:3300/0 conn(0x7ff4c406f5d0 msgr2=0x7ff4c40c8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:25:56.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.558+0000 7ff4ba000640 1 --2- 172.21.15.63:0/3990233634 >> v2:172.21.15.131:3300/0 conn(0x7ff4c406f5d0 0x7ff4c40c8a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:56.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.558+0000 7ff4ba000640 1 -- 172.21.15.63:0/3990233634 >> v1:172.21.15.131:6789/0 conn(0x7ff4c415ce40 legacy=0x7ff4c4072d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:25:56.561 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.558+0000 7ff4ba000640 1 -- 172.21.15.63:0/3990233634 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4c41596c0 con 0x7ff4c406f9b0 2024-05-21T01:25:56.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.558+0000 7ff4ba000640 1 --2- 172.21.15.63:0/3990233634 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff4c406f9b0 0x7ff4c4152a40 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ff4c40caef0 tx=0x7ff4ac01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3e9cc3d051bfc8d server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:25:56.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.558+0000 7ff4c2000640 1 -- 172.21.15.63:0/3990233634 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4ac0ab610 con 0x7ff4c406f9b0 2024-05-21T01:25:56.563 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.558+0000 7ff4c2000640 1 -- 172.21.15.63:0/3990233634 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4ac0b0070 con 0x7ff4c406f9b0 2024-05-21T01:25:56.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.558+0000 7ff4c2000640 1 -- 172.21.15.63:0/3990233634 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4ac0ab9d0 con 0x7ff4c406f9b0 2024-05-21T01:25:56.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.562+0000 7ff4c9c00640 1 -- 172.21.15.63:0/3990233634 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff4c406f9b0 msgr2=0x7ff4c4152a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:25:56.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.562+0000 7ff4c9c00640 1 --2- 172.21.15.63:0/3990233634 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff4c406f9b0 0x7ff4c4152a40 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ff4c40caef0 tx=0x7ff4ac01c520 comp rx=0 tx=0).stop 2024-05-21T01:25:56.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.562+0000 7ff4c9c00640 1 -- 172.21.15.63:0/3990233634 shutdown_connections 2024-05-21T01:25:56.564 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.562+0000 7ff4c9c00640 1 --2- 172.21.15.63:0/3990233634 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff4c406f9b0 0x7ff4c4152a40 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:56.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.562+0000 7ff4c9c00640 1 --2- 172.21.15.63:0/3990233634 >> v2:172.21.15.131:3300/0 conn(0x7ff4c406f5d0 0x7ff4c40c8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:56.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.562+0000 7ff4c9c00640 1 -- 172.21.15.63:0/3990233634 >> 172.21.15.63:0/3990233634 conn(0x7ff4c4068460 msgr2=0x7ff4c4068870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:25:56.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.562+0000 7ff4c9c00640 1 -- 172.21.15.63:0/3990233634 shutdown_connections 2024-05-21T01:25:56.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.562+0000 7ff4c9c00640 1 -- 172.21.15.63:0/3990233634 wait complete. 2024-05-21T01:25:56.565 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.562+0000 7ff4c9c00640 1 Processor -- start 2024-05-21T01:25:56.566 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.562+0000 7ff4c9c00640 1 -- start start 2024-05-21T01:25:56.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.562+0000 7ff4c9c00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff4c406f5d0 0x7ff4c4152450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:56.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.562+0000 7ff4c9c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff4c406f9b0 0x7ff4c415a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:56.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.562+0000 7ff4c9c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff4c415ce40 0x7ff4c4148550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:56.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.562+0000 7ff4c9c00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff4c4153100 con 0x7ff4c406f9b0 2024-05-21T01:25:56.567 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.562+0000 7ff4c9c00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7ff4c4152f80 con 0x7ff4c415ce40 2024-05-21T01:25:56.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.562+0000 7ff4c9c00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7ff4c4153280 con 0x7ff4c406f5d0 2024-05-21T01:25:56.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.562+0000 7ff4ba000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff4c406f9b0 0x7ff4c415a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:56.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.562+0000 7ff4ba000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff4c406f9b0 0x7ff4c415a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39908/0 (socket says 172.21.15.63:39908) 2024-05-21T01:25:56.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.562+0000 7ff4ba000640 1 -- 172.21.15.63:0/2878422114 learned_addr learned my addr 172.21.15.63:0/2878422114 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:25:56.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.562+0000 7ff4c3400640 1 --2- 172.21.15.63:0/2878422114 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff4c415ce40 0x7ff4c4148550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:56.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.562+0000 7ff4c2a00640 1 --2- 172.21.15.63:0/2878422114 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff4c406f5d0 0x7ff4c4152450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:56.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.562+0000 7ff4ba000640 1 -- 172.21.15.63:0/2878422114 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff4c406f5d0 msgr2=0x7ff4c4152450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:25:56.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.562+0000 7ff4ba000640 1 --2- 172.21.15.63:0/2878422114 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff4c406f5d0 0x7ff4c4152450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:56.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.562+0000 7ff4ba000640 1 -- 172.21.15.63:0/2878422114 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff4c415ce40 msgr2=0x7ff4c4148550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:25:56.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.562+0000 7ff4ba000640 1 --2- 172.21.15.63:0/2878422114 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff4c415ce40 0x7ff4c4148550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:56.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.562+0000 7ff4ba000640 1 -- 172.21.15.63:0/2878422114 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4c40c60d0 con 0x7ff4c406f9b0 2024-05-21T01:25:56.568 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.562+0000 7ff4c2a00640 1 --2- 172.21.15.63:0/2878422114 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff4c406f5d0 0x7ff4c4152450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T01:25:56.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.566+0000 7ff4ba000640 1 --2- 172.21.15.63:0/2878422114 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff4c406f9b0 0x7ff4c415a890 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac019130 tx=0x7ff4ac01ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:25:56.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.566+0000 7ff4bb400640 1 -- 172.21.15.63:0/2878422114 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4ac0be5f0 con 0x7ff4c406f9b0 2024-05-21T01:25:56.569 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.566+0000 7ff4bb400640 1 -- 172.21.15.63:0/2878422114 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4ac0be790 con 0x7ff4c406f9b0 2024-05-21T01:25:56.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.566+0000 7ff4bb400640 1 -- 172.21.15.63:0/2878422114 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4ac0beb80 con 0x7ff4c406f9b0 2024-05-21T01:25:56.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.566+0000 7ff4c9c00640 1 -- 172.21.15.63:0/2878422114 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4c4152990 con 0x7ff4c406f9b0 2024-05-21T01:25:56.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.566+0000 7ff4c9c00640 1 -- 172.21.15.63:0/2878422114 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4c4151970 con 0x7ff4c406f9b0 2024-05-21T01:25:56.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.566+0000 7ff4c9c00640 1 -- 172.21.15.63:0/2878422114 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4c40507f0 con 0x7ff4c406f9b0 2024-05-21T01:25:56.570 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.566+0000 7ff4bb400640 1 -- 172.21.15.63:0/2878422114 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7ff4ac0b43f0 con 0x7ff4c406f9b0 2024-05-21T01:25:56.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.566+0000 7ff4bb400640 1 --2- 172.21.15.63:0/2878422114 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7ff4a006f400 0x7ff4a00718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:56.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.566+0000 7ff4bb400640 1 -- 172.21.15.63:0/2878422114 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7ff4ac129e50 con 0x7ff4c406f9b0 2024-05-21T01:25:56.571 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.566+0000 7ff4c2a00640 1 --2- 172.21.15.63:0/2878422114 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7ff4a006f400 0x7ff4a00718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:56.572 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.570+0000 7ff4c2a00640 1 --2- 172.21.15.63:0/2878422114 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7ff4a006f400 0x7ff4a00718c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff4b400b9f0 tx=0x7ff4b4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:25:56.576 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.574+0000 7ff4bb400640 1 -- 172.21.15.63:0/2878422114 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7ff4ac0a8050 con 0x7ff4c406f9b0 2024-05-21T01:25:56.775 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.770+0000 7ff4c9c00640 1 -- 172.21.15.63:0/2878422114 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff4c4150870 con 0x7ff4c406f9b0 2024-05-21T01:25:56.776 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.774+0000 7ff4bb400640 1 -- 172.21.15.63:0/2878422114 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+6876 (secure 0 0 0) 0x7ff4ac016110 con 0x7ff4c406f9b0 2024-05-21T01:25:56.776 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-05-21T01:25:56.776 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6839/3045714273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6837","nonce":3045714273},{"type":"v1","addr":"172.21.15.131:6839","nonce":3045714273}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/2978367338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":2978367338},{"type":"v1","addr":"172.21.15.131:6835","nonce":2978367338}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/3005995321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6835","nonce":3005995321},{"type":"v1","addr":"172.21.15.63:6837","nonce":3005995321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-21T01:19:53.915775+0000","modified":"2024-05-21T01:20:31.724475+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4276,"mds_1":4270,"mds_2":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"e","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.63:6833/574189772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":574189772},{"type":"v1","addr":"172.21.15.63:6833","nonce":574189772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4270":{"gid":4270,"name":"f","rank":1,"incarnation":10,"state":"up:active","state_seq":11,"addr":"172.21.15.131:6838/3071941741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":3071941741},{"type":"v1","addr":"172.21.15.131:6838","nonce":3071941741}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.63:6836/2892727989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":2892727989},{"type":"v1","addr":"172.21.15.63:6836","nonce":2892727989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4276,"qdb_cluster":[4267,4270,4276]},"id":1}]} 2024-05-21T01:25:56.777 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 15 2024-05-21T01:25:56.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.774+0000 7ff4c9c00640 1 -- 172.21.15.63:0/2878422114 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7ff4a006f400 msgr2=0x7ff4a00718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:25:56.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.774+0000 7ff4c9c00640 1 --2- 172.21.15.63:0/2878422114 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7ff4a006f400 0x7ff4a00718c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff4b400b9f0 tx=0x7ff4b4008040 comp rx=0 tx=0).stop 2024-05-21T01:25:56.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.774+0000 7ff4c9c00640 1 -- 172.21.15.63:0/2878422114 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff4c406f9b0 msgr2=0x7ff4c415a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:25:56.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.774+0000 7ff4c9c00640 1 --2- 172.21.15.63:0/2878422114 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff4c406f9b0 0x7ff4c415a890 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac019130 tx=0x7ff4ac01ad60 comp rx=0 tx=0).stop 2024-05-21T01:25:56.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.774+0000 7ff4c9c00640 1 -- 172.21.15.63:0/2878422114 shutdown_connections 2024-05-21T01:25:56.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.774+0000 7ff4c9c00640 1 --2- 172.21.15.63:0/2878422114 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7ff4a006f400 0x7ff4a00718c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:56.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.774+0000 7ff4c9c00640 1 --2- 172.21.15.63:0/2878422114 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff4c415ce40 0x7ff4c4148550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:56.778 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.774+0000 7ff4c9c00640 1 --2- 172.21.15.63:0/2878422114 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff4c406f9b0 0x7ff4c415a890 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:56.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.774+0000 7ff4c9c00640 1 --2- 172.21.15.63:0/2878422114 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff4c406f5d0 0x7ff4c4152450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:56.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.774+0000 7ff4c9c00640 1 -- 172.21.15.63:0/2878422114 >> 172.21.15.63:0/2878422114 conn(0x7ff4c4068460 msgr2=0x7ff4c4068840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:25:56.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.774+0000 7ff4c9c00640 1 -- 172.21.15.63:0/2878422114 shutdown_connections 2024-05-21T01:25:56.779 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.774+0000 7ff4c9c00640 1 -- 172.21.15.63:0/2878422114 wait complete. 2024-05-21T01:25:56.798 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4276 quiesce db --set-id c699e4d7 --release --await' 2024-05-21T01:25:56.798 DEBUG:teuthology.orchestra.run.smithi063:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4276 quiesce db --set-id c699e4d7 --release --await 2024-05-21T01:25:56.947 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.942+0000 7fdfc3a00640 1 Processor -- start 2024-05-21T01:25:56.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.942+0000 7fdfc3a00640 1 -- start start 2024-05-21T01:25:56.948 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.946+0000 7fdfc3a00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdfbc15ce40 0x7fdfbc072d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:56.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.946+0000 7fdfc3a00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdfbc072550 con 0x7fdfbc06f5d0 2024-05-21T01:25:56.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.946+0000 7fdfc3a00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdfbc159100 con 0x7fdfbc06f9b0 2024-05-21T01:25:56.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.946+0000 7fdfc3a00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fdfbc1593e0 con 0x7fdfbc15ce40 2024-05-21T01:25:56.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.946+0000 7fdfc1000640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fdfbc06f5d0 0x7fdfbc0c8a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:55128/0 (socket says 172.21.15.63:55128) 2024-05-21T01:25:56.949 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.946+0000 7fdfc1000640 1 -- 172.21.15.63:0/1418565220 learned_addr learned my addr 172.21.15.63:0/1418565220 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-05-21T01:25:56.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.946+0000 7fdfc1a00640 1 --2- 172.21.15.63:0/1418565220 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdfbc15ce40 0x7fdfbc072d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:56.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.946+0000 7fdfbb400640 1 -- 172.21.15.63:0/1418565220 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4195082029 0 0) 0x7fdfbc072550 con 0x7fdfbc06f5d0 2024-05-21T01:25:56.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.946+0000 7fdfbb400640 1 -- 172.21.15.63:0/1418565220 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdfa4003530 con 0x7fdfbc06f5d0 2024-05-21T01:25:56.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.946+0000 7fdfbb400640 1 -- 172.21.15.63:0/1418565220 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3150933432 0 0) 0x7fdfa4003530 con 0x7fdfbc06f5d0 2024-05-21T01:25:56.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.946+0000 7fdfbb400640 1 -- 172.21.15.63:0/1418565220 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdfbc15ce40 msgr2=0x7fdfbc072d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:25:56.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.946+0000 7fdfbb400640 1 --2- 172.21.15.63:0/1418565220 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdfbc15ce40 0x7fdfbc072d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:56.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.946+0000 7fdfbb400640 1 -- 172.21.15.63:0/1418565220 >> v1:172.21.15.131:6789/0 conn(0x7fdfbc06f9b0 legacy=0x7fdfbc152a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:25:56.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.946+0000 7fdfbb400640 1 -- 172.21.15.63:0/1418565220 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfbc1596c0 con 0x7fdfbc06f5d0 2024-05-21T01:25:56.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.946+0000 7fdfbb400640 1 -- 172.21.15.63:0/1418565220 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 466403955 0 0) 0x7fdfb0001700 con 0x7fdfbc06f5d0 2024-05-21T01:25:56.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.946+0000 7fdfbb400640 1 -- 172.21.15.63:0/1418565220 >> v1:172.21.15.63:6789/0 conn(0x7fdfbc06f5d0 legacy=0x7fdfbc0c8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:25:56.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.946+0000 7fdfbb400640 1 --2- 172.21.15.63:0/1418565220 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdfa4003a40 0x7fdfa4003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:56.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.946+0000 7fdfbb400640 1 --2- 172.21.15.63:0/1418565220 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdfa4004810 0x7fdfa4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:56.951 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.946+0000 7fdfbb400640 1 --2- 172.21.15.63:0/1418565220 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdfbc15ce40 0x7fdfa4005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:56.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.946+0000 7fdfbb400640 1 -- 172.21.15.63:0/1418565220 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fdfbc1593e0 con 0x7fdfa4003a40 2024-05-21T01:25:56.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.946+0000 7fdfbb400640 1 -- 172.21.15.63:0/1418565220 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fdfa400bb00 con 0x7fdfa4004810 2024-05-21T01:25:56.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.946+0000 7fdfbb400640 1 -- 172.21.15.63:0/1418565220 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fdfa400bd00 con 0x7fdfbc15ce40 2024-05-21T01:25:56.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.946+0000 7fdfc1000640 1 --2- 172.21.15.63:0/1418565220 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdfa4003a40 0x7fdfa4003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:56.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.946+0000 7fdfbbe00640 1 --2- 172.21.15.63:0/1418565220 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdfa4004810 0x7fdfa4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:56.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.946+0000 7fdfc1a00640 1 --2- 172.21.15.63:0/1418565220 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdfbc15ce40 0x7fdfa4005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:56.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.946+0000 7fdfc1000640 1 -- 172.21.15.63:0/1418565220 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdfbc15ce40 msgr2=0x7fdfa4005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:25:56.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.946+0000 7fdfc1000640 1 --2- 172.21.15.63:0/1418565220 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdfbc15ce40 0x7fdfa4005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:56.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.946+0000 7fdfc1000640 1 -- 172.21.15.63:0/1418565220 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdfa4004810 msgr2=0x7fdfa4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:25:56.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.946+0000 7fdfc1000640 1 --2- 172.21.15.63:0/1418565220 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdfa4004810 0x7fdfa4004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:56.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.946+0000 7fdfc1000640 1 -- 172.21.15.63:0/1418565220 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfa4003530 con 0x7fdfa4003a40 2024-05-21T01:25:56.952 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.946+0000 7fdfbbe00640 1 --2- 172.21.15.63:0/1418565220 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdfa4004810 0x7fdfa4004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T01:25:56.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.950+0000 7fdfc1000640 1 --2- 172.21.15.63:0/1418565220 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdfa4003a40 0x7fdfa4003e60 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fdfb000c240 tx=0x7fdfb001cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b56d87077dc4a5f5 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:25:56.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.950+0000 7fdfbb400640 1 -- 172.21.15.63:0/1418565220 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfb0007d70 con 0x7fdfa4003a40 2024-05-21T01:25:56.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.950+0000 7fdfbb400640 1 -- 172.21.15.63:0/1418565220 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfb00a9020 con 0x7fdfa4003a40 2024-05-21T01:25:56.953 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.950+0000 7fdfbb400640 1 -- 172.21.15.63:0/1418565220 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfb0005b20 con 0x7fdfa4003a40 2024-05-21T01:25:56.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.950+0000 7fdfc3a00640 1 -- 172.21.15.63:0/1418565220 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdfa4003a40 msgr2=0x7fdfa4003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:25:56.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.950+0000 7fdfc3a00640 1 --2- 172.21.15.63:0/1418565220 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdfa4003a40 0x7fdfa4003e60 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fdfb000c240 tx=0x7fdfb001cbc0 comp rx=0 tx=0).stop 2024-05-21T01:25:56.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.950+0000 7fdfc1a00640 1 -- 172.21.15.63:0/1418565220 reap_dead start 2024-05-21T01:25:56.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.950+0000 7fdfc3a00640 1 -- 172.21.15.63:0/1418565220 shutdown_connections 2024-05-21T01:25:56.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.950+0000 7fdfc3a00640 1 -- 172.21.15.63:0/1418565220 >> 172.21.15.63:0/1418565220 conn(0x7fdfbc068460 msgr2=0x7fdfbc068870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:25:56.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.950+0000 7fdfc3a00640 1 -- 172.21.15.63:0/1418565220 shutdown_connections 2024-05-21T01:25:56.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.950+0000 7fdfc3a00640 1 -- 172.21.15.63:0/1418565220 wait complete. 2024-05-21T01:25:56.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.950+0000 7fdfc3a00640 1 Processor -- start 2024-05-21T01:25:56.956 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.954+0000 7fdfc3a00640 1 -- start start 2024-05-21T01:25:56.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.954+0000 7fdfc3a00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdfa4003a40 0x7fdfbc14f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:56.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.954+0000 7fdfc3a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdfbc14fe70 0x7fdfbc1f4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:56.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.954+0000 7fdfc3a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdfbc1f5430 0x7fdfbc14e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:56.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.954+0000 7fdfc3a00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fdfbc164510 con 0x7fdfbc14fe70 2024-05-21T01:25:56.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.954+0000 7fdfc3a00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fdfbc153360 con 0x7fdfbc1f5430 2024-05-21T01:25:56.957 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.954+0000 7fdfc3a00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fdfbc164690 con 0x7fdfa4003a40 2024-05-21T01:25:56.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.954+0000 7fdfbbe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdfbc14fe70 0x7fdfbc1f4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:56.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.954+0000 7fdfbbe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdfbc14fe70 0x7fdfbc1f4ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39926/0 (socket says 172.21.15.63:39926) 2024-05-21T01:25:56.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.954+0000 7fdfbbe00640 1 -- 172.21.15.63:0/3819704177 learned_addr learned my addr 172.21.15.63:0/3819704177 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:25:56.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.954+0000 7fdfc1000640 1 --2- 172.21.15.63:0/3819704177 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdfa4003a40 0x7fdfbc14f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:56.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.954+0000 7fdfc1a00640 1 --2- 172.21.15.63:0/3819704177 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdfbc1f5430 0x7fdfbc14e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:56.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.954+0000 7fdfbbe00640 1 -- 172.21.15.63:0/3819704177 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdfa4003a40 msgr2=0x7fdfbc14f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:25:56.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.954+0000 7fdfbbe00640 1 --2- 172.21.15.63:0/3819704177 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdfa4003a40 0x7fdfbc14f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:56.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.954+0000 7fdfbbe00640 1 -- 172.21.15.63:0/3819704177 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdfbc1f5430 msgr2=0x7fdfbc14e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:25:56.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.954+0000 7fdfbbe00640 1 --2- 172.21.15.63:0/3819704177 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdfbc1f5430 0x7fdfbc14e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:56.958 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.954+0000 7fdfbbe00640 1 -- 172.21.15.63:0/3819704177 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfbc1f58b0 con 0x7fdfbc14fe70 2024-05-21T01:25:56.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.954+0000 7fdfbbe00640 1 --2- 172.21.15.63:0/3819704177 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdfbc14fe70 0x7fdfbc1f4ef0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fdfa800e4b0 tx=0x7fdfa800e970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:25:56.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.954+0000 7fdfb8c00640 1 -- 172.21.15.63:0/3819704177 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfa80052e0 con 0x7fdfbc14fe70 2024-05-21T01:25:56.959 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.954+0000 7fdfb8c00640 1 -- 172.21.15.63:0/3819704177 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfa8007020 con 0x7fdfbc14fe70 2024-05-21T01:25:56.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.954+0000 7fdfb8c00640 1 -- 172.21.15.63:0/3819704177 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfa8005480 con 0x7fdfbc14fe70 2024-05-21T01:25:56.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.954+0000 7fdfc3a00640 1 -- 172.21.15.63:0/3819704177 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfbc1f8e70 con 0x7fdfbc14fe70 2024-05-21T01:25:56.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.954+0000 7fdfc3a00640 1 -- 172.21.15.63:0/3819704177 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfbc0cbdf0 con 0x7fdfbc14fe70 2024-05-21T01:25:56.960 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.958+0000 7fdfb8c00640 1 -- 172.21.15.63:0/3819704177 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7fdfa801a020 con 0x7fdfbc14fe70 2024-05-21T01:25:56.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.958+0000 7fdfb8c00640 1 --2- 172.21.15.63:0/3819704177 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fdf9c06f430 0x7fdf9c0718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:56.961 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.958+0000 7fdfb8c00640 1 -- 172.21.15.63:0/3819704177 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7fdfa808ec00 con 0x7fdfbc14fe70 2024-05-21T01:25:56.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.958+0000 7fdfc6e7e000 1 Processor -- start 2024-05-21T01:25:56.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.958+0000 7fdfc6e7e000 1 -- start start 2024-05-21T01:25:56.962 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.958+0000 7fdfc1000640 1 --2- 172.21.15.63:0/3819704177 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fdf9c06f430 0x7fdf9c0718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:56.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.958+0000 7fdfc6e7e000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5574368a0b90 0x55743686a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:56.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.958+0000 7fdfc6e7e000 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55743686a8d0 0x5574368a5620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:56.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.958+0000 7fdfc6e7e000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5574368a5b60 0x5574368a5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:56.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.958+0000 7fdfc6e7e000 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5574366bf8a0 con 0x55743686a8d0 2024-05-21T01:25:56.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.958+0000 7fdfc6e7e000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5574366af440 con 0x5574368a0b90 2024-05-21T01:25:56.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.958+0000 7fdfc6e7e000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5574366b3480 con 0x5574368a5b60 2024-05-21T01:25:56.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.958+0000 7fdfc1000640 1 --2- 172.21.15.63:0/3819704177 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fdf9c06f430 0x7fdf9c0718f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fdfb00aa000 tx=0x7fdfbc0c7730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:25:56.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.958+0000 7fdfbbe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55743686a8d0 0x5574368a5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:56.964 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.958+0000 7fdfbbe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55743686a8d0 0x5574368a5620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39934/0 (socket says 172.21.15.63:39934) 2024-05-21T01:25:56.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.958+0000 7fdfbbe00640 1 -- 172.21.15.63:0/2478036128 learned_addr learned my addr 172.21.15.63:0/2478036128 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:25:56.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.958+0000 7fdfc1000640 1 --2- 172.21.15.63:0/2478036128 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5574368a0b90 0x55743686a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:56.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.958+0000 7fdfc1a00640 1 --2- 172.21.15.63:0/2478036128 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5574368a5b60 0x5574368a5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:56.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.958+0000 7fdfbbe00640 1 -- 172.21.15.63:0/2478036128 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5574368a5b60 msgr2=0x5574368a5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:25:56.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.958+0000 7fdfbbe00640 1 --2- 172.21.15.63:0/2478036128 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5574368a5b60 0x5574368a5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:56.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.958+0000 7fdfbbe00640 1 -- 172.21.15.63:0/2478036128 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5574368a0b90 msgr2=0x55743686a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:25:56.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.958+0000 7fdfbbe00640 1 --2- 172.21.15.63:0/2478036128 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5574368a0b90 0x55743686a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:56.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.958+0000 7fdfbbe00640 1 -- 172.21.15.63:0/2478036128 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55743675b370 con 0x55743686a8d0 2024-05-21T01:25:56.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.958+0000 7fdfbbe00640 1 --2- 172.21.15.63:0/2478036128 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55743686a8d0 0x5574368a5620 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fdfa805aec0 tx=0x7fdfa805a9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cfddd5489a4f9c9 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:25:56.965 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.958+0000 7fdfad600640 1 -- 172.21.15.63:0/2478036128 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfa805b1c0 con 0x55743686a8d0 2024-05-21T01:25:56.966 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.958+0000 7fdfad600640 1 -- 172.21.15.63:0/2478036128 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfa808e030 con 0x55743686a8d0 2024-05-21T01:25:56.966 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.958+0000 7fdfad600640 1 -- 172.21.15.63:0/2478036128 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfa805f570 con 0x55743686a8d0 2024-05-21T01:25:56.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.962+0000 7fdfc6e7e000 1 -- 172.21.15.63:0/2478036128 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55743686a8d0 msgr2=0x5574368a5620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:25:56.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.962+0000 7fdfc6e7e000 1 --2- 172.21.15.63:0/2478036128 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55743686a8d0 0x5574368a5620 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fdfa805aec0 tx=0x7fdfa805a9f0 comp rx=0 tx=0).stop 2024-05-21T01:25:56.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.962+0000 7fdfc6e7e000 1 -- 172.21.15.63:0/2478036128 shutdown_connections 2024-05-21T01:25:56.970 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.962+0000 7fdfc6e7e000 1 --2- 172.21.15.63:0/2478036128 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5574368a5b60 0x5574368a5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:56.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.962+0000 7fdfc6e7e000 1 --2- 172.21.15.63:0/2478036128 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55743686a8d0 0x5574368a5620 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:56.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.962+0000 7fdfc6e7e000 1 --2- 172.21.15.63:0/2478036128 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5574368a0b90 0x55743686a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:56.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.962+0000 7fdfc6e7e000 1 -- 172.21.15.63:0/2478036128 >> 172.21.15.63:0/2478036128 conn(0x55743674cf90 msgr2=0x5574368a33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:25:56.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.962+0000 7fdfc6e7e000 1 -- 172.21.15.63:0/2478036128 shutdown_connections 2024-05-21T01:25:56.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.962+0000 7fdfc6e7e000 1 -- 172.21.15.63:0/2478036128 wait complete. 2024-05-21T01:25:56.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.962+0000 7fdfc6e7e000 1 -- start start 2024-05-21T01:25:56.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.962+0000 7fdfc6e7e000 1 Processor -- start 2024-05-21T01:25:56.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.962+0000 7fdfc6e7e000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55743686a8d0 0x55743689f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:56.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.962+0000 7fdfc6e7e000 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5574368a0b90 0x55743689fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:56.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.962+0000 7fdfc6e7e000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5574368a5b60 0x5574368ab3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:56.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.962+0000 7fdfc6e7e000 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x557436658170 con 0x5574368a0b90 2024-05-21T01:25:56.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.962+0000 7fdfc6e7e000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5574366564d0 con 0x55743686a8d0 2024-05-21T01:25:56.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.962+0000 7fdfc6e7e000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5574366b7ab0 con 0x5574368a5b60 2024-05-21T01:25:56.971 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.962+0000 7fdfc6e7e000 10 client.0 _ll_register_callbacks cb 0x557436651ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-21T01:25:56.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.962+0000 7fdfbbe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5574368a0b90 0x55743689fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:56.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.962+0000 7fdfbbe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5574368a0b90 0x55743689fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39950/0 (socket says 172.21.15.63:39950) 2024-05-21T01:25:56.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.962+0000 7fdfbbe00640 1 -- 172.21.15.63:0/843398217 learned_addr learned my addr 172.21.15.63:0/843398217 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:25:56.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.962+0000 7fdfc1000640 1 --2- 172.21.15.63:0/843398217 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55743686a8d0 0x55743689f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:56.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.962+0000 7fdfc1a00640 1 --2- 172.21.15.63:0/843398217 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5574368a5b60 0x5574368ab3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:56.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.962+0000 7fdfbbe00640 1 -- 172.21.15.63:0/843398217 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5574368a5b60 msgr2=0x5574368ab3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:25:56.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.962+0000 7fdfbbe00640 1 --2- 172.21.15.63:0/843398217 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5574368a5b60 0x5574368ab3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:56.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.962+0000 7fdfbbe00640 1 -- 172.21.15.63:0/843398217 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55743686a8d0 msgr2=0x55743689f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:25:56.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.962+0000 7fdfbbe00640 1 --2- 172.21.15.63:0/843398217 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55743686a8d0 0x55743689f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:56.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.962+0000 7fdfbbe00640 1 -- 172.21.15.63:0/843398217 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5574366f9260 con 0x5574368a0b90 2024-05-21T01:25:56.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.962+0000 7fdfc1000640 1 --2- 172.21.15.63:0/843398217 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55743686a8d0 0x55743689f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T01:25:56.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.962+0000 7fdfbbe00640 1 --2- 172.21.15.63:0/843398217 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5574368a0b90 0x55743689fc70 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fdfa80571f0 tx=0x7fdfa8000fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac2b86578a565996 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:25:56.972 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.962+0000 7fdfa2000640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-05-21T01:25:56.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.962+0000 7fdfa2000640 1 -- 172.21.15.63:0/843398217 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfa805f370 con 0x5574368a0b90 2024-05-21T01:25:56.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.962+0000 7fdfc6e7e000 1 -- 172.21.15.63:0/843398217 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdfa808e030 con 0x5574368a0b90 2024-05-21T01:25:56.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.962+0000 7fdfa2000640 1 -- 172.21.15.63:0/843398217 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7fdfa801a9d0 con 0x5574368a0b90 2024-05-21T01:25:56.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.962+0000 7fdfa2000640 1 -- 172.21.15.63:0/843398217 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7fdfa8082050 con 0x5574368a0b90 2024-05-21T01:25:56.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.962+0000 7fdfc6e7e000 10 client.5034 fetch_fsmap learned FSMap version 15 2024-05-21T01:25:56.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.962+0000 7fdfc6e7e000 1 -- 172.21.15.63:0/843398217 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x5574366566e0 con 0x5574368a0b90 2024-05-21T01:25:56.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.966+0000 7fdfa2000640 1 -- 172.21.15.63:0/843398217 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfa808e030 con 0x5574368a0b90 2024-05-21T01:25:56.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.966+0000 7fdfa2000640 1 -- 172.21.15.63:0/843398217 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 15) ==== 4752+0+0 (secure 0 0 0) 0x7fdfa805a420 con 0x5574368a0b90 2024-05-21T01:25:56.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.966+0000 7fdfc6e7e000 10 client.5034 fetch_fsmap finished waiting for FSMap version 15 2024-05-21T01:25:56.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.966+0000 7fdfc6e7e000 10 client.5034 resolve_mds: validated gid 4276 aka daemon mds.c 2024-05-21T01:25:56.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.966+0000 7fdfc6e7e000 20 client.5034 populate_metadata read hostname 'smithi063' 2024-05-21T01:25:56.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.966+0000 7fdfc6e7e000 1 --2- 172.21.15.63:0/843398217 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x5574368ac120 0x5574368ac530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:56.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.966+0000 7fdfc6e7e000 4 client.5034 mds_command: new command op to 4276 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-21T01:25:56.973 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.966+0000 7fdfc6e7e000 1 -- 172.21.15.63:0/843398217 --> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55743664b060 con 0x5574368ac120 2024-05-21T01:25:56.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.966+0000 7fdfc1000640 1 --2- 172.21.15.63:0/843398217 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x5574368ac120 0x5574368ac530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:56.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.966+0000 7fdfc1000640 1 --2- 172.21.15.63:0/843398217 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x5574368ac120 0x5574368ac530 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42e22f9c93c023f1 server_cookie=e84ae57cf9190d8b in_seq=0 out_seq=0 2024-05-21T01:25:56.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.966+0000 7fdfa2000640 10 client.5034 ms_handle_connect on v2:172.21.15.63:6834/2892727989 2024-05-21T01:25:56.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.966+0000 7fdfa2000640 1 -- 172.21.15.63:0/843398217 <== mds.0 v2:172.21.15.63:6834/2892727989 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x55743664b060 con 0x5574368ac120 2024-05-21T01:25:56.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.966+0000 7fdfa2000640 10 client.5034 handle_command_reply: tid=0 2024-05-21T01:25:56.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.966+0000 7fdfc6e7e000 1 client.5034 shutdown 2024-05-21T01:25:56.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.966+0000 7fdfc6e7e000 1 -- 172.21.15.63:0/843398217 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5574368a0b90 msgr2=0x55743689fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:25:56.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.966+0000 7fdfc6e7e000 1 --2- 172.21.15.63:0/843398217 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5574368a0b90 0x55743689fc70 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fdfa80571f0 tx=0x7fdfa8000fa0 comp rx=0 tx=0).stop 2024-05-21T01:25:56.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.966+0000 7fdfc6e7e000 1 -- 172.21.15.63:0/843398217 shutdown_connections 2024-05-21T01:25:56.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.966+0000 7fdfc6e7e000 1 --2- 172.21.15.63:0/843398217 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x5574368ac120 0x5574368ac530 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:56.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.966+0000 7fdfc6e7e000 1 --2- 172.21.15.63:0/843398217 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5574368a5b60 0x5574368ab3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:56.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.966+0000 7fdfc6e7e000 1 --2- 172.21.15.63:0/843398217 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5574368a0b90 0x55743689fc70 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:56.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.966+0000 7fdfc6e7e000 1 --2- 172.21.15.63:0/843398217 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55743686a8d0 0x55743689f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:56.974 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.966+0000 7fdfa2000640 0 client.5034 ms_handle_reset on v2:172.21.15.63:6834/2892727989 2024-05-21T01:25:56.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.966+0000 7fdfc6e7e000 1 -- 172.21.15.63:0/843398217 >> 172.21.15.63:0/843398217 conn(0x55743674cf90 msgr2=0x557436869b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:25:56.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.966+0000 7fdfc6e7e000 1 -- 172.21.15.63:0/843398217 shutdown_connections 2024-05-21T01:25:56.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.966+0000 7fdfc6e7e000 1 -- 172.21.15.63:0/843398217 wait complete. 2024-05-21T01:25:56.975 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.966+0000 7fdfc6e7e000 20 client.5034 trim_cache size 0 max 16384 2024-05-21T01:25:56.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.982+0000 7fdfc6e7e000 1 Processor -- start 2024-05-21T01:25:56.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.986+0000 7fdfc6e7e000 1 -- start start 2024-05-21T01:25:56.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.986+0000 7fdfc6e7e000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55743686a8d0 0x5574368610f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:56.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.986+0000 7fdfc6e7e000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5574368a0b90 0x557436861630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:56.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.986+0000 7fdfc6e7e000 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5574368a5b60 0x5574368bfda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:56.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.986+0000 7fdfc6e7e000 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fdfbc2024e0 con 0x5574368a5b60 2024-05-21T01:25:56.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.986+0000 7fdfc6e7e000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fdfbc201910 con 0x55743686a8d0 2024-05-21T01:25:56.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.986+0000 7fdfc6e7e000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fdfbc201e90 con 0x5574368a0b90 2024-05-21T01:25:56.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.986+0000 7fdfc1a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5574368a5b60 0x5574368bfda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:56.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.986+0000 7fdfc1a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5574368a5b60 0x5574368bfda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39958/0 (socket says 172.21.15.63:39958) 2024-05-21T01:25:56.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.986+0000 7fdfc1a00640 1 -- 172.21.15.63:0/2541472013 learned_addr learned my addr 172.21.15.63:0/2541472013 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:25:56.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.986+0000 7fdfc1000640 1 --2- 172.21.15.63:0/2541472013 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55743686a8d0 0x5574368610f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:56.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.986+0000 7fdfbbe00640 1 --2- 172.21.15.63:0/2541472013 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5574368a0b90 0x557436861630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:56.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.986+0000 7fdfc1a00640 1 -- 172.21.15.63:0/2541472013 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5574368a0b90 msgr2=0x557436861630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:25:56.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.986+0000 7fdfc1a00640 1 --2- 172.21.15.63:0/2541472013 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5574368a0b90 0x557436861630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:56.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.986+0000 7fdfc1a00640 1 -- 172.21.15.63:0/2541472013 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55743686a8d0 msgr2=0x5574368610f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:25:56.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.986+0000 7fdfc1a00640 1 --2- 172.21.15.63:0/2541472013 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55743686a8d0 0x5574368610f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:56.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.986+0000 7fdfc1a00640 1 -- 172.21.15.63:0/2541472013 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557436734cf0 con 0x5574368a5b60 2024-05-21T01:25:56.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.986+0000 7fdfc1a00640 1 --2- 172.21.15.63:0/2541472013 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5574368a5b60 0x5574368bfda0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fdfa4004790 tx=0x7fdfb4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7a7aeaec4df89b2 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:25:56.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.986+0000 7fdfacc00640 1 -- 172.21.15.63:0/2541472013 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfb40039a0 con 0x5574368a5b60 2024-05-21T01:25:56.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.986+0000 7fdfacc00640 1 -- 172.21.15.63:0/2541472013 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfb4003b60 con 0x5574368a5b60 2024-05-21T01:25:56.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.986+0000 7fdfacc00640 1 -- 172.21.15.63:0/2541472013 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfb40186f0 con 0x5574368a5b60 2024-05-21T01:25:56.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.986+0000 7fdfc6e7e000 1 -- 172.21.15.63:0/2541472013 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5574368a5b60 msgr2=0x5574368bfda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:25:56.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.986+0000 7fdfc6e7e000 1 --2- 172.21.15.63:0/2541472013 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5574368a5b60 0x5574368bfda0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fdfa4004790 tx=0x7fdfb4009750 comp rx=0 tx=0).stop 2024-05-21T01:25:56.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.986+0000 7fdfc6e7e000 1 -- 172.21.15.63:0/2541472013 shutdown_connections 2024-05-21T01:25:56.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.986+0000 7fdfc6e7e000 1 --2- 172.21.15.63:0/2541472013 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5574368a5b60 0x5574368bfda0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:56.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.986+0000 7fdfc6e7e000 1 --2- 172.21.15.63:0/2541472013 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5574368a0b90 0x557436861630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:56.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.986+0000 7fdfc6e7e000 1 --2- 172.21.15.63:0/2541472013 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55743686a8d0 0x5574368610f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:56.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.986+0000 7fdfc6e7e000 1 -- 172.21.15.63:0/2541472013 >> 172.21.15.63:0/2541472013 conn(0x55743674cf90 msgr2=0x5574368ab390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:25:56.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.986+0000 7fdfc6e7e000 1 -- 172.21.15.63:0/2541472013 shutdown_connections 2024-05-21T01:25:56.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.986+0000 7fdfc6e7e000 1 -- 172.21.15.63:0/2541472013 wait complete. 2024-05-21T01:25:56.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.986+0000 7fdfc6e7e000 1 -- start start 2024-05-21T01:25:56.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.986+0000 7fdfc6e7e000 1 Processor -- start 2024-05-21T01:25:56.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.990+0000 7fdfc6e7e000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55743686a8d0 0x557436866540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:56.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.990+0000 7fdfc6e7e000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5574368a0b90 0x557436866a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:56.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.990+0000 7fdfc6e7e000 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5574368a5b60 0x557436866fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:56.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.990+0000 7fdfc6e7e000 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5574366ab5f0 con 0x5574368a5b60 2024-05-21T01:25:56.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.990+0000 7fdfc6e7e000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x557436734860 con 0x5574368a0b90 2024-05-21T01:25:56.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.990+0000 7fdfc6e7e000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x557436647c50 con 0x55743686a8d0 2024-05-21T01:25:56.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.990+0000 7fdfc6e7e000 10 client.0 _ll_register_callbacks cb 0x7fdfa8085f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-21T01:25:56.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.990+0000 7fdfc1a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5574368a5b60 0x557436866fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:56.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.990+0000 7fdfc1a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5574368a5b60 0x557436866fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39960/0 (socket says 172.21.15.63:39960) 2024-05-21T01:25:56.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.990+0000 7fdfc1a00640 1 -- 172.21.15.63:0/4221327312 learned_addr learned my addr 172.21.15.63:0/4221327312 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:25:56.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.990+0000 7fdfbbe00640 1 --2- 172.21.15.63:0/4221327312 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5574368a0b90 0x557436866a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:56.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.990+0000 7fdfc1000640 1 --2- 172.21.15.63:0/4221327312 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55743686a8d0 0x557436866540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:56.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.990+0000 7fdfc1a00640 1 -- 172.21.15.63:0/4221327312 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55743686a8d0 msgr2=0x557436866540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:25:56.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.990+0000 7fdfc1a00640 1 --2- 172.21.15.63:0/4221327312 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55743686a8d0 0x557436866540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:56.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.990+0000 7fdfc1a00640 1 -- 172.21.15.63:0/4221327312 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5574368a0b90 msgr2=0x557436866a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:25:56.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.990+0000 7fdfc1a00640 1 --2- 172.21.15.63:0/4221327312 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5574368a0b90 0x557436866a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:56.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.990+0000 7fdfc1a00640 1 -- 172.21.15.63:0/4221327312 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557436661ca0 con 0x5574368a5b60 2024-05-21T01:25:56.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.990+0000 7fdfc1000640 1 --2- 172.21.15.63:0/4221327312 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55743686a8d0 0x557436866540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T01:25:56.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.990+0000 7fdfc1a00640 1 --2- 172.21.15.63:0/4221327312 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5574368a5b60 0x557436866fc0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fdfb400b010 tx=0x7fdfb4004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99cad8094131b88b server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:25:56.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.990+0000 7fdfa2000640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-05-21T01:25:56.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.990+0000 7fdfa2000640 1 -- 172.21.15.63:0/4221327312 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfb4004230 con 0x5574368a5b60 2024-05-21T01:25:56.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.990+0000 7fdfa2000640 1 -- 172.21.15.63:0/4221327312 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7fdfb40043d0 con 0x5574368a5b60 2024-05-21T01:25:56.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.990+0000 7fdfc6e7e000 1 -- 172.21.15.63:0/4221327312 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdfb4003b60 con 0x5574368a5b60 2024-05-21T01:25:56.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.990+0000 7fdfa2000640 1 -- 172.21.15.63:0/4221327312 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7fdfb4036050 con 0x5574368a5b60 2024-05-21T01:25:56.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.990+0000 7fdfc6e7e000 10 client.5040 fetch_fsmap learned FSMap version 15 2024-05-21T01:25:56.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.990+0000 7fdfc6e7e000 1 -- 172.21.15.63:0/4221327312 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x5574366469c0 con 0x5574368a5b60 2024-05-21T01:25:56.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.990+0000 7fdfa2000640 1 -- 172.21.15.63:0/4221327312 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfb4003b60 con 0x5574368a5b60 2024-05-21T01:25:56.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.990+0000 7fdfa2000640 1 -- 172.21.15.63:0/4221327312 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 15) ==== 4752+0+0 (secure 0 0 0) 0x7fdfb4039020 con 0x5574368a5b60 2024-05-21T01:25:56.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.990+0000 7fdfc6e7e000 10 client.5040 fetch_fsmap finished waiting for FSMap version 15 2024-05-21T01:25:56.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.990+0000 7fdfc6e7e000 10 client.5040 resolve_mds: validated gid 4276 aka daemon mds.c 2024-05-21T01:25:56.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.990+0000 7fdfc6e7e000 20 client.5040 populate_metadata read hostname 'smithi063' 2024-05-21T01:25:56.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.990+0000 7fdfc6e7e000 1 --2- 172.21.15.63:0/4221327312 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x5574368679e0 0x557436926e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:56.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.990+0000 7fdfc6e7e000 4 client.5040 mds_command: new command op to 4276 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "c699e4d7", "release": true, "await": true}] 2024-05-21T01:25:56.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.990+0000 7fdfc6e7e000 1 -- 172.21.15.63:0/4221327312 --> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] -- command(tid 0: {"prefix": "quiesce db", "set_id": "c699e4d7", "release": true, "await": true}) -- 0x5574366c17f0 con 0x5574368679e0 2024-05-21T01:25:56.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.990+0000 7fdfc1000640 1 --2- 172.21.15.63:0/4221327312 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x5574368679e0 0x557436926e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:56.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.990+0000 7fdfc1000640 1 --2- 172.21.15.63:0/4221327312 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x5574368679e0 0x557436926e80 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1df1fc2b7bff94b server_cookie=297f3a8319b8a0bb in_seq=0 out_seq=0 2024-05-21T01:25:56.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.990+0000 7fdfa2000640 10 client.5040 ms_handle_connect on v2:172.21.15.63:6834/2892727989 2024-05-21T01:25:56.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.994+0000 7fdfa2000640 1 -- 172.21.15.63:0/4221327312 <== mds.0 v2:172.21.15.63:6834/2892727989 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x5574366c17f0 con 0x5574368679e0 2024-05-21T01:25:56.999 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.994+0000 7fdfa2000640 10 client.5040 handle_command_reply: tid=0 2024-05-21T01:25:57.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.994+0000 7fdfc6e7e000 1 client.5040 shutdown 2024-05-21T01:25:57.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.994+0000 7fdfc6e7e000 1 -- 172.21.15.63:0/4221327312 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5574368a5b60 msgr2=0x557436866fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:25:57.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.994+0000 7fdfc6e7e000 1 --2- 172.21.15.63:0/4221327312 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5574368a5b60 0x557436866fc0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fdfb400b010 tx=0x7fdfb4004a50 comp rx=0 tx=0).stop 2024-05-21T01:25:57.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.994+0000 7fdfc6e7e000 1 -- 172.21.15.63:0/4221327312 shutdown_connections 2024-05-21T01:25:57.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.994+0000 7fdfc6e7e000 1 --2- 172.21.15.63:0/4221327312 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x5574368679e0 0x557436926e80 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:57.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.994+0000 7fdfc6e7e000 1 --2- 172.21.15.63:0/4221327312 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5574368a5b60 0x557436866fc0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:57.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.994+0000 7fdfc6e7e000 1 --2- 172.21.15.63:0/4221327312 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5574368a0b90 0x557436866a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:57.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.994+0000 7fdfc6e7e000 1 --2- 172.21.15.63:0/4221327312 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55743686a8d0 0x557436866540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:57.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.994+0000 7fdfc6e7e000 1 -- 172.21.15.63:0/4221327312 >> 172.21.15.63:0/4221327312 conn(0x55743674cf90 msgr2=0x5574368a9f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:25:57.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.994+0000 7fdfa2000640 0 client.5040 ms_handle_reset on v2:172.21.15.63:6834/2892727989 2024-05-21T01:25:57.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.994+0000 7fdfc6e7e000 1 -- 172.21.15.63:0/4221327312 shutdown_connections 2024-05-21T01:25:57.000 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.994+0000 7fdfc6e7e000 1 -- 172.21.15.63:0/4221327312 wait complete. 2024-05-21T01:25:57.001 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.994+0000 7fdfc6e7e000 20 client.5040 trim_cache size 0 max 16384 2024-05-21T01:25:57.001 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-05-21T01:25:57.001 INFO:teuthology.orchestra.run.smithi063.stdout: "epoch": 15, 2024-05-21T01:25:57.001 INFO:teuthology.orchestra.run.smithi063.stdout: "leader": 4276, 2024-05-21T01:25:57.001 INFO:teuthology.orchestra.run.smithi063.stdout: "set_version": 20, 2024-05-21T01:25:57.001 INFO:teuthology.orchestra.run.smithi063.stdout: "sets": { 2024-05-21T01:25:57.001 INFO:teuthology.orchestra.run.smithi063.stdout: "c699e4d7": { 2024-05-21T01:25:57.001 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 20, 2024-05-21T01:25:57.002 INFO:teuthology.orchestra.run.smithi063.stdout: "age_ref": 0.0, 2024-05-21T01:25:57.002 INFO:teuthology.orchestra.run.smithi063.stdout: "state": { 2024-05-21T01:25:57.002 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "RELEASED", 2024-05-21T01:25:57.002 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 0.0 2024-05-21T01:25:57.002 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-05-21T01:25:57.002 INFO:teuthology.orchestra.run.smithi063.stdout: "timeout": 90.0, 2024-05-21T01:25:57.002 INFO:teuthology.orchestra.run.smithi063.stdout: "expiration": 146.0, 2024-05-21T01:25:57.002 INFO:teuthology.orchestra.run.smithi063.stdout: "members": { 2024-05-21T01:25:57.002 INFO:teuthology.orchestra.run.smithi063.stdout: "file:/": { 2024-05-21T01:25:57.003 INFO:teuthology.orchestra.run.smithi063.stdout: "excluded": false, 2024-05-21T01:25:57.003 INFO:teuthology.orchestra.run.smithi063.stdout: "state": { 2024-05-21T01:25:57.003 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "RELEASED", 2024-05-21T01:25:57.003 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 0.0 2024-05-21T01:25:57.003 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-05-21T01:25:57.003 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-05-21T01:25:57.003 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-05-21T01:25:57.003 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-05-21T01:25:57.003 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-05-21T01:25:57.003 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-05-21T01:25:57.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.994+0000 7fdfc3a00640 1 -- 172.21.15.63:0/3819704177 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fdf9c06f430 msgr2=0x7fdf9c0718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:25:57.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.994+0000 7fdfc3a00640 1 --2- 172.21.15.63:0/3819704177 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fdf9c06f430 0x7fdf9c0718f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fdfb00aa000 tx=0x7fdfbc0c7730 comp rx=0 tx=0).stop 2024-05-21T01:25:57.004 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.994+0000 7fdfc3a00640 1 -- 172.21.15.63:0/3819704177 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdfbc14fe70 msgr2=0x7fdfbc1f4ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:25:57.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.994+0000 7fdfc3a00640 1 --2- 172.21.15.63:0/3819704177 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdfbc14fe70 0x7fdfbc1f4ef0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fdfa800e4b0 tx=0x7fdfa800e970 comp rx=0 tx=0).stop 2024-05-21T01:25:57.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.994+0000 7fdfc3a00640 1 -- 172.21.15.63:0/3819704177 shutdown_connections 2024-05-21T01:25:57.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.994+0000 7fdfc3a00640 1 --2- 172.21.15.63:0/3819704177 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fdf9c06f430 0x7fdf9c0718f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:57.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.994+0000 7fdfc3a00640 1 --2- 172.21.15.63:0/3819704177 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdfbc1f5430 0x7fdfbc14e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:57.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.994+0000 7fdfc3a00640 1 --2- 172.21.15.63:0/3819704177 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdfbc14fe70 0x7fdfbc1f4ef0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:57.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.994+0000 7fdfc3a00640 1 --2- 172.21.15.63:0/3819704177 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdfa4003a40 0x7fdfbc14f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:57.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.994+0000 7fdfc3a00640 1 -- 172.21.15.63:0/3819704177 >> 172.21.15.63:0/3819704177 conn(0x7fdfbc068460 msgr2=0x7fdfbc071b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:25:57.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.994+0000 7fdfc3a00640 1 -- 172.21.15.63:0/3819704177 shutdown_connections 2024-05-21T01:25:57.005 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:56.994+0000 7fdfc3a00640 1 -- 172.21.15.63:0/3819704177 wait complete. 2024-05-21T01:25:57.016 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'c699e4d7', total seconds elapsed: 26.6 2024-05-21T01:25:57.017 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 26.0 2024-05-21T01:25:57.017 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-21T01:25:57.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.154+0000 7efc39400640 1 Processor -- start 2024-05-21T01:25:57.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.154+0000 7efc39400640 1 -- start start 2024-05-21T01:25:57.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.154+0000 7efc39400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efc3406f5d0 0x7efc340c8a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:57.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.154+0000 7efc39400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7efc3406f9b0 0x7efc34152a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:57.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.154+0000 7efc39400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7efc3415ce40 0x7efc34152f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:57.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.154+0000 7efc39400640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7efc34072550 con 0x7efc3415ce40 2024-05-21T01:25:57.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.154+0000 7efc39400640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7efc34159100 con 0x7efc3406f9b0 2024-05-21T01:25:57.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.154+0000 7efc39400640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7efc341593e0 con 0x7efc3406f5d0 2024-05-21T01:25:57.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.154+0000 7efc33200640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7efc3415ce40 0x7efc34152f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:57.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.154+0000 7efc33200640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7efc3415ce40 0x7efc34152f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39966/0 (socket says 172.21.15.63:39966) 2024-05-21T01:25:57.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.154+0000 7efc33200640 1 -- 172.21.15.63:0/2076990673 learned_addr learned my addr 172.21.15.63:0/2076990673 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:25:57.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.154+0000 7efc32800640 1 --2- 172.21.15.63:0/2076990673 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efc3406f5d0 0x7efc340c8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:57.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.154+0000 7efc29e00640 1 --2- 172.21.15.63:0/2076990673 >> v2:172.21.15.131:3300/0 conn(0x7efc3406f9b0 0x7efc34152a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:57.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.158+0000 7efc33200640 1 -- 172.21.15.63:0/2076990673 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efc3406f5d0 msgr2=0x7efc340c8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:25:57.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.158+0000 7efc33200640 1 --2- 172.21.15.63:0/2076990673 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efc3406f5d0 0x7efc340c8a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:57.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.158+0000 7efc33200640 1 -- 172.21.15.63:0/2076990673 >> v2:172.21.15.131:3300/0 conn(0x7efc3406f9b0 msgr2=0x7efc34152a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:25:57.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.158+0000 7efc33200640 1 --2- 172.21.15.63:0/2076990673 >> v2:172.21.15.131:3300/0 conn(0x7efc3406f9b0 0x7efc34152a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:57.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.158+0000 7efc33200640 1 -- 172.21.15.63:0/2076990673 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc341596c0 con 0x7efc3415ce40 2024-05-21T01:25:57.162 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.158+0000 7efc33200640 1 --2- 172.21.15.63:0/2076990673 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efc3415ce40 0x7efc34152f80 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7efc340cae00 tx=0x7efc2c01ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee730562c904fe58 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:25:57.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.158+0000 7efc31e00640 1 -- 172.21.15.63:0/2076990673 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc2c0a7980 con 0x7efc3415ce40 2024-05-21T01:25:57.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.158+0000 7efc31e00640 1 -- 172.21.15.63:0/2076990673 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc2c0a7b20 con 0x7efc3415ce40 2024-05-21T01:25:57.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.158+0000 7efc31e00640 1 -- 172.21.15.63:0/2076990673 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc2c0af3f0 con 0x7efc3415ce40 2024-05-21T01:25:57.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.158+0000 7efc39400640 1 -- 172.21.15.63:0/2076990673 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efc3415ce40 msgr2=0x7efc34152f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:25:57.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.158+0000 7efc39400640 1 --2- 172.21.15.63:0/2076990673 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efc3415ce40 0x7efc34152f80 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7efc340cae00 tx=0x7efc2c01ec00 comp rx=0 tx=0).stop 2024-05-21T01:25:57.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.158+0000 7efc39400640 1 -- 172.21.15.63:0/2076990673 shutdown_connections 2024-05-21T01:25:57.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.158+0000 7efc39400640 1 --2- 172.21.15.63:0/2076990673 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efc3415ce40 0x7efc34152f80 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:57.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.158+0000 7efc39400640 1 --2- 172.21.15.63:0/2076990673 >> v2:172.21.15.131:3300/0 conn(0x7efc3406f9b0 0x7efc34152a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:57.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.158+0000 7efc39400640 1 --2- 172.21.15.63:0/2076990673 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efc3406f5d0 0x7efc340c8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:57.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.158+0000 7efc39400640 1 -- 172.21.15.63:0/2076990673 >> 172.21.15.63:0/2076990673 conn(0x7efc34068460 msgr2=0x7efc34068870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:25:57.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.158+0000 7efc39400640 1 -- 172.21.15.63:0/2076990673 shutdown_connections 2024-05-21T01:25:57.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.162+0000 7efc39400640 1 -- 172.21.15.63:0/2076990673 wait complete. 2024-05-21T01:25:57.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.162+0000 7efc39400640 1 Processor -- start 2024-05-21T01:25:57.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.162+0000 7efc39400640 1 -- start start 2024-05-21T01:25:57.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.162+0000 7efc39400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efc3406f5d0 0x7efc34153510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:57.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.162+0000 7efc39400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efc3406f9b0 0x7efc341f3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:57.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.162+0000 7efc39400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efc3415ce40 0x7efc3406c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:57.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.162+0000 7efc39400640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7efc34071630 con 0x7efc3406f9b0 2024-05-21T01:25:57.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.162+0000 7efc39400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7efc340714b0 con 0x7efc3415ce40 2024-05-21T01:25:57.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.162+0000 7efc39400640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7efc340717b0 con 0x7efc3406f5d0 2024-05-21T01:25:57.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.162+0000 7efc29e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efc3406f9b0 0x7efc341f3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:57.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.162+0000 7efc29e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efc3406f9b0 0x7efc341f3dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39976/0 (socket says 172.21.15.63:39976) 2024-05-21T01:25:57.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.162+0000 7efc29e00640 1 -- 172.21.15.63:0/2436560654 learned_addr learned my addr 172.21.15.63:0/2436560654 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:25:57.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.162+0000 7efc32800640 1 --2- 172.21.15.63:0/2436560654 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efc3406f5d0 0x7efc34153510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:57.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.162+0000 7efc33200640 1 --2- 172.21.15.63:0/2436560654 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efc3415ce40 0x7efc3406c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:57.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.162+0000 7efc29e00640 1 -- 172.21.15.63:0/2436560654 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efc3406f5d0 msgr2=0x7efc34153510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:25:57.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.162+0000 7efc29e00640 1 --2- 172.21.15.63:0/2436560654 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efc3406f5d0 0x7efc34153510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:57.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.162+0000 7efc29e00640 1 -- 172.21.15.63:0/2436560654 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efc3415ce40 msgr2=0x7efc3406c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:25:57.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.162+0000 7efc29e00640 1 --2- 172.21.15.63:0/2436560654 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efc3415ce40 0x7efc3406c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:57.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.162+0000 7efc29e00640 1 -- 172.21.15.63:0/2436560654 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc3415bac0 con 0x7efc3406f9b0 2024-05-21T01:25:57.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.162+0000 7efc29e00640 1 --2- 172.21.15.63:0/2436560654 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efc3406f9b0 0x7efc341f3dc0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7efc1c00d800 tx=0x7efc1c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:25:57.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.162+0000 7efc2b400640 1 -- 172.21.15.63:0/2436560654 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc1c004020 con 0x7efc3406f9b0 2024-05-21T01:25:57.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.162+0000 7efc2b400640 1 -- 172.21.15.63:0/2436560654 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc1c0041c0 con 0x7efc3406f9b0 2024-05-21T01:25:57.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.162+0000 7efc2b400640 1 -- 172.21.15.63:0/2436560654 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc1c0043b0 con 0x7efc3406f9b0 2024-05-21T01:25:57.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.162+0000 7efc39400640 1 -- 172.21.15.63:0/2436560654 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc341f4300 con 0x7efc3406f9b0 2024-05-21T01:25:57.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.166+0000 7efc39400640 1 -- 172.21.15.63:0/2436560654 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc3414e700 con 0x7efc3406f9b0 2024-05-21T01:25:57.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.166+0000 7efc39400640 1 -- 172.21.15.63:0/2436560654 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc340507f0 con 0x7efc3406f9b0 2024-05-21T01:25:57.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.166+0000 7efc2b400640 1 -- 172.21.15.63:0/2436560654 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7efc1c01b020 con 0x7efc3406f9b0 2024-05-21T01:25:57.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.166+0000 7efc2b400640 1 --2- 172.21.15.63:0/2436560654 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7efc1006f400 0x7efc100718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:57.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.166+0000 7efc2b400640 1 -- 172.21.15.63:0/2436560654 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7efc1c08f4b0 con 0x7efc3406f9b0 2024-05-21T01:25:57.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.166+0000 7efc32800640 1 --2- 172.21.15.63:0/2436560654 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7efc1006f400 0x7efc100718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:57.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.170+0000 7efc32800640 1 --2- 172.21.15.63:0/2436560654 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7efc1006f400 0x7efc100718c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7efc2400ba30 tx=0x7efc24008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:25:57.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.170+0000 7efc2b400640 1 -- 172.21.15.63:0/2436560654 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7efc1c05c020 con 0x7efc3406f9b0 2024-05-21T01:25:57.349 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-21T01:25:57.352 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-21T01:25:57.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.370+0000 7efc39400640 1 -- 172.21.15.63:0/2436560654 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efc3414fa60 con 0x7efc3406f9b0 2024-05-21T01:25:57.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.370+0000 7efc2b400640 1 -- 172.21.15.63:0/2436560654 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+6876 (secure 0 0 0) 0x7efc1c05b920 con 0x7efc3406f9b0 2024-05-21T01:25:57.374 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-05-21T01:25:57.374 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6839/3045714273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6837","nonce":3045714273},{"type":"v1","addr":"172.21.15.131:6839","nonce":3045714273}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/2978367338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":2978367338},{"type":"v1","addr":"172.21.15.131:6835","nonce":2978367338}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/3005995321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6835","nonce":3005995321},{"type":"v1","addr":"172.21.15.63:6837","nonce":3005995321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-21T01:19:53.915775+0000","modified":"2024-05-21T01:20:31.724475+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4276,"mds_1":4270,"mds_2":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"e","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.63:6833/574189772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":574189772},{"type":"v1","addr":"172.21.15.63:6833","nonce":574189772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4270":{"gid":4270,"name":"f","rank":1,"incarnation":10,"state":"up:active","state_seq":11,"addr":"172.21.15.131:6838/3071941741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":3071941741},{"type":"v1","addr":"172.21.15.131:6838","nonce":3071941741}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.63:6836/2892727989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":2892727989},{"type":"v1","addr":"172.21.15.63:6836","nonce":2892727989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4276,"qdb_cluster":[4267,4270,4276]},"id":1}]} 2024-05-21T01:25:57.375 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 15 2024-05-21T01:25:57.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.374+0000 7efc39400640 1 -- 172.21.15.63:0/2436560654 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7efc1006f400 msgr2=0x7efc100718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:25:57.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.374+0000 7efc39400640 1 --2- 172.21.15.63:0/2436560654 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7efc1006f400 0x7efc100718c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7efc2400ba30 tx=0x7efc24008040 comp rx=0 tx=0).stop 2024-05-21T01:25:57.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.374+0000 7efc39400640 1 -- 172.21.15.63:0/2436560654 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efc3406f9b0 msgr2=0x7efc341f3dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:25:57.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.374+0000 7efc39400640 1 --2- 172.21.15.63:0/2436560654 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efc3406f9b0 0x7efc341f3dc0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7efc1c00d800 tx=0x7efc1c00dcc0 comp rx=0 tx=0).stop 2024-05-21T01:25:57.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.374+0000 7efc39400640 1 -- 172.21.15.63:0/2436560654 shutdown_connections 2024-05-21T01:25:57.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.374+0000 7efc39400640 1 --2- 172.21.15.63:0/2436560654 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7efc1006f400 0x7efc100718c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:57.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.374+0000 7efc39400640 1 --2- 172.21.15.63:0/2436560654 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efc3415ce40 0x7efc3406c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:57.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.374+0000 7efc39400640 1 --2- 172.21.15.63:0/2436560654 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efc3406f9b0 0x7efc341f3dc0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:57.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.374+0000 7efc39400640 1 --2- 172.21.15.63:0/2436560654 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efc3406f5d0 0x7efc34153510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:57.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.374+0000 7efc39400640 1 -- 172.21.15.63:0/2436560654 >> 172.21.15.63:0/2436560654 conn(0x7efc34068460 msgr2=0x7efc34075ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:25:57.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.374+0000 7efc39400640 1 -- 172.21.15.63:0/2436560654 shutdown_connections 2024-05-21T01:25:57.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.374+0000 7efc39400640 1 -- 172.21.15.63:0/2436560654 wait complete. 2024-05-21T01:25:57.396 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4276 quiesce db / --timeout 90 --expiration 146.0 --await-for 45.0' 2024-05-21T01:25:57.396 DEBUG:teuthology.orchestra.run.smithi063:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4276 quiesce db / --timeout 90 --expiration 146.0 --await-for 45.0 2024-05-21T01:25:57.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.586+0000 7ffa53600640 1 Processor -- start 2024-05-21T01:25:57.591 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.586+0000 7ffa53600640 1 -- start start 2024-05-21T01:25:57.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.590+0000 7ffa53600640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffa4c1563e0 0x7ffa4c073650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:57.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.590+0000 7ffa53600640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ffa4c15c8e0 0x7ffa4c15fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:57.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.590+0000 7ffa53600640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa4c071ff0 con 0x7ffa4c156000 2024-05-21T01:25:57.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.590+0000 7ffa53600640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7ffa4c15cd70 con 0x7ffa4c15c8e0 2024-05-21T01:25:57.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.590+0000 7ffa53600640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7ffa4c15f580 con 0x7ffa4c1563e0 2024-05-21T01:25:57.592 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.590+0000 7ffa50c00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7ffa4c156000 0x7ffa4c06f270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:55142/0 (socket says 172.21.15.63:55142) 2024-05-21T01:25:57.593 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.590+0000 7ffa50c00640 1 -- 172.21.15.63:0/4182913671 learned_addr learned my addr 172.21.15.63:0/4182913671 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-05-21T01:25:57.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.590+0000 7ffa51600640 1 --2- 172.21.15.63:0/4182913671 >> v2:172.21.15.131:3300/0 conn(0x7ffa4c15c8e0 0x7ffa4c15fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:57.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.590+0000 7ffa4be00640 1 --2- 172.21.15.63:0/4182913671 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffa4c1563e0 0x7ffa4c073650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:57.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.590+0000 7ffa4b400640 1 -- 172.21.15.63:0/4182913671 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3460176293 0 0) 0x7ffa4c071ff0 con 0x7ffa4c156000 2024-05-21T01:25:57.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.590+0000 7ffa4b400640 1 -- 172.21.15.63:0/4182913671 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffa34003530 con 0x7ffa4c156000 2024-05-21T01:25:57.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.590+0000 7ffa4b400640 1 -- 172.21.15.63:0/4182913671 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1715506577 0 0) 0x7ffa34003530 con 0x7ffa4c156000 2024-05-21T01:25:57.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.590+0000 7ffa4b400640 1 -- 172.21.15.63:0/4182913671 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffa4c1563e0 msgr2=0x7ffa4c073650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:25:57.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.590+0000 7ffa4b400640 1 --2- 172.21.15.63:0/4182913671 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffa4c1563e0 0x7ffa4c073650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:57.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.590+0000 7ffa4b400640 1 -- 172.21.15.63:0/4182913671 >> v2:172.21.15.131:3300/0 conn(0x7ffa4c15c8e0 msgr2=0x7ffa4c15fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:25:57.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.590+0000 7ffa4b400640 1 --2- 172.21.15.63:0/4182913671 >> v2:172.21.15.131:3300/0 conn(0x7ffa4c15c8e0 0x7ffa4c15fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:57.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.590+0000 7ffa4b400640 1 -- 172.21.15.63:0/4182913671 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa4c0722d0 con 0x7ffa4c156000 2024-05-21T01:25:57.595 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.590+0000 7ffa4b400640 1 -- 172.21.15.63:0/4182913671 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 466403955 0 0) 0x7ffa40001700 con 0x7ffa4c156000 2024-05-21T01:25:57.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.590+0000 7ffa4b400640 1 -- 172.21.15.63:0/4182913671 >> v1:172.21.15.63:6789/0 conn(0x7ffa4c156000 legacy=0x7ffa4c06f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:25:57.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.590+0000 7ffa4b400640 1 --2- 172.21.15.63:0/4182913671 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffa34003a10 0x7ffa34003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:57.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.590+0000 7ffa4b400640 1 --2- 172.21.15.63:0/4182913671 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa34004810 0x7ffa34004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:57.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.590+0000 7ffa4b400640 1 --2- 172.21.15.63:0/4182913671 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffa340051d0 0x7ffa3400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:57.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.590+0000 7ffa4b400640 1 -- 172.21.15.63:0/4182913671 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ffa4c15cd70 con 0x7ffa34004810 2024-05-21T01:25:57.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.590+0000 7ffa4b400640 1 -- 172.21.15.63:0/4182913671 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7ffa4c15f580 con 0x7ffa34003a10 2024-05-21T01:25:57.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.590+0000 7ffa4b400640 1 -- 172.21.15.63:0/4182913671 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7ffa3400bf10 con 0x7ffa340051d0 2024-05-21T01:25:57.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.590+0000 7ffa4be00640 1 --2- 172.21.15.63:0/4182913671 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa34004810 0x7ffa34004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:57.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.590+0000 7ffa50c00640 1 --2- 172.21.15.63:0/4182913671 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffa34003a10 0x7ffa34003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:57.596 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.590+0000 7ffa51600640 1 --2- 172.21.15.63:0/4182913671 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffa340051d0 0x7ffa3400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:57.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.590+0000 7ffa4be00640 1 -- 172.21.15.63:0/4182913671 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffa340051d0 msgr2=0x7ffa3400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:25:57.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.590+0000 7ffa4be00640 1 --2- 172.21.15.63:0/4182913671 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffa340051d0 0x7ffa3400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:57.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.590+0000 7ffa4be00640 1 -- 172.21.15.63:0/4182913671 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffa34003a10 msgr2=0x7ffa34003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:25:57.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.590+0000 7ffa4be00640 1 --2- 172.21.15.63:0/4182913671 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffa34003a10 0x7ffa34003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:57.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.590+0000 7ffa4be00640 1 -- 172.21.15.63:0/4182913671 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa34003530 con 0x7ffa34004810 2024-05-21T01:25:57.597 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.590+0000 7ffa51600640 1 --2- 172.21.15.63:0/4182913671 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffa340051d0 0x7ffa3400b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T01:25:57.598 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.594+0000 7ffa4be00640 1 --2- 172.21.15.63:0/4182913671 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa34004810 0x7ffa34004c90 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ffa38009ae0 tx=0x7ffa3801ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e29b71ba8c2509fd server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:25:57.598 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.594+0000 7ffa4b400640 1 -- 172.21.15.63:0/4182913671 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa380b2070 con 0x7ffa34004810 2024-05-21T01:25:57.598 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.594+0000 7ffa4b400640 1 -- 172.21.15.63:0/4182913671 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa380a5660 con 0x7ffa34004810 2024-05-21T01:25:57.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.594+0000 7ffa4b400640 1 -- 172.21.15.63:0/4182913671 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa380096b0 con 0x7ffa34004810 2024-05-21T01:25:57.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.594+0000 7ffa53600640 1 -- 172.21.15.63:0/4182913671 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa34004810 msgr2=0x7ffa34004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:25:57.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.594+0000 7ffa53600640 1 --2- 172.21.15.63:0/4182913671 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa34004810 0x7ffa34004c90 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ffa38009ae0 tx=0x7ffa3801ca70 comp rx=0 tx=0).stop 2024-05-21T01:25:57.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.594+0000 7ffa51600640 1 -- 172.21.15.63:0/4182913671 reap_dead start 2024-05-21T01:25:57.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.594+0000 7ffa53600640 1 -- 172.21.15.63:0/4182913671 shutdown_connections 2024-05-21T01:25:57.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.594+0000 7ffa53600640 1 -- 172.21.15.63:0/4182913671 >> 172.21.15.63:0/4182913671 conn(0x7ffa4c068290 msgr2=0x7ffa4c0686a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:25:57.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.594+0000 7ffa53600640 1 -- 172.21.15.63:0/4182913671 shutdown_connections 2024-05-21T01:25:57.599 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.594+0000 7ffa53600640 1 -- 172.21.15.63:0/4182913671 wait complete. 2024-05-21T01:25:57.602 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.594+0000 7ffa53600640 1 Processor -- start 2024-05-21T01:25:57.602 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.594+0000 7ffa53600640 1 -- start start 2024-05-21T01:25:57.602 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.598+0000 7ffa53600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa34004810 0x7ffa4c154680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:57.602 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.598+0000 7ffa53600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffa4c155440 0x7ffa4c1f1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:57.602 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.598+0000 7ffa53600640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffa4c150d50 0x7ffa4c1f24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:57.602 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.598+0000 7ffa53600640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ffa4c0c8130 con 0x7ffa34004810 2024-05-21T01:25:57.602 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.598+0000 7ffa53600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7ffa4c072890 con 0x7ffa4c155440 2024-05-21T01:25:57.602 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.598+0000 7ffa53600640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7ffa4c0c82b0 con 0x7ffa4c150d50 2024-05-21T01:25:57.602 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.598+0000 7ffa50c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa34004810 0x7ffa4c154680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:57.602 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.598+0000 7ffa50c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa34004810 0x7ffa4c154680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39988/0 (socket says 172.21.15.63:39988) 2024-05-21T01:25:57.602 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.598+0000 7ffa50c00640 1 -- 172.21.15.63:0/3770733006 learned_addr learned my addr 172.21.15.63:0/3770733006 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:25:57.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.598+0000 7ffa4be00640 1 --2- 172.21.15.63:0/3770733006 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffa4c155440 0x7ffa4c1f1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:57.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.598+0000 7ffa51600640 1 --2- 172.21.15.63:0/3770733006 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffa4c150d50 0x7ffa4c1f24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:57.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.598+0000 7ffa50c00640 1 -- 172.21.15.63:0/3770733006 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffa4c150d50 msgr2=0x7ffa4c1f24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:25:57.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.598+0000 7ffa50c00640 1 --2- 172.21.15.63:0/3770733006 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffa4c150d50 0x7ffa4c1f24e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:57.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.598+0000 7ffa50c00640 1 -- 172.21.15.63:0/3770733006 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffa4c155440 msgr2=0x7ffa4c1f1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:25:57.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.598+0000 7ffa50c00640 1 --2- 172.21.15.63:0/3770733006 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffa4c155440 0x7ffa4c1f1fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:57.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.598+0000 7ffa50c00640 1 -- 172.21.15.63:0/3770733006 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa4c158cc0 con 0x7ffa34004810 2024-05-21T01:25:57.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.598+0000 7ffa50c00640 1 --2- 172.21.15.63:0/3770733006 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa34004810 0x7ffa4c154680 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ffa40000f60 tx=0x7ffa400126f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:25:57.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.598+0000 7ffa48c00640 1 -- 172.21.15.63:0/3770733006 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa4001c070 con 0x7ffa34004810 2024-05-21T01:25:57.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.598+0000 7ffa48c00640 1 -- 172.21.15.63:0/3770733006 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa40014750 con 0x7ffa34004810 2024-05-21T01:25:57.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.598+0000 7ffa53600640 1 -- 172.21.15.63:0/3770733006 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa4c158fa0 con 0x7ffa34004810 2024-05-21T01:25:57.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.598+0000 7ffa48c00640 1 -- 172.21.15.63:0/3770733006 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa40014b40 con 0x7ffa34004810 2024-05-21T01:25:57.603 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.598+0000 7ffa53600640 1 -- 172.21.15.63:0/3770733006 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa4c159560 con 0x7ffa34004810 2024-05-21T01:25:57.604 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.602+0000 7ffa48c00640 1 -- 172.21.15.63:0/3770733006 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7ffa4001f070 con 0x7ffa34004810 2024-05-21T01:25:57.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.602+0000 7ffa48c00640 1 --2- 172.21.15.63:0/3770733006 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7ffa2c06f400 0x7ffa2c0718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:57.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.602+0000 7ffa569e7000 1 Processor -- start 2024-05-21T01:25:57.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.602+0000 7ffa48c00640 1 -- 172.21.15.63:0/3770733006 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7ffa40091ed0 con 0x7ffa34004810 2024-05-21T01:25:57.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.602+0000 7ffa569e7000 1 -- start start 2024-05-21T01:25:57.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.602+0000 7ffa4be00640 1 --2- 172.21.15.63:0/3770733006 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7ffa2c06f400 0x7ffa2c0718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:57.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.602+0000 7ffa569e7000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cec2530130 0x55cec24f9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:57.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.602+0000 7ffa569e7000 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cec24fa100 0x55cec2534bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:57.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.602+0000 7ffa569e7000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cec2535100 0x55cec25354e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:57.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.602+0000 7ffa569e7000 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55cec234f740 con 0x55cec24fa100 2024-05-21T01:25:57.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.602+0000 7ffa569e7000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55cec233f2e0 con 0x55cec2530130 2024-05-21T01:25:57.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.602+0000 7ffa569e7000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55cec2343320 con 0x55cec2535100 2024-05-21T01:25:57.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.602+0000 7ffa4be00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cec24fa100 0x55cec2534bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:57.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.602+0000 7ffa4be00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cec24fa100 0x55cec2534bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:40000/0 (socket says 172.21.15.63:40000) 2024-05-21T01:25:57.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.602+0000 7ffa4be00640 1 -- 172.21.15.63:0/601681364 learned_addr learned my addr 172.21.15.63:0/601681364 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:25:57.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.602+0000 7ffa50c00640 1 --2- 172.21.15.63:0/601681364 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cec2530130 0x55cec24f9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:57.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.602+0000 7ffa51600640 1 --2- 172.21.15.63:0/601681364 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cec2535100 0x55cec25354e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:57.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.602+0000 7ffa4be00640 1 --2- 172.21.15.63:0/3770733006 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7ffa2c06f400 0x7ffa2c0718c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ffa380af000 tx=0x7ffa38004740 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:25:57.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.602+0000 7ffa4be00640 1 -- 172.21.15.63:0/601681364 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cec2535100 msgr2=0x55cec25354e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:25:57.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.602+0000 7ffa4be00640 1 --2- 172.21.15.63:0/601681364 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cec2535100 0x55cec25354e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:57.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.602+0000 7ffa4be00640 1 -- 172.21.15.63:0/601681364 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cec2530130 msgr2=0x55cec24f9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:25:57.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.602+0000 7ffa4be00640 1 --2- 172.21.15.63:0/601681364 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cec2530130 0x55cec24f9bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:57.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.602+0000 7ffa4be00640 1 -- 172.21.15.63:0/601681364 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cec22e1490 con 0x55cec24fa100 2024-05-21T01:25:57.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.602+0000 7ffa4be00640 1 --2- 172.21.15.63:0/601681364 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cec24fa100 0x55cec2534bc0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ffa380b0040 tx=0x7ffa380b8000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebbffc6c63ae40d2 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:25:57.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.602+0000 7ffa3d600640 1 -- 172.21.15.63:0/601681364 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa380bf070 con 0x55cec24fa100 2024-05-21T01:25:57.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.602+0000 7ffa3d600640 1 -- 172.21.15.63:0/601681364 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa380a5d30 con 0x55cec24fa100 2024-05-21T01:25:57.609 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.602+0000 7ffa3d600640 1 -- 172.21.15.63:0/601681364 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa380b2040 con 0x55cec24fa100 2024-05-21T01:25:57.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.606+0000 7ffa569e7000 1 -- 172.21.15.63:0/601681364 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cec24fa100 msgr2=0x55cec2534bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:25:57.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.606+0000 7ffa569e7000 1 --2- 172.21.15.63:0/601681364 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cec24fa100 0x55cec2534bc0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ffa380b0040 tx=0x7ffa380b8000 comp rx=0 tx=0).stop 2024-05-21T01:25:57.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.606+0000 7ffa569e7000 1 -- 172.21.15.63:0/601681364 shutdown_connections 2024-05-21T01:25:57.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.606+0000 7ffa569e7000 1 --2- 172.21.15.63:0/601681364 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cec2535100 0x55cec25354e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:57.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.606+0000 7ffa569e7000 1 --2- 172.21.15.63:0/601681364 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cec24fa100 0x55cec2534bc0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:57.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.606+0000 7ffa569e7000 1 --2- 172.21.15.63:0/601681364 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cec2530130 0x55cec24f9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:57.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.606+0000 7ffa569e7000 1 -- 172.21.15.63:0/601681364 >> 172.21.15.63:0/601681364 conn(0x55cec23dbd80 msgr2=0x55cec2532980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:25:57.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.606+0000 7ffa569e7000 1 -- 172.21.15.63:0/601681364 shutdown_connections 2024-05-21T01:25:57.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.606+0000 7ffa569e7000 1 -- 172.21.15.63:0/601681364 wait complete. 2024-05-21T01:25:57.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.606+0000 7ffa569e7000 1 -- start start 2024-05-21T01:25:57.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.606+0000 7ffa569e7000 1 Processor -- start 2024-05-21T01:25:57.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.606+0000 7ffa569e7000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cec24fa100 0x55cec24f4730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:57.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.606+0000 7ffa569e7000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cec2530130 0x55cec24f4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:57.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.606+0000 7ffa569e7000 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cec2535100 0x55cec24f51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:57.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.606+0000 7ffa569e7000 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55cec200ab10 con 0x55cec2535100 2024-05-21T01:25:57.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.606+0000 7ffa569e7000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55cec22fb670 con 0x55cec2530130 2024-05-21T01:25:57.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.606+0000 7ffa569e7000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55cec2347950 con 0x55cec24fa100 2024-05-21T01:25:57.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.606+0000 7ffa569e7000 10 client.0 _ll_register_callbacks cb 0x55cec24df540 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-21T01:25:57.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.606+0000 7ffa51600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cec2535100 0x55cec24f51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:57.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.606+0000 7ffa50c00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cec24fa100 0x55cec24f4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:57.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.606+0000 7ffa51600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cec2535100 0x55cec24f51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:40014/0 (socket says 172.21.15.63:40014) 2024-05-21T01:25:57.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.606+0000 7ffa51600640 1 -- 172.21.15.63:0/1629294335 learned_addr learned my addr 172.21.15.63:0/1629294335 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:25:57.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.606+0000 7ffa4be00640 1 --2- 172.21.15.63:0/1629294335 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cec2530130 0x55cec24f4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:57.614 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.606+0000 7ffa51600640 1 -- 172.21.15.63:0/1629294335 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cec24fa100 msgr2=0x55cec24f4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:25:57.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.606+0000 7ffa51600640 1 --2- 172.21.15.63:0/1629294335 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cec24fa100 0x55cec24f4730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:57.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.606+0000 7ffa51600640 1 -- 172.21.15.63:0/1629294335 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cec2530130 msgr2=0x55cec24f4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:25:57.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.606+0000 7ffa51600640 1 --2- 172.21.15.63:0/1629294335 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cec2530130 0x55cec24f4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:57.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.606+0000 7ffa51600640 1 -- 172.21.15.63:0/1629294335 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cec22f4e40 con 0x55cec2535100 2024-05-21T01:25:57.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.606+0000 7ffa51600640 1 --2- 172.21.15.63:0/1629294335 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cec2535100 0x55cec24f51b0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c071460 tx=0x7ffa44004700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f01d555e6b414e9 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:25:57.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.606+0000 7ffa32000640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-05-21T01:25:57.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.606+0000 7ffa32000640 1 -- 172.21.15.63:0/1629294335 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa4401b070 con 0x55cec2535100 2024-05-21T01:25:57.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.606+0000 7ffa32000640 1 -- 172.21.15.63:0/1629294335 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7ffa44007ca0 con 0x55cec2535100 2024-05-21T01:25:57.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.606+0000 7ffa569e7000 1 -- 172.21.15.63:0/1629294335 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa380a5d30 con 0x55cec2535100 2024-05-21T01:25:57.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.610+0000 7ffa32000640 1 -- 172.21.15.63:0/1629294335 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7ffa44026050 con 0x55cec2535100 2024-05-21T01:25:57.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.610+0000 7ffa569e7000 10 client.5058 fetch_fsmap learned FSMap version 15 2024-05-21T01:25:57.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.610+0000 7ffa569e7000 1 -- 172.21.15.63:0/1629294335 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x55cec23c4890 con 0x55cec2535100 2024-05-21T01:25:57.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.610+0000 7ffa32000640 1 -- 172.21.15.63:0/1629294335 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa380a5d30 con 0x55cec2535100 2024-05-21T01:25:57.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.610+0000 7ffa32000640 1 -- 172.21.15.63:0/1629294335 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 15) ==== 4752+0+0 (secure 0 0 0) 0x7ffa44029020 con 0x55cec2535100 2024-05-21T01:25:57.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.610+0000 7ffa569e7000 10 client.5058 fetch_fsmap finished waiting for FSMap version 15 2024-05-21T01:25:57.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.610+0000 7ffa569e7000 10 client.5058 resolve_mds: validated gid 4276 aka daemon mds.c 2024-05-21T01:25:57.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.610+0000 7ffa569e7000 20 client.5058 populate_metadata read hostname 'smithi063' 2024-05-21T01:25:57.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.610+0000 7ffa569e7000 1 --2- 172.21.15.63:0/1629294335 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x55cec25488c0 0x55cec254acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:57.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.610+0000 7ffa569e7000 4 client.5058 mds_command: new command op to 4276 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-21T01:25:57.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.610+0000 7ffa569e7000 1 -- 172.21.15.63:0/1629294335 --> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cec22db7f0 con 0x55cec25488c0 2024-05-21T01:25:57.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.610+0000 7ffa50c00640 1 --2- 172.21.15.63:0/1629294335 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x55cec25488c0 0x55cec254acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:57.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.610+0000 7ffa32000640 10 client.5058 ms_handle_connect on v2:172.21.15.63:6834/2892727989 2024-05-21T01:25:57.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.610+0000 7ffa50c00640 1 --2- 172.21.15.63:0/1629294335 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x55cec25488c0 0x55cec254acb0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=656620f49264546e server_cookie=5be041b350733d3a in_seq=0 out_seq=0 2024-05-21T01:25:57.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.610+0000 7ffa32000640 1 -- 172.21.15.63:0/1629294335 <== mds.0 v2:172.21.15.63:6834/2892727989 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x55cec22db7f0 con 0x55cec25488c0 2024-05-21T01:25:57.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.610+0000 7ffa32000640 10 client.5058 handle_command_reply: tid=0 2024-05-21T01:25:57.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.610+0000 7ffa569e7000 1 client.5058 shutdown 2024-05-21T01:25:57.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.610+0000 7ffa569e7000 1 -- 172.21.15.63:0/1629294335 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cec2535100 msgr2=0x55cec24f51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:25:57.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.610+0000 7ffa569e7000 1 --2- 172.21.15.63:0/1629294335 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cec2535100 0x55cec24f51b0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c071460 tx=0x7ffa44004700 comp rx=0 tx=0).stop 2024-05-21T01:25:57.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.610+0000 7ffa569e7000 1 -- 172.21.15.63:0/1629294335 shutdown_connections 2024-05-21T01:25:57.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.610+0000 7ffa569e7000 1 --2- 172.21.15.63:0/1629294335 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x55cec25488c0 0x55cec254acb0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:57.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.610+0000 7ffa569e7000 1 --2- 172.21.15.63:0/1629294335 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cec2535100 0x55cec24f51b0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:57.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.610+0000 7ffa569e7000 1 --2- 172.21.15.63:0/1629294335 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cec2530130 0x55cec24f4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:57.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.610+0000 7ffa569e7000 1 --2- 172.21.15.63:0/1629294335 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cec24fa100 0x55cec24f4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:57.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.610+0000 7ffa569e7000 1 -- 172.21.15.63:0/1629294335 >> 172.21.15.63:0/1629294335 conn(0x55cec23dbd80 msgr2=0x55cec24f9330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:25:57.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.610+0000 7ffa32000640 0 client.5058 ms_handle_reset on v2:172.21.15.63:6834/2892727989 2024-05-21T01:25:57.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.610+0000 7ffa569e7000 1 -- 172.21.15.63:0/1629294335 shutdown_connections 2024-05-21T01:25:57.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.610+0000 7ffa569e7000 1 -- 172.21.15.63:0/1629294335 wait complete. 2024-05-21T01:25:57.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.610+0000 7ffa569e7000 20 client.5058 trim_cache size 0 max 16384 2024-05-21T01:25:57.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.630+0000 7ffa569e7000 1 Processor -- start 2024-05-21T01:25:57.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.630+0000 7ffa569e7000 1 -- start start 2024-05-21T01:25:57.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.630+0000 7ffa569e7000 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cec23dbd80 0x55cec254b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:57.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.630+0000 7ffa569e7000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cec24fa100 0x55cec254be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:57.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.630+0000 7ffa569e7000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cec2530130 0x55cec254c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:57.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.630+0000 7ffa569e7000 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ffa4c1fe9a0 con 0x55cec23dbd80 2024-05-21T01:25:57.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.630+0000 7ffa569e7000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7ffa4c14b600 con 0x55cec24fa100 2024-05-21T01:25:57.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.630+0000 7ffa569e7000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7ffa4c1fe350 con 0x55cec2530130 2024-05-21T01:25:57.634 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.630+0000 7ffa50c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cec23dbd80 0x55cec254b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:57.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.630+0000 7ffa50c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cec23dbd80 0x55cec254b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:40026/0 (socket says 172.21.15.63:40026) 2024-05-21T01:25:57.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.630+0000 7ffa50c00640 1 -- 172.21.15.63:0/410052685 learned_addr learned my addr 172.21.15.63:0/410052685 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:25:57.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.630+0000 7ffa4be00640 1 --2- 172.21.15.63:0/410052685 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cec24fa100 0x55cec254be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:57.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.630+0000 7ffa51600640 1 --2- 172.21.15.63:0/410052685 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cec2530130 0x55cec254c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:57.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.630+0000 7ffa50c00640 1 -- 172.21.15.63:0/410052685 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cec2530130 msgr2=0x55cec254c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:25:57.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.630+0000 7ffa50c00640 1 --2- 172.21.15.63:0/410052685 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cec2530130 0x55cec254c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:57.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.630+0000 7ffa50c00640 1 -- 172.21.15.63:0/410052685 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cec24fa100 msgr2=0x55cec254be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:25:57.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.630+0000 7ffa50c00640 1 --2- 172.21.15.63:0/410052685 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cec24fa100 0x55cec254be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:57.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.630+0000 7ffa50c00640 1 -- 172.21.15.63:0/410052685 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cec239bda0 con 0x55cec23dbd80 2024-05-21T01:25:57.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.630+0000 7ffa51600640 1 --2- 172.21.15.63:0/410052685 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cec2530130 0x55cec254c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T01:25:57.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.630+0000 7ffa50c00640 1 --2- 172.21.15.63:0/410052685 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cec23dbd80 0x55cec254b8e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ffa4008fff0 tx=0x7ffa40018040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fd9dc4390b2951c server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:25:57.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.630+0000 7ffa3cc00640 1 -- 172.21.15.63:0/410052685 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa40090100 con 0x55cec23dbd80 2024-05-21T01:25:57.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.630+0000 7ffa3cc00640 1 -- 172.21.15.63:0/410052685 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa4005a680 con 0x55cec23dbd80 2024-05-21T01:25:57.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.630+0000 7ffa3cc00640 1 -- 172.21.15.63:0/410052685 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa4005d650 con 0x55cec23dbd80 2024-05-21T01:25:57.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.630+0000 7ffa569e7000 1 -- 172.21.15.63:0/410052685 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cec23dbd80 msgr2=0x55cec254b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:25:57.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.630+0000 7ffa569e7000 1 --2- 172.21.15.63:0/410052685 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cec23dbd80 0x55cec254b8e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ffa4008fff0 tx=0x7ffa40018040 comp rx=0 tx=0).stop 2024-05-21T01:25:57.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.630+0000 7ffa569e7000 1 -- 172.21.15.63:0/410052685 shutdown_connections 2024-05-21T01:25:57.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.630+0000 7ffa569e7000 1 --2- 172.21.15.63:0/410052685 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cec2530130 0x55cec254c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:57.639 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.630+0000 7ffa569e7000 1 --2- 172.21.15.63:0/410052685 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cec24fa100 0x55cec254be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:57.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.630+0000 7ffa569e7000 1 --2- 172.21.15.63:0/410052685 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cec23dbd80 0x55cec254b8e0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:57.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.630+0000 7ffa569e7000 1 -- 172.21.15.63:0/410052685 >> 172.21.15.63:0/410052685 conn(0x55cec24f96a0 msgr2=0x55cec252e970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:25:57.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.630+0000 7ffa569e7000 1 -- 172.21.15.63:0/410052685 shutdown_connections 2024-05-21T01:25:57.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.630+0000 7ffa569e7000 1 -- 172.21.15.63:0/410052685 wait complete. 2024-05-21T01:25:57.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.630+0000 7ffa569e7000 1 -- start start 2024-05-21T01:25:57.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.630+0000 7ffa569e7000 1 Processor -- start 2024-05-21T01:25:57.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.634+0000 7ffa569e7000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cec23dbd80 0x55cec256e300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:57.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.634+0000 7ffa569e7000 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cec24fa100 0x55cec256e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:57.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.634+0000 7ffa569e7000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cec2530130 0x55cec256ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:57.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.634+0000 7ffa569e7000 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55cec233b0e0 con 0x55cec24fa100 2024-05-21T01:25:57.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.634+0000 7ffa569e7000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55cec23c4400 con 0x55cec23dbd80 2024-05-21T01:25:57.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.634+0000 7ffa569e7000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55cec22d83e0 con 0x55cec2530130 2024-05-21T01:25:57.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.634+0000 7ffa569e7000 10 client.0 _ll_register_callbacks cb 0x7ffa44009bf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-21T01:25:57.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.634+0000 7ffa4be00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cec24fa100 0x55cec256e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:57.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.634+0000 7ffa4be00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cec24fa100 0x55cec256e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:40034/0 (socket says 172.21.15.63:40034) 2024-05-21T01:25:57.641 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.634+0000 7ffa4be00640 1 -- 172.21.15.63:0/1110369859 learned_addr learned my addr 172.21.15.63:0/1110369859 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:25:57.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.634+0000 7ffa50c00640 1 --2- 172.21.15.63:0/1110369859 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cec23dbd80 0x55cec256e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:57.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.634+0000 7ffa51600640 1 --2- 172.21.15.63:0/1110369859 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cec2530130 0x55cec256ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:57.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.634+0000 7ffa4be00640 1 -- 172.21.15.63:0/1110369859 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cec2530130 msgr2=0x55cec256ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:25:57.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.634+0000 7ffa4be00640 1 --2- 172.21.15.63:0/1110369859 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cec2530130 0x55cec256ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:57.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.634+0000 7ffa4be00640 1 -- 172.21.15.63:0/1110369859 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cec23dbd80 msgr2=0x55cec256e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:25:57.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.634+0000 7ffa4be00640 1 --2- 172.21.15.63:0/1110369859 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cec23dbd80 0x55cec256e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:57.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.634+0000 7ffa4be00640 1 -- 172.21.15.63:0/1110369859 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cec22d3f40 con 0x55cec24fa100 2024-05-21T01:25:57.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.634+0000 7ffa51600640 1 --2- 172.21.15.63:0/1110369859 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cec2530130 0x55cec256ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T01:25:57.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.634+0000 7ffa4be00640 1 --2- 172.21.15.63:0/1110369859 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cec24fa100 0x55cec256e840 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ffa3801cf50 tx=0x7ffa38019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da0e7b077127d6d4 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:25:57.642 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.634+0000 7ffa32000640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-05-21T01:25:57.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.634+0000 7ffa32000640 1 -- 172.21.15.63:0/1110369859 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa380d3020 con 0x55cec24fa100 2024-05-21T01:25:57.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.634+0000 7ffa32000640 1 -- 172.21.15.63:0/1110369859 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7ffa38004490 con 0x55cec24fa100 2024-05-21T01:25:57.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.634+0000 7ffa569e7000 1 -- 172.21.15.63:0/1110369859 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa4005a680 con 0x55cec24fa100 2024-05-21T01:25:57.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.634+0000 7ffa32000640 1 -- 172.21.15.63:0/1110369859 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7ffa380dd050 con 0x55cec24fa100 2024-05-21T01:25:57.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.634+0000 7ffa569e7000 10 client.5064 fetch_fsmap learned FSMap version 15 2024-05-21T01:25:57.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.634+0000 7ffa569e7000 1 -- 172.21.15.63:0/1110369859 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x55cec22e6f80 con 0x55cec24fa100 2024-05-21T01:25:57.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.634+0000 7ffa32000640 1 -- 172.21.15.63:0/1110369859 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa4005a680 con 0x55cec24fa100 2024-05-21T01:25:57.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.634+0000 7ffa32000640 1 -- 172.21.15.63:0/1110369859 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 15) ==== 4752+0+0 (secure 0 0 0) 0x7ffa380e0020 con 0x55cec24fa100 2024-05-21T01:25:57.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.634+0000 7ffa569e7000 10 client.5064 fetch_fsmap finished waiting for FSMap version 15 2024-05-21T01:25:57.643 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.634+0000 7ffa569e7000 10 client.5064 resolve_mds: validated gid 4276 aka daemon mds.c 2024-05-21T01:25:57.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.634+0000 7ffa569e7000 20 client.5064 populate_metadata read hostname 'smithi063' 2024-05-21T01:25:57.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.634+0000 7ffa569e7000 1 --2- 172.21.15.63:0/1110369859 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x55cec2535100 0x55cec25b5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:25:57.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.634+0000 7ffa569e7000 4 client.5064 mds_command: new command op to 4276 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 146.0, "await_for": 45.0}] 2024-05-21T01:25:57.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.634+0000 7ffa569e7000 1 -- 172.21.15.63:0/1110369859 --> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 146.0, "await_for": 45.0}) -- 0x55cec24f8f70 con 0x55cec2535100 2024-05-21T01:25:57.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.634+0000 7ffa50c00640 1 --2- 172.21.15.63:0/1110369859 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x55cec2535100 0x55cec25b5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:25:57.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.634+0000 7ffa50c00640 1 --2- 172.21.15.63:0/1110369859 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x55cec2535100 0x55cec25b5dd0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d31e3d18000459fb server_cookie=9b682ccc3b0c0391 in_seq=0 out_seq=0 2024-05-21T01:25:57.644 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.634+0000 7ffa32000640 10 client.5064 ms_handle_connect on v2:172.21.15.63:6834/2892727989 2024-05-21T01:25:57.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.638+0000 7ffa32000640 1 -- 172.21.15.63:0/1110369859 <== mds.0 v2:172.21.15.63:6834/2892727989 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x55cec24f8f70 con 0x55cec2535100 2024-05-21T01:25:57.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.638+0000 7ffa32000640 10 client.5064 handle_command_reply: tid=0 2024-05-21T01:25:57.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.638+0000 7ffa569e7000 1 client.5064 shutdown 2024-05-21T01:25:57.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.638+0000 7ffa569e7000 1 -- 172.21.15.63:0/1110369859 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cec24fa100 msgr2=0x55cec256e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:25:57.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.638+0000 7ffa569e7000 1 --2- 172.21.15.63:0/1110369859 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cec24fa100 0x55cec256e840 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ffa3801cf50 tx=0x7ffa38019810 comp rx=0 tx=0).stop 2024-05-21T01:25:57.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.638+0000 7ffa569e7000 1 -- 172.21.15.63:0/1110369859 shutdown_connections 2024-05-21T01:25:57.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.638+0000 7ffa569e7000 1 --2- 172.21.15.63:0/1110369859 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x55cec2535100 0x55cec25b5dd0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:57.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.638+0000 7ffa569e7000 1 --2- 172.21.15.63:0/1110369859 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55cec2530130 0x55cec256ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:57.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.638+0000 7ffa569e7000 1 --2- 172.21.15.63:0/1110369859 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55cec24fa100 0x55cec256e840 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:57.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.638+0000 7ffa569e7000 1 --2- 172.21.15.63:0/1110369859 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cec23dbd80 0x55cec256e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:57.646 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.638+0000 7ffa32000640 0 client.5064 ms_handle_reset on v2:172.21.15.63:6834/2892727989 2024-05-21T01:25:57.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.638+0000 7ffa569e7000 1 -- 172.21.15.63:0/1110369859 >> 172.21.15.63:0/1110369859 conn(0x55cec24f96a0 msgr2=0x55cec254a8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:25:57.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.638+0000 7ffa569e7000 1 -- 172.21.15.63:0/1110369859 shutdown_connections 2024-05-21T01:25:57.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.638+0000 7ffa569e7000 1 -- 172.21.15.63:0/1110369859 wait complete. 2024-05-21T01:25:57.647 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.638+0000 7ffa569e7000 20 client.5064 trim_cache size 0 max 16384 2024-05-21T01:25:57.650 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-05-21T01:25:57.650 INFO:teuthology.orchestra.run.smithi063.stdout: "epoch": 15, 2024-05-21T01:25:57.650 INFO:teuthology.orchestra.run.smithi063.stdout: "leader": 4276, 2024-05-21T01:25:57.650 INFO:teuthology.orchestra.run.smithi063.stdout: "set_version": 22, 2024-05-21T01:25:57.650 INFO:teuthology.orchestra.run.smithi063.stdout: "sets": { 2024-05-21T01:25:57.650 INFO:teuthology.orchestra.run.smithi063.stdout: "5514a50b": { 2024-05-21T01:25:57.650 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 22, 2024-05-21T01:25:57.650 INFO:teuthology.orchestra.run.smithi063.stdout: "age_ref": 0.0, 2024-05-21T01:25:57.650 INFO:teuthology.orchestra.run.smithi063.stdout: "state": { 2024-05-21T01:25:57.650 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "QUIESCED", 2024-05-21T01:25:57.650 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 0.0 2024-05-21T01:25:57.650 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-05-21T01:25:57.651 INFO:teuthology.orchestra.run.smithi063.stdout: "timeout": 90.0, 2024-05-21T01:25:57.651 INFO:teuthology.orchestra.run.smithi063.stdout: "expiration": 146.0, 2024-05-21T01:25:57.651 INFO:teuthology.orchestra.run.smithi063.stdout: "members": { 2024-05-21T01:25:57.651 INFO:teuthology.orchestra.run.smithi063.stdout: "file:/": { 2024-05-21T01:25:57.651 INFO:teuthology.orchestra.run.smithi063.stdout: "excluded": false, 2024-05-21T01:25:57.651 INFO:teuthology.orchestra.run.smithi063.stdout: "state": { 2024-05-21T01:25:57.651 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "QUIESCED", 2024-05-21T01:25:57.651 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 0.0 2024-05-21T01:25:57.651 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-05-21T01:25:57.651 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-05-21T01:25:57.652 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-05-21T01:25:57.652 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-05-21T01:25:57.652 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-05-21T01:25:57.652 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-05-21T01:25:57.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.642+0000 7ffa53600640 1 -- 172.21.15.63:0/3770733006 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7ffa2c06f400 msgr2=0x7ffa2c0718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:25:57.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.642+0000 7ffa53600640 1 --2- 172.21.15.63:0/3770733006 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7ffa2c06f400 0x7ffa2c0718c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ffa380af000 tx=0x7ffa38004740 comp rx=0 tx=0).stop 2024-05-21T01:25:57.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.642+0000 7ffa53600640 1 -- 172.21.15.63:0/3770733006 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa34004810 msgr2=0x7ffa4c154680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:25:57.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.642+0000 7ffa53600640 1 --2- 172.21.15.63:0/3770733006 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa34004810 0x7ffa4c154680 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ffa40000f60 tx=0x7ffa400126f0 comp rx=0 tx=0).stop 2024-05-21T01:25:57.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.642+0000 7ffa53600640 1 -- 172.21.15.63:0/3770733006 shutdown_connections 2024-05-21T01:25:57.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.642+0000 7ffa53600640 1 --2- 172.21.15.63:0/3770733006 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7ffa2c06f400 0x7ffa2c0718c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:57.653 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.642+0000 7ffa53600640 1 --2- 172.21.15.63:0/3770733006 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffa4c150d50 0x7ffa4c1f24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:57.654 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.642+0000 7ffa53600640 1 --2- 172.21.15.63:0/3770733006 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffa4c155440 0x7ffa4c1f1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:57.654 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.642+0000 7ffa53600640 1 --2- 172.21.15.63:0/3770733006 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffa34004810 0x7ffa4c154680 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:25:57.654 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.642+0000 7ffa53600640 1 -- 172.21.15.63:0/3770733006 >> 172.21.15.63:0/3770733006 conn(0x7ffa4c068290 msgr2=0x7ffa4c15fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:25:57.654 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.642+0000 7ffa53600640 1 -- 172.21.15.63:0/3770733006 shutdown_connections 2024-05-21T01:25:57.654 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:25:57.642+0000 7ffa53600640 1 -- 172.21.15.63:0/3770733006 wait complete. 2024-05-21T01:25:57.663 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '5514a50b', quiesce took 0.6 seconds. Will release after: 25.4 2024-05-21T01:26:23.065 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-21T01:26:23.233 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.229+0000 7f089b200640 1 Processor -- start 2024-05-21T01:26:23.233 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.229+0000 7f089b200640 1 -- start start 2024-05-21T01:26:23.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.229+0000 7f089b200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0894156070 0x7f0894071640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:23.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.229+0000 7f089b200640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f0894071b80 0x7f08940cf530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:23.234 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.229+0000 7f089b200640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f089415bf20 con 0x7f089406f080 2024-05-21T01:26:23.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.229+0000 7f089b200640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f089415c1e0 con 0x7f0894071b80 2024-05-21T01:26:23.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.229+0000 7f089b200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f089415c4c0 con 0x7f0894156070 2024-05-21T01:26:23.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.229+0000 7f088be00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f0894071b80 0x7f08940cf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:23.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.229+0000 7f0899200640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f089406f080 0x7f089415d9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:38012/0 (socket says 172.21.15.63:38012) 2024-05-21T01:26:23.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.229+0000 7f0899200640 1 -- 172.21.15.63:0/615479013 learned_addr learned my addr 172.21.15.63:0/615479013 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-05-21T01:26:23.235 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.229+0000 7f0893e00640 1 --2- 172.21.15.63:0/615479013 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0894156070 0x7f0894071640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:23.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.229+0000 7f088be00640 1 -- 172.21.15.63:0/615479013 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0894156070 msgr2=0x7f0894071640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:26:23.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.229+0000 7f088be00640 1 --2- 172.21.15.63:0/615479013 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0894156070 0x7f0894071640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:23.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.229+0000 7f088be00640 1 -- 172.21.15.63:0/615479013 >> v1:172.21.15.63:6789/0 conn(0x7f089406f080 legacy=0x7f089415d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:23.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.229+0000 7f088be00640 1 -- 172.21.15.63:0/615479013 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f089415c7a0 con 0x7f0894071b80 2024-05-21T01:26:23.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.233+0000 7f088be00640 1 --2- 172.21.15.63:0/615479013 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0894071b80 0x7f08940cf530 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f087c0097c0 tx=0x7f087c01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3b781083a162007 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:23.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.233+0000 7f0893400640 1 -- 172.21.15.63:0/615479013 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f087c0b0070 con 0x7f0894071b80 2024-05-21T01:26:23.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.233+0000 7f0893400640 1 -- 172.21.15.63:0/615479013 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f087c0ab600 con 0x7f0894071b80 2024-05-21T01:26:23.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.233+0000 7f0893400640 1 -- 172.21.15.63:0/615479013 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f087c0ab9d0 con 0x7f0894071b80 2024-05-21T01:26:23.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.233+0000 7f089b200640 1 -- 172.21.15.63:0/615479013 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0894071b80 msgr2=0x7f08940cf530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:23.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.233+0000 7f089b200640 1 --2- 172.21.15.63:0/615479013 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0894071b80 0x7f08940cf530 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f087c0097c0 tx=0x7f087c01c4a0 comp rx=0 tx=0).stop 2024-05-21T01:26:23.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.233+0000 7f089b200640 1 -- 172.21.15.63:0/615479013 shutdown_connections 2024-05-21T01:26:23.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.233+0000 7f089b200640 1 --2- 172.21.15.63:0/615479013 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0894071b80 0x7f08940cf530 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:23.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.233+0000 7f089b200640 1 --2- 172.21.15.63:0/615479013 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0894156070 0x7f0894071640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:23.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.233+0000 7f089b200640 1 -- 172.21.15.63:0/615479013 >> 172.21.15.63:0/615479013 conn(0x7f08940735f0 msgr2=0x7f0894073a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:26:23.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.237+0000 7f089b200640 1 -- 172.21.15.63:0/615479013 shutdown_connections 2024-05-21T01:26:23.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.237+0000 7f089b200640 1 -- 172.21.15.63:0/615479013 wait complete. 2024-05-21T01:26:23.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.237+0000 7f089b200640 1 Processor -- start 2024-05-21T01:26:23.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.237+0000 7f089b200640 1 -- start start 2024-05-21T01:26:23.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.237+0000 7f089b200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f089406f080 0x7f0894155580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:23.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.237+0000 7f089b200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0894071b80 0x7f089414a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:23.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.237+0000 7f089b200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0894156070 0x7f08941f8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:23.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.237+0000 7f089b200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f08941565d0 con 0x7f0894071b80 2024-05-21T01:26:23.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.237+0000 7f089b200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f0894156450 con 0x7f089406f080 2024-05-21T01:26:23.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.237+0000 7f089b200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f08941690c0 con 0x7f0894156070 2024-05-21T01:26:23.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.237+0000 7f088be00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0894071b80 0x7f089414a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:23.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.237+0000 7f088be00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0894071b80 0x7f089414a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35170/0 (socket says 172.21.15.63:35170) 2024-05-21T01:26:23.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.237+0000 7f088be00640 1 -- 172.21.15.63:0/2360679086 learned_addr learned my addr 172.21.15.63:0/2360679086 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:26:23.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.237+0000 7f0893e00640 1 --2- 172.21.15.63:0/2360679086 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f089406f080 0x7f0894155580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:23.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.237+0000 7f0899200640 1 --2- 172.21.15.63:0/2360679086 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0894156070 0x7f08941f8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:23.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.237+0000 7f088be00640 1 -- 172.21.15.63:0/2360679086 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0894156070 msgr2=0x7f08941f8c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:23.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.237+0000 7f088be00640 1 --2- 172.21.15.63:0/2360679086 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0894156070 0x7f08941f8c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:23.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.237+0000 7f088be00640 1 -- 172.21.15.63:0/2360679086 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f089406f080 msgr2=0x7f0894155580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:23.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.241+0000 7f088be00640 1 --2- 172.21.15.63:0/2360679086 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f089406f080 0x7f0894155580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:23.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.241+0000 7f088be00640 1 -- 172.21.15.63:0/2360679086 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f089406f580 con 0x7f0894071b80 2024-05-21T01:26:23.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.241+0000 7f0893e00640 1 --2- 172.21.15.63:0/2360679086 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f089406f080 0x7f0894155580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T01:26:23.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.241+0000 7f088be00640 1 --2- 172.21.15.63:0/2360679086 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0894071b80 0x7f089414a6e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f087c0ae040 tx=0x7f087c019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:23.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.241+0000 7f0890c00640 1 -- 172.21.15.63:0/2360679086 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f087c0ba070 con 0x7f0894071b80 2024-05-21T01:26:23.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.241+0000 7f0890c00640 1 -- 172.21.15.63:0/2360679086 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f087c0b43f0 con 0x7f0894071b80 2024-05-21T01:26:23.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.241+0000 7f0890c00640 1 -- 172.21.15.63:0/2360679086 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f087c0b0040 con 0x7f0894071b80 2024-05-21T01:26:23.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.241+0000 7f089b200640 1 -- 172.21.15.63:0/2360679086 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08941f63c0 con 0x7f0894071b80 2024-05-21T01:26:23.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.241+0000 7f089b200640 1 -- 172.21.15.63:0/2360679086 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0894149840 con 0x7f0894071b80 2024-05-21T01:26:23.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.241+0000 7f089b200640 1 -- 172.21.15.63:0/2360679086 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08940507f0 con 0x7f0894071b80 2024-05-21T01:26:23.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.241+0000 7f0890c00640 1 -- 172.21.15.63:0/2360679086 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7f087c0bd070 con 0x7f0894071b80 2024-05-21T01:26:23.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.245+0000 7f0890c00640 1 --2- 172.21.15.63:0/2360679086 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f087006f430 0x7f08700718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:23.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.245+0000 7f0890c00640 1 -- 172.21.15.63:0/2360679086 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f087c128630 con 0x7f0894071b80 2024-05-21T01:26:23.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.245+0000 7f0893e00640 1 --2- 172.21.15.63:0/2360679086 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f087006f430 0x7f08700718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:23.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.245+0000 7f0893e00640 1 --2- 172.21.15.63:0/2360679086 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f087006f430 0x7f08700718f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0884009bb0 tx=0x7f0884008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:23.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.245+0000 7f0890c00640 1 -- 172.21.15.63:0/2360679086 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f087c016090 con 0x7f0894071b80 2024-05-21T01:26:23.498 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.493+0000 7f089b200640 1 -- 172.21.15.63:0/2360679086 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f08940ce7e0 con 0x7f0894071b80 2024-05-21T01:26:23.499 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.493+0000 7f0890c00640 1 -- 172.21.15.63:0/2360679086 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+6876 (secure 0 0 0) 0x7f087c0f52b0 con 0x7f0894071b80 2024-05-21T01:26:23.499 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-05-21T01:26:23.499 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6839/3045714273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6837","nonce":3045714273},{"type":"v1","addr":"172.21.15.131:6839","nonce":3045714273}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/2978367338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":2978367338},{"type":"v1","addr":"172.21.15.131:6835","nonce":2978367338}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/3005995321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6835","nonce":3005995321},{"type":"v1","addr":"172.21.15.63:6837","nonce":3005995321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-21T01:19:53.915775+0000","modified":"2024-05-21T01:20:31.724475+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4276,"mds_1":4270,"mds_2":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"e","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.63:6833/574189772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":574189772},{"type":"v1","addr":"172.21.15.63:6833","nonce":574189772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4270":{"gid":4270,"name":"f","rank":1,"incarnation":10,"state":"up:active","state_seq":11,"addr":"172.21.15.131:6838/3071941741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":3071941741},{"type":"v1","addr":"172.21.15.131:6838","nonce":3071941741}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.63:6836/2892727989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":2892727989},{"type":"v1","addr":"172.21.15.63:6836","nonce":2892727989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4276,"qdb_cluster":[4267,4270,4276]},"id":1}]} 2024-05-21T01:26:23.499 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 15 2024-05-21T01:26:23.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.497+0000 7f089b200640 1 -- 172.21.15.63:0/2360679086 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f087006f430 msgr2=0x7f08700718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:23.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.497+0000 7f089b200640 1 --2- 172.21.15.63:0/2360679086 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f087006f430 0x7f08700718f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0884009bb0 tx=0x7f0884008040 comp rx=0 tx=0).stop 2024-05-21T01:26:23.502 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.497+0000 7f089b200640 1 -- 172.21.15.63:0/2360679086 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0894071b80 msgr2=0x7f089414a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:23.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.497+0000 7f089b200640 1 --2- 172.21.15.63:0/2360679086 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0894071b80 0x7f089414a6e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f087c0ae040 tx=0x7f087c019240 comp rx=0 tx=0).stop 2024-05-21T01:26:23.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.497+0000 7f089b200640 1 -- 172.21.15.63:0/2360679086 shutdown_connections 2024-05-21T01:26:23.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.497+0000 7f089b200640 1 --2- 172.21.15.63:0/2360679086 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f087006f430 0x7f08700718f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:23.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.497+0000 7f089b200640 1 --2- 172.21.15.63:0/2360679086 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0894156070 0x7f08941f8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:23.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.497+0000 7f089b200640 1 --2- 172.21.15.63:0/2360679086 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0894071b80 0x7f089414a6e0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:23.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.497+0000 7f089b200640 1 --2- 172.21.15.63:0/2360679086 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f089406f080 0x7f0894155580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:23.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.497+0000 7f089b200640 1 -- 172.21.15.63:0/2360679086 >> 172.21.15.63:0/2360679086 conn(0x7f08940735f0 msgr2=0x7f089415d8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:26:23.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.497+0000 7f089b200640 1 -- 172.21.15.63:0/2360679086 shutdown_connections 2024-05-21T01:26:23.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.497+0000 7f089b200640 1 -- 172.21.15.63:0/2360679086 wait complete. 2024-05-21T01:26:23.536 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4276 quiesce db --set-id 5514a50b --release --await' 2024-05-21T01:26:23.536 DEBUG:teuthology.orchestra.run.smithi063:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4276 quiesce db --set-id 5514a50b --release --await 2024-05-21T01:26:23.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.725+0000 7f8140e00640 1 Processor -- start 2024-05-21T01:26:23.729 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.725+0000 7f8140e00640 1 -- start start 2024-05-21T01:26:23.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.725+0000 7f8140e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f813c0cc700 0x7f813c155e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:23.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.725+0000 7f8140e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f813c0b61b0 0x7f813c156350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:23.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.725+0000 7f8140e00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f813c0b4a00 con 0x7f813c0ccae0 2024-05-21T01:26:23.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.725+0000 7f8140e00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f813c0b47b0 con 0x7f813c0b61b0 2024-05-21T01:26:23.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.725+0000 7f8140e00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f813c0b4ce0 con 0x7f813c0cc700 2024-05-21T01:26:23.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.725+0000 7f8139e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f813c0cc700 0x7f813c155e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:23.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.725+0000 7f813a800640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f813c0b61b0 0x7f813c156350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:23.732 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.725+0000 7f8139400640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f813c0ccae0 0x7f813c0b5aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.63:39326/0 (socket says 172.21.15.63:39326) 2024-05-21T01:26:23.732 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.725+0000 7f8139400640 1 -- 172.21.15.63:0/3500264355 learned_addr learned my addr 172.21.15.63:0/3500264355 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-05-21T01:26:23.732 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.729+0000 7f8138a00640 1 -- 172.21.15.63:0/3500264355 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1328053189 0 0) 0x7f813c0b4a00 con 0x7f813c0ccae0 2024-05-21T01:26:23.732 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.729+0000 7f8138a00640 1 -- 172.21.15.63:0/3500264355 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8120003530 con 0x7f813c0ccae0 2024-05-21T01:26:23.732 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.729+0000 7f8139e00640 1 -- 172.21.15.63:0/3500264355 >> v2:172.21.15.131:3300/0 conn(0x7f813c0b61b0 msgr2=0x7f813c156350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:26:23.733 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.729+0000 7f8139e00640 1 --2- 172.21.15.63:0/3500264355 >> v2:172.21.15.131:3300/0 conn(0x7f813c0b61b0 0x7f813c156350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:23.733 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.729+0000 7f8139e00640 1 -- 172.21.15.63:0/3500264355 >> v1:172.21.15.131:6789/0 conn(0x7f813c0ccae0 legacy=0x7f813c0b5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:23.733 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.729+0000 7f8139e00640 1 -- 172.21.15.63:0/3500264355 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f813c0b4fc0 con 0x7f813c0cc700 2024-05-21T01:26:23.735 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.729+0000 7f8139e00640 1 --2- 172.21.15.63:0/3500264355 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f813c0cc700 0x7f813c155e10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f812c0097c0 tx=0x7f812c01c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f47cc0fe82d5d1fc server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:23.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.733+0000 7f8138a00640 1 -- 172.21.15.63:0/3500264355 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f812c0b2070 con 0x7f813c0cc700 2024-05-21T01:26:23.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.733+0000 7f8138a00640 1 -- 172.21.15.63:0/3500264355 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f812c0ad640 con 0x7f813c0cc700 2024-05-21T01:26:23.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.733+0000 7f8138a00640 1 -- 172.21.15.63:0/3500264355 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f812c0ad9f0 con 0x7f813c0cc700 2024-05-21T01:26:23.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.733+0000 7f8140e00640 1 -- 172.21.15.63:0/3500264355 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f813c0cc700 msgr2=0x7f813c155e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:23.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.733+0000 7f8140e00640 1 --2- 172.21.15.63:0/3500264355 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f813c0cc700 0x7f813c155e10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f812c0097c0 tx=0x7f812c01c4a0 comp rx=0 tx=0).stop 2024-05-21T01:26:23.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.733+0000 7f8140e00640 1 -- 172.21.15.63:0/3500264355 shutdown_connections 2024-05-21T01:26:23.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.733+0000 7f8140e00640 1 --2- 172.21.15.63:0/3500264355 >> v2:172.21.15.131:3300/0 conn(0x7f813c0b61b0 0x7f813c156350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:23.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.733+0000 7f8140e00640 1 --2- 172.21.15.63:0/3500264355 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f813c0cc700 0x7f813c155e10 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:23.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.733+0000 7f8140e00640 1 -- 172.21.15.63:0/3500264355 >> 172.21.15.63:0/3500264355 conn(0x7f813c068290 msgr2=0x7f813c0686a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:26:23.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.733+0000 7f8140e00640 1 -- 172.21.15.63:0/3500264355 shutdown_connections 2024-05-21T01:26:23.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.733+0000 7f8140e00640 1 -- 172.21.15.63:0/3500264355 wait complete. 2024-05-21T01:26:23.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.737+0000 7f8140e00640 1 Processor -- start 2024-05-21T01:26:23.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.737+0000 7f8140e00640 1 -- start start 2024-05-21T01:26:23.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.737+0000 7f8140e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f813c0b61b0 0x7f813c14d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:23.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.737+0000 7f8140e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f813c0cc700 0x7f813c1f4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:23.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.737+0000 7f8140e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f813c0ccae0 0x7f813c1f50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:23.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.737+0000 7f8140e00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f813c0d1f20 con 0x7f813c0cc700 2024-05-21T01:26:23.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.737+0000 7f8140e00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f813c0d20a0 con 0x7f813c0b61b0 2024-05-21T01:26:23.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.737+0000 7f8140e00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f813c168920 con 0x7f813c0ccae0 2024-05-21T01:26:23.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.737+0000 7f8139400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f813c0cc700 0x7f813c1f4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:23.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.737+0000 7f8139400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f813c0cc700 0x7f813c1f4b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35176/0 (socket says 172.21.15.63:35176) 2024-05-21T01:26:23.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.737+0000 7f8139400640 1 -- 172.21.15.63:0/1466135598 learned_addr learned my addr 172.21.15.63:0/1466135598 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:26:23.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.737+0000 7f8139e00640 1 --2- 172.21.15.63:0/1466135598 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f813c0b61b0 0x7f813c14d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:23.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.737+0000 7f813a800640 1 --2- 172.21.15.63:0/1466135598 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f813c0ccae0 0x7f813c1f50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:23.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.737+0000 7f8139400640 1 -- 172.21.15.63:0/1466135598 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f813c0ccae0 msgr2=0x7f813c1f50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:23.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.737+0000 7f8139400640 1 --2- 172.21.15.63:0/1466135598 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f813c0ccae0 0x7f813c1f50b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:23.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.737+0000 7f8139400640 1 -- 172.21.15.63:0/1466135598 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f813c0b61b0 msgr2=0x7f813c14d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:23.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.737+0000 7f8139400640 1 --2- 172.21.15.63:0/1466135598 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f813c0b61b0 0x7f813c14d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:23.743 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.737+0000 7f8139400640 1 -- 172.21.15.63:0/1466135598 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f813c154ce0 con 0x7f813c0cc700 2024-05-21T01:26:23.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.737+0000 7f8139400640 1 --2- 172.21.15.63:0/1466135598 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f813c0cc700 0x7f813c1f4b70 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f812800c430 tx=0x7f812800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:23.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.737+0000 7f8132000640 1 -- 172.21.15.63:0/1466135598 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8128017070 con 0x7f813c0cc700 2024-05-21T01:26:23.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.737+0000 7f8132000640 1 -- 172.21.15.63:0/1466135598 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8128005cf0 con 0x7f813c0cc700 2024-05-21T01:26:23.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.737+0000 7f8132000640 1 -- 172.21.15.63:0/1466135598 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81280072f0 con 0x7f813c0cc700 2024-05-21T01:26:23.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.737+0000 7f8140e00640 1 -- 172.21.15.63:0/1466135598 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f813c15a1f0 con 0x7f813c0cc700 2024-05-21T01:26:23.744 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.737+0000 7f8140e00640 1 -- 172.21.15.63:0/1466135598 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f813c155260 con 0x7f813c0cc700 2024-05-21T01:26:23.745 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.741+0000 7f8132000640 1 -- 172.21.15.63:0/1466135598 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7f812801a070 con 0x7f813c0cc700 2024-05-21T01:26:23.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.741+0000 7f8132000640 1 --2- 172.21.15.63:0/1466135598 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f811c06f400 0x7f811c0718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:23.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.741+0000 7f8132000640 1 -- 172.21.15.63:0/1466135598 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f812808e9b0 con 0x7f813c0cc700 2024-05-21T01:26:23.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.741+0000 7f814428e000 1 Processor -- start 2024-05-21T01:26:23.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.741+0000 7f8139e00640 1 --2- 172.21.15.63:0/1466135598 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f811c06f400 0x7f811c0718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:23.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.741+0000 7f814428e000 1 -- start start 2024-05-21T01:26:23.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.745+0000 7f814428e000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5623bf729b90 0x5623bf6f3390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:23.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.745+0000 7f814428e000 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5623bf6f38d0 0x5623bf72e620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:23.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.745+0000 7f814428e000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5623bf72eb60 0x5623bf72ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:23.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.745+0000 7f814428e000 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5623bf5488a0 con 0x5623bf6f38d0 2024-05-21T01:26:23.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.745+0000 7f814428e000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5623bf538440 con 0x5623bf729b90 2024-05-21T01:26:23.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.745+0000 7f814428e000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5623bf53c480 con 0x5623bf72eb60 2024-05-21T01:26:23.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.745+0000 7f8139400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5623bf6f38d0 0x5623bf72e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:23.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.745+0000 7f8139400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5623bf6f38d0 0x5623bf72e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35188/0 (socket says 172.21.15.63:35188) 2024-05-21T01:26:23.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.745+0000 7f8139400640 1 -- 172.21.15.63:0/232146385 learned_addr learned my addr 172.21.15.63:0/232146385 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:26:23.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.745+0000 7f8139e00640 1 --2- 172.21.15.63:0/1466135598 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f811c06f400 0x7f811c0718c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f812c0af000 tx=0x7f812c0a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:23.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.745+0000 7f8139e00640 1 --2- 172.21.15.63:0/232146385 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5623bf729b90 0x5623bf6f3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:23.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.745+0000 7f813a800640 1 --2- 172.21.15.63:0/232146385 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5623bf72eb60 0x5623bf72ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:23.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.745+0000 7f8139400640 1 -- 172.21.15.63:0/232146385 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5623bf72eb60 msgr2=0x5623bf72ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:26:23.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.745+0000 7f8139400640 1 --2- 172.21.15.63:0/232146385 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5623bf72eb60 0x5623bf72ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:23.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.745+0000 7f8139400640 1 -- 172.21.15.63:0/232146385 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5623bf729b90 msgr2=0x5623bf6f3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:26:23.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.745+0000 7f8139400640 1 --2- 172.21.15.63:0/232146385 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5623bf729b90 0x5623bf6f3390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:23.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.745+0000 7f8139400640 1 -- 172.21.15.63:0/232146385 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623bf5e4370 con 0x5623bf6f38d0 2024-05-21T01:26:23.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.745+0000 7f8139400640 1 --2- 172.21.15.63:0/232146385 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5623bf6f38d0 0x5623bf72e620 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f81280070a0 tx=0x7f812805ad20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae9daa50a7bd2d12 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:23.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.745+0000 7f8126a00640 1 -- 172.21.15.63:0/232146385 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f812805f1d0 con 0x5623bf6f38d0 2024-05-21T01:26:23.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.745+0000 7f8126a00640 1 -- 172.21.15.63:0/232146385 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8128063bf0 con 0x5623bf6f38d0 2024-05-21T01:26:23.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.745+0000 7f8126a00640 1 -- 172.21.15.63:0/232146385 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81280076b0 con 0x5623bf6f38d0 2024-05-21T01:26:23.752 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.749+0000 7f814428e000 1 -- 172.21.15.63:0/232146385 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5623bf6f38d0 msgr2=0x5623bf72e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:23.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.749+0000 7f814428e000 1 --2- 172.21.15.63:0/232146385 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5623bf6f38d0 0x5623bf72e620 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f81280070a0 tx=0x7f812805ad20 comp rx=0 tx=0).stop 2024-05-21T01:26:23.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.749+0000 7f814428e000 1 -- 172.21.15.63:0/232146385 shutdown_connections 2024-05-21T01:26:23.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.749+0000 7f814428e000 1 --2- 172.21.15.63:0/232146385 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5623bf72eb60 0x5623bf72ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:23.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.749+0000 7f814428e000 1 --2- 172.21.15.63:0/232146385 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5623bf6f38d0 0x5623bf72e620 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:23.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.749+0000 7f814428e000 1 --2- 172.21.15.63:0/232146385 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5623bf729b90 0x5623bf6f3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:23.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.749+0000 7f814428e000 1 -- 172.21.15.63:0/232146385 >> 172.21.15.63:0/232146385 conn(0x5623bf5d5f90 msgr2=0x5623bf72c3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:26:23.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.749+0000 7f814428e000 1 -- 172.21.15.63:0/232146385 shutdown_connections 2024-05-21T01:26:23.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.749+0000 7f814428e000 1 -- 172.21.15.63:0/232146385 wait complete. 2024-05-21T01:26:23.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.749+0000 7f814428e000 1 -- start start 2024-05-21T01:26:23.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.749+0000 7f814428e000 1 Processor -- start 2024-05-21T01:26:23.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.749+0000 7f814428e000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5623bf6f38d0 0x5623bf728730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:23.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.749+0000 7f814428e000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5623bf729b90 0x5623bf728c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:23.756 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.749+0000 7f814428e000 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5623bf72eb60 0x5623bf7343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:23.756 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.749+0000 7f814428e000 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5623bf4df4d0 con 0x5623bf72eb60 2024-05-21T01:26:23.756 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.749+0000 7f814428e000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5623bf540ab0 con 0x5623bf729b90 2024-05-21T01:26:23.756 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.749+0000 7f814428e000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5623bf5488a0 con 0x5623bf6f38d0 2024-05-21T01:26:23.756 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.749+0000 7f814428e000 10 client.0 _ll_register_callbacks cb 0x5623bf4daee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-21T01:26:23.756 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.749+0000 7f813a800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5623bf72eb60 0x5623bf7343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:23.756 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.749+0000 7f813a800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5623bf72eb60 0x5623bf7343b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35200/0 (socket says 172.21.15.63:35200) 2024-05-21T01:26:23.756 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.749+0000 7f813a800640 1 -- 172.21.15.63:0/2649757170 learned_addr learned my addr 172.21.15.63:0/2649757170 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:26:23.756 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.749+0000 7f8139e00640 1 --2- 172.21.15.63:0/2649757170 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5623bf6f38d0 0x5623bf728730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:23.756 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.749+0000 7f8139400640 1 --2- 172.21.15.63:0/2649757170 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5623bf729b90 0x5623bf728c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:23.758 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.753+0000 7f813a800640 1 -- 172.21.15.63:0/2649757170 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5623bf6f38d0 msgr2=0x5623bf728730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:26:23.758 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.753+0000 7f813a800640 1 --2- 172.21.15.63:0/2649757170 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5623bf6f38d0 0x5623bf728730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:23.758 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.753+0000 7f813a800640 1 -- 172.21.15.63:0/2649757170 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5623bf729b90 msgr2=0x5623bf728c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:26:23.758 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.753+0000 7f813a800640 1 --2- 172.21.15.63:0/2649757170 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5623bf729b90 0x5623bf728c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:23.758 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.753+0000 7f813a800640 1 -- 172.21.15.63:0/2649757170 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5623bf582260 con 0x5623bf72eb60 2024-05-21T01:26:23.758 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.753+0000 7f813a800640 1 --2- 172.21.15.63:0/2649757170 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5623bf72eb60 0x5623bf7343b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f8134007d30 tx=0x7f8134012610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf31d82ee60bef9b server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:23.758 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.753+0000 7f811b400640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-05-21T01:26:23.758 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.753+0000 7f811b400640 1 -- 172.21.15.63:0/2649757170 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f813401c020 con 0x5623bf72eb60 2024-05-21T01:26:23.758 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.753+0000 7f814428e000 1 -- 172.21.15.63:0/2649757170 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8128063bf0 con 0x5623bf72eb60 2024-05-21T01:26:23.758 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.753+0000 7f811b400640 1 -- 172.21.15.63:0/2649757170 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f8134018670 con 0x5623bf72eb60 2024-05-21T01:26:23.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.753+0000 7f811b400640 1 -- 172.21.15.63:0/2649757170 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f8134026050 con 0x5623bf72eb60 2024-05-21T01:26:23.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.753+0000 7f814428e000 10 client.5082 fetch_fsmap learned FSMap version 15 2024-05-21T01:26:23.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.753+0000 7f814428e000 1 -- 172.21.15.63:0/2649757170 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x5623bf4df6e0 con 0x5623bf72eb60 2024-05-21T01:26:23.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.753+0000 7f811b400640 1 -- 172.21.15.63:0/2649757170 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8128063bf0 con 0x5623bf72eb60 2024-05-21T01:26:23.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.753+0000 7f811b400640 1 -- 172.21.15.63:0/2649757170 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 15) ==== 4752+0+0 (secure 0 0 0) 0x7f8134029020 con 0x5623bf72eb60 2024-05-21T01:26:23.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.753+0000 7f814428e000 10 client.5082 fetch_fsmap finished waiting for FSMap version 15 2024-05-21T01:26:23.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.753+0000 7f814428e000 10 client.5082 resolve_mds: validated gid 4276 aka daemon mds.c 2024-05-21T01:26:23.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.753+0000 7f814428e000 20 client.5082 populate_metadata read hostname 'smithi063' 2024-05-21T01:26:23.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.753+0000 7f814428e000 1 --2- 172.21.15.63:0/2649757170 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x5623bf7350f0 0x5623bf735500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:23.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.753+0000 7f814428e000 4 client.5082 mds_command: new command op to 4276 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-21T01:26:23.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.753+0000 7f814428e000 1 -- 172.21.15.63:0/2649757170 --> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5623bf4d4060 con 0x5623bf7350f0 2024-05-21T01:26:23.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.753+0000 7f8139e00640 1 --2- 172.21.15.63:0/2649757170 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x5623bf7350f0 0x5623bf735500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:23.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.753+0000 7f811b400640 10 client.5082 ms_handle_connect on v2:172.21.15.63:6834/2892727989 2024-05-21T01:26:23.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.753+0000 7f8139e00640 1 --2- 172.21.15.63:0/2649757170 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x5623bf7350f0 0x5623bf735500 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=98f690d363648015 server_cookie=f786deb110f4c233 in_seq=0 out_seq=0 2024-05-21T01:26:23.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.753+0000 7f811b400640 1 -- 172.21.15.63:0/2649757170 <== mds.0 v2:172.21.15.63:6834/2892727989 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x5623bf4d4060 con 0x5623bf7350f0 2024-05-21T01:26:23.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.753+0000 7f811b400640 10 client.5082 handle_command_reply: tid=0 2024-05-21T01:26:23.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.753+0000 7f814428e000 1 client.5082 shutdown 2024-05-21T01:26:23.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.753+0000 7f814428e000 1 -- 172.21.15.63:0/2649757170 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5623bf72eb60 msgr2=0x5623bf7343b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:23.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.753+0000 7f814428e000 1 --2- 172.21.15.63:0/2649757170 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5623bf72eb60 0x5623bf7343b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f8134007d30 tx=0x7f8134012610 comp rx=0 tx=0).stop 2024-05-21T01:26:23.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.753+0000 7f814428e000 1 -- 172.21.15.63:0/2649757170 shutdown_connections 2024-05-21T01:26:23.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.753+0000 7f814428e000 1 --2- 172.21.15.63:0/2649757170 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x5623bf7350f0 0x5623bf735500 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:23.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.753+0000 7f814428e000 1 --2- 172.21.15.63:0/2649757170 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5623bf72eb60 0x5623bf7343b0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:23.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.753+0000 7f814428e000 1 --2- 172.21.15.63:0/2649757170 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5623bf729b90 0x5623bf728c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:23.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.753+0000 7f814428e000 1 --2- 172.21.15.63:0/2649757170 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5623bf6f38d0 0x5623bf728730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:23.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.753+0000 7f814428e000 1 -- 172.21.15.63:0/2649757170 >> 172.21.15.63:0/2649757170 conn(0x5623bf5d5f90 msgr2=0x5623bf6f2b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:26:23.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.753+0000 7f811b400640 0 client.5082 ms_handle_reset on v2:172.21.15.63:6834/2892727989 2024-05-21T01:26:23.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.757+0000 7f814428e000 1 -- 172.21.15.63:0/2649757170 shutdown_connections 2024-05-21T01:26:23.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.757+0000 7f814428e000 1 -- 172.21.15.63:0/2649757170 wait complete. 2024-05-21T01:26:23.762 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.757+0000 7f814428e000 20 client.5082 trim_cache size 0 max 16384 2024-05-21T01:26:23.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.785+0000 7f814428e000 1 Processor -- start 2024-05-21T01:26:23.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.785+0000 7f814428e000 1 -- start start 2024-05-21T01:26:23.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.785+0000 7f814428e000 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5623bf6f38d0 0x5623bf734180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:23.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.785+0000 7f814428e000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5623bf729b90 0x5623bf749fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:23.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.785+0000 7f814428e000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5623bf72eb60 0x5623bf74a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:23.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.785+0000 7f814428e000 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f813c201200 con 0x5623bf6f38d0 2024-05-21T01:26:23.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.785+0000 7f814428e000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f813c1f8720 con 0x5623bf729b90 2024-05-21T01:26:23.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.785+0000 7f814428e000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f813c200be0 con 0x5623bf72eb60 2024-05-21T01:26:23.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.785+0000 7f8139e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5623bf6f38d0 0x5623bf734180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:23.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.785+0000 7f8139e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5623bf6f38d0 0x5623bf734180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35206/0 (socket says 172.21.15.63:35206) 2024-05-21T01:26:23.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.785+0000 7f8139e00640 1 -- 172.21.15.63:0/999886102 learned_addr learned my addr 172.21.15.63:0/999886102 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:26:23.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.785+0000 7f8139400640 1 --2- 172.21.15.63:0/999886102 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5623bf729b90 0x5623bf749fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:23.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.785+0000 7f813a800640 1 --2- 172.21.15.63:0/999886102 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5623bf72eb60 0x5623bf74a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:23.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.785+0000 7f8139e00640 1 -- 172.21.15.63:0/999886102 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5623bf72eb60 msgr2=0x5623bf74a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:26:23.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.785+0000 7f8139e00640 1 --2- 172.21.15.63:0/999886102 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5623bf72eb60 0x5623bf74a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:23.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.785+0000 7f8139e00640 1 -- 172.21.15.63:0/999886102 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5623bf729b90 msgr2=0x5623bf749fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:26:23.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.785+0000 7f8139e00640 1 --2- 172.21.15.63:0/999886102 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5623bf729b90 0x5623bf749fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:23.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.785+0000 7f8139e00640 1 -- 172.21.15.63:0/999886102 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623bf5bdcf0 con 0x5623bf6f38d0 2024-05-21T01:26:23.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.785+0000 7f8139400640 1 --2- 172.21.15.63:0/999886102 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5623bf729b90 0x5623bf749fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T01:26:23.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.785+0000 7f8139e00640 1 --2- 172.21.15.63:0/999886102 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5623bf6f38d0 0x5623bf734180 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f812c0b0040 tx=0x7f812c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e622285a00897636 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:23.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.789+0000 7f8126000640 1 -- 172.21.15.63:0/999886102 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f812c0b2050 con 0x5623bf6f38d0 2024-05-21T01:26:23.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.789+0000 7f8126000640 1 -- 172.21.15.63:0/999886102 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f812c0b3040 con 0x5623bf6f38d0 2024-05-21T01:26:23.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.789+0000 7f8126000640 1 -- 172.21.15.63:0/999886102 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f812c003820 con 0x5623bf6f38d0 2024-05-21T01:26:23.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.789+0000 7f814428e000 1 -- 172.21.15.63:0/999886102 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5623bf6f38d0 msgr2=0x5623bf734180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:23.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.789+0000 7f814428e000 1 --2- 172.21.15.63:0/999886102 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5623bf6f38d0 0x5623bf734180 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f812c0b0040 tx=0x7f812c004740 comp rx=0 tx=0).stop 2024-05-21T01:26:23.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.789+0000 7f814428e000 1 -- 172.21.15.63:0/999886102 shutdown_connections 2024-05-21T01:26:23.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.789+0000 7f814428e000 1 --2- 172.21.15.63:0/999886102 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5623bf72eb60 0x5623bf74a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:23.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.789+0000 7f814428e000 1 --2- 172.21.15.63:0/999886102 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5623bf729b90 0x5623bf749fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:23.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.789+0000 7f814428e000 1 --2- 172.21.15.63:0/999886102 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5623bf6f38d0 0x5623bf734180 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:23.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.789+0000 7f814428e000 1 -- 172.21.15.63:0/999886102 >> 172.21.15.63:0/999886102 conn(0x5623bf5d5f90 msgr2=0x5623bf6ea0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:26:23.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.789+0000 7f814428e000 1 -- 172.21.15.63:0/999886102 shutdown_connections 2024-05-21T01:26:23.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.789+0000 7f814428e000 1 -- 172.21.15.63:0/999886102 wait complete. 2024-05-21T01:26:23.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.789+0000 7f814428e000 1 -- start start 2024-05-21T01:26:23.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.789+0000 7f814428e000 1 Processor -- start 2024-05-21T01:26:23.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.789+0000 7f814428e000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5623bf6f38d0 0x5623bf74a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:23.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.789+0000 7f814428e000 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5623bf729b90 0x5623bf736730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:23.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.789+0000 7f814428e000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5623bf72eb60 0x5623bf736c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:23.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.789+0000 7f814428e000 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x5623bf5345f0 con 0x5623bf729b90 2024-05-21T01:26:23.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.789+0000 7f814428e000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x5623bf5bd860 con 0x5623bf72eb60 2024-05-21T01:26:23.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.789+0000 7f814428e000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x5623bf4d0c50 con 0x5623bf6f38d0 2024-05-21T01:26:23.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.789+0000 7f814428e000 10 client.0 _ll_register_callbacks cb 0x7f8134009d80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-21T01:26:23.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.789+0000 7f8139400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5623bf729b90 0x5623bf736730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:23.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.789+0000 7f8139400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5623bf729b90 0x5623bf736730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:35208/0 (socket says 172.21.15.63:35208) 2024-05-21T01:26:23.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.789+0000 7f8139400640 1 -- 172.21.15.63:0/3611146979 learned_addr learned my addr 172.21.15.63:0/3611146979 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:26:23.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.789+0000 7f813a800640 1 --2- 172.21.15.63:0/3611146979 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5623bf72eb60 0x5623bf736c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:23.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.789+0000 7f8139e00640 1 --2- 172.21.15.63:0/3611146979 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5623bf6f38d0 0x5623bf74a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:23.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.789+0000 7f8139400640 1 -- 172.21.15.63:0/3611146979 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5623bf6f38d0 msgr2=0x5623bf74a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:26:23.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.789+0000 7f8139400640 1 --2- 172.21.15.63:0/3611146979 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5623bf6f38d0 0x5623bf74a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:23.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.789+0000 7f8139400640 1 -- 172.21.15.63:0/3611146979 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5623bf72eb60 msgr2=0x5623bf736c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:26:23.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.789+0000 7f8139400640 1 --2- 172.21.15.63:0/3611146979 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5623bf72eb60 0x5623bf736c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:23.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.789+0000 7f8139400640 1 -- 172.21.15.63:0/3611146979 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5623bf4eaca0 con 0x5623bf729b90 2024-05-21T01:26:23.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.789+0000 7f813a800640 1 --2- 172.21.15.63:0/3611146979 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5623bf72eb60 0x5623bf736c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T01:26:23.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.789+0000 7f8139e00640 1 --2- 172.21.15.63:0/3611146979 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5623bf6f38d0 0x5623bf74a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T01:26:23.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.789+0000 7f8139400640 1 --2- 172.21.15.63:0/3611146979 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5623bf729b90 0x5623bf736730 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f81280058b0 tx=0x7f812808c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d5c45d8546aabe9 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:23.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.789+0000 7f811b400640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-05-21T01:26:23.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.789+0000 7f811b400640 1 -- 172.21.15.63:0/3611146979 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8128080060 con 0x5623bf729b90 2024-05-21T01:26:23.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.789+0000 7f811b400640 1 -- 172.21.15.63:0/3611146979 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f812807bdb0 con 0x5623bf729b90 2024-05-21T01:26:23.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.789+0000 7f814428e000 1 -- 172.21.15.63:0/3611146979 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f812c0b3040 con 0x5623bf729b90 2024-05-21T01:26:23.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.793+0000 7f811b400640 1 -- 172.21.15.63:0/3611146979 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7f8128057470 con 0x5623bf729b90 2024-05-21T01:26:23.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.793+0000 7f814428e000 10 client.5088 fetch_fsmap learned FSMap version 15 2024-05-21T01:26:23.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.793+0000 7f814428e000 1 -- 172.21.15.63:0/3611146979 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x5623bf4cf9c0 con 0x5623bf729b90 2024-05-21T01:26:23.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.793+0000 7f811b400640 1 -- 172.21.15.63:0/3611146979 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f812c0b3040 con 0x5623bf729b90 2024-05-21T01:26:23.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.793+0000 7f811b400640 1 -- 172.21.15.63:0/3611146979 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 15) ==== 4752+0+0 (secure 0 0 0) 0x7f8128007490 con 0x5623bf729b90 2024-05-21T01:26:23.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.793+0000 7f814428e000 10 client.5088 fetch_fsmap finished waiting for FSMap version 15 2024-05-21T01:26:23.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.793+0000 7f814428e000 10 client.5088 resolve_mds: validated gid 4276 aka daemon mds.c 2024-05-21T01:26:23.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.793+0000 7f814428e000 20 client.5088 populate_metadata read hostname 'smithi063' 2024-05-21T01:26:23.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.793+0000 7f814428e000 1 --2- 172.21.15.63:0/3611146979 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x5623bf6eea80 0x5623bf6eee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:23.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.793+0000 7f814428e000 4 client.5088 mds_command: new command op to 4276 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "5514a50b", "release": true, "await": true}] 2024-05-21T01:26:23.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.793+0000 7f814428e000 1 -- 172.21.15.63:0/3611146979 --> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] -- command(tid 0: {"prefix": "quiesce db", "set_id": "5514a50b", "release": true, "await": true}) -- 0x5623bf54a7f0 con 0x5623bf6eea80 2024-05-21T01:26:23.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.793+0000 7f8139e00640 1 --2- 172.21.15.63:0/3611146979 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x5623bf6eea80 0x5623bf6eee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:23.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.793+0000 7f8139e00640 1 --2- 172.21.15.63:0/3611146979 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x5623bf6eea80 0x5623bf6eee90 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4454c66f220d75c6 server_cookie=e733ecfa674a6f4 in_seq=0 out_seq=0 2024-05-21T01:26:23.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.793+0000 7f811b400640 10 client.5088 ms_handle_connect on v2:172.21.15.63:6834/2892727989 2024-05-21T01:26:23.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.793+0000 7f811b400640 1 -- 172.21.15.63:0/3611146979 <== mds.0 v2:172.21.15.63:6834/2892727989 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x5623bf54a7f0 con 0x5623bf6eea80 2024-05-21T01:26:23.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.793+0000 7f811b400640 10 client.5088 handle_command_reply: tid=0 2024-05-21T01:26:23.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.793+0000 7f814428e000 1 client.5088 shutdown 2024-05-21T01:26:23.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.793+0000 7f814428e000 1 -- 172.21.15.63:0/3611146979 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5623bf729b90 msgr2=0x5623bf736730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:23.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.793+0000 7f814428e000 1 --2- 172.21.15.63:0/3611146979 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5623bf729b90 0x5623bf736730 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f81280058b0 tx=0x7f812808c9a0 comp rx=0 tx=0).stop 2024-05-21T01:26:23.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.793+0000 7f814428e000 1 -- 172.21.15.63:0/3611146979 shutdown_connections 2024-05-21T01:26:23.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.793+0000 7f814428e000 1 --2- 172.21.15.63:0/3611146979 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x5623bf6eea80 0x5623bf6eee90 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:23.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.793+0000 7f814428e000 1 --2- 172.21.15.63:0/3611146979 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5623bf72eb60 0x5623bf736c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:23.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.793+0000 7f814428e000 1 --2- 172.21.15.63:0/3611146979 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5623bf729b90 0x5623bf736730 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:23.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.793+0000 7f811b400640 0 client.5088 ms_handle_reset on v2:172.21.15.63:6834/2892727989 2024-05-21T01:26:23.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.793+0000 7f814428e000 1 --2- 172.21.15.63:0/3611146979 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5623bf6f38d0 0x5623bf74a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:23.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.793+0000 7f814428e000 1 -- 172.21.15.63:0/3611146979 >> 172.21.15.63:0/3611146979 conn(0x5623bf5d5f90 msgr2=0x5623bf732f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:26:23.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.793+0000 7f814428e000 1 -- 172.21.15.63:0/3611146979 shutdown_connections 2024-05-21T01:26:23.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.793+0000 7f814428e000 1 -- 172.21.15.63:0/3611146979 wait complete. 2024-05-21T01:26:23.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.793+0000 7f814428e000 20 client.5088 trim_cache size 0 max 16384 2024-05-21T01:26:23.802 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-05-21T01:26:23.802 INFO:teuthology.orchestra.run.smithi063.stdout: "epoch": 15, 2024-05-21T01:26:23.802 INFO:teuthology.orchestra.run.smithi063.stdout: "leader": 4276, 2024-05-21T01:26:23.803 INFO:teuthology.orchestra.run.smithi063.stdout: "set_version": 24, 2024-05-21T01:26:23.803 INFO:teuthology.orchestra.run.smithi063.stdout: "sets": { 2024-05-21T01:26:23.803 INFO:teuthology.orchestra.run.smithi063.stdout: "5514a50b": { 2024-05-21T01:26:23.803 INFO:teuthology.orchestra.run.smithi063.stdout: "version": 24, 2024-05-21T01:26:23.803 INFO:teuthology.orchestra.run.smithi063.stdout: "age_ref": 0.0, 2024-05-21T01:26:23.803 INFO:teuthology.orchestra.run.smithi063.stdout: "state": { 2024-05-21T01:26:23.803 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "RELEASED", 2024-05-21T01:26:23.803 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 0.0 2024-05-21T01:26:23.803 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2024-05-21T01:26:23.803 INFO:teuthology.orchestra.run.smithi063.stdout: "timeout": 90.0, 2024-05-21T01:26:23.803 INFO:teuthology.orchestra.run.smithi063.stdout: "expiration": 146.0, 2024-05-21T01:26:23.803 INFO:teuthology.orchestra.run.smithi063.stdout: "members": { 2024-05-21T01:26:23.803 INFO:teuthology.orchestra.run.smithi063.stdout: "file:/": { 2024-05-21T01:26:23.803 INFO:teuthology.orchestra.run.smithi063.stdout: "excluded": false, 2024-05-21T01:26:23.804 INFO:teuthology.orchestra.run.smithi063.stdout: "state": { 2024-05-21T01:26:23.804 INFO:teuthology.orchestra.run.smithi063.stdout: "name": "RELEASED", 2024-05-21T01:26:23.804 INFO:teuthology.orchestra.run.smithi063.stdout: "age": 0.0 2024-05-21T01:26:23.804 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-05-21T01:26:23.804 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-05-21T01:26:23.804 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-05-21T01:26:23.804 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-05-21T01:26:23.804 INFO:teuthology.orchestra.run.smithi063.stdout: } 2024-05-21T01:26:23.804 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-05-21T01:26:23.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.793+0000 7f8140e00640 1 -- 172.21.15.63:0/1466135598 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f811c06f400 msgr2=0x7f811c0718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:23.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.793+0000 7f8140e00640 1 --2- 172.21.15.63:0/1466135598 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f811c06f400 0x7f811c0718c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f812c0af000 tx=0x7f812c0a7070 comp rx=0 tx=0).stop 2024-05-21T01:26:23.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.793+0000 7f8140e00640 1 -- 172.21.15.63:0/1466135598 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f813c0cc700 msgr2=0x7f813c1f4b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:23.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.793+0000 7f8140e00640 1 --2- 172.21.15.63:0/1466135598 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f813c0cc700 0x7f813c1f4b70 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f812800c430 tx=0x7f812800c8f0 comp rx=0 tx=0).stop 2024-05-21T01:26:23.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.793+0000 7f8140e00640 1 -- 172.21.15.63:0/1466135598 shutdown_connections 2024-05-21T01:26:23.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.793+0000 7f8140e00640 1 --2- 172.21.15.63:0/1466135598 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f811c06f400 0x7f811c0718c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:23.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.793+0000 7f8140e00640 1 --2- 172.21.15.63:0/1466135598 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f813c0ccae0 0x7f813c1f50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:23.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.797+0000 7f8140e00640 1 --2- 172.21.15.63:0/1466135598 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f813c0cc700 0x7f813c1f4b70 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:23.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.797+0000 7f8140e00640 1 --2- 172.21.15.63:0/1466135598 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f813c0b61b0 0x7f813c14d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:23.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.797+0000 7f8140e00640 1 -- 172.21.15.63:0/1466135598 >> 172.21.15.63:0/1466135598 conn(0x7f813c068290 msgr2=0x7f813c0cf700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:26:23.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.797+0000 7f8140e00640 1 -- 172.21.15.63:0/1466135598 shutdown_connections 2024-05-21T01:26:23.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:23.797+0000 7f8140e00640 1 -- 172.21.15.63:0/1466135598 wait complete. 2024-05-21T01:26:23.823 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '5514a50b', total seconds elapsed: 26.8 2024-05-21T01:26:26.226 INFO:tasks.workunit.client.0.smithi063.stdout: 2024-05-21T01:26:26.226 INFO:tasks.workunit.client.0.smithi063.stdout: Children see throughput for 1 re-readers = 370504.19 kB/sec 2024-05-21T01:26:26.226 INFO:tasks.workunit.client.0.smithi063.stdout: Parent sees throughput for 1 re-readers = 370496.92 kB/sec 2024-05-21T01:26:26.226 INFO:tasks.workunit.client.0.smithi063.stdout: Min throughput per process = 370504.19 kB/sec 2024-05-21T01:26:26.227 INFO:tasks.workunit.client.0.smithi063.stdout: Max throughput per process = 370504.19 kB/sec 2024-05-21T01:26:26.227 INFO:tasks.workunit.client.0.smithi063.stdout: Avg throughput per process = 370504.19 kB/sec 2024-05-21T01:26:26.227 INFO:tasks.workunit.client.0.smithi063.stdout: Min xfer = 10485760.00 kB 2024-05-21T01:26:27.407 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-21T01:26:27.411 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-21T01:26:36.335 INFO:tasks.workunit.client.0.smithi063.stdout: 2024-05-21T01:26:36.335 INFO:tasks.workunit.client.0.smithi063.stdout: 2024-05-21T01:26:36.335 INFO:tasks.workunit.client.0.smithi063.stdout: 2024-05-21T01:26:36.335 INFO:tasks.workunit.client.0.smithi063.stdout:iozone test complete. 2024-05-21T01:26:36.337 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-05-21T01:26:36.337 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-05-21T01:26:36.379 INFO:tasks.workunit:Stopping ['suites/iozone.sh'] on client.0... 2024-05-21T01:26:36.380 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-05-21T01:26:38.076 DEBUG:teuthology.parallel:result is None 2024-05-21T01:26:38.076 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-05-21T01:26:38.108 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-05-21T01:26:38.108 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2024-05-21T01:26:38.117 INFO:tasks.quiescer:joining Quiescers 2024-05-21T01:26:38.117 WARNING:tasks.quiescer:The quiescer is requested to stop, running cancel all 2024-05-21T01:26:38.118 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-21T01:26:38.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.305+0000 7fa38be00640 1 Processor -- start 2024-05-21T01:26:38.308 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.305+0000 7fa38be00640 1 -- start start 2024-05-21T01:26:38.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.305+0000 7fa38be00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa38c155e80 0x7fa38c0747d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:38.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.305+0000 7fa38be00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa38c0c8f10 0x7fa38c15bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:38.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.305+0000 7fa38be00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa38c0ca080 0x7fa38c0ca510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:38.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.305+0000 7fa38be00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7fa38c15f9d0 con 0x7fa38c0ca080 2024-05-21T01:26:38.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.305+0000 7fa38be00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fa38c0c80d0 con 0x7fa38c0c8f10 2024-05-21T01:26:38.310 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.305+0000 7fa38be00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fa38c0c92f0 con 0x7fa38c155e80 2024-05-21T01:26:38.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.305+0000 7fa38b400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa38c0ca080 0x7fa38c0ca510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:38.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.305+0000 7fa38b400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa38c0ca080 0x7fa38c0ca510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47980/0 (socket says 172.21.15.63:47980) 2024-05-21T01:26:38.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.305+0000 7fa38b400640 1 -- 172.21.15.63:0/3716352615 learned_addr learned my addr 172.21.15.63:0/3716352615 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:26:38.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.305+0000 7fa38a000640 1 --2- 172.21.15.63:0/3716352615 >> v2:172.21.15.131:3300/0 conn(0x7fa38c0c8f10 0x7fa38c15bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:38.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.305+0000 7fa38aa00640 1 --2- 172.21.15.63:0/3716352615 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa38c155e80 0x7fa38c0747d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:38.311 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.305+0000 7fa38b400640 1 -- 172.21.15.63:0/3716352615 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa38c155e80 msgr2=0x7fa38c0747d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:26:38.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.305+0000 7fa38b400640 1 --2- 172.21.15.63:0/3716352615 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa38c155e80 0x7fa38c0747d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:38.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.305+0000 7fa38b400640 1 -- 172.21.15.63:0/3716352615 >> v2:172.21.15.131:3300/0 conn(0x7fa38c0c8f10 msgr2=0x7fa38c15bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:26:38.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.305+0000 7fa38b400640 1 --2- 172.21.15.63:0/3716352615 >> v2:172.21.15.131:3300/0 conn(0x7fa38c0c8f10 0x7fa38c15bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:38.312 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.305+0000 7fa38b400640 1 -- 172.21.15.63:0/3716352615 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa38c0c8330 con 0x7fa38c0ca080 2024-05-21T01:26:38.314 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.309+0000 7fa38b400640 1 --2- 172.21.15.63:0/3716352615 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa38c0ca080 0x7fa38c0ca510 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fa38c069580 tx=0x7fa38401c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ed72578625fdc65 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:38.315 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.309+0000 7fa389600640 1 -- 172.21.15.63:0/3716352615 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3840a55e0 con 0x7fa38c0ca080 2024-05-21T01:26:38.315 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.309+0000 7fa389600640 1 -- 172.21.15.63:0/3716352615 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3840a5780 con 0x7fa38c0ca080 2024-05-21T01:26:38.315 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.309+0000 7fa389600640 1 -- 172.21.15.63:0/3716352615 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3840a5b50 con 0x7fa38c0ca080 2024-05-21T01:26:38.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.309+0000 7fa38be00640 1 -- 172.21.15.63:0/3716352615 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa38c0ca080 msgr2=0x7fa38c0ca510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:38.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.309+0000 7fa38be00640 1 --2- 172.21.15.63:0/3716352615 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa38c0ca080 0x7fa38c0ca510 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fa38c069580 tx=0x7fa38401c960 comp rx=0 tx=0).stop 2024-05-21T01:26:38.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.309+0000 7fa38be00640 1 -- 172.21.15.63:0/3716352615 shutdown_connections 2024-05-21T01:26:38.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.309+0000 7fa38be00640 1 --2- 172.21.15.63:0/3716352615 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa38c0ca080 0x7fa38c0ca510 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:38.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.309+0000 7fa38be00640 1 --2- 172.21.15.63:0/3716352615 >> v2:172.21.15.131:3300/0 conn(0x7fa38c0c8f10 0x7fa38c15bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:38.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.309+0000 7fa38be00640 1 --2- 172.21.15.63:0/3716352615 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa38c155e80 0x7fa38c0747d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:38.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.309+0000 7fa38be00640 1 -- 172.21.15.63:0/3716352615 >> 172.21.15.63:0/3716352615 conn(0x7fa38c06f590 msgr2=0x7fa38c06f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:26:38.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.309+0000 7fa38be00640 1 -- 172.21.15.63:0/3716352615 shutdown_connections 2024-05-21T01:26:38.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.309+0000 7fa38be00640 1 -- 172.21.15.63:0/3716352615 wait complete. 2024-05-21T01:26:38.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.313+0000 7fa38be00640 1 Processor -- start 2024-05-21T01:26:38.318 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.313+0000 7fa38be00640 1 -- start start 2024-05-21T01:26:38.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.313+0000 7fa38be00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa38c0c8f10 0x7fa38c1f8880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:38.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.313+0000 7fa38be00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa38c0ca080 0x7fa38c1f4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:38.319 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.313+0000 7fa38be00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa38c155e80 0x7fa38c15a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:38.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.313+0000 7fa38be00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fa38c0c7a30 con 0x7fa38c0c8f10 2024-05-21T01:26:38.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.313+0000 7fa38be00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa38c15f660 con 0x7fa38c155e80 2024-05-21T01:26:38.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.313+0000 7fa38be00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fa38c0c7bb0 con 0x7fa38c0ca080 2024-05-21T01:26:38.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.313+0000 7fa38aa00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa38c0c8f10 0x7fa38c1f8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:38.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.313+0000 7fa38aa00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa38c0c8f10 0x7fa38c1f8880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47988/0 (socket says 172.21.15.63:47988) 2024-05-21T01:26:38.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.313+0000 7fa38aa00640 1 -- 172.21.15.63:0/4204223495 learned_addr learned my addr 172.21.15.63:0/4204223495 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:26:38.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.313+0000 7fa38a000640 1 --2- 172.21.15.63:0/4204223495 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa38c0ca080 0x7fa38c1f4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:38.320 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.313+0000 7fa38b400640 1 --2- 172.21.15.63:0/4204223495 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa38c155e80 0x7fa38c15a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:38.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.317+0000 7fa38aa00640 1 -- 172.21.15.63:0/4204223495 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa38c0ca080 msgr2=0x7fa38c1f4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:38.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.317+0000 7fa38aa00640 1 --2- 172.21.15.63:0/4204223495 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa38c0ca080 0x7fa38c1f4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:38.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.317+0000 7fa38aa00640 1 -- 172.21.15.63:0/4204223495 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa38c155e80 msgr2=0x7fa38c15a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:38.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.317+0000 7fa38aa00640 1 --2- 172.21.15.63:0/4204223495 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa38c155e80 0x7fa38c15a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:38.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.317+0000 7fa38aa00640 1 -- 172.21.15.63:0/4204223495 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa38c15c930 con 0x7fa38c0c8f10 2024-05-21T01:26:38.321 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.317+0000 7fa38aa00640 1 --2- 172.21.15.63:0/4204223495 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa38c0c8f10 0x7fa38c1f8880 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fa37c00d620 tx=0x7fa37c00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:38.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.317+0000 7fa382a00640 1 -- 172.21.15.63:0/4204223495 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa37c00b620 con 0x7fa38c0c8f10 2024-05-21T01:26:38.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.317+0000 7fa382a00640 1 -- 172.21.15.63:0/4204223495 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa37c019070 con 0x7fa38c0c8f10 2024-05-21T01:26:38.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.317+0000 7fa38be00640 1 -- 172.21.15.63:0/4204223495 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa38c15c370 con 0x7fa38c0c8f10 2024-05-21T01:26:38.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.317+0000 7fa382a00640 1 -- 172.21.15.63:0/4204223495 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa37c00b9e0 con 0x7fa38c0c8f10 2024-05-21T01:26:38.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.317+0000 7fa38be00640 1 -- 172.21.15.63:0/4204223495 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa38c1f7da0 con 0x7fa38c0c8f10 2024-05-21T01:26:38.322 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.317+0000 7fa38be00640 1 -- 172.21.15.63:0/4204223495 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa38c06c0c0 con 0x7fa38c0c8f10 2024-05-21T01:26:38.323 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.317+0000 7fa382a00640 1 -- 172.21.15.63:0/4204223495 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7fa37c00bb80 con 0x7fa38c0c8f10 2024-05-21T01:26:38.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.321+0000 7fa382a00640 1 --2- 172.21.15.63:0/4204223495 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fa36c06f400 0x7fa36c0718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:38.324 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.321+0000 7fa382a00640 1 -- 172.21.15.63:0/4204223495 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7fa37c08faa0 con 0x7fa38c0c8f10 2024-05-21T01:26:38.325 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.321+0000 7fa38a000640 1 --2- 172.21.15.63:0/4204223495 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fa36c06f400 0x7fa36c0718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:38.326 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.321+0000 7fa38a000640 1 --2- 172.21.15.63:0/4204223495 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fa36c06f400 0x7fa36c0718c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa38c14f980 tx=0x7fa378008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:38.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.325+0000 7fa382a00640 1 -- 172.21.15.63:0/4204223495 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fa37c05c600 con 0x7fa38c0c8f10 2024-05-21T01:26:38.574 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.569+0000 7fa38be00640 1 -- 172.21.15.63:0/4204223495 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa38c159700 con 0x7fa38c0c8f10 2024-05-21T01:26:38.577 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.569+0000 7fa382a00640 1 -- 172.21.15.63:0/4204223495 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+6876 (secure 0 0 0) 0x7fa37c05bf00 con 0x7fa38c0c8f10 2024-05-21T01:26:38.578 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-05-21T01:26:38.578 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6839/3045714273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6837","nonce":3045714273},{"type":"v1","addr":"172.21.15.131:6839","nonce":3045714273}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/2978367338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":2978367338},{"type":"v1","addr":"172.21.15.131:6835","nonce":2978367338}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/3005995321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6835","nonce":3005995321},{"type":"v1","addr":"172.21.15.63:6837","nonce":3005995321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-21T01:19:53.915775+0000","modified":"2024-05-21T01:20:31.724475+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4276,"mds_1":4270,"mds_2":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"e","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.63:6833/574189772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":574189772},{"type":"v1","addr":"172.21.15.63:6833","nonce":574189772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4270":{"gid":4270,"name":"f","rank":1,"incarnation":10,"state":"up:active","state_seq":11,"addr":"172.21.15.131:6838/3071941741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":3071941741},{"type":"v1","addr":"172.21.15.131:6838","nonce":3071941741}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.63:6836/2892727989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":2892727989},{"type":"v1","addr":"172.21.15.63:6836","nonce":2892727989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4276,"qdb_cluster":[4267,4270,4276]},"id":1}]} 2024-05-21T01:26:38.579 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 15 2024-05-21T01:26:38.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.573+0000 7fa38be00640 1 -- 172.21.15.63:0/4204223495 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fa36c06f400 msgr2=0x7fa36c0718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:38.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.573+0000 7fa38be00640 1 --2- 172.21.15.63:0/4204223495 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fa36c06f400 0x7fa36c0718c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa38c14f980 tx=0x7fa378008040 comp rx=0 tx=0).stop 2024-05-21T01:26:38.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.573+0000 7fa38be00640 1 -- 172.21.15.63:0/4204223495 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa38c0c8f10 msgr2=0x7fa38c1f8880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:38.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.573+0000 7fa38be00640 1 --2- 172.21.15.63:0/4204223495 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa38c0c8f10 0x7fa38c1f8880 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fa37c00d620 tx=0x7fa37c00dae0 comp rx=0 tx=0).stop 2024-05-21T01:26:38.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.573+0000 7fa38be00640 1 -- 172.21.15.63:0/4204223495 shutdown_connections 2024-05-21T01:26:38.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.573+0000 7fa38be00640 1 --2- 172.21.15.63:0/4204223495 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fa36c06f400 0x7fa36c0718c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:38.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.573+0000 7fa38be00640 1 --2- 172.21.15.63:0/4204223495 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa38c155e80 0x7fa38c15a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:38.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.573+0000 7fa38be00640 1 --2- 172.21.15.63:0/4204223495 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa38c0ca080 0x7fa38c1f4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:38.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.573+0000 7fa38be00640 1 --2- 172.21.15.63:0/4204223495 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa38c0c8f10 0x7fa38c1f8880 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:38.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.573+0000 7fa38be00640 1 -- 172.21.15.63:0/4204223495 >> 172.21.15.63:0/4204223495 conn(0x7fa38c06f590 msgr2=0x7fa38c06f970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:26:38.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.573+0000 7fa38be00640 1 -- 172.21.15.63:0/4204223495 shutdown_connections 2024-05-21T01:26:38.580 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.573+0000 7fa38be00640 1 -- 172.21.15.63:0/4204223495 wait complete. 2024-05-21T01:26:38.596 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4276 quiesce db --cancel --all' 2024-05-21T01:26:38.597 DEBUG:teuthology.orchestra.run.smithi063:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4276 quiesce db --cancel --all 2024-05-21T01:26:38.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.745+0000 7fca0cc00640 1 Processor -- start 2024-05-21T01:26:38.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.745+0000 7fca0cc00640 1 -- start start 2024-05-21T01:26:38.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.745+0000 7fca0cc00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fca08159cb0 0x7fca080735e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:38.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.745+0000 7fca0cc00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fca08073b20 0x7fca0806d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:38.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.745+0000 7fca0cc00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca081543e0 con 0x7fca08154000 2024-05-21T01:26:38.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.745+0000 7fca0cc00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7fca0815d2a0 con 0x7fca08073b20 2024-05-21T01:26:38.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.745+0000 7fca0cc00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fca0815b1a0 con 0x7fca08159cb0 2024-05-21T01:26:38.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.745+0000 7fca06800640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fca08073b20 0x7fca0806d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:38.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.745+0000 7fca05e00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fca08154000 0x7fca0815da10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37472/0 (socket says 172.21.15.63:37472) 2024-05-21T01:26:38.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.745+0000 7fca05e00640 1 -- 172.21.15.63:0/2737956687 learned_addr learned my addr 172.21.15.63:0/2737956687 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-05-21T01:26:38.750 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.745+0000 7fca05400640 1 --2- 172.21.15.63:0/2737956687 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fca08159cb0 0x7fca080735e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:38.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.745+0000 7fca06800640 1 -- 172.21.15.63:0/2737956687 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fca08159cb0 msgr2=0x7fca080735e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:26:38.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.745+0000 7fca06800640 1 --2- 172.21.15.63:0/2737956687 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fca08159cb0 0x7fca080735e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:38.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.745+0000 7fca06800640 1 -- 172.21.15.63:0/2737956687 >> v1:172.21.15.63:6789/0 conn(0x7fca08154000 legacy=0x7fca0815da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:38.751 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.745+0000 7fca06800640 1 -- 172.21.15.63:0/2737956687 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca0815a1f0 con 0x7fca08073b20 2024-05-21T01:26:38.753 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.749+0000 7fca06800640 1 --2- 172.21.15.63:0/2737956687 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca08073b20 0x7fca0806d240 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fca00009d90 tx=0x7fca0001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e91670fbdc55ba2 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:38.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.749+0000 7fca04a00640 1 -- 172.21.15.63:0/2737956687 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca000b2070 con 0x7fca08073b20 2024-05-21T01:26:38.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.749+0000 7fca04a00640 1 -- 172.21.15.63:0/2737956687 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca000a5a50 con 0x7fca08073b20 2024-05-21T01:26:38.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.749+0000 7fca04a00640 1 -- 172.21.15.63:0/2737956687 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca000a5e20 con 0x7fca08073b20 2024-05-21T01:26:38.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.749+0000 7fca0cc00640 1 -- 172.21.15.63:0/2737956687 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca08073b20 msgr2=0x7fca0806d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:38.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.749+0000 7fca0cc00640 1 --2- 172.21.15.63:0/2737956687 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca08073b20 0x7fca0806d240 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fca00009d90 tx=0x7fca0001c970 comp rx=0 tx=0).stop 2024-05-21T01:26:38.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.749+0000 7fca0cc00640 1 -- 172.21.15.63:0/2737956687 shutdown_connections 2024-05-21T01:26:38.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.749+0000 7fca0cc00640 1 --2- 172.21.15.63:0/2737956687 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca08073b20 0x7fca0806d240 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:38.754 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.749+0000 7fca0cc00640 1 --2- 172.21.15.63:0/2737956687 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fca08159cb0 0x7fca080735e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:38.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.749+0000 7fca0cc00640 1 -- 172.21.15.63:0/2737956687 >> 172.21.15.63:0/2737956687 conn(0x7fca0806efc0 msgr2=0x7fca0806f3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:26:38.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.749+0000 7fca0cc00640 1 -- 172.21.15.63:0/2737956687 shutdown_connections 2024-05-21T01:26:38.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.749+0000 7fca0cc00640 1 -- 172.21.15.63:0/2737956687 wait complete. 2024-05-21T01:26:38.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.749+0000 7fca0cc00640 1 Processor -- start 2024-05-21T01:26:38.755 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.749+0000 7fca0cc00640 1 -- start start 2024-05-21T01:26:38.758 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.753+0000 7fca0cc00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca08073b20 0x7fca081f5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:38.758 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.753+0000 7fca0cc00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca08154000 0x7fca0814adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:38.758 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.753+0000 7fca0cc00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fca08159cb0 0x7fca0814b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:38.758 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.753+0000 7fca0cc00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fca0815d4f0 con 0x7fca08073b20 2024-05-21T01:26:38.758 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.753+0000 7fca0cc00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fca0815aa90 con 0x7fca08154000 2024-05-21T01:26:38.758 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.753+0000 7fca0cc00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fca0815e120 con 0x7fca08159cb0 2024-05-21T01:26:38.758 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.753+0000 7fca05e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca08073b20 0x7fca081f5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:38.758 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.753+0000 7fca05e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca08073b20 0x7fca081f5b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48020/0 (socket says 172.21.15.63:48020) 2024-05-21T01:26:38.758 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.753+0000 7fca05e00640 1 -- 172.21.15.63:0/3345338506 learned_addr learned my addr 172.21.15.63:0/3345338506 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:26:38.758 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.753+0000 7fca06800640 1 --2- 172.21.15.63:0/3345338506 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fca08159cb0 0x7fca0814b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:38.758 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.753+0000 7fca05400640 1 --2- 172.21.15.63:0/3345338506 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca08154000 0x7fca0814adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:38.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.753+0000 7fca05e00640 1 -- 172.21.15.63:0/3345338506 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fca08159cb0 msgr2=0x7fca0814b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:38.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.753+0000 7fca05e00640 1 --2- 172.21.15.63:0/3345338506 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fca08159cb0 0x7fca0814b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:38.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.753+0000 7fca05e00640 1 -- 172.21.15.63:0/3345338506 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca08154000 msgr2=0x7fca0814adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:38.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.753+0000 7fca05e00640 1 --2- 172.21.15.63:0/3345338506 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca08154000 0x7fca0814adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:38.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.753+0000 7fca05e00640 1 -- 172.21.15.63:0/3345338506 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca081f6440 con 0x7fca08073b20 2024-05-21T01:26:38.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.753+0000 7fca06800640 1 --2- 172.21.15.63:0/3345338506 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fca08159cb0 0x7fca0814b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T01:26:38.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.753+0000 7fca05400640 1 --2- 172.21.15.63:0/3345338506 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca08154000 0x7fca0814adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T01:26:38.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.753+0000 7fca05e00640 1 --2- 172.21.15.63:0/3345338506 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca08073b20 0x7fca081f5b70 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fc9f800c480 tx=0x7fc9f800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:38.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.753+0000 7fc9fe000640 1 -- 172.21.15.63:0/3345338506 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9f8017070 con 0x7fca08073b20 2024-05-21T01:26:38.759 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.753+0000 7fc9fe000640 1 -- 172.21.15.63:0/3345338506 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9f8005d10 con 0x7fca08073b20 2024-05-21T01:26:38.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.753+0000 7fc9fe000640 1 -- 172.21.15.63:0/3345338506 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9f80072b0 con 0x7fca08073b20 2024-05-21T01:26:38.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.753+0000 7fca0cc00640 1 -- 172.21.15.63:0/3345338506 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca08156b60 con 0x7fca08073b20 2024-05-21T01:26:38.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.753+0000 7fca0cc00640 1 -- 172.21.15.63:0/3345338506 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca08156e00 con 0x7fca08073b20 2024-05-21T01:26:38.760 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.757+0000 7fc9fe000640 1 -- 172.21.15.63:0/3345338506 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7fc9f801a070 con 0x7fca08073b20 2024-05-21T01:26:38.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.757+0000 7fc9fe000640 1 --2- 172.21.15.63:0/3345338506 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fc9e806f400 0x7fc9e80718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:38.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.757+0000 7fc9fe000640 1 -- 172.21.15.63:0/3345338506 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7fc9f808ea20 con 0x7fca08073b20 2024-05-21T01:26:38.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.757+0000 7fca100cc000 1 Processor -- start 2024-05-21T01:26:38.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.757+0000 7fca100cc000 1 -- start start 2024-05-21T01:26:38.761 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.757+0000 7fca05400640 1 --2- 172.21.15.63:0/3345338506 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fc9e806f400 0x7fc9e80718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:38.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.757+0000 7fca100cc000 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ef7cd24170 0x55ef7cd24550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:38.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.757+0000 7fca100cc000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ef7cd24a90 0x55ef7cd01ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:38.763 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.757+0000 7fca100cc000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef7cd02000 0x55ef7cd023e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:38.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.757+0000 7fca100cc000 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55ef7cb35590 con 0x55ef7cd24170 2024-05-21T01:26:38.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.757+0000 7fca100cc000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55ef7cb25130 con 0x55ef7cd02000 2024-05-21T01:26:38.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.757+0000 7fca100cc000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55ef7cb29170 con 0x55ef7cd24a90 2024-05-21T01:26:38.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.757+0000 7fca05e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ef7cd24170 0x55ef7cd24550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:38.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.757+0000 7fca05e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ef7cd24170 0x55ef7cd24550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48026/0 (socket says 172.21.15.63:48026) 2024-05-21T01:26:38.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.757+0000 7fca05e00640 1 -- 172.21.15.63:0/2245995544 learned_addr learned my addr 172.21.15.63:0/2245995544 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:26:38.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.757+0000 7fca05400640 1 --2- 172.21.15.63:0/3345338506 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fc9e806f400 0x7fc9e80718c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fca081effd0 tx=0x7fc9f4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:38.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.757+0000 7fca06800640 1 --2- 172.21.15.63:0/2245995544 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef7cd02000 0x55ef7cd023e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:38.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.757+0000 7fca05400640 1 --2- 172.21.15.63:0/2245995544 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ef7cd24a90 0x55ef7cd01ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:38.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.757+0000 7fca05e00640 1 -- 172.21.15.63:0/2245995544 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ef7cd24a90 msgr2=0x55ef7cd01ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:26:38.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.757+0000 7fca05e00640 1 --2- 172.21.15.63:0/2245995544 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ef7cd24a90 0x55ef7cd01ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:38.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.757+0000 7fca05e00640 1 -- 172.21.15.63:0/2245995544 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef7cd02000 msgr2=0x55ef7cd023e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:26:38.764 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.757+0000 7fca05e00640 1 --2- 172.21.15.63:0/2245995544 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef7cd02000 0x55ef7cd023e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:38.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.757+0000 7fca05e00640 1 -- 172.21.15.63:0/2245995544 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef7cb6d610 con 0x55ef7cd24170 2024-05-21T01:26:38.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.757+0000 7fca05400640 1 --2- 172.21.15.63:0/2245995544 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ef7cd24a90 0x55ef7cd01ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T01:26:38.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.757+0000 7fca05e00640 1 --2- 172.21.15.63:0/2245995544 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ef7cd24170 0x55ef7cd24550 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fc9f8056fa0 tx=0x7fc9f805aaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccb65a26fcdb66bf server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:38.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.757+0000 7fc9f2a00640 1 -- 172.21.15.63:0/2245995544 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9f805f2d0 con 0x55ef7cd24170 2024-05-21T01:26:38.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.757+0000 7fc9f2a00640 1 -- 172.21.15.63:0/2245995544 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9f8063cf0 con 0x55ef7cd24170 2024-05-21T01:26:38.765 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.757+0000 7fc9f2a00640 1 -- 172.21.15.63:0/2245995544 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9f8063a60 con 0x55ef7cd24170 2024-05-21T01:26:38.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.761+0000 7fca100cc000 1 -- 172.21.15.63:0/2245995544 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ef7cd24170 msgr2=0x55ef7cd24550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:38.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.761+0000 7fca100cc000 1 --2- 172.21.15.63:0/2245995544 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ef7cd24170 0x55ef7cd24550 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fc9f8056fa0 tx=0x7fc9f805aaf0 comp rx=0 tx=0).stop 2024-05-21T01:26:38.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.761+0000 7fca100cc000 1 -- 172.21.15.63:0/2245995544 shutdown_connections 2024-05-21T01:26:38.768 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.761+0000 7fca100cc000 1 --2- 172.21.15.63:0/2245995544 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef7cd02000 0x55ef7cd023e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:38.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.761+0000 7fca100cc000 1 --2- 172.21.15.63:0/2245995544 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ef7cd24a90 0x55ef7cd01ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:38.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.761+0000 7fca100cc000 1 --2- 172.21.15.63:0/2245995544 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ef7cd24170 0x55ef7cd24550 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:38.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.761+0000 7fca100cc000 1 -- 172.21.15.63:0/2245995544 >> 172.21.15.63:0/2245995544 conn(0x55ef7cbc1600 msgr2=0x55ef7cd18c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:26:38.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.761+0000 7fca100cc000 1 -- 172.21.15.63:0/2245995544 shutdown_connections 2024-05-21T01:26:38.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.761+0000 7fca100cc000 1 -- 172.21.15.63:0/2245995544 wait complete. 2024-05-21T01:26:38.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.761+0000 7fca100cc000 1 -- start start 2024-05-21T01:26:38.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.761+0000 7fca100cc000 1 Processor -- start 2024-05-21T01:26:38.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.761+0000 7fca100cc000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef7cd02000 0x55ef7ccdef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:38.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.761+0000 7fca100cc000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ef7cd24170 0x55ef7ccdf450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:38.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.761+0000 7fca100cc000 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ef7cd24a90 0x55ef7cd19cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:38.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.761+0000 7fca100cc000 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55ef7cbf37e0 con 0x55ef7cd24a90 2024-05-21T01:26:38.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.761+0000 7fca100cc000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55ef7cb34360 con 0x55ef7cd02000 2024-05-21T01:26:38.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.761+0000 7fca100cc000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55ef7caec7f0 con 0x55ef7cd24170 2024-05-21T01:26:38.769 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.761+0000 7fca100cc000 10 client.0 _ll_register_callbacks cb 0x55ef7ccc5010 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-21T01:26:38.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.761+0000 7fca06800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ef7cd24a90 0x55ef7cd19cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:38.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.761+0000 7fca06800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ef7cd24a90 0x55ef7cd19cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48034/0 (socket says 172.21.15.63:48034) 2024-05-21T01:26:38.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.761+0000 7fca06800640 1 -- 172.21.15.63:0/2922876393 learned_addr learned my addr 172.21.15.63:0/2922876393 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:26:38.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.761+0000 7fca05e00640 1 --2- 172.21.15.63:0/2922876393 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef7cd02000 0x55ef7ccdef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:38.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.761+0000 7fca05400640 1 --2- 172.21.15.63:0/2922876393 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ef7cd24170 0x55ef7ccdf450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:38.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.761+0000 7fca06800640 1 -- 172.21.15.63:0/2922876393 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ef7cd24170 msgr2=0x55ef7ccdf450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:26:38.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.761+0000 7fca06800640 1 --2- 172.21.15.63:0/2922876393 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ef7cd24170 0x55ef7ccdf450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:38.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.761+0000 7fca06800640 1 -- 172.21.15.63:0/2922876393 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef7cd02000 msgr2=0x55ef7ccdef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:26:38.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.761+0000 7fca06800640 1 --2- 172.21.15.63:0/2922876393 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef7cd02000 0x55ef7ccdef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:38.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.761+0000 7fca06800640 1 -- 172.21.15.63:0/2922876393 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef7caf2930 con 0x55ef7cd24a90 2024-05-21T01:26:38.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.761+0000 7fca06800640 1 --2- 172.21.15.63:0/2922876393 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ef7cd24a90 0x55ef7cd19cb0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fca000b0040 tx=0x7fca0001b1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b271037a69757523 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:38.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.761+0000 7fc9e7400640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-05-21T01:26:38.770 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.761+0000 7fc9e7400640 1 -- 172.21.15.63:0/2922876393 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca000be070 con 0x55ef7cd24a90 2024-05-21T01:26:38.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.761+0000 7fc9e7400640 1 -- 172.21.15.63:0/2922876393 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7fca000ad8f0 con 0x55ef7cd24a90 2024-05-21T01:26:38.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.761+0000 7fca100cc000 1 -- 172.21.15.63:0/2922876393 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9f8063cf0 con 0x55ef7cd24a90 2024-05-21T01:26:38.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.761+0000 7fc9e7400640 1 -- 172.21.15.63:0/2922876393 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7fca000c8050 con 0x55ef7cd24a90 2024-05-21T01:26:38.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.761+0000 7fca100cc000 10 client.5109 fetch_fsmap learned FSMap version 15 2024-05-21T01:26:38.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.761+0000 7fca100cc000 1 -- 172.21.15.63:0/2922876393 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x55ef7cae0d30 con 0x55ef7cd24a90 2024-05-21T01:26:38.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.765+0000 7fc9e7400640 1 -- 172.21.15.63:0/2922876393 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9f8063cf0 con 0x55ef7cd24a90 2024-05-21T01:26:38.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.765+0000 7fc9e7400640 1 -- 172.21.15.63:0/2922876393 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 15) ==== 4752+0+0 (secure 0 0 0) 0x7fca000cb020 con 0x55ef7cd24a90 2024-05-21T01:26:38.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.765+0000 7fca100cc000 10 client.5109 fetch_fsmap finished waiting for FSMap version 15 2024-05-21T01:26:38.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.765+0000 7fca100cc000 10 client.5109 resolve_mds: validated gid 4276 aka daemon mds.c 2024-05-21T01:26:38.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.765+0000 7fca100cc000 20 client.5109 populate_metadata read hostname 'smithi063' 2024-05-21T01:26:38.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.765+0000 7fca100cc000 1 --2- 172.21.15.63:0/2922876393 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x55ef7cd33200 0x55ef7cd355f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:38.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.765+0000 7fca100cc000 4 client.5109 mds_command: new command op to 4276 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-21T01:26:38.771 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.765+0000 7fca100cc000 1 -- 172.21.15.63:0/2922876393 --> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ef7cbac900 con 0x55ef7cd33200 2024-05-21T01:26:38.772 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.765+0000 7fca05e00640 1 --2- 172.21.15.63:0/2922876393 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x55ef7cd33200 0x55ef7cd355f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:38.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.765+0000 7fca05e00640 1 --2- 172.21.15.63:0/2922876393 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x55ef7cd33200 0x55ef7cd355f0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d11ac4862450c7b6 server_cookie=45ef6bd1bb62ad64 in_seq=0 out_seq=0 2024-05-21T01:26:38.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.765+0000 7fc9e7400640 10 client.5109 ms_handle_connect on v2:172.21.15.63:6834/2892727989 2024-05-21T01:26:38.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.765+0000 7fc9e7400640 1 -- 172.21.15.63:0/2922876393 <== mds.0 v2:172.21.15.63:6834/2892727989 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x55ef7cbac900 con 0x55ef7cd33200 2024-05-21T01:26:38.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.765+0000 7fc9e7400640 10 client.5109 handle_command_reply: tid=0 2024-05-21T01:26:38.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.765+0000 7fca100cc000 1 client.5109 shutdown 2024-05-21T01:26:38.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.765+0000 7fca100cc000 1 -- 172.21.15.63:0/2922876393 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ef7cd24a90 msgr2=0x55ef7cd19cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:38.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.765+0000 7fca100cc000 1 --2- 172.21.15.63:0/2922876393 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ef7cd24a90 0x55ef7cd19cb0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fca000b0040 tx=0x7fca0001b1b0 comp rx=0 tx=0).stop 2024-05-21T01:26:38.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.765+0000 7fca100cc000 1 -- 172.21.15.63:0/2922876393 shutdown_connections 2024-05-21T01:26:38.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.765+0000 7fca100cc000 1 --2- 172.21.15.63:0/2922876393 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x55ef7cd33200 0x55ef7cd355f0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:38.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.765+0000 7fca100cc000 1 --2- 172.21.15.63:0/2922876393 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ef7cd24a90 0x55ef7cd19cb0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:38.773 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.765+0000 7fca100cc000 1 --2- 172.21.15.63:0/2922876393 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ef7cd24170 0x55ef7ccdf450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:38.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.765+0000 7fc9e7400640 0 client.5109 ms_handle_reset on v2:172.21.15.63:6834/2892727989 2024-05-21T01:26:38.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.765+0000 7fca100cc000 1 --2- 172.21.15.63:0/2922876393 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef7cd02000 0x55ef7ccdef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:38.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.765+0000 7fca100cc000 1 -- 172.21.15.63:0/2922876393 >> 172.21.15.63:0/2922876393 conn(0x55ef7cbc1600 msgr2=0x55ef7cd18a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:26:38.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.765+0000 7fca100cc000 1 -- 172.21.15.63:0/2922876393 shutdown_connections 2024-05-21T01:26:38.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.765+0000 7fca100cc000 1 -- 172.21.15.63:0/2922876393 wait complete. 2024-05-21T01:26:38.774 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.765+0000 7fca100cc000 20 client.5109 trim_cache size 0 max 16384 2024-05-21T01:26:38.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.785+0000 7fca100cc000 1 Processor -- start 2024-05-21T01:26:38.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.785+0000 7fca100cc000 1 -- start start 2024-05-21T01:26:38.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.785+0000 7fca100cc000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef7cbc1600 0x55ef7cd355f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:38.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.785+0000 7fca100cc000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ef7cd02000 0x55ef7cd35b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:38.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.785+0000 7fca100cc000 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ef7cd24170 0x55ef7cd36070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:38.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.785+0000 7fca100cc000 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fca081fd490 con 0x55ef7cd24170 2024-05-21T01:26:38.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.785+0000 7fca100cc000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fca08073130 con 0x55ef7cbc1600 2024-05-21T01:26:38.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.785+0000 7fca100cc000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fca081fce40 con 0x55ef7cd02000 2024-05-21T01:26:38.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.785+0000 7fca06800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ef7cd24170 0x55ef7cd36070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:38.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.785+0000 7fca06800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ef7cd24170 0x55ef7cd36070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48048/0 (socket says 172.21.15.63:48048) 2024-05-21T01:26:38.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.785+0000 7fca06800640 1 -- 172.21.15.63:0/863729945 learned_addr learned my addr 172.21.15.63:0/863729945 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:26:38.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.785+0000 7fca05e00640 1 --2- 172.21.15.63:0/863729945 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef7cbc1600 0x55ef7cd355f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:38.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.785+0000 7fca05400640 1 --2- 172.21.15.63:0/863729945 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ef7cd02000 0x55ef7cd35b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:38.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.785+0000 7fca06800640 1 -- 172.21.15.63:0/863729945 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ef7cd02000 msgr2=0x55ef7cd35b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:26:38.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.785+0000 7fca06800640 1 --2- 172.21.15.63:0/863729945 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ef7cd02000 0x55ef7cd35b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:38.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.785+0000 7fca06800640 1 -- 172.21.15.63:0/863729945 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef7cbc1600 msgr2=0x55ef7cd355f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:26:38.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.785+0000 7fca06800640 1 --2- 172.21.15.63:0/863729945 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef7cbc1600 0x55ef7cd355f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:38.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.785+0000 7fca06800640 1 -- 172.21.15.63:0/863729945 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef7cba96b0 con 0x55ef7cd24170 2024-05-21T01:26:38.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.785+0000 7fca05400640 1 --2- 172.21.15.63:0/863729945 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ef7cd02000 0x55ef7cd35b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T01:26:38.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.785+0000 7fca06800640 1 --2- 172.21.15.63:0/863729945 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ef7cd24170 0x55ef7cd36070 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fca0001a5a0 tx=0x7fca000b8000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=374dbae1c31a675b server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:38.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.785+0000 7fc9f2000640 1 -- 172.21.15.63:0/863729945 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca000be040 con 0x55ef7cd24170 2024-05-21T01:26:38.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.785+0000 7fc9f2000640 1 -- 172.21.15.63:0/863729945 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca000ade50 con 0x55ef7cd24170 2024-05-21T01:26:38.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.785+0000 7fc9f2000640 1 -- 172.21.15.63:0/863729945 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca000b2040 con 0x55ef7cd24170 2024-05-21T01:26:38.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.785+0000 7fca100cc000 1 -- 172.21.15.63:0/863729945 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ef7cd24170 msgr2=0x55ef7cd36070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:38.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.785+0000 7fca100cc000 1 --2- 172.21.15.63:0/863729945 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ef7cd24170 0x55ef7cd36070 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fca0001a5a0 tx=0x7fca000b8000 comp rx=0 tx=0).stop 2024-05-21T01:26:38.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.785+0000 7fca100cc000 1 -- 172.21.15.63:0/863729945 shutdown_connections 2024-05-21T01:26:38.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.785+0000 7fca100cc000 1 --2- 172.21.15.63:0/863729945 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ef7cd24170 0x55ef7cd36070 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:38.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.785+0000 7fca100cc000 1 --2- 172.21.15.63:0/863729945 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ef7cd02000 0x55ef7cd35b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:38.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.785+0000 7fca100cc000 1 --2- 172.21.15.63:0/863729945 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef7cbc1600 0x55ef7cd355f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:38.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.785+0000 7fca100cc000 1 -- 172.21.15.63:0/863729945 >> 172.21.15.63:0/863729945 conn(0x55ef7cd18ab0 msgr2=0x55ef7cd018a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:26:38.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.785+0000 7fca100cc000 1 -- 172.21.15.63:0/863729945 shutdown_connections 2024-05-21T01:26:38.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.785+0000 7fca100cc000 1 -- 172.21.15.63:0/863729945 wait complete. 2024-05-21T01:26:38.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.785+0000 7fca100cc000 1 -- start start 2024-05-21T01:26:38.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.785+0000 7fca100cc000 1 Processor -- start 2024-05-21T01:26:38.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.789+0000 7fca100cc000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ef7cbc1600 0x55ef7cd95c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:38.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.789+0000 7fca100cc000 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ef7cd02000 0x55ef7cd96160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:38.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.789+0000 7fca100cc000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef7cd24170 0x55ef7cd968c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:38.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.789+0000 7fca100cc000 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x55ef7cb28480 con 0x55ef7cd02000 2024-05-21T01:26:38.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.789+0000 7fca100cc000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55ef7cae3ec0 con 0x55ef7cd24170 2024-05-21T01:26:38.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.789+0000 7fca100cc000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x55ef7cb2d7a0 con 0x55ef7cbc1600 2024-05-21T01:26:38.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.789+0000 7fca100cc000 10 client.0 _ll_register_callbacks cb 0x7fca000b0070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-21T01:26:38.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.789+0000 7fca05400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ef7cd02000 0x55ef7cd96160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:38.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.789+0000 7fca05400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ef7cd02000 0x55ef7cd96160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48050/0 (socket says 172.21.15.63:48050) 2024-05-21T01:26:38.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.789+0000 7fca05400640 1 -- 172.21.15.63:0/2345022241 learned_addr learned my addr 172.21.15.63:0/2345022241 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:26:38.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.789+0000 7fca05e00640 1 --2- 172.21.15.63:0/2345022241 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ef7cbc1600 0x55ef7cd95c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:38.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.789+0000 7fca06800640 1 --2- 172.21.15.63:0/2345022241 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef7cd24170 0x55ef7cd968c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:38.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.789+0000 7fca05400640 1 -- 172.21.15.63:0/2345022241 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ef7cbc1600 msgr2=0x55ef7cd95c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:26:38.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.789+0000 7fca05400640 1 --2- 172.21.15.63:0/2345022241 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ef7cbc1600 0x55ef7cd95c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:38.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.789+0000 7fca05400640 1 -- 172.21.15.63:0/2345022241 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef7cd24170 msgr2=0x55ef7cd968c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:26:38.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.789+0000 7fca05400640 1 --2- 172.21.15.63:0/2345022241 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef7cd24170 0x55ef7cd968c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:38.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.789+0000 7fca05400640 1 -- 172.21.15.63:0/2345022241 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef7cb807d0 con 0x55ef7cd02000 2024-05-21T01:26:38.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.789+0000 7fca05400640 1 --2- 172.21.15.63:0/2345022241 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ef7cd02000 0x55ef7cd96160 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fc9f400f000 tx=0x7fc9f4004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8f274a087c7a963 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:38.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.789+0000 7fc9e7400640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2024-05-21T01:26:38.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.789+0000 7fc9e7400640 1 -- 172.21.15.63:0/2345022241 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9f4027020 con 0x55ef7cd02000 2024-05-21T01:26:38.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.789+0000 7fc9e7400640 1 -- 172.21.15.63:0/2345022241 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7fc9f4015c90 con 0x55ef7cd02000 2024-05-21T01:26:38.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.789+0000 7fca100cc000 1 -- 172.21.15.63:0/2345022241 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca000ade50 con 0x55ef7cd02000 2024-05-21T01:26:38.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.789+0000 7fc9e7400640 1 -- 172.21.15.63:0/2345022241 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (secure 0 0 0) 0x7fc9f400f040 con 0x55ef7cd02000 2024-05-21T01:26:38.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.789+0000 7fca100cc000 10 client.5115 fetch_fsmap learned FSMap version 15 2024-05-21T01:26:38.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.789+0000 7fca100cc000 1 -- 172.21.15.63:0/2345022241 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) -- 0x55ef7c7e1400 con 0x55ef7cd02000 2024-05-21T01:26:38.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.789+0000 7fc9e7400640 1 -- 172.21.15.63:0/2345022241 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca000ade50 con 0x55ef7cd02000 2024-05-21T01:26:38.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.789+0000 7fc9e7400640 1 -- 172.21.15.63:0/2345022241 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 15) ==== 4752+0+0 (secure 0 0 0) 0x7fc9f4034020 con 0x55ef7cd02000 2024-05-21T01:26:38.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.789+0000 7fca100cc000 10 client.5115 fetch_fsmap finished waiting for FSMap version 15 2024-05-21T01:26:38.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.789+0000 7fca100cc000 10 client.5115 resolve_mds: validated gid 4276 aka daemon mds.c 2024-05-21T01:26:38.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.789+0000 7fca100cc000 20 client.5115 populate_metadata read hostname 'smithi063' 2024-05-21T01:26:38.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.789+0000 7fca100cc000 1 --2- 172.21.15.63:0/2345022241 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x55ef7cd24a90 0x55ef7cd97590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:38.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.789+0000 7fca100cc000 4 client.5115 mds_command: new command op to 4276 tid=0 multi_id=0 [{"prefix": "quiesce db", "cancel": true, "all": true}] 2024-05-21T01:26:38.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.789+0000 7fca100cc000 1 -- 172.21.15.63:0/2345022241 --> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] -- command(tid 0: {"prefix": "quiesce db", "cancel": true, "all": true}) -- 0x55ef7cac0df0 con 0x55ef7cd24a90 2024-05-21T01:26:38.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.789+0000 7fca05e00640 1 --2- 172.21.15.63:0/2345022241 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x55ef7cd24a90 0x55ef7cd97590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:38.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.789+0000 7fc9e7400640 10 client.5115 ms_handle_connect on v2:172.21.15.63:6834/2892727989 2024-05-21T01:26:38.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.789+0000 7fca05e00640 1 --2- 172.21.15.63:0/2345022241 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x55ef7cd24a90 0x55ef7cd97590 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=391b1fde6326cfb1 server_cookie=c8ac995ad46101fd in_seq=0 out_seq=0 2024-05-21T01:26:38.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.789+0000 7fc9e7400640 1 -- 172.21.15.63:0/2345022241 <== mds.0 v2:172.21.15.63:6834/2892727989 1 ==== command_reply(tid 0: 0 ) ==== 8+0+79 (crc 0 0 0) 0x55ef7cac0df0 con 0x55ef7cd24a90 2024-05-21T01:26:38.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.789+0000 7fc9e7400640 10 client.5115 handle_command_reply: tid=0 2024-05-21T01:26:38.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.789+0000 7fca100cc000 1 client.5115 shutdown 2024-05-21T01:26:38.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.789+0000 7fca100cc000 1 -- 172.21.15.63:0/2345022241 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ef7cd02000 msgr2=0x55ef7cd96160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:38.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.789+0000 7fca100cc000 1 --2- 172.21.15.63:0/2345022241 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ef7cd02000 0x55ef7cd96160 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fc9f400f000 tx=0x7fc9f4004740 comp rx=0 tx=0).stop 2024-05-21T01:26:38.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.789+0000 7fca100cc000 1 -- 172.21.15.63:0/2345022241 shutdown_connections 2024-05-21T01:26:38.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.789+0000 7fca100cc000 1 --2- 172.21.15.63:0/2345022241 >> [v2:172.21.15.63:6834/2892727989,v1:172.21.15.63:6836/2892727989] conn(0x55ef7cd24a90 0x55ef7cd97590 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:38.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.789+0000 7fca100cc000 1 --2- 172.21.15.63:0/2345022241 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ef7cd24170 0x55ef7cd968c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:38.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.789+0000 7fca100cc000 1 --2- 172.21.15.63:0/2345022241 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ef7cd02000 0x55ef7cd96160 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:38.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.789+0000 7fc9e7400640 0 client.5115 ms_handle_reset on v2:172.21.15.63:6834/2892727989 2024-05-21T01:26:38.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.789+0000 7fca100cc000 1 --2- 172.21.15.63:0/2345022241 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x55ef7cbc1600 0x55ef7cd95c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:38.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.789+0000 7fca100cc000 1 -- 172.21.15.63:0/2345022241 >> 172.21.15.63:0/2345022241 conn(0x55ef7cd18ab0 msgr2=0x55ef7ccfe390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:26:38.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.789+0000 7fca100cc000 1 -- 172.21.15.63:0/2345022241 shutdown_connections 2024-05-21T01:26:38.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.789+0000 7fca100cc000 1 -- 172.21.15.63:0/2345022241 wait complete. 2024-05-21T01:26:38.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.793+0000 7fca100cc000 20 client.5115 trim_cache size 0 max 16384 2024-05-21T01:26:38.800 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-05-21T01:26:38.800 INFO:teuthology.orchestra.run.smithi063.stdout: "epoch": 15, 2024-05-21T01:26:38.800 INFO:teuthology.orchestra.run.smithi063.stdout: "leader": 4276, 2024-05-21T01:26:38.800 INFO:teuthology.orchestra.run.smithi063.stdout: "set_version": 24, 2024-05-21T01:26:38.800 INFO:teuthology.orchestra.run.smithi063.stdout: "sets": {} 2024-05-21T01:26:38.800 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-05-21T01:26:38.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.793+0000 7fca0cc00640 1 -- 172.21.15.63:0/3345338506 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fc9e806f400 msgr2=0x7fc9e80718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:38.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.793+0000 7fca0cc00640 1 --2- 172.21.15.63:0/3345338506 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fc9e806f400 0x7fc9e80718c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fca081effd0 tx=0x7fc9f4008040 comp rx=0 tx=0).stop 2024-05-21T01:26:38.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.793+0000 7fca0cc00640 1 -- 172.21.15.63:0/3345338506 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca08073b20 msgr2=0x7fca081f5b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:38.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.793+0000 7fca0cc00640 1 --2- 172.21.15.63:0/3345338506 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca08073b20 0x7fca081f5b70 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fc9f800c480 tx=0x7fc9f800c940 comp rx=0 tx=0).stop 2024-05-21T01:26:38.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.793+0000 7fca0cc00640 1 -- 172.21.15.63:0/3345338506 shutdown_connections 2024-05-21T01:26:38.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.793+0000 7fca0cc00640 1 --2- 172.21.15.63:0/3345338506 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fc9e806f400 0x7fc9e80718c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:38.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.793+0000 7fca0cc00640 1 --2- 172.21.15.63:0/3345338506 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fca08159cb0 0x7fca0814b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:38.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.793+0000 7fca0cc00640 1 --2- 172.21.15.63:0/3345338506 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca08154000 0x7fca0814adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:38.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.793+0000 7fca0cc00640 1 --2- 172.21.15.63:0/3345338506 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fca08073b20 0x7fca081f5b70 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:38.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.793+0000 7fca0cc00640 1 -- 172.21.15.63:0/3345338506 >> 172.21.15.63:0/3345338506 conn(0x7fca0806efc0 msgr2=0x7fca0814deb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:26:38.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.793+0000 7fca0cc00640 1 -- 172.21.15.63:0/3345338506 shutdown_connections 2024-05-21T01:26:38.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:38.793+0000 7fca0cc00640 1 -- 172.21.15.63:0/3345338506 wait complete. 2024-05-21T01:26:38.815 INFO:tasks.quiescer:done joining Quiescers 2024-05-21T01:26:38.815 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-05-21T01:26:38.824 INFO:tasks.kclient:Unmounting kernel clients... 2024-05-21T01:26:38.824 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-05-21T01:26:38.824 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-21T01:26:38.833 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-05-21T01:26:38.833 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-21T01:26:38.883 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-21T01:26:39.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:39.065+0000 7f7c29a00640 1 Processor -- start 2024-05-21T01:26:39.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:39.065+0000 7f7c29a00640 1 -- start start 2024-05-21T01:26:39.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:39.065+0000 7f7c29a00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f7c24156070 0x7f7c24071640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:39.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:39.065+0000 7f7c29a00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7c24071b80 0x7f7c240cf530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:39.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:39.065+0000 7f7c29a00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c2415bf20 con 0x7f7c2406f080 2024-05-21T01:26:39.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:39.065+0000 7f7c29a00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f7c2415c1e0 con 0x7f7c24071b80 2024-05-21T01:26:39.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:39.065+0000 7f7c29a00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f7c2415c4c0 con 0x7f7c24156070 2024-05-21T01:26:39.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:39.065+0000 7f7c23400640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f7c2406f080 0x7f7c2415d9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37478/0 (socket says 172.21.15.63:37478) 2024-05-21T01:26:39.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:39.065+0000 7f7c23400640 1 -- 172.21.15.63:0/4270025064 learned_addr learned my addr 172.21.15.63:0/4270025064 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-05-21T01:26:39.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:39.065+0000 7f7c1be00640 1 --2- 172.21.15.63:0/4270025064 >> v2:172.21.15.63:3300/0 conn(0x7f7c24071b80 0x7f7c240cf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:39.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:39.065+0000 7f7c22a00640 1 --2- 172.21.15.63:0/4270025064 >> v2:172.21.15.131:3300/0 conn(0x7f7c24156070 0x7f7c24071640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:39.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:39.065+0000 7f7c1be00640 1 -- 172.21.15.63:0/4270025064 >> v2:172.21.15.131:3300/0 conn(0x7f7c24156070 msgr2=0x7f7c24071640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:26:39.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:39.065+0000 7f7c1be00640 1 --2- 172.21.15.63:0/4270025064 >> v2:172.21.15.131:3300/0 conn(0x7f7c24156070 0x7f7c24071640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:39.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:39.065+0000 7f7c1be00640 1 -- 172.21.15.63:0/4270025064 >> v1:172.21.15.63:6789/0 conn(0x7f7c2406f080 legacy=0x7f7c2415d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:39.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:39.065+0000 7f7c1be00640 1 -- 172.21.15.63:0/4270025064 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c2415c7a0 con 0x7f7c24071b80 2024-05-21T01:26:39.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:39.069+0000 7f7c1be00640 1 --2- 172.21.15.63:0/4270025064 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7c24071b80 0x7f7c240cf530 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f7c240721a0 tx=0x7f7c0c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b457f094a18a4e9a server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:39.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:39.069+0000 7f7c22000640 1 -- 172.21.15.63:0/4270025064 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c0c0b0070 con 0x7f7c24071b80 2024-05-21T01:26:39.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:39.069+0000 7f7c22000640 1 -- 172.21.15.63:0/4270025064 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c0c0ab600 con 0x7f7c24071b80 2024-05-21T01:26:39.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:39.069+0000 7f7c22000640 1 -- 172.21.15.63:0/4270025064 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c0c0ab9d0 con 0x7f7c24071b80 2024-05-21T01:26:39.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:39.069+0000 7f7c29a00640 1 -- 172.21.15.63:0/4270025064 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7c24071b80 msgr2=0x7f7c240cf530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:39.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:39.069+0000 7f7c29a00640 1 --2- 172.21.15.63:0/4270025064 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7c24071b80 0x7f7c240cf530 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f7c240721a0 tx=0x7f7c0c01c480 comp rx=0 tx=0).stop 2024-05-21T01:26:39.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:39.069+0000 7f7c29a00640 1 -- 172.21.15.63:0/4270025064 shutdown_connections 2024-05-21T01:26:39.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:39.069+0000 7f7c29a00640 1 --2- 172.21.15.63:0/4270025064 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7c24071b80 0x7f7c240cf530 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:39.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:39.069+0000 7f7c29a00640 1 --2- 172.21.15.63:0/4270025064 >> v2:172.21.15.131:3300/0 conn(0x7f7c24156070 0x7f7c24071640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:39.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:39.069+0000 7f7c29a00640 1 -- 172.21.15.63:0/4270025064 >> 172.21.15.63:0/4270025064 conn(0x7f7c240735f0 msgr2=0x7f7c24073a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:26:39.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:39.069+0000 7f7c29a00640 1 -- 172.21.15.63:0/4270025064 shutdown_connections 2024-05-21T01:26:39.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:39.069+0000 7f7c29a00640 1 -- 172.21.15.63:0/4270025064 wait complete. 2024-05-21T01:26:39.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:39.073+0000 7f7c29a00640 1 Processor -- start 2024-05-21T01:26:39.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:39.073+0000 7f7c29a00640 1 -- start start 2024-05-21T01:26:39.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:39.073+0000 7f7c29a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7c2406f080 0x7f7c24154d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:39.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:39.073+0000 7f7c29a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7c24071b80 0x7f7c24160620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:39.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:39.073+0000 7f7c29a00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7c24156070 0x7f7c240cb980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:39.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:39.073+0000 7f7c29a00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f7c241565d0 con 0x7f7c2406f080 2024-05-21T01:26:39.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:39.073+0000 7f7c29a00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f7c24156450 con 0x7f7c24071b80 2024-05-21T01:26:39.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:39.073+0000 7f7c29a00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f7c241690c0 con 0x7f7c24156070 2024-05-21T01:26:39.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:39.073+0000 7f7c22a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7c2406f080 0x7f7c24154d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:39.080 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:39.073+0000 7f7c22a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7c2406f080 0x7f7c24154d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48066/0 (socket says 172.21.15.63:48066) 2024-05-21T01:26:39.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:39.073+0000 7f7c22a00640 1 -- 172.21.15.63:0/520047723 learned_addr learned my addr 172.21.15.63:0/520047723 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:26:39.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:39.073+0000 7f7c1be00640 1 --2- 172.21.15.63:0/520047723 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7c24071b80 0x7f7c24160620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:39.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:39.073+0000 7f7c23400640 1 --2- 172.21.15.63:0/520047723 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7c24156070 0x7f7c240cb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:39.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:39.073+0000 7f7c22a00640 1 -- 172.21.15.63:0/520047723 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7c24156070 msgr2=0x7f7c240cb980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:39.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:39.073+0000 7f7c22a00640 1 --2- 172.21.15.63:0/520047723 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7c24156070 0x7f7c240cb980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:39.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:39.073+0000 7f7c22a00640 1 -- 172.21.15.63:0/520047723 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7c24071b80 msgr2=0x7f7c24160620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:39.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:39.073+0000 7f7c22a00640 1 --2- 172.21.15.63:0/520047723 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7c24071b80 0x7f7c24160620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:39.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:39.073+0000 7f7c22a00640 1 -- 172.21.15.63:0/520047723 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c241f5a80 con 0x7f7c2406f080 2024-05-21T01:26:39.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:39.073+0000 7f7c23400640 1 --2- 172.21.15.63:0/520047723 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7c24156070 0x7f7c240cb980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T01:26:39.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:39.073+0000 7f7c22a00640 1 --2- 172.21.15.63:0/520047723 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7c2406f080 0x7f7c24154d20 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f7c1400d830 tx=0x7f7c1400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:39.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:39.073+0000 7f7c1aa00640 1 -- 172.21.15.63:0/520047723 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c1400b6c0 con 0x7f7c2406f080 2024-05-21T01:26:39.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:39.073+0000 7f7c1aa00640 1 -- 172.21.15.63:0/520047723 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c14019070 con 0x7f7c2406f080 2024-05-21T01:26:39.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:39.073+0000 7f7c1aa00640 1 -- 172.21.15.63:0/520047723 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c1400ba60 con 0x7f7c2406f080 2024-05-21T01:26:39.081 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:39.073+0000 7f7c29a00640 1 -- 172.21.15.63:0/520047723 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c2415ea60 con 0x7f7c2406f080 2024-05-21T01:26:39.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:39.073+0000 7f7c29a00640 1 -- 172.21.15.63:0/520047723 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c241f5d00 con 0x7f7c2406f080 2024-05-21T01:26:39.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:39.077+0000 7f7c29a00640 1 -- 172.21.15.63:0/520047723 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c240507f0 con 0x7f7c2406f080 2024-05-21T01:26:39.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:39.077+0000 7f7c1aa00640 1 -- 172.21.15.63:0/520047723 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7f7c1401e460 con 0x7f7c2406f080 2024-05-21T01:26:39.082 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:39.077+0000 7f7c1aa00640 1 --2- 172.21.15.63:0/520047723 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f7c0006f400 0x7f7c000718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:39.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:39.077+0000 7f7c1aa00640 1 -- 172.21.15.63:0/520047723 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f7c1408fd50 con 0x7f7c2406f080 2024-05-21T01:26:39.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:39.077+0000 7f7c1be00640 1 --2- 172.21.15.63:0/520047723 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f7c0006f400 0x7f7c000718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:39.083 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:39.077+0000 7f7c1be00640 1 --2- 172.21.15.63:0/520047723 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f7c0006f400 0x7f7c000718c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c0ad000 tx=0x7f7c0c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:39.086 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:39.081+0000 7f7c1aa00640 1 -- 172.21.15.63:0/520047723 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f7c241f5a80 con 0x7f7c2406f080 2024-05-21T01:26:39.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:39.261+0000 7f7c29a00640 1 -- 172.21.15.63:0/520047723 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f7c240c9bc0 con 0x7f7c2406f080 2024-05-21T01:26:39.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:39.261+0000 7f7c1aa00640 1 -- 172.21.15.63:0/520047723 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7f7c1405c8c0 con 0x7f7c2406f080 2024-05-21T01:26:39.267 INFO:teuthology.orchestra.run.smithi063.stderr:listed 0 entries 2024-05-21T01:26:39.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:39.265+0000 7f7c29a00640 1 -- 172.21.15.63:0/520047723 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f7c0006f400 msgr2=0x7f7c000718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:39.269 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:39.265+0000 7f7c29a00640 1 --2- 172.21.15.63:0/520047723 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f7c0006f400 0x7f7c000718c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c0ad000 tx=0x7f7c0c008040 comp rx=0 tx=0).stop 2024-05-21T01:26:39.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:39.265+0000 7f7c29a00640 1 -- 172.21.15.63:0/520047723 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7c2406f080 msgr2=0x7f7c24154d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:39.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:39.265+0000 7f7c29a00640 1 --2- 172.21.15.63:0/520047723 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7c2406f080 0x7f7c24154d20 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f7c1400d830 tx=0x7f7c1400dcf0 comp rx=0 tx=0).stop 2024-05-21T01:26:39.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:39.265+0000 7f7c29a00640 1 -- 172.21.15.63:0/520047723 shutdown_connections 2024-05-21T01:26:39.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:39.265+0000 7f7c29a00640 1 --2- 172.21.15.63:0/520047723 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f7c0006f400 0x7f7c000718c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:39.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:39.265+0000 7f7c29a00640 1 --2- 172.21.15.63:0/520047723 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7c24156070 0x7f7c240cb980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:39.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:39.265+0000 7f7c29a00640 1 --2- 172.21.15.63:0/520047723 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7c24071b80 0x7f7c24160620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:39.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:39.265+0000 7f7c29a00640 1 --2- 172.21.15.63:0/520047723 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7c2406f080 0x7f7c24154d20 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:39.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:39.265+0000 7f7c29a00640 1 -- 172.21.15.63:0/520047723 >> 172.21.15.63:0/520047723 conn(0x7f7c240735f0 msgr2=0x7f7c240cee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:26:39.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:39.265+0000 7f7c29a00640 1 -- 172.21.15.63:0/520047723 shutdown_connections 2024-05-21T01:26:39.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:39.265+0000 7f7c29a00640 1 -- 172.21.15.63:0/520047723 wait complete. 2024-05-21T01:26:39.289 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-21T01:26:39.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-21T01:26:39.289 DEBUG:teuthology.orchestra.run.smithi063:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-21T01:26:39.874 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi063.front.sepia.ceph.com 2024-05-21T01:26:39.874 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-21T01:26:39.874 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-21T01:26:39.902 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-21T01:26:39.902 DEBUG:teuthology.orchestra.run.smithi063:> ip netns list 2024-05-21T01:26:39.957 INFO:teuthology.orchestra.run.smithi063.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-21T01:26:39.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-21T01:26:39.957 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-21T01:26:40.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-21T01:26:40.025 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link delete ceph-brx 2024-05-21T01:26:40.218 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-05-21T01:26:40.227 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-21T01:26:40.227 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-21T01:26:40.369 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.365+0000 7f2777800640 1 Processor -- start 2024-05-21T01:26:40.370 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.365+0000 7f2777800640 1 -- start start 2024-05-21T01:26:40.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.365+0000 7f2777800640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f2770156010 0x7f277015c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:40.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.365+0000 7f2777800640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f277015f560 con 0x7f277006ff60 2024-05-21T01:26:40.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.365+0000 7f2777800640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f277015f800 con 0x7f27701563f0 2024-05-21T01:26:40.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.365+0000 7f2777800640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f277015fae0 con 0x7f2770156010 2024-05-21T01:26:40.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.365+0000 7f2775800640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f277006ff60 0x7f27700727c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37490/0 (socket says 172.21.15.63:37490) 2024-05-21T01:26:40.371 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.365+0000 7f2775800640 1 -- 172.21.15.63:0/1675328381 learned_addr learned my addr 172.21.15.63:0/1675328381 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-05-21T01:26:40.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.365+0000 7f2774e00640 1 --2- 172.21.15.63:0/1675328381 >> v2:172.21.15.131:3300/0 conn(0x7f2770156010 0x7f277015c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:40.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.365+0000 7f276fe00640 1 -- 172.21.15.63:0/1675328381 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3188672699 0 0) 0x7f277015f560 con 0x7f277006ff60 2024-05-21T01:26:40.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.365+0000 7f276fe00640 1 -- 172.21.15.63:0/1675328381 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2754003530 con 0x7f277006ff60 2024-05-21T01:26:40.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.369+0000 7f276fe00640 1 -- 172.21.15.63:0/1675328381 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2697632 0 0) 0x7f2754003530 con 0x7f277006ff60 2024-05-21T01:26:40.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.369+0000 7f276fe00640 1 -- 172.21.15.63:0/1675328381 >> v2:172.21.15.131:3300/0 conn(0x7f2770156010 msgr2=0x7f277015c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:26:40.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.369+0000 7f276fe00640 1 --2- 172.21.15.63:0/1675328381 >> v2:172.21.15.131:3300/0 conn(0x7f2770156010 0x7f277015c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:40.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.369+0000 7f276fe00640 1 -- 172.21.15.63:0/1675328381 >> v1:172.21.15.131:6789/0 conn(0x7f27701563f0 legacy=0x7f27700c8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:40.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.369+0000 7f276fe00640 1 -- 172.21.15.63:0/1675328381 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f277015fdc0 con 0x7f277006ff60 2024-05-21T01:26:40.373 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.369+0000 7f276fe00640 1 -- 172.21.15.63:0/1675328381 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 466403955 0 0) 0x7f2768001a80 con 0x7f277006ff60 2024-05-21T01:26:40.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.369+0000 7f276fe00640 1 -- 172.21.15.63:0/1675328381 >> v1:172.21.15.63:6789/0 conn(0x7f277006ff60 legacy=0x7f27700727c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:40.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.369+0000 7f276fe00640 1 --2- 172.21.15.63:0/1675328381 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2754003a60 0x7f2754003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:40.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.369+0000 7f276fe00640 1 --2- 172.21.15.63:0/1675328381 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2754004810 0x7f2754004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:40.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.369+0000 7f276fe00640 1 --2- 172.21.15.63:0/1675328381 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f27540051d0 0x7f275400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:40.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.369+0000 7f276fe00640 1 -- 172.21.15.63:0/1675328381 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f277015fae0 con 0x7f27540051d0 2024-05-21T01:26:40.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.369+0000 7f276fe00640 1 -- 172.21.15.63:0/1675328381 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f275400c170 con 0x7f2754004810 2024-05-21T01:26:40.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.369+0000 7f276fe00640 1 -- 172.21.15.63:0/1675328381 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f275400c370 con 0x7f2754003a60 2024-05-21T01:26:40.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.369+0000 7f2775800640 1 --2- 172.21.15.63:0/1675328381 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f27540051d0 0x7f275400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:40.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.369+0000 7f2767e00640 1 --2- 172.21.15.63:0/1675328381 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2754004810 0x7f2754004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:40.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.369+0000 7f2774e00640 1 --2- 172.21.15.63:0/1675328381 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2754003a60 0x7f2754003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:40.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.369+0000 7f2775800640 1 -- 172.21.15.63:0/1675328381 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2754003a60 msgr2=0x7f2754003e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:26:40.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.369+0000 7f2775800640 1 --2- 172.21.15.63:0/1675328381 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2754003a60 0x7f2754003e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:40.374 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.369+0000 7f2775800640 1 -- 172.21.15.63:0/1675328381 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2754004810 msgr2=0x7f2754004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:26:40.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.369+0000 7f2775800640 1 --2- 172.21.15.63:0/1675328381 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2754004810 0x7f2754004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:40.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.369+0000 7f2775800640 1 -- 172.21.15.63:0/1675328381 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2754003530 con 0x7f27540051d0 2024-05-21T01:26:40.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.369+0000 7f2775800640 1 -- 172.21.15.63:0/1675328381 reap_dead start 2024-05-21T01:26:40.375 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.369+0000 7f2775800640 1 --2- 172.21.15.63:0/1675328381 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f27540051d0 0x7f275400b9d0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f276800a830 tx=0x7f276801d2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54871d1f92f6e6e8 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:40.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.373+0000 7f276fe00640 1 -- 172.21.15.63:0/1675328381 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f276800a450 con 0x7f27540051d0 2024-05-21T01:26:40.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.373+0000 7f276fe00640 1 -- 172.21.15.63:0/1675328381 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2768007310 con 0x7f27540051d0 2024-05-21T01:26:40.376 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.373+0000 7f276fe00640 1 -- 172.21.15.63:0/1675328381 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2768007700 con 0x7f27540051d0 2024-05-21T01:26:40.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.373+0000 7f2777800640 1 -- 172.21.15.63:0/1675328381 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f27540051d0 msgr2=0x7f275400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:40.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.373+0000 7f2777800640 1 --2- 172.21.15.63:0/1675328381 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f27540051d0 0x7f275400b9d0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f276800a830 tx=0x7f276801d2c0 comp rx=0 tx=0).stop 2024-05-21T01:26:40.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.373+0000 7f2777800640 1 -- 172.21.15.63:0/1675328381 shutdown_connections 2024-05-21T01:26:40.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.373+0000 7f2777800640 1 --2- 172.21.15.63:0/1675328381 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f27540051d0 0x7f275400b9d0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:40.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.373+0000 7f2777800640 1 -- 172.21.15.63:0/1675328381 >> 172.21.15.63:0/1675328381 conn(0x7f27700ce640 msgr2=0x7f27700cea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:26:40.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.373+0000 7f2777800640 1 -- 172.21.15.63:0/1675328381 shutdown_connections 2024-05-21T01:26:40.377 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.373+0000 7f2777800640 1 -- 172.21.15.63:0/1675328381 wait complete. 2024-05-21T01:26:40.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.373+0000 7f2777800640 1 Processor -- start 2024-05-21T01:26:40.378 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.373+0000 7f2777800640 1 -- start start 2024-05-21T01:26:40.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.373+0000 7f2777800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f27540051d0 0x7f27700cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:40.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.373+0000 7f2777800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2770148be0 0x7f27700c9c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:40.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.373+0000 7f2777800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f277014a7b0 0x7f2770141b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:40.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.373+0000 7f2777800640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f27700703f0 con 0x7f2770148be0 2024-05-21T01:26:40.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.373+0000 7f2777800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f2770160380 con 0x7f277014a7b0 2024-05-21T01:26:40.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.373+0000 7f2777800640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f2770070570 con 0x7f27540051d0 2024-05-21T01:26:40.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.373+0000 7f2767e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2770148be0 0x7f27700c9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:40.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.373+0000 7f2767e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2770148be0 0x7f27700c9c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48076/0 (socket says 172.21.15.63:48076) 2024-05-21T01:26:40.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.373+0000 7f2767e00640 1 -- 172.21.15.63:0/3857588961 learned_addr learned my addr 172.21.15.63:0/3857588961 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:26:40.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.373+0000 7f2774e00640 1 --2- 172.21.15.63:0/3857588961 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f27540051d0 0x7f27700cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:40.380 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.373+0000 7f2775800640 1 --2- 172.21.15.63:0/3857588961 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f277014a7b0 0x7f2770141b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:40.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.377+0000 7f2767e00640 1 -- 172.21.15.63:0/3857588961 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f27540051d0 msgr2=0x7f27700cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:40.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.377+0000 7f2767e00640 1 --2- 172.21.15.63:0/3857588961 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f27540051d0 0x7f27700cccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:40.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.377+0000 7f2767e00640 1 -- 172.21.15.63:0/3857588961 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f277014a7b0 msgr2=0x7f2770141b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:40.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.377+0000 7f2767e00640 1 --2- 172.21.15.63:0/3857588961 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f277014a7b0 0x7f2770141b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:40.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.377+0000 7f2767e00640 1 -- 172.21.15.63:0/3857588961 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27700cd230 con 0x7f2770148be0 2024-05-21T01:26:40.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.377+0000 7f2767e00640 1 --2- 172.21.15.63:0/3857588961 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2770148be0 0x7f27700c9c70 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f275800f820 tx=0x7f275800fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:40.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.377+0000 7f276d600640 1 -- 172.21.15.63:0/3857588961 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f275801a070 con 0x7f2770148be0 2024-05-21T01:26:40.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.377+0000 7f276d600640 1 -- 172.21.15.63:0/3857588961 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2758005110 con 0x7f2770148be0 2024-05-21T01:26:40.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.377+0000 7f276d600640 1 -- 172.21.15.63:0/3857588961 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27580067e0 con 0x7f2770148be0 2024-05-21T01:26:40.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.377+0000 7f2777800640 1 -- 172.21.15.63:0/3857588961 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f277014fd80 con 0x7f2770148be0 2024-05-21T01:26:40.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.377+0000 7f2777800640 1 -- 172.21.15.63:0/3857588961 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27700cc4f0 con 0x7f2770148be0 2024-05-21T01:26:40.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.377+0000 7f2777800640 1 -- 172.21.15.63:0/3857588961 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27701f26b0 con 0x7f2770148be0 2024-05-21T01:26:40.382 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.377+0000 7f276d600640 1 -- 172.21.15.63:0/3857588961 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7f2758006980 con 0x7f2770148be0 2024-05-21T01:26:40.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.377+0000 7f276d600640 1 --2- 172.21.15.63:0/3857588961 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f274c06f430 0x7f274c0718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:40.383 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.377+0000 7f276d600640 1 -- 172.21.15.63:0/3857588961 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f275808eda0 con 0x7f2770148be0 2024-05-21T01:26:40.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.381+0000 7f2774e00640 1 --2- 172.21.15.63:0/3857588961 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f274c06f430 0x7f274c0718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:40.384 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.381+0000 7f2774e00640 1 --2- 172.21.15.63:0/3857588961 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f274c06f430 0x7f274c0718f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f27600099b0 tx=0x7f2760008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:40.387 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.381+0000 7f276d600640 1 -- 172.21.15.63:0/3857588961 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f27701f26b0 con 0x7f2770148be0 2024-05-21T01:26:40.553 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.549+0000 7f2777800640 1 -- 172.21.15.63:0/3857588961 --> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f27700507f0 con 0x7f274c06f430 2024-05-21T01:26:40.579 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.573+0000 7f276d600640 1 -- 172.21.15.63:0/3857588961 <== mgr.4103 v2:172.21.15.131:6832/921953667 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+334387 (secure 0 0 0) 0x7f27700507f0 con 0x7f274c06f430 2024-05-21T01:26:40.583 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-05-21T01:26:40.585 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-05-21T01:26:40.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.577+0000 7f2777800640 1 -- 172.21.15.63:0/3857588961 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f274c06f430 msgr2=0x7f274c0718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:40.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.577+0000 7f2777800640 1 --2- 172.21.15.63:0/3857588961 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f274c06f430 0x7f274c0718f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f27600099b0 tx=0x7f2760008040 comp rx=0 tx=0).stop 2024-05-21T01:26:40.586 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.577+0000 7f2777800640 1 -- 172.21.15.63:0/3857588961 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2770148be0 msgr2=0x7f27700c9c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:40.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.577+0000 7f2777800640 1 --2- 172.21.15.63:0/3857588961 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2770148be0 0x7f27700c9c70 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f275800f820 tx=0x7f275800fce0 comp rx=0 tx=0).stop 2024-05-21T01:26:40.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.577+0000 7f2777800640 1 -- 172.21.15.63:0/3857588961 shutdown_connections 2024-05-21T01:26:40.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.577+0000 7f2777800640 1 --2- 172.21.15.63:0/3857588961 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f274c06f430 0x7f274c0718f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:40.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.577+0000 7f2777800640 1 --2- 172.21.15.63:0/3857588961 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f277014a7b0 0x7f2770141b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:40.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.577+0000 7f2777800640 1 --2- 172.21.15.63:0/3857588961 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2770148be0 0x7f27700c9c70 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:40.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.577+0000 7f2777800640 1 --2- 172.21.15.63:0/3857588961 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f27540051d0 0x7f27700cccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:40.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.577+0000 7f2777800640 1 -- 172.21.15.63:0/3857588961 >> 172.21.15.63:0/3857588961 conn(0x7f27700ce640 msgr2=0x7f277014ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:26:40.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.577+0000 7f2777800640 1 -- 172.21.15.63:0/3857588961 shutdown_connections 2024-05-21T01:26:40.587 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.577+0000 7f2777800640 1 -- 172.21.15.63:0/3857588961 wait complete. 2024-05-21T01:26:40.604 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":226,"stamp":"2024-05-21T01:26:38.608749+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":5112089206,"num_objects":1281,"num_object_clones":0,"num_object_copies":4998,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1281,"num_whiteouts":0,"num_read":5197,"num_read_kb":21004346,"num_write":9676,"num_write_kb":25170442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10127,"ondisk_log_size":10127,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1189216,"kb_used_data":800992,"kb_used_omap":12,"kb_used_meta":388147,"kb_avail":753785504,"statfs":{"total":773094113280,"available":771876356096,"internally_reserved":0,"allocated":820215808,"data_stored":12999642827,"data_compressed":641321588,"data_compressed_allocated":812081152,"data_compressed_original":12993003520,"omap_allocated":12750,"internal_metadata":397463090},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,1,2,1,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-5628749616,"num_objects":-1342,"num_object_clones":0,"num_object_copies":-5368,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1342,"num_whiteouts":0,"num_read":251,"num_read_kb":1024001,"num_write":1351,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004862"},"pg_stats":[{"pgid":"2.1f","version":"25'9","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:07.489107+0000","last_change":"2024-05-21T01:19:53.545236+0000","last_active":"2024-05-21T01:24:07.489107+0000","last_peered":"2024-05-21T01:24:07.489107+0000","last_clean":"2024-05-21T01:24:07.489107+0000","last_became_active":"2024-05-21T01:19:53.544469+0000","last_became_peered":"2024-05-21T01:19:53.544469+0000","last_unstale":"2024-05-21T01:24:07.489107+0000","last_undegraded":"2024-05-21T01:24:07.489107+0000","last_fullsized":"2024-05-21T01:24:07.489107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:33:09.421287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:23:58.496231+0000","last_change":"2024-05-21T01:19:54.568235+0000","last_active":"2024-05-21T01:23:58.496231+0000","last_peered":"2024-05-21T01:23:58.496231+0000","last_clean":"2024-05-21T01:23:58.496231+0000","last_became_active":"2024-05-21T01:19:54.567245+0000","last_became_peered":"2024-05-21T01:19:54.567245+0000","last_unstale":"2024-05-21T01:23:58.496231+0000","last_undegraded":"2024-05-21T01:23:58.496231+0000","last_fullsized":"2024-05-21T01:23:58.496231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:39:51.222819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"27'318","reported_seq":514,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:37.507383+0000","last_change":"2024-05-21T01:19:58.618772+0000","last_active":"2024-05-21T01:26:37.507383+0000","last_peered":"2024-05-21T01:26:37.507383+0000","last_clean":"2024-05-21T01:26:37.507383+0000","last_became_active":"2024-05-21T01:19:58.617757+0000","last_became_peered":"2024-05-21T01:19:58.617757+0000","last_unstale":"2024-05-21T01:26:37.507383+0000","last_undegraded":"2024-05-21T01:26:37.507383+0000","last_fullsized":"2024-05-21T01:26:37.507383+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":318,"log_dups_size":0,"ondisk_log_size":318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T13:07:31.666521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":176,"num_read_kb":720896,"num_write":297,"num_write_kb":835584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"25'2","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:23:53.495690+0000","last_change":"2024-05-21T01:19:53.551775+0000","last_active":"2024-05-21T01:23:53.495690+0000","last_peered":"2024-05-21T01:23:53.495690+0000","last_clean":"2024-05-21T01:23:53.495690+0000","last_became_active":"2024-05-21T01:19:53.551049+0000","last_became_peered":"2024-05-21T01:19:53.551049+0000","last_unstale":"2024-05-21T01:23:53.495690+0000","last_undegraded":"2024-05-21T01:23:53.495690+0000","last_fullsized":"2024-05-21T01:23:53.495690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:49:02.289202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:08.498886+0000","last_change":"2024-05-21T01:19:54.573420+0000","last_active":"2024-05-21T01:24:08.498886+0000","last_peered":"2024-05-21T01:24:08.498886+0000","last_clean":"2024-05-21T01:24:08.498886+0000","last_became_active":"2024-05-21T01:19:54.569573+0000","last_became_peered":"2024-05-21T01:19:54.569573+0000","last_unstale":"2024-05-21T01:24:08.498886+0000","last_undegraded":"2024-05-21T01:24:08.498886+0000","last_fullsized":"2024-05-21T01:24:08.498886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:00:12.257816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"27'253","reported_seq":469,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:25.966417+0000","last_change":"2024-05-21T01:19:58.604490+0000","last_active":"2024-05-21T01:26:25.966417+0000","last_peered":"2024-05-21T01:26:25.966417+0000","last_clean":"2024-05-21T01:26:25.966417+0000","last_became_active":"2024-05-21T01:19:58.604108+0000","last_became_peered":"2024-05-21T01:19:58.604108+0000","last_unstale":"2024-05-21T01:26:25.966417+0000","last_undegraded":"2024-05-21T01:26:25.966417+0000","last_fullsized":"2024-05-21T01:26:25.966417+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":253,"log_dups_size":0,"ondisk_log_size":253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:11:10.963073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":411041792,"num_objects":98,"num_object_clones":0,"num_object_copies":392,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":196,"num_read_kb":802816,"num_write":241,"num_write_kb":925696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"27'5","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:42.721812+0000","last_change":"2024-05-21T01:19:53.525403+0000","last_active":"2024-05-21T01:22:42.721812+0000","last_peered":"2024-05-21T01:22:42.721812+0000","last_clean":"2024-05-21T01:22:42.721812+0000","last_became_active":"2024-05-21T01:19:53.521265+0000","last_became_peered":"2024-05-21T01:19:53.521265+0000","last_unstale":"2024-05-21T01:22:42.721812+0000","last_undegraded":"2024-05-21T01:22:42.721812+0000","last_fullsized":"2024-05-21T01:22:42.721812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:52:16.488269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:24.468744+0000","last_change":"2024-05-21T01:19:54.536436+0000","last_active":"2024-05-21T01:22:24.468744+0000","last_peered":"2024-05-21T01:22:24.468744+0000","last_clean":"2024-05-21T01:22:24.468744+0000","last_became_active":"2024-05-21T01:19:54.536061+0000","last_became_peered":"2024-05-21T01:19:54.536061+0000","last_unstale":"2024-05-21T01:22:24.468744+0000","last_undegraded":"2024-05-21T01:22:24.468744+0000","last_fullsized":"2024-05-21T01:22:24.468744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:48:23.811712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"27'217","reported_seq":386,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:25.789588+0000","last_change":"2024-05-21T01:19:58.623087+0000","last_active":"2024-05-21T01:26:25.789588+0000","last_peered":"2024-05-21T01:26:25.789588+0000","last_clean":"2024-05-21T01:26:25.789588+0000","last_became_active":"2024-05-21T01:19:58.622672+0000","last_became_peered":"2024-05-21T01:19:58.622672+0000","last_unstale":"2024-05-21T01:26:25.789588+0000","last_undegraded":"2024-05-21T01:26:25.789588+0000","last_fullsized":"2024-05-21T01:26:25.789588+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:45:49.241750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":310378496,"num_objects":74,"num_object_clones":0,"num_object_copies":296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":149,"num_read_kb":610304,"num_write":199,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:24.484977+0000","last_change":"2024-05-21T01:19:53.522497+0000","last_active":"2024-05-21T01:22:24.484977+0000","last_peered":"2024-05-21T01:22:24.484977+0000","last_clean":"2024-05-21T01:22:24.484977+0000","last_became_active":"2024-05-21T01:19:53.521684+0000","last_became_peered":"2024-05-21T01:19:53.521684+0000","last_unstale":"2024-05-21T01:22:24.484977+0000","last_undegraded":"2024-05-21T01:22:24.484977+0000","last_fullsized":"2024-05-21T01:22:24.484977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:18:17.808255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:24.486725+0000","last_change":"2024-05-21T01:19:54.549512+0000","last_active":"2024-05-21T01:22:24.486725+0000","last_peered":"2024-05-21T01:22:24.486725+0000","last_clean":"2024-05-21T01:22:24.486725+0000","last_became_active":"2024-05-21T01:19:54.549291+0000","last_became_peered":"2024-05-21T01:19:54.549291+0000","last_unstale":"2024-05-21T01:22:24.486725+0000","last_undegraded":"2024-05-21T01:22:24.486725+0000","last_fullsized":"2024-05-21T01:22:24.486725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:48:34.571236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"27'200","reported_seq":362,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:25.697086+0000","last_change":"2024-05-21T01:19:58.614748+0000","last_active":"2024-05-21T01:26:25.697086+0000","last_peered":"2024-05-21T01:26:25.697086+0000","last_clean":"2024-05-21T01:26:25.697086+0000","last_became_active":"2024-05-21T01:19:58.614313+0000","last_became_peered":"2024-05-21T01:19:58.614313+0000","last_unstale":"2024-05-21T01:26:25.697086+0000","last_undegraded":"2024-05-21T01:26:25.697086+0000","last_fullsized":"2024-05-21T01:26:25.697086+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:45:34.204591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":297795584,"num_objects":71,"num_object_clones":0,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":142,"num_read_kb":581632,"num_write":181,"num_write_kb":688128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:14.556315+0000","last_change":"2024-05-21T01:19:54.545467+0000","last_active":"2024-05-21T01:24:14.556315+0000","last_peered":"2024-05-21T01:24:14.556315+0000","last_clean":"2024-05-21T01:24:14.556315+0000","last_became_active":"2024-05-21T01:19:54.545181+0000","last_became_peered":"2024-05-21T01:19:54.545181+0000","last_unstale":"2024-05-21T01:24:14.556315+0000","last_undegraded":"2024-05-21T01:24:14.556315+0000","last_fullsized":"2024-05-21T01:24:14.556315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:43:15.387067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"27'5","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:42.722196+0000","last_change":"2024-05-21T01:19:53.536139+0000","last_active":"2024-05-21T01:22:42.722196+0000","last_peered":"2024-05-21T01:22:42.722196+0000","last_clean":"2024-05-21T01:22:42.722196+0000","last_became_active":"2024-05-21T01:19:53.535899+0000","last_became_peered":"2024-05-21T01:19:53.535899+0000","last_unstale":"2024-05-21T01:22:42.722196+0000","last_undegraded":"2024-05-21T01:22:42.722196+0000","last_fullsized":"2024-05-21T01:22:42.722196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:40:12.033744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"27'236","reported_seq":437,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:25.905774+0000","last_change":"2024-05-21T01:19:58.621487+0000","last_active":"2024-05-21T01:26:25.905774+0000","last_peered":"2024-05-21T01:26:25.905774+0000","last_clean":"2024-05-21T01:26:25.905774+0000","last_became_active":"2024-05-21T01:19:58.621083+0000","last_became_peered":"2024-05-21T01:19:58.621083+0000","last_unstale":"2024-05-21T01:26:25.905774+0000","last_undegraded":"2024-05-21T01:26:25.905774+0000","last_fullsized":"2024-05-21T01:26:25.905774+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":236,"log_dups_size":0,"ondisk_log_size":236,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:18:44.587274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":377487360,"num_objects":90,"num_object_clones":0,"num_object_copies":360,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":90,"num_whiteouts":0,"num_read":181,"num_read_kb":741376,"num_write":219,"num_write_kb":843776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:12.470739+0000","last_change":"2024-05-21T01:19:54.572420+0000","last_active":"2024-05-21T01:22:12.470739+0000","last_peered":"2024-05-21T01:22:12.470739+0000","last_clean":"2024-05-21T01:22:12.470739+0000","last_became_active":"2024-05-21T01:19:54.571863+0000","last_became_peered":"2024-05-21T01:19:54.571863+0000","last_unstale":"2024-05-21T01:22:12.470739+0000","last_undegraded":"2024-05-21T01:22:12.470739+0000","last_fullsized":"2024-05-21T01:22:12.470739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:13:52.491903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"27'3","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:13.507766+0000","last_change":"2024-05-21T01:19:53.553351+0000","last_active":"2024-05-21T01:24:13.507766+0000","last_peered":"2024-05-21T01:24:13.507766+0000","last_clean":"2024-05-21T01:24:13.507766+0000","last_became_active":"2024-05-21T01:19:53.552694+0000","last_became_peered":"2024-05-21T01:19:53.552694+0000","last_unstale":"2024-05-21T01:24:13.507766+0000","last_undegraded":"2024-05-21T01:24:13.507766+0000","last_fullsized":"2024-05-21T01:24:13.507766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:46:55.273278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"27'216","reported_seq":404,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:25.636952+0000","last_change":"2024-05-21T01:19:58.594904+0000","last_active":"2024-05-21T01:26:25.636952+0000","last_peered":"2024-05-21T01:26:25.636952+0000","last_clean":"2024-05-21T01:26:25.636952+0000","last_became_active":"2024-05-21T01:19:58.594450+0000","last_became_peered":"2024-05-21T01:19:58.594450+0000","last_unstale":"2024-05-21T01:26:25.636952+0000","last_undegraded":"2024-05-21T01:26:25.636952+0000","last_fullsized":"2024-05-21T01:26:25.636952+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:37:30.286986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":352321536,"num_objects":84,"num_object_clones":0,"num_object_copies":336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":0,"num_read":168,"num_read_kb":688128,"num_write":207,"num_write_kb":794624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:17.490540+0000","last_change":"2024-05-21T01:19:54.554750+0000","last_active":"2024-05-21T01:24:17.490540+0000","last_peered":"2024-05-21T01:24:17.490540+0000","last_clean":"2024-05-21T01:24:17.490540+0000","last_became_active":"2024-05-21T01:19:54.551583+0000","last_became_peered":"2024-05-21T01:19:54.551583+0000","last_unstale":"2024-05-21T01:24:17.490540+0000","last_undegraded":"2024-05-21T01:24:17.490540+0000","last_fullsized":"2024-05-21T01:24:17.490540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:37:19.564099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"25'3","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:17.490604+0000","last_change":"2024-05-21T01:19:53.523277+0000","last_active":"2024-05-21T01:24:17.490604+0000","last_peered":"2024-05-21T01:24:17.490604+0000","last_clean":"2024-05-21T01:24:17.490604+0000","last_became_active":"2024-05-21T01:19:53.522525+0000","last_became_peered":"2024-05-21T01:19:53.522525+0000","last_unstale":"2024-05-21T01:24:17.490604+0000","last_undegraded":"2024-05-21T01:24:17.490604+0000","last_fullsized":"2024-05-21T01:24:17.490604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:23:59.949781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"27'278","reported_seq":456,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:37.503134+0000","last_change":"2024-05-21T01:19:58.615575+0000","last_active":"2024-05-21T01:26:37.503134+0000","last_peered":"2024-05-21T01:26:37.503134+0000","last_clean":"2024-05-21T01:26:37.503134+0000","last_became_active":"2024-05-21T01:19:58.614401+0000","last_became_peered":"2024-05-21T01:19:58.614401+0000","last_unstale":"2024-05-21T01:26:37.503134+0000","last_undegraded":"2024-05-21T01:26:37.503134+0000","last_fullsized":"2024-05-21T01:26:37.503134+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":278,"log_dups_size":0,"ondisk_log_size":278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:51:09.839503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":158,"num_read_kb":647168,"num_write":259,"num_write_kb":729088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:14.556307+0000","last_change":"2024-05-21T01:19:54.555489+0000","last_active":"2024-05-21T01:24:14.556307+0000","last_peered":"2024-05-21T01:24:14.556307+0000","last_clean":"2024-05-21T01:24:14.556307+0000","last_became_active":"2024-05-21T01:19:54.555227+0000","last_became_peered":"2024-05-21T01:19:54.555227+0000","last_unstale":"2024-05-21T01:24:14.556307+0000","last_undegraded":"2024-05-21T01:24:14.556307+0000","last_fullsized":"2024-05-21T01:24:14.556307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:00:22.873520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"25'2","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:14.509091+0000","last_change":"2024-05-21T01:19:53.520840+0000","last_active":"2024-05-21T01:24:14.509091+0000","last_peered":"2024-05-21T01:24:14.509091+0000","last_clean":"2024-05-21T01:24:14.509091+0000","last_became_active":"2024-05-21T01:19:53.520540+0000","last_became_peered":"2024-05-21T01:19:53.520540+0000","last_unstale":"2024-05-21T01:24:14.509091+0000","last_undegraded":"2024-05-21T01:24:14.509091+0000","last_fullsized":"2024-05-21T01:24:14.509091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:08:36.426465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"27'215","reported_seq":405,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:26.133755+0000","last_change":"2024-05-21T01:19:58.604357+0000","last_active":"2024-05-21T01:26:26.133755+0000","last_peered":"2024-05-21T01:26:26.133755+0000","last_clean":"2024-05-21T01:26:26.133755+0000","last_became_active":"2024-05-21T01:19:58.603922+0000","last_became_peered":"2024-05-21T01:19:58.603922+0000","last_unstale":"2024-05-21T01:26:26.133755+0000","last_undegraded":"2024-05-21T01:26:26.133755+0000","last_fullsized":"2024-05-21T01:26:26.133755+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:55:18.226031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":356515840,"num_objects":85,"num_object_clones":0,"num_object_copies":340,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85,"num_whiteouts":0,"num_read":170,"num_read_kb":696320,"num_write":203,"num_write_kb":786432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:17.490671+0000","last_change":"2024-05-21T01:19:54.569315+0000","last_active":"2024-05-21T01:24:17.490671+0000","last_peered":"2024-05-21T01:24:17.490671+0000","last_clean":"2024-05-21T01:24:17.490671+0000","last_became_active":"2024-05-21T01:19:54.568232+0000","last_became_peered":"2024-05-21T01:19:54.568232+0000","last_unstale":"2024-05-21T01:24:17.490671+0000","last_undegraded":"2024-05-21T01:24:17.490671+0000","last_fullsized":"2024-05-21T01:24:17.490671+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:19:01.819418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"25'4","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:14.556346+0000","last_change":"2024-05-21T01:19:53.525301+0000","last_active":"2024-05-21T01:24:14.556346+0000","last_peered":"2024-05-21T01:24:14.556346+0000","last_clean":"2024-05-21T01:24:14.556346+0000","last_became_active":"2024-05-21T01:19:53.525010+0000","last_became_peered":"2024-05-21T01:19:53.525010+0000","last_unstale":"2024-05-21T01:24:14.556346+0000","last_undegraded":"2024-05-21T01:24:14.556346+0000","last_fullsized":"2024-05-21T01:24:14.556346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:53:11.316975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"27'209","reported_seq":358,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:26.096778+0000","last_change":"2024-05-21T01:19:58.590354+0000","last_active":"2024-05-21T01:26:26.096778+0000","last_peered":"2024-05-21T01:26:26.096778+0000","last_clean":"2024-05-21T01:26:26.096778+0000","last_became_active":"2024-05-21T01:19:58.589985+0000","last_became_peered":"2024-05-21T01:19:58.589985+0000","last_unstale":"2024-05-21T01:26:26.096778+0000","last_undegraded":"2024-05-21T01:26:26.096778+0000","last_fullsized":"2024-05-21T01:26:26.096778+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:08:09.222858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":268435456,"num_objects":64,"num_object_clones":0,"num_object_copies":256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":128,"num_read_kb":524288,"num_write":185,"num_write_kb":679936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:17.490762+0000","last_change":"2024-05-21T01:19:54.555318+0000","last_active":"2024-05-21T01:24:17.490762+0000","last_peered":"2024-05-21T01:24:17.490762+0000","last_clean":"2024-05-21T01:24:17.490762+0000","last_became_active":"2024-05-21T01:19:54.552947+0000","last_became_peered":"2024-05-21T01:19:54.552947+0000","last_unstale":"2024-05-21T01:24:17.490762+0000","last_undegraded":"2024-05-21T01:24:17.490762+0000","last_fullsized":"2024-05-21T01:24:17.490762+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:29:24.153986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"27'30","reported_seq":59,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:32.740014+0000","last_change":"2024-05-21T01:19:53.525004+0000","last_active":"2024-05-21T01:26:32.740014+0000","last_peered":"2024-05-21T01:26:32.740014+0000","last_clean":"2024-05-21T01:26:32.740014+0000","last_became_active":"2024-05-21T01:19:53.521014+0000","last_became_peered":"2024-05-21T01:19:53.521014+0000","last_unstale":"2024-05-21T01:26:32.740014+0000","last_undegraded":"2024-05-21T01:26:32.740014+0000","last_fullsized":"2024-05-21T01:26:32.740014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:02:46.668320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"27'268","reported_seq":427,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:37.289842+0000","last_change":"2024-05-21T01:19:58.599880+0000","last_active":"2024-05-21T01:26:37.289842+0000","last_peered":"2024-05-21T01:26:37.289842+0000","last_clean":"2024-05-21T01:26:37.289842+0000","last_became_active":"2024-05-21T01:19:58.598712+0000","last_became_peered":"2024-05-21T01:19:58.598712+0000","last_unstale":"2024-05-21T01:26:37.289842+0000","last_undegraded":"2024-05-21T01:26:37.289842+0000","last_fullsized":"2024-05-21T01:26:37.289842+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":268,"log_dups_size":0,"ondisk_log_size":268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:43:05.995986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":138,"num_read_kb":565248,"num_write":255,"num_write_kb":720896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:08.507007+0000","last_change":"2024-05-21T01:19:54.576044+0000","last_active":"2024-05-21T01:24:08.507007+0000","last_peered":"2024-05-21T01:24:08.507007+0000","last_clean":"2024-05-21T01:24:08.507007+0000","last_became_active":"2024-05-21T01:19:54.575543+0000","last_became_peered":"2024-05-21T01:19:54.575543+0000","last_unstale":"2024-05-21T01:24:08.507007+0000","last_undegraded":"2024-05-21T01:24:08.507007+0000","last_fullsized":"2024-05-21T01:24:08.507007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T09:33:07.188470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"25'1","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:04.555386+0000","last_change":"2024-05-21T01:19:53.543705+0000","last_active":"2024-05-21T01:24:04.555386+0000","last_peered":"2024-05-21T01:24:04.555386+0000","last_clean":"2024-05-21T01:24:04.555386+0000","last_became_active":"2024-05-21T01:19:53.543450+0000","last_became_peered":"2024-05-21T01:19:53.543450+0000","last_unstale":"2024-05-21T01:24:04.555386+0000","last_undegraded":"2024-05-21T01:24:04.555386+0000","last_fullsized":"2024-05-21T01:24:04.555386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:05:49.465156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"27'267","reported_seq":424,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:38.308781+0000","last_change":"2024-05-21T01:19:58.612049+0000","last_active":"2024-05-21T01:26:38.308781+0000","last_peered":"2024-05-21T01:26:38.308781+0000","last_clean":"2024-05-21T01:26:38.308781+0000","last_became_active":"2024-05-21T01:19:58.610837+0000","last_became_peered":"2024-05-21T01:19:58.610837+0000","last_unstale":"2024-05-21T01:26:38.308781+0000","last_undegraded":"2024-05-21T01:26:38.308781+0000","last_fullsized":"2024-05-21T01:26:38.308781+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":267,"log_dups_size":0,"ondisk_log_size":267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:24:14.332056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":557056,"num_write":249,"num_write_kb":679936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:04.542429+0000","last_change":"2024-05-21T01:19:54.553083+0000","last_active":"2024-05-21T01:24:04.542429+0000","last_peered":"2024-05-21T01:24:04.542429+0000","last_clean":"2024-05-21T01:24:04.542429+0000","last_became_active":"2024-05-21T01:19:54.552812+0000","last_became_peered":"2024-05-21T01:19:54.552812+0000","last_unstale":"2024-05-21T01:24:04.542429+0000","last_undegraded":"2024-05-21T01:24:04.542429+0000","last_fullsized":"2024-05-21T01:24:04.542429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:37:25.835345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:03.497940+0000","last_change":"2024-05-21T01:19:53.551697+0000","last_active":"2024-05-21T01:24:03.497940+0000","last_peered":"2024-05-21T01:24:03.497940+0000","last_clean":"2024-05-21T01:24:03.497940+0000","last_became_active":"2024-05-21T01:19:53.550921+0000","last_became_peered":"2024-05-21T01:19:53.550921+0000","last_unstale":"2024-05-21T01:24:03.497940+0000","last_undegraded":"2024-05-21T01:24:03.497940+0000","last_fullsized":"2024-05-21T01:24:03.497940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T09:31:31.996638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"27'289","reported_seq":468,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:38.366664+0000","last_change":"2024-05-21T01:19:58.626472+0000","last_active":"2024-05-21T01:26:38.366664+0000","last_peered":"2024-05-21T01:26:38.366664+0000","last_clean":"2024-05-21T01:26:38.366664+0000","last_became_active":"2024-05-21T01:19:58.625720+0000","last_became_peered":"2024-05-21T01:19:58.625720+0000","last_unstale":"2024-05-21T01:26:38.366664+0000","last_undegraded":"2024-05-21T01:26:38.366664+0000","last_fullsized":"2024-05-21T01:26:38.366664+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":289,"log_dups_size":0,"ondisk_log_size":289,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:16:03.911585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":158,"num_read_kb":647168,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:04.508249+0000","last_change":"2024-05-21T01:19:54.547947+0000","last_active":"2024-05-21T01:24:04.508249+0000","last_peered":"2024-05-21T01:24:04.508249+0000","last_clean":"2024-05-21T01:24:04.508249+0000","last_became_active":"2024-05-21T01:19:54.547689+0000","last_became_peered":"2024-05-21T01:19:54.547689+0000","last_unstale":"2024-05-21T01:24:04.508249+0000","last_undegraded":"2024-05-21T01:24:04.508249+0000","last_fullsized":"2024-05-21T01:24:04.508249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:40:55.985899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"25'1","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:04.555333+0000","last_change":"2024-05-21T01:19:53.540973+0000","last_active":"2024-05-21T01:24:04.555333+0000","last_peered":"2024-05-21T01:24:04.555333+0000","last_clean":"2024-05-21T01:24:04.555333+0000","last_became_active":"2024-05-21T01:19:53.540670+0000","last_became_peered":"2024-05-21T01:19:53.540670+0000","last_unstale":"2024-05-21T01:24:04.555333+0000","last_undegraded":"2024-05-21T01:24:04.555333+0000","last_fullsized":"2024-05-21T01:24:04.555333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:08:21.802284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"27'277","reported_seq":446,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:38.380089+0000","last_change":"2024-05-21T01:19:58.611280+0000","last_active":"2024-05-21T01:26:38.380089+0000","last_peered":"2024-05-21T01:26:38.380089+0000","last_clean":"2024-05-21T01:26:38.380089+0000","last_became_active":"2024-05-21T01:19:58.610511+0000","last_became_peered":"2024-05-21T01:19:58.610511+0000","last_unstale":"2024-05-21T01:26:38.380089+0000","last_undegraded":"2024-05-21T01:26:38.380089+0000","last_fullsized":"2024-05-21T01:26:38.380089+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:49:19.660422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":606208,"num_write":264,"num_write_kb":720896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:23:58.496160+0000","last_change":"2024-05-21T01:19:54.572546+0000","last_active":"2024-05-21T01:23:58.496160+0000","last_peered":"2024-05-21T01:23:58.496160+0000","last_clean":"2024-05-21T01:23:58.496160+0000","last_became_active":"2024-05-21T01:19:54.572022+0000","last_became_peered":"2024-05-21T01:19:54.572022+0000","last_unstale":"2024-05-21T01:23:58.496160+0000","last_undegraded":"2024-05-21T01:23:58.496160+0000","last_fullsized":"2024-05-21T01:23:58.496160+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:50:08.351383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"27'8","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:35.052139+0000","last_change":"2024-05-21T01:19:53.556786+0000","last_active":"2024-05-21T01:26:35.052139+0000","last_peered":"2024-05-21T01:26:35.052139+0000","last_clean":"2024-05-21T01:26:35.052139+0000","last_became_active":"2024-05-21T01:19:53.556143+0000","last_became_peered":"2024-05-21T01:19:53.556143+0000","last_unstale":"2024-05-21T01:26:35.052139+0000","last_undegraded":"2024-05-21T01:26:35.052139+0000","last_fullsized":"2024-05-21T01:26:35.052139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:02:17.391701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":417,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"27'289","reported_seq":452,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:38.385695+0000","last_change":"2024-05-21T01:19:58.599203+0000","last_active":"2024-05-21T01:26:38.385695+0000","last_peered":"2024-05-21T01:26:38.385695+0000","last_clean":"2024-05-21T01:26:38.385695+0000","last_became_active":"2024-05-21T01:19:58.598175+0000","last_became_peered":"2024-05-21T01:19:58.598175+0000","last_unstale":"2024-05-21T01:26:38.385695+0000","last_undegraded":"2024-05-21T01:26:38.385695+0000","last_fullsized":"2024-05-21T01:26:38.385695+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":289,"log_dups_size":0,"ondisk_log_size":289,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:45:17.138090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":581632,"num_write":270,"num_write_kb":737280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:08.506876+0000","last_change":"2024-05-21T01:19:54.551092+0000","last_active":"2024-05-21T01:24:08.506876+0000","last_peered":"2024-05-21T01:24:08.506876+0000","last_clean":"2024-05-21T01:24:08.506876+0000","last_became_active":"2024-05-21T01:19:54.550338+0000","last_became_peered":"2024-05-21T01:19:54.550338+0000","last_unstale":"2024-05-21T01:24:08.506876+0000","last_undegraded":"2024-05-21T01:24:08.506876+0000","last_fullsized":"2024-05-21T01:24:08.506876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:29:13.540719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"25'3","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:23:54.554210+0000","last_change":"2024-05-21T01:19:53.554835+0000","last_active":"2024-05-21T01:23:54.554210+0000","last_peered":"2024-05-21T01:23:54.554210+0000","last_clean":"2024-05-21T01:23:54.554210+0000","last_became_active":"2024-05-21T01:19:53.554598+0000","last_became_peered":"2024-05-21T01:19:53.554598+0000","last_unstale":"2024-05-21T01:23:54.554210+0000","last_undegraded":"2024-05-21T01:23:54.554210+0000","last_fullsized":"2024-05-21T01:23:54.554210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:28:43.940978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"27'351","reported_seq":558,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:38.359893+0000","last_change":"2024-05-21T01:19:58.629747+0000","last_active":"2024-05-21T01:26:38.359893+0000","last_peered":"2024-05-21T01:26:38.359893+0000","last_clean":"2024-05-21T01:26:38.359893+0000","last_became_active":"2024-05-21T01:19:58.622106+0000","last_became_peered":"2024-05-21T01:19:58.622106+0000","last_unstale":"2024-05-21T01:26:38.359893+0000","last_undegraded":"2024-05-21T01:26:38.359893+0000","last_fullsized":"2024-05-21T01:26:38.359893+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:22:07.047914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":761856,"num_write":339,"num_write_kb":925696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:07.489038+0000","last_change":"2024-05-21T01:19:54.554303+0000","last_active":"2024-05-21T01:24:07.489038+0000","last_peered":"2024-05-21T01:24:07.489038+0000","last_clean":"2024-05-21T01:24:07.489038+0000","last_became_active":"2024-05-21T01:19:54.552126+0000","last_became_peered":"2024-05-21T01:19:54.552126+0000","last_unstale":"2024-05-21T01:24:07.489038+0000","last_undegraded":"2024-05-21T01:24:07.489038+0000","last_fullsized":"2024-05-21T01:24:07.489038+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:59:46.383359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"25'3","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:04.555354+0000","last_change":"2024-05-21T01:19:53.536580+0000","last_active":"2024-05-21T01:24:04.555354+0000","last_peered":"2024-05-21T01:24:04.555354+0000","last_clean":"2024-05-21T01:24:04.555354+0000","last_became_active":"2024-05-21T01:19:53.535105+0000","last_became_peered":"2024-05-21T01:19:53.535105+0000","last_unstale":"2024-05-21T01:24:04.555354+0000","last_undegraded":"2024-05-21T01:24:04.555354+0000","last_fullsized":"2024-05-21T01:24:04.555354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:58:05.019025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":125,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:23:49.506777+0000","last_change":"2024-05-21T01:19:49.490062+0000","last_active":"2024-05-21T01:23:49.506777+0000","last_peered":"2024-05-21T01:23:49.506777+0000","last_clean":"2024-05-21T01:23:49.506777+0000","last_became_active":"2024-05-21T01:19:49.488796+0000","last_became_peered":"2024-05-21T01:19:49.488796+0000","last_unstale":"2024-05-21T01:23:49.506777+0000","last_undegraded":"2024-05-21T01:23:49.506777+0000","last_fullsized":"2024-05-21T01:23:49.506777+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:47.457865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:47.457865+0000","last_clean_scrub_stamp":"2024-05-21T01:19:47.457865+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T09:37:06.199150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"27'215","reported_seq":391,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:26.075844+0000","last_change":"2024-05-21T01:19:58.590851+0000","last_active":"2024-05-21T01:26:26.075844+0000","last_peered":"2024-05-21T01:26:26.075844+0000","last_clean":"2024-05-21T01:26:26.075844+0000","last_became_active":"2024-05-21T01:19:58.589288+0000","last_became_peered":"2024-05-21T01:19:58.589288+0000","last_unstale":"2024-05-21T01:26:26.075844+0000","last_undegraded":"2024-05-21T01:26:26.075844+0000","last_fullsized":"2024-05-21T01:26:26.075844+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:36:46.992834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":322961408,"num_objects":77,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":155,"num_read_kb":634880,"num_write":199,"num_write_kb":753664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:09.476149+0000","last_change":"2024-05-21T01:19:54.543894+0000","last_active":"2024-05-21T01:22:09.476149+0000","last_peered":"2024-05-21T01:22:09.476149+0000","last_clean":"2024-05-21T01:22:09.476149+0000","last_became_active":"2024-05-21T01:19:54.543586+0000","last_became_peered":"2024-05-21T01:19:54.543586+0000","last_unstale":"2024-05-21T01:22:09.476149+0000","last_undegraded":"2024-05-21T01:22:09.476149+0000","last_fullsized":"2024-05-21T01:22:09.476149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:33:02.756634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"25'3","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:23.509317+0000","last_change":"2024-05-21T01:19:53.532115+0000","last_active":"2024-05-21T01:24:23.509317+0000","last_peered":"2024-05-21T01:24:23.509317+0000","last_clean":"2024-05-21T01:24:23.509317+0000","last_became_active":"2024-05-21T01:19:53.529879+0000","last_became_peered":"2024-05-21T01:19:53.529879+0000","last_unstale":"2024-05-21T01:24:23.509317+0000","last_undegraded":"2024-05-21T01:24:23.509317+0000","last_fullsized":"2024-05-21T01:24:23.509317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:42:07.436243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"27'221","reported_seq":402,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:26.122026+0000","last_change":"2024-05-21T01:19:58.604417+0000","last_active":"2024-05-21T01:26:26.122026+0000","last_peered":"2024-05-21T01:26:26.122026+0000","last_clean":"2024-05-21T01:26:26.122026+0000","last_became_active":"2024-05-21T01:19:58.603929+0000","last_became_peered":"2024-05-21T01:19:58.603929+0000","last_unstale":"2024-05-21T01:26:26.122026+0000","last_undegraded":"2024-05-21T01:26:26.122026+0000","last_fullsized":"2024-05-21T01:26:26.122026+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:15:59.031738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":335544320,"num_objects":80,"num_object_clones":0,"num_object_copies":320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":160,"num_read_kb":655360,"num_write":199,"num_write_kb":761856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:09.483356+0000","last_change":"2024-05-21T01:19:54.542096+0000","last_active":"2024-05-21T01:22:09.483356+0000","last_peered":"2024-05-21T01:22:09.483356+0000","last_clean":"2024-05-21T01:22:09.483356+0000","last_became_active":"2024-05-21T01:19:54.541837+0000","last_became_peered":"2024-05-21T01:19:54.541837+0000","last_unstale":"2024-05-21T01:22:09.483356+0000","last_undegraded":"2024-05-21T01:22:09.483356+0000","last_fullsized":"2024-05-21T01:22:09.483356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:55:30.807311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:23.503932+0000","last_change":"2024-05-21T01:19:53.551697+0000","last_active":"2024-05-21T01:24:23.503932+0000","last_peered":"2024-05-21T01:24:23.503932+0000","last_clean":"2024-05-21T01:24:23.503932+0000","last_became_active":"2024-05-21T01:19:53.550893+0000","last_became_peered":"2024-05-21T01:19:53.550893+0000","last_unstale":"2024-05-21T01:24:23.503932+0000","last_undegraded":"2024-05-21T01:24:23.503932+0000","last_fullsized":"2024-05-21T01:24:23.503932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:42:20.295229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"27'271","reported_seq":433,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:38.398598+0000","last_change":"2024-05-21T01:19:58.628526+0000","last_active":"2024-05-21T01:26:38.398598+0000","last_peered":"2024-05-21T01:26:38.398598+0000","last_clean":"2024-05-21T01:26:38.398598+0000","last_became_active":"2024-05-21T01:19:58.620667+0000","last_became_peered":"2024-05-21T01:19:58.620667+0000","last_unstale":"2024-05-21T01:26:38.398598+0000","last_undegraded":"2024-05-21T01:26:38.398598+0000","last_fullsized":"2024-05-21T01:26:38.398598+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:46:22.396063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":581632,"num_write":261,"num_write_kb":712704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:09.483391+0000","last_change":"2024-05-21T01:19:54.532551+0000","last_active":"2024-05-21T01:22:09.483391+0000","last_peered":"2024-05-21T01:22:09.483391+0000","last_clean":"2024-05-21T01:22:09.483391+0000","last_became_active":"2024-05-21T01:19:54.532251+0000","last_became_peered":"2024-05-21T01:19:54.532251+0000","last_unstale":"2024-05-21T01:22:09.483391+0000","last_undegraded":"2024-05-21T01:22:09.483391+0000","last_fullsized":"2024-05-21T01:22:09.483391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:00:30.042781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:12.468593+0000","last_change":"2024-05-21T01:19:53.554659+0000","last_active":"2024-05-21T01:22:12.468593+0000","last_peered":"2024-05-21T01:22:12.468593+0000","last_clean":"2024-05-21T01:22:12.468593+0000","last_became_active":"2024-05-21T01:19:53.553953+0000","last_became_peered":"2024-05-21T01:19:53.553953+0000","last_unstale":"2024-05-21T01:22:12.468593+0000","last_undegraded":"2024-05-21T01:22:12.468593+0000","last_fullsized":"2024-05-21T01:22:12.468593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:31:13.091061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"27'248","reported_seq":439,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:26.032890+0000","last_change":"2024-05-21T01:19:58.593243+0000","last_active":"2024-05-21T01:26:26.032890+0000","last_peered":"2024-05-21T01:26:26.032890+0000","last_clean":"2024-05-21T01:26:26.032890+0000","last_became_active":"2024-05-21T01:19:58.592758+0000","last_became_peered":"2024-05-21T01:19:58.592758+0000","last_unstale":"2024-05-21T01:26:26.032890+0000","last_undegraded":"2024-05-21T01:26:26.032890+0000","last_fullsized":"2024-05-21T01:26:26.032890+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":248,"log_dups_size":0,"ondisk_log_size":248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:46:17.877736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":356515840,"num_objects":85,"num_object_clones":0,"num_object_copies":340,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85,"num_whiteouts":0,"num_read":170,"num_read_kb":696320,"num_write":233,"num_write_kb":868352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:09.467479+0000","last_change":"2024-05-21T01:19:54.538391+0000","last_active":"2024-05-21T01:22:09.467479+0000","last_peered":"2024-05-21T01:22:09.467479+0000","last_clean":"2024-05-21T01:22:09.467479+0000","last_became_active":"2024-05-21T01:19:54.538106+0000","last_became_peered":"2024-05-21T01:19:54.538106+0000","last_unstale":"2024-05-21T01:22:09.467479+0000","last_undegraded":"2024-05-21T01:22:09.467479+0000","last_fullsized":"2024-05-21T01:22:09.467479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:36:07.297496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"25'2","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:09.483407+0000","last_change":"2024-05-21T01:19:53.551917+0000","last_active":"2024-05-21T01:22:09.483407+0000","last_peered":"2024-05-21T01:22:09.483407+0000","last_clean":"2024-05-21T01:22:09.483407+0000","last_became_active":"2024-05-21T01:19:53.551608+0000","last_became_peered":"2024-05-21T01:19:53.551608+0000","last_unstale":"2024-05-21T01:22:09.483407+0000","last_undegraded":"2024-05-21T01:22:09.483407+0000","last_fullsized":"2024-05-21T01:22:09.483407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:20:54.093966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"27'207","reported_seq":363,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:25.851833+0000","last_change":"2024-05-21T01:19:58.613367+0000","last_active":"2024-05-21T01:26:25.851833+0000","last_peered":"2024-05-21T01:26:25.851833+0000","last_clean":"2024-05-21T01:26:25.851833+0000","last_became_active":"2024-05-21T01:19:58.612950+0000","last_became_peered":"2024-05-21T01:19:58.612950+0000","last_unstale":"2024-05-21T01:26:25.851833+0000","last_undegraded":"2024-05-21T01:26:25.851833+0000","last_fullsized":"2024-05-21T01:26:25.851833+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:32:12.365734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":281018368,"num_objects":67,"num_object_clones":0,"num_object_copies":268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":135,"num_read_kb":552960,"num_write":191,"num_write_kb":704512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:14.476560+0000","last_change":"2024-05-21T01:19:54.548979+0000","last_active":"2024-05-21T01:22:14.476560+0000","last_peered":"2024-05-21T01:22:14.476560+0000","last_clean":"2024-05-21T01:22:14.476560+0000","last_became_active":"2024-05-21T01:19:54.548704+0000","last_became_peered":"2024-05-21T01:19:54.548704+0000","last_unstale":"2024-05-21T01:22:14.476560+0000","last_undegraded":"2024-05-21T01:22:14.476560+0000","last_fullsized":"2024-05-21T01:22:14.476560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:57:09.076705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"25'15","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:17.469218+0000","last_change":"2024-05-21T01:19:53.542425+0000","last_active":"2024-05-21T01:22:17.469218+0000","last_peered":"2024-05-21T01:22:17.469218+0000","last_clean":"2024-05-21T01:22:17.469218+0000","last_became_active":"2024-05-21T01:19:53.541577+0000","last_became_peered":"2024-05-21T01:19:53.541577+0000","last_unstale":"2024-05-21T01:22:17.469218+0000","last_undegraded":"2024-05-21T01:22:17.469218+0000","last_fullsized":"2024-05-21T01:22:17.469218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:47:54.892789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"27'384","reported_seq":612,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:38.426942+0000","last_change":"2024-05-21T01:20:43.554019+0000","last_active":"2024-05-21T01:26:38.426942+0000","last_peered":"2024-05-21T01:26:38.426942+0000","last_clean":"2024-05-21T01:26:38.426942+0000","last_became_active":"2024-05-21T01:20:43.553035+0000","last_became_peered":"2024-05-21T01:20:43.553035+0000","last_unstale":"2024-05-21T01:26:38.426942+0000","last_undegraded":"2024-05-21T01:26:38.426942+0000","last_fullsized":"2024-05-21T01:26:38.426942+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:00:23.785030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":201,"num_read_kb":823296,"num_write":360,"num_write_kb":983040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1,6],"acting":[5,0,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:14.467762+0000","last_change":"2024-05-21T01:19:54.575541+0000","last_active":"2024-05-21T01:22:14.467762+0000","last_peered":"2024-05-21T01:22:14.467762+0000","last_clean":"2024-05-21T01:22:14.467762+0000","last_became_active":"2024-05-21T01:19:54.575314+0000","last_became_peered":"2024-05-21T01:19:54.575314+0000","last_unstale":"2024-05-21T01:22:14.467762+0000","last_undegraded":"2024-05-21T01:22:14.467762+0000","last_fullsized":"2024-05-21T01:22:14.467762+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:02:36.840590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"25'3","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:14.483933+0000","last_change":"2024-05-21T01:19:53.523758+0000","last_active":"2024-05-21T01:22:14.483933+0000","last_peered":"2024-05-21T01:22:14.483933+0000","last_clean":"2024-05-21T01:22:14.483933+0000","last_became_active":"2024-05-21T01:19:53.523273+0000","last_became_peered":"2024-05-21T01:19:53.523273+0000","last_unstale":"2024-05-21T01:22:14.483933+0000","last_undegraded":"2024-05-21T01:22:14.483933+0000","last_fullsized":"2024-05-21T01:22:14.483933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:05:47.275193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"27'288","reported_seq":455,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:38.413187+0000","last_change":"2024-05-21T01:19:58.621996+0000","last_active":"2024-05-21T01:26:38.413187+0000","last_peered":"2024-05-21T01:26:38.413187+0000","last_clean":"2024-05-21T01:26:38.413187+0000","last_became_active":"2024-05-21T01:19:58.620552+0000","last_became_peered":"2024-05-21T01:19:58.620552+0000","last_unstale":"2024-05-21T01:26:38.413187+0000","last_undegraded":"2024-05-21T01:26:38.413187+0000","last_fullsized":"2024-05-21T01:26:38.413187+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:58:32.635003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":602112,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:14.476602+0000","last_change":"2024-05-21T01:19:54.557379+0000","last_active":"2024-05-21T01:22:14.476602+0000","last_peered":"2024-05-21T01:22:14.476602+0000","last_clean":"2024-05-21T01:22:14.476602+0000","last_became_active":"2024-05-21T01:19:54.550335+0000","last_became_peered":"2024-05-21T01:19:54.550335+0000","last_unstale":"2024-05-21T01:22:14.476602+0000","last_undegraded":"2024-05-21T01:22:14.476602+0000","last_fullsized":"2024-05-21T01:22:14.476602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:24:52.297888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"25'3","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:14.476584+0000","last_change":"2024-05-21T01:19:53.534431+0000","last_active":"2024-05-21T01:22:14.476584+0000","last_peered":"2024-05-21T01:22:14.476584+0000","last_clean":"2024-05-21T01:22:14.476584+0000","last_became_active":"2024-05-21T01:19:53.534174+0000","last_became_peered":"2024-05-21T01:19:53.534174+0000","last_unstale":"2024-05-21T01:22:14.476584+0000","last_undegraded":"2024-05-21T01:22:14.476584+0000","last_fullsized":"2024-05-21T01:22:14.476584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:42:04.743914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"27'287","reported_seq":453,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:37.857440+0000","last_change":"2024-05-21T01:19:58.609289+0000","last_active":"2024-05-21T01:26:37.857440+0000","last_peered":"2024-05-21T01:26:37.857440+0000","last_clean":"2024-05-21T01:26:37.857440+0000","last_became_active":"2024-05-21T01:19:58.608371+0000","last_became_peered":"2024-05-21T01:19:58.608371+0000","last_unstale":"2024-05-21T01:26:37.857440+0000","last_undegraded":"2024-05-21T01:26:37.857440+0000","last_fullsized":"2024-05-21T01:26:37.857440+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":287,"log_dups_size":0,"ondisk_log_size":287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:27:36.997803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":598016,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"27'1","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:42.739115+0000","last_change":"2024-05-21T01:19:54.551617+0000","last_active":"2024-05-21T01:22:42.739115+0000","last_peered":"2024-05-21T01:22:42.739115+0000","last_clean":"2024-05-21T01:22:42.739115+0000","last_became_active":"2024-05-21T01:19:54.550865+0000","last_became_peered":"2024-05-21T01:19:54.550865+0000","last_unstale":"2024-05-21T01:22:42.739115+0000","last_undegraded":"2024-05-21T01:22:42.739115+0000","last_fullsized":"2024-05-21T01:22:42.739115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:32:44.168265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"25'6","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:17.471297+0000","last_change":"2024-05-21T01:19:53.535936+0000","last_active":"2024-05-21T01:22:17.471297+0000","last_peered":"2024-05-21T01:22:17.471297+0000","last_clean":"2024-05-21T01:22:17.471297+0000","last_became_active":"2024-05-21T01:19:53.535143+0000","last_became_peered":"2024-05-21T01:19:53.535143+0000","last_unstale":"2024-05-21T01:22:17.471297+0000","last_undegraded":"2024-05-21T01:22:17.471297+0000","last_fullsized":"2024-05-21T01:22:17.471297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:50:51.433726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"27'246","reported_seq":450,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:24.775109+0000","last_change":"2024-05-21T01:19:58.622615+0000","last_active":"2024-05-21T01:26:24.775109+0000","last_peered":"2024-05-21T01:26:24.775109+0000","last_clean":"2024-05-21T01:26:24.775109+0000","last_became_active":"2024-05-21T01:19:58.622250+0000","last_became_peered":"2024-05-21T01:19:58.622250+0000","last_unstale":"2024-05-21T01:26:24.775109+0000","last_undegraded":"2024-05-21T01:26:24.775109+0000","last_fullsized":"2024-05-21T01:26:24.775109+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:05:22.913945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":385875968,"num_objects":92,"num_object_clones":0,"num_object_copies":368,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":0,"num_read":184,"num_read_kb":753664,"num_write":235,"num_write_kb":892928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:19.484407+0000","last_change":"2024-05-21T01:19:54.558348+0000","last_active":"2024-05-21T01:22:19.484407+0000","last_peered":"2024-05-21T01:22:19.484407+0000","last_clean":"2024-05-21T01:22:19.484407+0000","last_became_active":"2024-05-21T01:19:54.558095+0000","last_became_peered":"2024-05-21T01:19:54.558095+0000","last_unstale":"2024-05-21T01:22:19.484407+0000","last_undegraded":"2024-05-21T01:22:19.484407+0000","last_fullsized":"2024-05-21T01:22:19.484407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:43:48.625583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'1398","reported_seq":1426,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:31.782342+0000","last_change":"2024-05-21T01:19:53.534947+0000","last_active":"2024-05-21T01:26:31.782342+0000","last_peered":"2024-05-21T01:26:31.782342+0000","last_clean":"2024-05-21T01:26:31.782342+0000","last_became_active":"2024-05-21T01:19:53.534616+0000","last_became_peered":"2024-05-21T01:19:53.534616+0000","last_unstale":"2024-05-21T01:26:31.782342+0000","last_undegraded":"2024-05-21T01:26:31.782342+0000","last_fullsized":"2024-05-21T01:26:31.782342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":1398,"log_dups_size":0,"ondisk_log_size":1398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:01:25.372035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2832371,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1398,"num_write_kb":2931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"27'292","reported_seq":472,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:37.447318+0000","last_change":"2024-05-21T01:19:58.617970+0000","last_active":"2024-05-21T01:26:37.447318+0000","last_peered":"2024-05-21T01:26:37.447318+0000","last_clean":"2024-05-21T01:26:37.447318+0000","last_became_active":"2024-05-21T01:19:58.617061+0000","last_became_peered":"2024-05-21T01:19:58.617061+0000","last_unstale":"2024-05-21T01:26:37.447318+0000","last_undegraded":"2024-05-21T01:26:37.447318+0000","last_fullsized":"2024-05-21T01:26:37.447318+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":292,"log_dups_size":0,"ondisk_log_size":292,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:48:50.703577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":160,"num_read_kb":655360,"num_write":276,"num_write_kb":786432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:14.476618+0000","last_change":"2024-05-21T01:19:54.557175+0000","last_active":"2024-05-21T01:22:14.476618+0000","last_peered":"2024-05-21T01:22:14.476618+0000","last_clean":"2024-05-21T01:22:14.476618+0000","last_became_active":"2024-05-21T01:19:54.556933+0000","last_became_peered":"2024-05-21T01:19:54.556933+0000","last_unstale":"2024-05-21T01:22:14.476618+0000","last_undegraded":"2024-05-21T01:22:14.476618+0000","last_fullsized":"2024-05-21T01:22:14.476618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:15:44.089544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"27'7","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:23:09.625489+0000","last_change":"2024-05-21T01:19:53.536780+0000","last_active":"2024-05-21T01:23:09.625489+0000","last_peered":"2024-05-21T01:23:09.625489+0000","last_clean":"2024-05-21T01:23:09.625489+0000","last_became_active":"2024-05-21T01:19:53.535768+0000","last_became_peered":"2024-05-21T01:19:53.535768+0000","last_unstale":"2024-05-21T01:23:09.625489+0000","last_undegraded":"2024-05-21T01:23:09.625489+0000","last_fullsized":"2024-05-21T01:23:09.625489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:04:14.732801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"27'233","reported_seq":427,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:25.827377+0000","last_change":"2024-05-21T01:19:58.606532+0000","last_active":"2024-05-21T01:26:25.827377+0000","last_peered":"2024-05-21T01:26:25.827377+0000","last_clean":"2024-05-21T01:26:25.827377+0000","last_became_active":"2024-05-21T01:19:58.606180+0000","last_became_peered":"2024-05-21T01:19:58.606180+0000","last_unstale":"2024-05-21T01:26:25.827377+0000","last_undegraded":"2024-05-21T01:26:25.827377+0000","last_fullsized":"2024-05-21T01:26:25.827377+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":233,"log_dups_size":0,"ondisk_log_size":233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:25:31.161427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":364904448,"num_objects":87,"num_object_clones":0,"num_object_copies":348,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":87,"num_whiteouts":0,"num_read":174,"num_read_kb":712704,"num_write":210,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:23.483713+0000","last_change":"2024-05-21T01:19:54.571280+0000","last_active":"2024-05-21T01:22:23.483713+0000","last_peered":"2024-05-21T01:22:23.483713+0000","last_clean":"2024-05-21T01:22:23.483713+0000","last_became_active":"2024-05-21T01:19:54.568778+0000","last_became_peered":"2024-05-21T01:19:54.568778+0000","last_unstale":"2024-05-21T01:22:23.483713+0000","last_undegraded":"2024-05-21T01:22:23.483713+0000","last_fullsized":"2024-05-21T01:22:23.483713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:43:16.583632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"25'2","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:19.484415+0000","last_change":"2024-05-21T01:19:53.530770+0000","last_active":"2024-05-21T01:22:19.484415+0000","last_peered":"2024-05-21T01:22:19.484415+0000","last_clean":"2024-05-21T01:22:19.484415+0000","last_became_active":"2024-05-21T01:19:53.526431+0000","last_became_peered":"2024-05-21T01:19:53.526431+0000","last_unstale":"2024-05-21T01:22:19.484415+0000","last_undegraded":"2024-05-21T01:22:19.484415+0000","last_fullsized":"2024-05-21T01:22:19.484415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:08:59.892029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"27'308","reported_seq":482,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:37.507162+0000","last_change":"2024-05-21T01:19:58.611576+0000","last_active":"2024-05-21T01:26:37.507162+0000","last_peered":"2024-05-21T01:26:37.507162+0000","last_clean":"2024-05-21T01:26:37.507162+0000","last_became_active":"2024-05-21T01:19:58.610838+0000","last_became_peered":"2024-05-21T01:19:58.610838+0000","last_unstale":"2024-05-21T01:26:37.507162+0000","last_undegraded":"2024-05-21T01:26:37.507162+0000","last_fullsized":"2024-05-21T01:26:37.507162+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":308,"log_dups_size":0,"ondisk_log_size":308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:07:31.736640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":154,"num_read_kb":630784,"num_write":289,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:19.468434+0000","last_change":"2024-05-21T01:19:54.552709+0000","last_active":"2024-05-21T01:22:19.468434+0000","last_peered":"2024-05-21T01:22:19.468434+0000","last_clean":"2024-05-21T01:22:19.468434+0000","last_became_active":"2024-05-21T01:19:54.547898+0000","last_became_peered":"2024-05-21T01:19:54.547898+0000","last_unstale":"2024-05-21T01:22:19.468434+0000","last_undegraded":"2024-05-21T01:22:19.468434+0000","last_fullsized":"2024-05-21T01:22:19.468434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:20:17.933506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"27'4","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:42.723905+0000","last_change":"2024-05-21T01:19:53.534507+0000","last_active":"2024-05-21T01:22:42.723905+0000","last_peered":"2024-05-21T01:22:42.723905+0000","last_clean":"2024-05-21T01:22:42.723905+0000","last_became_active":"2024-05-21T01:19:53.534036+0000","last_became_peered":"2024-05-21T01:19:53.534036+0000","last_unstale":"2024-05-21T01:22:42.723905+0000","last_undegraded":"2024-05-21T01:22:42.723905+0000","last_fullsized":"2024-05-21T01:22:42.723905+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:01:08.218098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"27'333","reported_seq":527,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:37.225760+0000","last_change":"2024-05-21T01:19:58.608135+0000","last_active":"2024-05-21T01:26:37.225760+0000","last_peered":"2024-05-21T01:26:37.225760+0000","last_clean":"2024-05-21T01:26:37.225760+0000","last_became_active":"2024-05-21T01:19:58.607242+0000","last_became_peered":"2024-05-21T01:19:58.607242+0000","last_unstale":"2024-05-21T01:26:37.225760+0000","last_undegraded":"2024-05-21T01:26:37.225760+0000","last_fullsized":"2024-05-21T01:26:37.225760+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":333,"log_dups_size":0,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:05:26.197876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":174,"num_read_kb":712704,"num_write":318,"num_write_kb":892928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"27'274","reported_seq":451,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:37.505912+0000","last_change":"2024-05-21T01:19:58.624883+0000","last_active":"2024-05-21T01:26:37.505912+0000","last_peered":"2024-05-21T01:26:37.505912+0000","last_clean":"2024-05-21T01:26:37.505912+0000","last_became_active":"2024-05-21T01:19:58.623991+0000","last_became_peered":"2024-05-21T01:19:58.623991+0000","last_unstale":"2024-05-21T01:26:37.505912+0000","last_undegraded":"2024-05-21T01:26:37.505912+0000","last_fullsized":"2024-05-21T01:26:37.505912+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:29:26.251376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":156,"num_read_kb":638976,"num_write":260,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"27'1","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:47.497400+0000","last_change":"2024-05-21T01:19:54.549215+0000","last_active":"2024-05-21T01:24:47.497400+0000","last_peered":"2024-05-21T01:24:47.497400+0000","last_clean":"2024-05-21T01:24:47.497400+0000","last_became_active":"2024-05-21T01:19:54.548426+0000","last_became_peered":"2024-05-21T01:19:54.548426+0000","last_unstale":"2024-05-21T01:24:47.497400+0000","last_undegraded":"2024-05-21T01:24:47.497400+0000","last_fullsized":"2024-05-21T01:24:47.497400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:10:10.800391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"25'1","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:19.477048+0000","last_change":"2024-05-21T01:19:53.526106+0000","last_active":"2024-05-21T01:22:19.477048+0000","last_peered":"2024-05-21T01:22:19.477048+0000","last_clean":"2024-05-21T01:22:19.477048+0000","last_became_active":"2024-05-21T01:19:53.525786+0000","last_became_peered":"2024-05-21T01:19:53.525786+0000","last_unstale":"2024-05-21T01:22:19.477048+0000","last_undegraded":"2024-05-21T01:22:19.477048+0000","last_fullsized":"2024-05-21T01:22:19.477048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:01:05.180803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"27'201","reported_seq":374,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:26.008564+0000","last_change":"2024-05-21T01:19:58.615481+0000","last_active":"2024-05-21T01:26:26.008564+0000","last_peered":"2024-05-21T01:26:26.008564+0000","last_clean":"2024-05-21T01:26:26.008564+0000","last_became_active":"2024-05-21T01:19:58.614879+0000","last_became_peered":"2024-05-21T01:19:58.614879+0000","last_unstale":"2024-05-21T01:26:26.008564+0000","last_undegraded":"2024-05-21T01:26:26.008564+0000","last_fullsized":"2024-05-21T01:26:26.008564+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:45:57.208342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":318767104,"num_objects":76,"num_object_clones":0,"num_object_copies":304,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":152,"num_read_kb":622592,"num_write":191,"num_write_kb":729088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:23.483559+0000","last_change":"2024-05-21T01:19:54.570650+0000","last_active":"2024-05-21T01:22:23.483559+0000","last_peered":"2024-05-21T01:22:23.483559+0000","last_clean":"2024-05-21T01:22:23.483559+0000","last_became_active":"2024-05-21T01:19:54.570034+0000","last_became_peered":"2024-05-21T01:19:54.570034+0000","last_unstale":"2024-05-21T01:22:23.483559+0000","last_undegraded":"2024-05-21T01:22:23.483559+0000","last_fullsized":"2024-05-21T01:22:23.483559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:01:05.887729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"25'2","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:18.478669+0000","last_change":"2024-05-21T01:19:53.532017+0000","last_active":"2024-05-21T01:22:18.478669+0000","last_peered":"2024-05-21T01:22:18.478669+0000","last_clean":"2024-05-21T01:22:18.478669+0000","last_became_active":"2024-05-21T01:19:53.529457+0000","last_became_peered":"2024-05-21T01:19:53.529457+0000","last_unstale":"2024-05-21T01:22:18.478669+0000","last_undegraded":"2024-05-21T01:22:18.478669+0000","last_fullsized":"2024-05-21T01:22:18.478669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:58:03.979929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"25'3","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:24.486665+0000","last_change":"2024-05-21T01:19:53.525620+0000","last_active":"2024-05-21T01:22:24.486665+0000","last_peered":"2024-05-21T01:22:24.486665+0000","last_clean":"2024-05-21T01:22:24.486665+0000","last_became_active":"2024-05-21T01:19:53.525315+0000","last_became_peered":"2024-05-21T01:19:53.525315+0000","last_unstale":"2024-05-21T01:22:24.486665+0000","last_undegraded":"2024-05-21T01:22:24.486665+0000","last_fullsized":"2024-05-21T01:22:24.486665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:30:38.075463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:27.470739+0000","last_change":"2024-05-21T01:19:54.555344+0000","last_active":"2024-05-21T01:22:27.470739+0000","last_peered":"2024-05-21T01:22:27.470739+0000","last_clean":"2024-05-21T01:22:27.470739+0000","last_became_active":"2024-05-21T01:19:54.552817+0000","last_became_peered":"2024-05-21T01:19:54.552817+0000","last_unstale":"2024-05-21T01:22:27.470739+0000","last_undegraded":"2024-05-21T01:22:27.470739+0000","last_fullsized":"2024-05-21T01:22:27.470739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:10:03.810064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"27'306","reported_seq":496,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:37.366700+0000","last_change":"2024-05-21T01:19:58.619520+0000","last_active":"2024-05-21T01:26:37.366700+0000","last_peered":"2024-05-21T01:26:37.366700+0000","last_clean":"2024-05-21T01:26:37.366700+0000","last_became_active":"2024-05-21T01:19:58.617165+0000","last_became_peered":"2024-05-21T01:19:58.617165+0000","last_unstale":"2024-05-21T01:26:37.366700+0000","last_undegraded":"2024-05-21T01:26:37.366700+0000","last_fullsized":"2024-05-21T01:26:37.366700+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":306,"log_dups_size":0,"ondisk_log_size":306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T13:07:51.530746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":170,"num_read_kb":696320,"num_write":287,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"25'6","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:23.483608+0000","last_change":"2024-05-21T01:19:53.551547+0000","last_active":"2024-05-21T01:22:23.483608+0000","last_peered":"2024-05-21T01:22:23.483608+0000","last_clean":"2024-05-21T01:22:23.483608+0000","last_became_active":"2024-05-21T01:19:53.550931+0000","last_became_peered":"2024-05-21T01:19:53.550931+0000","last_unstale":"2024-05-21T01:22:23.483608+0000","last_undegraded":"2024-05-21T01:22:23.483608+0000","last_fullsized":"2024-05-21T01:22:23.483608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:13:47.329230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:24.468719+0000","last_change":"2024-05-21T01:19:54.574552+0000","last_active":"2024-05-21T01:22:24.468719+0000","last_peered":"2024-05-21T01:22:24.468719+0000","last_clean":"2024-05-21T01:22:24.468719+0000","last_became_active":"2024-05-21T01:19:54.574246+0000","last_became_peered":"2024-05-21T01:19:54.574246+0000","last_unstale":"2024-05-21T01:22:24.468719+0000","last_undegraded":"2024-05-21T01:22:24.468719+0000","last_fullsized":"2024-05-21T01:22:24.468719+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:23:33.685798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"27'316","reported_seq":508,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:37.411321+0000","last_change":"2024-05-21T01:19:58.624400+0000","last_active":"2024-05-21T01:26:37.411321+0000","last_peered":"2024-05-21T01:26:37.411321+0000","last_clean":"2024-05-21T01:26:37.411321+0000","last_became_active":"2024-05-21T01:19:58.623388+0000","last_became_peered":"2024-05-21T01:19:58.623388+0000","last_unstale":"2024-05-21T01:26:37.411321+0000","last_undegraded":"2024-05-21T01:26:37.411321+0000","last_fullsized":"2024-05-21T01:26:37.411321+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":316,"log_dups_size":0,"ondisk_log_size":316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:59:30.019393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":172,"num_read_kb":704512,"num_write":302,"num_write_kb":851968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:04.542395+0000","last_change":"2024-05-21T01:19:54.553262+0000","last_active":"2024-05-21T01:24:04.542395+0000","last_peered":"2024-05-21T01:24:04.542395+0000","last_clean":"2024-05-21T01:24:04.542395+0000","last_became_active":"2024-05-21T01:19:54.553060+0000","last_became_peered":"2024-05-21T01:19:54.553060+0000","last_unstale":"2024-05-21T01:24:04.542395+0000","last_undegraded":"2024-05-21T01:24:04.542395+0000","last_fullsized":"2024-05-21T01:24:04.542395+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:18:14.077480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:07.486721+0000","last_change":"2024-05-21T01:19:54.566851+0000","last_active":"2024-05-21T01:24:07.486721+0000","last_peered":"2024-05-21T01:24:07.486721+0000","last_clean":"2024-05-21T01:24:07.486721+0000","last_became_active":"2024-05-21T01:19:54.565573+0000","last_became_peered":"2024-05-21T01:19:54.565573+0000","last_unstale":"2024-05-21T01:24:07.486721+0000","last_undegraded":"2024-05-21T01:24:07.486721+0000","last_fullsized":"2024-05-21T01:24:07.486721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:51:30.883954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:04.555306+0000","last_change":"2024-05-21T01:19:54.566934+0000","last_active":"2024-05-21T01:24:04.555306+0000","last_peered":"2024-05-21T01:24:04.555306+0000","last_clean":"2024-05-21T01:24:04.555306+0000","last_became_active":"2024-05-21T01:19:54.566503+0000","last_became_peered":"2024-05-21T01:19:54.566503+0000","last_unstale":"2024-05-21T01:24:04.555306+0000","last_undegraded":"2024-05-21T01:24:04.555306+0000","last_fullsized":"2024-05-21T01:24:04.555306+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:14:54.262165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:08.498777+0000","last_change":"2024-05-21T01:19:54.573091+0000","last_active":"2024-05-21T01:24:08.498777+0000","last_peered":"2024-05-21T01:24:08.498777+0000","last_clean":"2024-05-21T01:24:08.498777+0000","last_became_active":"2024-05-21T01:19:54.572366+0000","last_became_peered":"2024-05-21T01:19:54.572366+0000","last_unstale":"2024-05-21T01:24:08.498777+0000","last_undegraded":"2024-05-21T01:24:08.498777+0000","last_fullsized":"2024-05-21T01:24:08.498777+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:10:09.353807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:18.508498+0000","last_change":"2024-05-21T01:19:54.563339+0000","last_active":"2024-05-21T01:24:18.508498+0000","last_peered":"2024-05-21T01:24:18.508498+0000","last_clean":"2024-05-21T01:24:18.508498+0000","last_became_active":"2024-05-21T01:19:54.557934+0000","last_became_peered":"2024-05-21T01:19:54.557934+0000","last_unstale":"2024-05-21T01:24:18.508498+0000","last_undegraded":"2024-05-21T01:24:18.508498+0000","last_fullsized":"2024-05-21T01:24:18.508498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:46:21.598689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:18.508542+0000","last_change":"2024-05-21T01:19:54.553551+0000","last_active":"2024-05-21T01:24:18.508542+0000","last_peered":"2024-05-21T01:24:18.508542+0000","last_clean":"2024-05-21T01:24:18.508542+0000","last_became_active":"2024-05-21T01:19:54.552812+0000","last_became_peered":"2024-05-21T01:19:54.552812+0000","last_unstale":"2024-05-21T01:24:18.508542+0000","last_undegraded":"2024-05-21T01:24:18.508542+0000","last_fullsized":"2024-05-21T01:24:18.508542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:27:41.166606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:14.543296+0000","last_change":"2024-05-21T01:19:54.548604+0000","last_active":"2024-05-21T01:24:14.543296+0000","last_peered":"2024-05-21T01:24:14.543296+0000","last_clean":"2024-05-21T01:24:14.543296+0000","last_became_active":"2024-05-21T01:19:54.548263+0000","last_became_peered":"2024-05-21T01:19:54.548263+0000","last_unstale":"2024-05-21T01:24:14.543296+0000","last_undegraded":"2024-05-21T01:24:14.543296+0000","last_fullsized":"2024-05-21T01:24:14.543296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:33:55.302088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:18.503082+0000","last_change":"2024-05-21T01:19:54.573995+0000","last_active":"2024-05-21T01:24:18.503082+0000","last_peered":"2024-05-21T01:24:18.503082+0000","last_clean":"2024-05-21T01:24:18.503082+0000","last_became_active":"2024-05-21T01:19:54.570373+0000","last_became_peered":"2024-05-21T01:19:54.570373+0000","last_unstale":"2024-05-21T01:24:18.503082+0000","last_undegraded":"2024-05-21T01:24:18.503082+0000","last_fullsized":"2024-05-21T01:24:18.503082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:44:23.194713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:14.556285+0000","last_change":"2024-05-21T01:19:54.575196+0000","last_active":"2024-05-21T01:24:14.556285+0000","last_peered":"2024-05-21T01:24:14.556285+0000","last_clean":"2024-05-21T01:24:14.556285+0000","last_became_active":"2024-05-21T01:19:54.574945+0000","last_became_peered":"2024-05-21T01:19:54.574945+0000","last_unstale":"2024-05-21T01:24:14.556285+0000","last_undegraded":"2024-05-21T01:24:14.556285+0000","last_fullsized":"2024-05-21T01:24:14.556285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:52:56.244771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:13.481163+0000","last_change":"2024-05-21T01:19:54.566719+0000","last_active":"2024-05-21T01:22:13.481163+0000","last_peered":"2024-05-21T01:22:13.481163+0000","last_clean":"2024-05-21T01:22:13.481163+0000","last_became_active":"2024-05-21T01:19:54.565922+0000","last_became_peered":"2024-05-21T01:19:54.565922+0000","last_unstale":"2024-05-21T01:22:13.481163+0000","last_undegraded":"2024-05-21T01:22:13.481163+0000","last_fullsized":"2024-05-21T01:22:13.481163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:39:19.454688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:09.467331+0000","last_change":"2024-05-21T01:19:54.536815+0000","last_active":"2024-05-21T01:22:09.467331+0000","last_peered":"2024-05-21T01:22:09.467331+0000","last_clean":"2024-05-21T01:22:09.467331+0000","last_became_active":"2024-05-21T01:19:54.535957+0000","last_became_peered":"2024-05-21T01:19:54.535957+0000","last_unstale":"2024-05-21T01:22:09.467331+0000","last_undegraded":"2024-05-21T01:22:09.467331+0000","last_fullsized":"2024-05-21T01:22:09.467331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:24:53.906256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:12.468542+0000","last_change":"2024-05-21T01:19:54.552466+0000","last_active":"2024-05-21T01:22:12.468542+0000","last_peered":"2024-05-21T01:22:12.468542+0000","last_clean":"2024-05-21T01:22:12.468542+0000","last_became_active":"2024-05-21T01:19:54.551790+0000","last_became_peered":"2024-05-21T01:19:54.551790+0000","last_unstale":"2024-05-21T01:22:12.468542+0000","last_undegraded":"2024-05-21T01:22:12.468542+0000","last_fullsized":"2024-05-21T01:22:12.468542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:24:34.737707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:09.483333+0000","last_change":"2024-05-21T01:19:54.535314+0000","last_active":"2024-05-21T01:22:09.483333+0000","last_peered":"2024-05-21T01:22:09.483333+0000","last_clean":"2024-05-21T01:22:09.483333+0000","last_became_active":"2024-05-21T01:19:54.534793+0000","last_became_peered":"2024-05-21T01:19:54.534793+0000","last_unstale":"2024-05-21T01:22:09.483333+0000","last_undegraded":"2024-05-21T01:22:09.483333+0000","last_fullsized":"2024-05-21T01:22:09.483333+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:52:35.492250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:09.476158+0000","last_change":"2024-05-21T01:19:54.556323+0000","last_active":"2024-05-21T01:22:09.476158+0000","last_peered":"2024-05-21T01:22:09.476158+0000","last_clean":"2024-05-21T01:22:09.476158+0000","last_became_active":"2024-05-21T01:19:54.556043+0000","last_became_peered":"2024-05-21T01:19:54.556043+0000","last_unstale":"2024-05-21T01:22:09.476158+0000","last_undegraded":"2024-05-21T01:22:09.476158+0000","last_fullsized":"2024-05-21T01:22:09.476158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:34:02.068527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:17.471339+0000","last_change":"2024-05-21T01:19:54.567457+0000","last_active":"2024-05-21T01:22:17.471339+0000","last_peered":"2024-05-21T01:22:17.471339+0000","last_clean":"2024-05-21T01:22:17.471339+0000","last_became_active":"2024-05-21T01:19:54.565326+0000","last_became_peered":"2024-05-21T01:19:54.565326+0000","last_unstale":"2024-05-21T01:22:17.471339+0000","last_undegraded":"2024-05-21T01:22:17.471339+0000","last_fullsized":"2024-05-21T01:22:17.471339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:11:05.775389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:14.476659+0000","last_change":"2024-05-21T01:19:54.562078+0000","last_active":"2024-05-21T01:22:14.476659+0000","last_peered":"2024-05-21T01:22:14.476659+0000","last_clean":"2024-05-21T01:22:14.476659+0000","last_became_active":"2024-05-21T01:19:54.558286+0000","last_became_peered":"2024-05-21T01:19:54.558286+0000","last_unstale":"2024-05-21T01:22:14.476659+0000","last_undegraded":"2024-05-21T01:22:14.476659+0000","last_fullsized":"2024-05-21T01:22:14.476659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T09:09:58.360014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:14.476530+0000","last_change":"2024-05-21T01:19:54.548274+0000","last_active":"2024-05-21T01:22:14.476530+0000","last_peered":"2024-05-21T01:22:14.476530+0000","last_clean":"2024-05-21T01:22:14.476530+0000","last_became_active":"2024-05-21T01:19:54.548079+0000","last_became_peered":"2024-05-21T01:19:54.548079+0000","last_unstale":"2024-05-21T01:22:14.476530+0000","last_undegraded":"2024-05-21T01:22:14.476530+0000","last_fullsized":"2024-05-21T01:22:14.476530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:49:03.296571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:18.482423+0000","last_change":"2024-05-21T01:19:54.568211+0000","last_active":"2024-05-21T01:22:18.482423+0000","last_peered":"2024-05-21T01:22:18.482423+0000","last_clean":"2024-05-21T01:22:18.482423+0000","last_became_active":"2024-05-21T01:19:54.567512+0000","last_became_peered":"2024-05-21T01:19:54.567512+0000","last_unstale":"2024-05-21T01:22:18.482423+0000","last_undegraded":"2024-05-21T01:22:18.482423+0000","last_fullsized":"2024-05-21T01:22:18.482423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:32:18.004763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:18.478735+0000","last_change":"2024-05-21T01:19:54.556683+0000","last_active":"2024-05-21T01:22:18.478735+0000","last_peered":"2024-05-21T01:22:18.478735+0000","last_clean":"2024-05-21T01:22:18.478735+0000","last_became_active":"2024-05-21T01:19:54.555947+0000","last_became_peered":"2024-05-21T01:19:54.555947+0000","last_unstale":"2024-05-21T01:22:18.478735+0000","last_undegraded":"2024-05-21T01:22:18.478735+0000","last_fullsized":"2024-05-21T01:22:18.478735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:59:04.593946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:23.479642+0000","last_change":"2024-05-21T01:19:54.560218+0000","last_active":"2024-05-21T01:22:23.479642+0000","last_peered":"2024-05-21T01:22:23.479642+0000","last_clean":"2024-05-21T01:22:23.479642+0000","last_became_active":"2024-05-21T01:19:54.557787+0000","last_became_peered":"2024-05-21T01:19:54.557787+0000","last_unstale":"2024-05-21T01:22:23.479642+0000","last_undegraded":"2024-05-21T01:22:23.479642+0000","last_fullsized":"2024-05-21T01:22:23.479642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:05:48.282563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:19.484381+0000","last_change":"2024-05-21T01:19:54.535096+0000","last_active":"2024-05-21T01:22:19.484381+0000","last_peered":"2024-05-21T01:22:19.484381+0000","last_clean":"2024-05-21T01:22:19.484381+0000","last_became_active":"2024-05-21T01:19:54.534472+0000","last_became_peered":"2024-05-21T01:19:54.534472+0000","last_unstale":"2024-05-21T01:22:19.484381+0000","last_undegraded":"2024-05-21T01:22:19.484381+0000","last_fullsized":"2024-05-21T01:22:19.484381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:05:40.018457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:19.484397+0000","last_change":"2024-05-21T01:19:54.546352+0000","last_active":"2024-05-21T01:22:19.484397+0000","last_peered":"2024-05-21T01:22:19.484397+0000","last_clean":"2024-05-21T01:22:19.484397+0000","last_became_active":"2024-05-21T01:19:54.546055+0000","last_became_peered":"2024-05-21T01:19:54.546055+0000","last_unstale":"2024-05-21T01:22:19.484397+0000","last_undegraded":"2024-05-21T01:22:19.484397+0000","last_fullsized":"2024-05-21T01:22:19.484397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:14:56.268312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"27'1","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:23:12.478847+0000","last_change":"2024-05-21T01:20:43.551219+0000","last_active":"2024-05-21T01:23:12.478847+0000","last_peered":"2024-05-21T01:23:12.478847+0000","last_clean":"2024-05-21T01:23:12.478847+0000","last_became_active":"2024-05-21T01:20:43.550179+0000","last_became_peered":"2024-05-21T01:20:43.550179+0000","last_unstale":"2024-05-21T01:23:12.478847+0000","last_undegraded":"2024-05-21T01:23:12.478847+0000","last_fullsized":"2024-05-21T01:23:12.478847+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:00:31.919441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:19.468196+0000","last_change":"2024-05-21T01:19:54.548954+0000","last_active":"2024-05-21T01:22:19.468196+0000","last_peered":"2024-05-21T01:22:19.468196+0000","last_clean":"2024-05-21T01:22:19.468196+0000","last_became_active":"2024-05-21T01:19:54.547528+0000","last_became_peered":"2024-05-21T01:19:54.547528+0000","last_unstale":"2024-05-21T01:22:19.468196+0000","last_undegraded":"2024-05-21T01:22:19.468196+0000","last_fullsized":"2024-05-21T01:22:19.468196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:47:24.598610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:28.484197+0000","last_change":"2024-05-21T01:19:54.575256+0000","last_active":"2024-05-21T01:22:28.484197+0000","last_peered":"2024-05-21T01:22:28.484197+0000","last_clean":"2024-05-21T01:22:28.484197+0000","last_became_active":"2024-05-21T01:19:54.570119+0000","last_became_peered":"2024-05-21T01:19:54.570119+0000","last_unstale":"2024-05-21T01:22:28.484197+0000","last_undegraded":"2024-05-21T01:22:28.484197+0000","last_fullsized":"2024-05-21T01:22:28.484197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:10:02.800110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:24.484926+0000","last_change":"2024-05-21T01:19:54.550134+0000","last_active":"2024-05-21T01:22:24.484926+0000","last_peered":"2024-05-21T01:22:24.484926+0000","last_clean":"2024-05-21T01:22:24.484926+0000","last_became_active":"2024-05-21T01:19:54.549617+0000","last_became_peered":"2024-05-21T01:19:54.549617+0000","last_unstale":"2024-05-21T01:22:24.484926+0000","last_undegraded":"2024-05-21T01:22:24.484926+0000","last_fullsized":"2024-05-21T01:22:24.484926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:34:59.845458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:24.469102+0000","last_change":"2024-05-21T01:19:54.555653+0000","last_active":"2024-05-21T01:22:24.469102+0000","last_peered":"2024-05-21T01:22:24.469102+0000","last_clean":"2024-05-21T01:22:24.469102+0000","last_became_active":"2024-05-21T01:19:54.555274+0000","last_became_peered":"2024-05-21T01:19:54.555274+0000","last_unstale":"2024-05-21T01:22:24.469102+0000","last_undegraded":"2024-05-21T01:22:24.469102+0000","last_fullsized":"2024-05-21T01:22:24.469102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:43:43.237853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:24.484953+0000","last_change":"2024-05-21T01:19:54.568866+0000","last_active":"2024-05-21T01:22:24.484953+0000","last_peered":"2024-05-21T01:22:24.484953+0000","last_clean":"2024-05-21T01:22:24.484953+0000","last_became_active":"2024-05-21T01:19:54.568605+0000","last_became_peered":"2024-05-21T01:19:54.568605+0000","last_unstale":"2024-05-21T01:22:24.484953+0000","last_undegraded":"2024-05-21T01:22:24.484953+0000","last_fullsized":"2024-05-21T01:22:24.484953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:21:20.820620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:23:54.541542+0000","last_change":"2024-05-21T01:19:54.557468+0000","last_active":"2024-05-21T01:23:54.541542+0000","last_peered":"2024-05-21T01:23:54.541542+0000","last_clean":"2024-05-21T01:23:54.541542+0000","last_became_active":"2024-05-21T01:19:54.554976+0000","last_became_peered":"2024-05-21T01:19:54.554976+0000","last_unstale":"2024-05-21T01:23:54.541542+0000","last_undegraded":"2024-05-21T01:23:54.541542+0000","last_fullsized":"2024-05-21T01:23:54.541542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:25:08.737348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:08.498825+0000","last_change":"2024-05-21T01:19:54.566991+0000","last_active":"2024-05-21T01:24:08.498825+0000","last_peered":"2024-05-21T01:24:08.498825+0000","last_clean":"2024-05-21T01:24:08.498825+0000","last_became_active":"2024-05-21T01:19:54.566349+0000","last_became_peered":"2024-05-21T01:19:54.566349+0000","last_unstale":"2024-05-21T01:24:08.498825+0000","last_undegraded":"2024-05-21T01:24:08.498825+0000","last_fullsized":"2024-05-21T01:24:08.498825+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:25:43.468081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:08.498850+0000","last_change":"2024-05-21T01:19:54.576100+0000","last_active":"2024-05-21T01:24:08.498850+0000","last_peered":"2024-05-21T01:24:08.498850+0000","last_clean":"2024-05-21T01:24:08.498850+0000","last_became_active":"2024-05-21T01:19:54.574914+0000","last_became_peered":"2024-05-21T01:19:54.574914+0000","last_unstale":"2024-05-21T01:24:08.498850+0000","last_undegraded":"2024-05-21T01:24:08.498850+0000","last_fullsized":"2024-05-21T01:24:08.498850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:29:30.730283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:04.508300+0000","last_change":"2024-05-21T01:19:54.546570+0000","last_active":"2024-05-21T01:24:04.508300+0000","last_peered":"2024-05-21T01:24:04.508300+0000","last_clean":"2024-05-21T01:24:04.508300+0000","last_became_active":"2024-05-21T01:19:54.546284+0000","last_became_peered":"2024-05-21T01:19:54.546284+0000","last_unstale":"2024-05-21T01:24:04.508300+0000","last_undegraded":"2024-05-21T01:24:04.508300+0000","last_fullsized":"2024-05-21T01:24:04.508300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:36:30.219522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":5108662272,"num_objects":1218,"num_object_clones":0,"num_object_copies":4872,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1218,"num_whiteouts":0,"num_read":5128,"num_read_kb":21004288,"num_write":7998,"num_write_kb":25165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":700841984,"data_stored":11213471744,"data_compressed":553427776,"data_compressed_allocated":700841984,"data_compressed_original":11213471744,"omap_allocated":0,"internal_metadata":0},"log_size":8513,"ondisk_log_size":8513,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2836566,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":1577,"num_write_kb":2990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":5832704,"data_stored":5673731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1539,"ondisk_log_size":1539,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66932,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509526,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":254380,"kb_used_data":192676,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94117460,"statfs":{"total":96636764160,"available":96376279040,"internally_reserved":0,"allocated":197300224,"data_stored":3152137147,"data_compressed":155324160,"data_compressed_allocated":197001216,"data_compressed_original":3152019456,"omap_allocated":1592,"internal_metadata":63175112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509526,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":199736,"kb_used_data":142192,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94172104,"statfs":{"total":96636764160,"available":96432234496,"internally_reserved":0,"allocated":145604608,"data_stored":2282553094,"data_compressed":112667200,"data_compressed_allocated":142475264,"data_compressed_original":2279604224,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509524,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":239972,"kb_used_data":194908,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94131868,"statfs":{"total":96636764160,"available":96391032832,"internally_reserved":0,"allocated":199585792,"data_stored":3188378033,"data_compressed":156965466,"data_compressed_allocated":199274496,"data_compressed_original":3188244480,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509524,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":145648,"kb_used_data":114472,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94226192,"statfs":{"total":96636764160,"available":96487620608,"internally_reserved":0,"allocated":117219328,"data_stored":1870777365,"data_compressed":92678176,"data_compressed_allocated":116916224,"data_compressed_original":1870659584,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542230,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56296,"kb_used_data":7072,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94315544,"statfs":{"total":96636764160,"available":96579117056,"internally_reserved":0,"allocated":7241728,"data_stored":111266983,"data_compressed":5474816,"data_compressed_allocated":6946816,"data_compressed_original":111149056,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542230,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63348,"kb_used_data":18284,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94308492,"statfs":{"total":96636764160,"available":96571895808,"internally_reserved":0,"allocated":18722816,"data_stored":294309502,"data_compressed":14325786,"data_compressed_allocated":18395136,"data_compressed_original":294174720,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,1,1,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574933,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":119288,"kb_used_data":70064,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94252552,"statfs":{"total":96636764160,"available":96514613248,"internally_reserved":0,"allocated":71745536,"data_stored":1143065540,"data_compressed":56865920,"data_compressed_allocated":71434240,"data_compressed_original":1142947840,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574933,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":110548,"kb_used_data":61324,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94261292,"statfs":{"total":96636764160,"available":96523563008,"internally_reserved":0,"allocated":62795776,"data_stored":957155163,"data_compressed":47020064,"data_compressed_allocated":59637760,"data_compressed_original":954204160,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33466,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33466,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2846720,"data_stored":2832405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":2875392,"data_stored":2834538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":116916224,"data_stored":1870659584,"data_compressed":92678176,"data_compressed_allocated":116916224,"data_compressed_original":1870659584,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":199229440,"data_stored":3187671040,"data_compressed":156932000,"data_compressed_allocated":199229440,"data_compressed_original":3187671040,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":142475264,"data_stored":2279604224,"data_compressed":112667200,"data_compressed_allocated":142475264,"data_compressed_original":2279604224,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":197001216,"data_stored":3152019456,"data_compressed":155324160,"data_compressed_allocated":197001216,"data_compressed_original":3152019456,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20054016,"data_stored":320864256,"data_compressed":15825312,"data_compressed_allocated":20054016,"data_compressed_original":320864256,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":25165824,"data_stored":402653184,"data_compressed":20000928,"data_compressed_allocated":25165824,"data_compressed_original":402653184,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-21T01:26:40.610 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-21T01:26:40.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.785+0000 7ff6d7e00640 1 Processor -- start 2024-05-21T01:26:40.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.785+0000 7ff6d7e00640 1 -- start start 2024-05-21T01:26:40.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.785+0000 7ff6d7e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff6d006f9b0 0x7ff6d0152a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:40.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.785+0000 7ff6d7e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff6d015ce40 0x7ff6d0152f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:40.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.785+0000 7ff6d7e00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6d0072550 con 0x7ff6d006f5d0 2024-05-21T01:26:40.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.785+0000 7ff6d7e00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7ff6d0159100 con 0x7ff6d006f9b0 2024-05-21T01:26:40.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.785+0000 7ff6d7e00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7ff6d01593e0 con 0x7ff6d015ce40 2024-05-21T01:26:40.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.785+0000 7ff6d4a00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff6d006f9b0 0x7ff6d0152a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:40.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.785+0000 7ff6d4a00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff6d006f9b0 0x7ff6d0152a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48086/0 (socket says 172.21.15.63:48086) 2024-05-21T01:26:40.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.785+0000 7ff6d4a00640 1 -- 172.21.15.63:0/3509542316 learned_addr learned my addr 172.21.15.63:0/3509542316 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:26:40.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.785+0000 7ff6d5e00640 1 --2- 172.21.15.63:0/3509542316 >> v2:172.21.15.131:3300/0 conn(0x7ff6d015ce40 0x7ff6d0152f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:40.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.785+0000 7ff6d4a00640 1 -- 172.21.15.63:0/3509542316 >> v2:172.21.15.131:3300/0 conn(0x7ff6d015ce40 msgr2=0x7ff6d0152f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:26:40.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.785+0000 7ff6d4a00640 1 --2- 172.21.15.63:0/3509542316 >> v2:172.21.15.131:3300/0 conn(0x7ff6d015ce40 0x7ff6d0152f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:40.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.785+0000 7ff6d4a00640 1 -- 172.21.15.63:0/3509542316 >> v1:172.21.15.63:6789/0 conn(0x7ff6d006f5d0 legacy=0x7ff6d00c8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:40.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.785+0000 7ff6d4a00640 1 -- 172.21.15.63:0/3509542316 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6d01596c0 con 0x7ff6d006f9b0 2024-05-21T01:26:40.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.789+0000 7ff6d4a00640 1 --2- 172.21.15.63:0/3509542316 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff6d006f9b0 0x7ff6d0152a40 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7ff6d00cadd0 tx=0x7ff6bc01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cdde23542e5d7c3 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:40.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.789+0000 7ff6cfe00640 1 -- 172.21.15.63:0/3509542316 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6bc0ab610 con 0x7ff6d006f9b0 2024-05-21T01:26:40.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.789+0000 7ff6cfe00640 1 -- 172.21.15.63:0/3509542316 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6bc0b0070 con 0x7ff6d006f9b0 2024-05-21T01:26:40.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.789+0000 7ff6cfe00640 1 -- 172.21.15.63:0/3509542316 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6bc0ab9d0 con 0x7ff6d006f9b0 2024-05-21T01:26:40.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.789+0000 7ff6d7e00640 1 -- 172.21.15.63:0/3509542316 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff6d006f9b0 msgr2=0x7ff6d0152a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:40.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.789+0000 7ff6d7e00640 1 --2- 172.21.15.63:0/3509542316 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff6d006f9b0 0x7ff6d0152a40 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7ff6d00cadd0 tx=0x7ff6bc01c520 comp rx=0 tx=0).stop 2024-05-21T01:26:40.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.789+0000 7ff6d7e00640 1 -- 172.21.15.63:0/3509542316 shutdown_connections 2024-05-21T01:26:40.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.789+0000 7ff6d7e00640 1 --2- 172.21.15.63:0/3509542316 >> v2:172.21.15.131:3300/0 conn(0x7ff6d015ce40 0x7ff6d0152f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:40.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.789+0000 7ff6d7e00640 1 --2- 172.21.15.63:0/3509542316 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff6d006f9b0 0x7ff6d0152a40 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:40.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.789+0000 7ff6d7e00640 1 -- 172.21.15.63:0/3509542316 >> 172.21.15.63:0/3509542316 conn(0x7ff6d0068460 msgr2=0x7ff6d0068870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:26:40.795 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.789+0000 7ff6d7e00640 1 -- 172.21.15.63:0/3509542316 shutdown_connections 2024-05-21T01:26:40.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.789+0000 7ff6d7e00640 1 -- 172.21.15.63:0/3509542316 wait complete. 2024-05-21T01:26:40.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.793+0000 7ff6d7e00640 1 Processor -- start 2024-05-21T01:26:40.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.793+0000 7ff6d7e00640 1 -- start start 2024-05-21T01:26:40.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.793+0000 7ff6d7e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff6d006f5d0 0x7ff6d00c9f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:40.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.793+0000 7ff6d7e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff6d006f9b0 0x7ff6d00cd840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:40.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.793+0000 7ff6d7e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff6d015ce40 0x7ff6d014f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:40.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.793+0000 7ff6d7e00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff6d01658a0 con 0x7ff6d006f9b0 2024-05-21T01:26:40.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.793+0000 7ff6d7e00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7ff6d0165720 con 0x7ff6d015ce40 2024-05-21T01:26:40.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.793+0000 7ff6d7e00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7ff6d0165a20 con 0x7ff6d006f5d0 2024-05-21T01:26:40.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.793+0000 7ff6d4a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff6d006f9b0 0x7ff6d00cd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:40.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.793+0000 7ff6d4a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff6d006f9b0 0x7ff6d00cd840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48090/0 (socket says 172.21.15.63:48090) 2024-05-21T01:26:40.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.793+0000 7ff6d4a00640 1 -- 172.21.15.63:0/33085164 learned_addr learned my addr 172.21.15.63:0/33085164 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:26:40.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.793+0000 7ff6d5400640 1 --2- 172.21.15.63:0/33085164 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff6d006f5d0 0x7ff6d00c9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:40.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.793+0000 7ff6d5e00640 1 --2- 172.21.15.63:0/33085164 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff6d015ce40 0x7ff6d014f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:40.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.793+0000 7ff6d4a00640 1 -- 172.21.15.63:0/33085164 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff6d006f5d0 msgr2=0x7ff6d00c9f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:40.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.793+0000 7ff6d4a00640 1 --2- 172.21.15.63:0/33085164 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff6d006f5d0 0x7ff6d00c9f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:40.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.793+0000 7ff6d4a00640 1 -- 172.21.15.63:0/33085164 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff6d015ce40 msgr2=0x7ff6d014f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:40.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.793+0000 7ff6d4a00640 1 --2- 172.21.15.63:0/33085164 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff6d015ce40 0x7ff6d014f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:40.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.793+0000 7ff6d4a00640 1 -- 172.21.15.63:0/33085164 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6d014e710 con 0x7ff6d006f9b0 2024-05-21T01:26:40.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.793+0000 7ff6d4a00640 1 --2- 172.21.15.63:0/33085164 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff6d006f9b0 0x7ff6d00cd840 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc0ad040 tx=0x7ff6bc01ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:40.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.793+0000 7ff6cd600640 1 -- 172.21.15.63:0/33085164 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6bc0be5f0 con 0x7ff6d006f9b0 2024-05-21T01:26:40.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.793+0000 7ff6cd600640 1 -- 172.21.15.63:0/33085164 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6bc0be790 con 0x7ff6d006f9b0 2024-05-21T01:26:40.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.793+0000 7ff6cd600640 1 -- 172.21.15.63:0/33085164 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6bc0beb40 con 0x7ff6d006f9b0 2024-05-21T01:26:40.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.793+0000 7ff6d7e00640 1 -- 172.21.15.63:0/33085164 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6d00c8ac0 con 0x7ff6d006f9b0 2024-05-21T01:26:40.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.793+0000 7ff6d7e00640 1 -- 172.21.15.63:0/33085164 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6d014e9b0 con 0x7ff6d006f9b0 2024-05-21T01:26:40.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.797+0000 7ff6d7e00640 1 -- 172.21.15.63:0/33085164 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6d00507f0 con 0x7ff6d006f9b0 2024-05-21T01:26:40.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.797+0000 7ff6cd600640 1 -- 172.21.15.63:0/33085164 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7ff6bc0b43f0 con 0x7ff6d006f9b0 2024-05-21T01:26:40.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.797+0000 7ff6cd600640 1 --2- 172.21.15.63:0/33085164 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7ff6b006f400 0x7ff6b00718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:40.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.797+0000 7ff6cd600640 1 -- 172.21.15.63:0/33085164 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7ff6bc129d00 con 0x7ff6d006f9b0 2024-05-21T01:26:40.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.797+0000 7ff6d5400640 1 --2- 172.21.15.63:0/33085164 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7ff6b006f400 0x7ff6b00718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:40.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.797+0000 7ff6d5400640 1 --2- 172.21.15.63:0/33085164 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7ff6b006f400 0x7ff6b00718c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff6c4001650 tx=0x7ff6c4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:40.806 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.801+0000 7ff6cd600640 1 -- 172.21.15.63:0/33085164 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7ff6bc0c4060 con 0x7ff6d006f9b0 2024-05-21T01:26:40.967 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.961+0000 7ff6d7e00640 1 -- 172.21.15.63:0/33085164 --> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff6d01516f0 con 0x7ff6b006f400 2024-05-21T01:26:40.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.985+0000 7ff6cd600640 1 -- 172.21.15.63:0/33085164 <== mgr.4103 v2:172.21.15.131:6832/921953667 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+333957 (secure 0 0 0) 0x7ff6d01516f0 con 0x7ff6b006f400 2024-05-21T01:26:40.994 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-05-21T01:26:40.996 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-05-21T01:26:40.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.989+0000 7ff6d7e00640 1 -- 172.21.15.63:0/33085164 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7ff6b006f400 msgr2=0x7ff6b00718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:40.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.989+0000 7ff6d7e00640 1 --2- 172.21.15.63:0/33085164 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7ff6b006f400 0x7ff6b00718c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff6c4001650 tx=0x7ff6c4009040 comp rx=0 tx=0).stop 2024-05-21T01:26:40.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.989+0000 7ff6d7e00640 1 -- 172.21.15.63:0/33085164 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff6d006f9b0 msgr2=0x7ff6d00cd840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:40.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.989+0000 7ff6d7e00640 1 --2- 172.21.15.63:0/33085164 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff6d006f9b0 0x7ff6d00cd840 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc0ad040 tx=0x7ff6bc01ad60 comp rx=0 tx=0).stop 2024-05-21T01:26:40.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.989+0000 7ff6d7e00640 1 -- 172.21.15.63:0/33085164 shutdown_connections 2024-05-21T01:26:40.997 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.989+0000 7ff6d7e00640 1 --2- 172.21.15.63:0/33085164 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7ff6b006f400 0x7ff6b00718c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:40.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.989+0000 7ff6d7e00640 1 --2- 172.21.15.63:0/33085164 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff6d015ce40 0x7ff6d014f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:40.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.989+0000 7ff6d7e00640 1 --2- 172.21.15.63:0/33085164 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff6d006f9b0 0x7ff6d00cd840 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:40.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.989+0000 7ff6d7e00640 1 --2- 172.21.15.63:0/33085164 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff6d006f5d0 0x7ff6d00c9f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:40.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.989+0000 7ff6d7e00640 1 -- 172.21.15.63:0/33085164 >> 172.21.15.63:0/33085164 conn(0x7ff6d0068460 msgr2=0x7ff6d0157420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:26:40.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.989+0000 7ff6d7e00640 1 -- 172.21.15.63:0/33085164 shutdown_connections 2024-05-21T01:26:40.998 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:40.989+0000 7ff6d7e00640 1 -- 172.21.15.63:0/33085164 wait complete. 2024-05-21T01:26:41.014 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":227,"stamp":"2024-05-21T01:26:40.609651+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":372534127,"num_objects":151,"num_object_clones":0,"num_object_copies":478,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":151,"num_whiteouts":0,"num_read":5197,"num_read_kb":21004346,"num_write":10809,"num_write_kb":25170452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11260,"ondisk_log_size":11260,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":532324,"kb_used_data":160740,"kb_used_omap":12,"kb_used_meta":371507,"kb_avail":754442396,"statfs":{"total":773094113280,"available":772549013504,"internally_reserved":0,"allocated":164597760,"data_stored":2509693468,"data_compressed":123720052,"data_compressed_allocated":156459008,"data_compressed_original":2503049216,"omap_allocated":12750,"internal_metadata":380423730},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,1,2,1,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-10368304695,"num_objects":-2472,"num_object_clones":0,"num_object_copies":-9888,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2472,"num_whiteouts":0,"num_read":64,"num_read_kb":258049,"num_write":2484,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004944"},"pg_stats":[{"pgid":"2.1f","version":"25'9","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:07.489107+0000","last_change":"2024-05-21T01:19:53.545236+0000","last_active":"2024-05-21T01:24:07.489107+0000","last_peered":"2024-05-21T01:24:07.489107+0000","last_clean":"2024-05-21T01:24:07.489107+0000","last_became_active":"2024-05-21T01:19:53.544469+0000","last_became_peered":"2024-05-21T01:19:53.544469+0000","last_unstale":"2024-05-21T01:24:07.489107+0000","last_undegraded":"2024-05-21T01:24:07.489107+0000","last_fullsized":"2024-05-21T01:24:07.489107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:33:09.421287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:23:58.496231+0000","last_change":"2024-05-21T01:19:54.568235+0000","last_active":"2024-05-21T01:23:58.496231+0000","last_peered":"2024-05-21T01:23:58.496231+0000","last_clean":"2024-05-21T01:23:58.496231+0000","last_became_active":"2024-05-21T01:19:54.567245+0000","last_became_peered":"2024-05-21T01:19:54.567245+0000","last_unstale":"2024-05-21T01:23:58.496231+0000","last_undegraded":"2024-05-21T01:23:58.496231+0000","last_fullsized":"2024-05-21T01:23:58.496231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:39:51.222819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"27'318","reported_seq":514,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:37.507383+0000","last_change":"2024-05-21T01:19:58.618772+0000","last_active":"2024-05-21T01:26:37.507383+0000","last_peered":"2024-05-21T01:26:37.507383+0000","last_clean":"2024-05-21T01:26:37.507383+0000","last_became_active":"2024-05-21T01:19:58.617757+0000","last_became_peered":"2024-05-21T01:19:58.617757+0000","last_unstale":"2024-05-21T01:26:37.507383+0000","last_undegraded":"2024-05-21T01:26:37.507383+0000","last_fullsized":"2024-05-21T01:26:37.507383+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":318,"log_dups_size":0,"ondisk_log_size":318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T13:07:31.666521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":176,"num_read_kb":720896,"num_write":297,"num_write_kb":835584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"25'2","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:23:53.495690+0000","last_change":"2024-05-21T01:19:53.551775+0000","last_active":"2024-05-21T01:23:53.495690+0000","last_peered":"2024-05-21T01:23:53.495690+0000","last_clean":"2024-05-21T01:23:53.495690+0000","last_became_active":"2024-05-21T01:19:53.551049+0000","last_became_peered":"2024-05-21T01:19:53.551049+0000","last_unstale":"2024-05-21T01:23:53.495690+0000","last_undegraded":"2024-05-21T01:23:53.495690+0000","last_fullsized":"2024-05-21T01:23:53.495690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:49:02.289202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:08.498886+0000","last_change":"2024-05-21T01:19:54.573420+0000","last_active":"2024-05-21T01:24:08.498886+0000","last_peered":"2024-05-21T01:24:08.498886+0000","last_clean":"2024-05-21T01:24:08.498886+0000","last_became_active":"2024-05-21T01:19:54.569573+0000","last_became_peered":"2024-05-21T01:19:54.569573+0000","last_unstale":"2024-05-21T01:24:08.498886+0000","last_undegraded":"2024-05-21T01:24:08.498886+0000","last_fullsized":"2024-05-21T01:24:08.498886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:00:12.257816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"27'351","reported_seq":567,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:38.381342+0000","last_change":"2024-05-21T01:19:58.604490+0000","last_active":"2024-05-21T01:26:38.381342+0000","last_peered":"2024-05-21T01:26:38.381342+0000","last_clean":"2024-05-21T01:26:38.381342+0000","last_became_active":"2024-05-21T01:19:58.604108+0000","last_became_peered":"2024-05-21T01:19:58.604108+0000","last_unstale":"2024-05-21T01:26:38.381342+0000","last_undegraded":"2024-05-21T01:26:38.381342+0000","last_fullsized":"2024-05-21T01:26:38.381342+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:11:10.963073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":196,"num_read_kb":802816,"num_write":339,"num_write_kb":925696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"27'5","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:42.721812+0000","last_change":"2024-05-21T01:19:53.525403+0000","last_active":"2024-05-21T01:22:42.721812+0000","last_peered":"2024-05-21T01:22:42.721812+0000","last_clean":"2024-05-21T01:22:42.721812+0000","last_became_active":"2024-05-21T01:19:53.521265+0000","last_became_peered":"2024-05-21T01:19:53.521265+0000","last_unstale":"2024-05-21T01:22:42.721812+0000","last_undegraded":"2024-05-21T01:22:42.721812+0000","last_fullsized":"2024-05-21T01:22:42.721812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:52:16.488269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:24.468744+0000","last_change":"2024-05-21T01:19:54.536436+0000","last_active":"2024-05-21T01:22:24.468744+0000","last_peered":"2024-05-21T01:22:24.468744+0000","last_clean":"2024-05-21T01:22:24.468744+0000","last_became_active":"2024-05-21T01:19:54.536061+0000","last_became_peered":"2024-05-21T01:19:54.536061+0000","last_unstale":"2024-05-21T01:22:24.468744+0000","last_undegraded":"2024-05-21T01:22:24.468744+0000","last_fullsized":"2024-05-21T01:22:24.468744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:48:23.811712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"27'291","reported_seq":460,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:38.327934+0000","last_change":"2024-05-21T01:19:58.623087+0000","last_active":"2024-05-21T01:26:38.327934+0000","last_peered":"2024-05-21T01:26:38.327934+0000","last_clean":"2024-05-21T01:26:38.327934+0000","last_became_active":"2024-05-21T01:19:58.622672+0000","last_became_peered":"2024-05-21T01:19:58.622672+0000","last_unstale":"2024-05-21T01:26:38.327934+0000","last_undegraded":"2024-05-21T01:26:38.327934+0000","last_fullsized":"2024-05-21T01:26:38.327934+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:45:49.241750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":149,"num_read_kb":610304,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:24.484977+0000","last_change":"2024-05-21T01:19:53.522497+0000","last_active":"2024-05-21T01:22:24.484977+0000","last_peered":"2024-05-21T01:22:24.484977+0000","last_clean":"2024-05-21T01:22:24.484977+0000","last_became_active":"2024-05-21T01:19:53.521684+0000","last_became_peered":"2024-05-21T01:19:53.521684+0000","last_unstale":"2024-05-21T01:22:24.484977+0000","last_undegraded":"2024-05-21T01:22:24.484977+0000","last_fullsized":"2024-05-21T01:22:24.484977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:18:17.808255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:24.486725+0000","last_change":"2024-05-21T01:19:54.549512+0000","last_active":"2024-05-21T01:22:24.486725+0000","last_peered":"2024-05-21T01:22:24.486725+0000","last_clean":"2024-05-21T01:22:24.486725+0000","last_became_active":"2024-05-21T01:19:54.549291+0000","last_became_peered":"2024-05-21T01:19:54.549291+0000","last_unstale":"2024-05-21T01:22:24.486725+0000","last_undegraded":"2024-05-21T01:22:24.486725+0000","last_fullsized":"2024-05-21T01:22:24.486725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:48:34.571236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"27'271","reported_seq":433,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:38.303196+0000","last_change":"2024-05-21T01:19:58.614748+0000","last_active":"2024-05-21T01:26:38.303196+0000","last_peered":"2024-05-21T01:26:38.303196+0000","last_clean":"2024-05-21T01:26:38.303196+0000","last_became_active":"2024-05-21T01:19:58.614313+0000","last_became_peered":"2024-05-21T01:19:58.614313+0000","last_unstale":"2024-05-21T01:26:38.303196+0000","last_undegraded":"2024-05-21T01:26:38.303196+0000","last_fullsized":"2024-05-21T01:26:38.303196+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:45:34.204591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":581632,"num_write":252,"num_write_kb":688128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:14.556315+0000","last_change":"2024-05-21T01:19:54.545467+0000","last_active":"2024-05-21T01:24:14.556315+0000","last_peered":"2024-05-21T01:24:14.556315+0000","last_clean":"2024-05-21T01:24:14.556315+0000","last_became_active":"2024-05-21T01:19:54.545181+0000","last_became_peered":"2024-05-21T01:19:54.545181+0000","last_unstale":"2024-05-21T01:24:14.556315+0000","last_undegraded":"2024-05-21T01:24:14.556315+0000","last_fullsized":"2024-05-21T01:24:14.556315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:43:15.387067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"27'5","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:24.595463+0000","last_change":"2024-05-21T01:19:53.536139+0000","last_active":"2024-05-21T01:24:24.595463+0000","last_peered":"2024-05-21T01:24:24.595463+0000","last_clean":"2024-05-21T01:24:24.595463+0000","last_became_active":"2024-05-21T01:19:53.535899+0000","last_became_peered":"2024-05-21T01:19:53.535899+0000","last_unstale":"2024-05-21T01:24:24.595463+0000","last_undegraded":"2024-05-21T01:24:24.595463+0000","last_fullsized":"2024-05-21T01:24:24.595463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:40:12.033744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"27'326","reported_seq":527,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:38.371289+0000","last_change":"2024-05-21T01:19:58.621487+0000","last_active":"2024-05-21T01:26:38.371289+0000","last_peered":"2024-05-21T01:26:38.371289+0000","last_clean":"2024-05-21T01:26:38.371289+0000","last_became_active":"2024-05-21T01:19:58.621083+0000","last_became_peered":"2024-05-21T01:19:58.621083+0000","last_unstale":"2024-05-21T01:26:38.371289+0000","last_undegraded":"2024-05-21T01:26:38.371289+0000","last_fullsized":"2024-05-21T01:26:38.371289+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:18:44.587274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":181,"num_read_kb":741376,"num_write":309,"num_write_kb":843776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:12.470739+0000","last_change":"2024-05-21T01:19:54.572420+0000","last_active":"2024-05-21T01:22:12.470739+0000","last_peered":"2024-05-21T01:22:12.470739+0000","last_clean":"2024-05-21T01:22:12.470739+0000","last_became_active":"2024-05-21T01:19:54.571863+0000","last_became_peered":"2024-05-21T01:19:54.571863+0000","last_unstale":"2024-05-21T01:22:12.470739+0000","last_undegraded":"2024-05-21T01:22:12.470739+0000","last_fullsized":"2024-05-21T01:22:12.470739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:13:52.491903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"27'3","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:13.507766+0000","last_change":"2024-05-21T01:19:53.553351+0000","last_active":"2024-05-21T01:24:13.507766+0000","last_peered":"2024-05-21T01:24:13.507766+0000","last_clean":"2024-05-21T01:24:13.507766+0000","last_became_active":"2024-05-21T01:19:53.552694+0000","last_became_peered":"2024-05-21T01:19:53.552694+0000","last_unstale":"2024-05-21T01:24:13.507766+0000","last_undegraded":"2024-05-21T01:24:13.507766+0000","last_fullsized":"2024-05-21T01:24:13.507766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:46:55.273278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"27'300","reported_seq":488,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:38.313014+0000","last_change":"2024-05-21T01:19:58.594904+0000","last_active":"2024-05-21T01:26:38.313014+0000","last_peered":"2024-05-21T01:26:38.313014+0000","last_clean":"2024-05-21T01:26:38.313014+0000","last_became_active":"2024-05-21T01:19:58.594450+0000","last_became_peered":"2024-05-21T01:19:58.594450+0000","last_unstale":"2024-05-21T01:26:38.313014+0000","last_undegraded":"2024-05-21T01:26:38.313014+0000","last_fullsized":"2024-05-21T01:26:38.313014+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":300,"log_dups_size":0,"ondisk_log_size":300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:37:30.286986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":688128,"num_write":291,"num_write_kb":794624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:17.490540+0000","last_change":"2024-05-21T01:19:54.554750+0000","last_active":"2024-05-21T01:24:17.490540+0000","last_peered":"2024-05-21T01:24:17.490540+0000","last_clean":"2024-05-21T01:24:17.490540+0000","last_became_active":"2024-05-21T01:19:54.551583+0000","last_became_peered":"2024-05-21T01:19:54.551583+0000","last_unstale":"2024-05-21T01:24:17.490540+0000","last_undegraded":"2024-05-21T01:24:17.490540+0000","last_fullsized":"2024-05-21T01:24:17.490540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:37:19.564099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"25'3","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:17.490604+0000","last_change":"2024-05-21T01:19:53.523277+0000","last_active":"2024-05-21T01:24:17.490604+0000","last_peered":"2024-05-21T01:24:17.490604+0000","last_clean":"2024-05-21T01:24:17.490604+0000","last_became_active":"2024-05-21T01:19:53.522525+0000","last_became_peered":"2024-05-21T01:19:53.522525+0000","last_unstale":"2024-05-21T01:24:17.490604+0000","last_undegraded":"2024-05-21T01:24:17.490604+0000","last_fullsized":"2024-05-21T01:24:17.490604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:23:59.949781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"27'278","reported_seq":456,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:37.503134+0000","last_change":"2024-05-21T01:19:58.615575+0000","last_active":"2024-05-21T01:26:37.503134+0000","last_peered":"2024-05-21T01:26:37.503134+0000","last_clean":"2024-05-21T01:26:37.503134+0000","last_became_active":"2024-05-21T01:19:58.614401+0000","last_became_peered":"2024-05-21T01:19:58.614401+0000","last_unstale":"2024-05-21T01:26:37.503134+0000","last_undegraded":"2024-05-21T01:26:37.503134+0000","last_fullsized":"2024-05-21T01:26:37.503134+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":278,"log_dups_size":0,"ondisk_log_size":278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:51:09.839503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":158,"num_read_kb":647168,"num_write":259,"num_write_kb":729088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:14.556307+0000","last_change":"2024-05-21T01:19:54.555489+0000","last_active":"2024-05-21T01:24:14.556307+0000","last_peered":"2024-05-21T01:24:14.556307+0000","last_clean":"2024-05-21T01:24:14.556307+0000","last_became_active":"2024-05-21T01:19:54.555227+0000","last_became_peered":"2024-05-21T01:19:54.555227+0000","last_unstale":"2024-05-21T01:24:14.556307+0000","last_undegraded":"2024-05-21T01:24:14.556307+0000","last_fullsized":"2024-05-21T01:24:14.556307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:00:22.873520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"25'2","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:14.509091+0000","last_change":"2024-05-21T01:19:53.520840+0000","last_active":"2024-05-21T01:24:14.509091+0000","last_peered":"2024-05-21T01:24:14.509091+0000","last_clean":"2024-05-21T01:24:14.509091+0000","last_became_active":"2024-05-21T01:19:53.520540+0000","last_became_peered":"2024-05-21T01:19:53.520540+0000","last_unstale":"2024-05-21T01:24:14.509091+0000","last_undegraded":"2024-05-21T01:24:14.509091+0000","last_fullsized":"2024-05-21T01:24:14.509091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:08:36.426465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"27'300","reported_seq":490,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:38.425435+0000","last_change":"2024-05-21T01:19:58.604357+0000","last_active":"2024-05-21T01:26:38.425435+0000","last_peered":"2024-05-21T01:26:38.425435+0000","last_clean":"2024-05-21T01:26:38.425435+0000","last_became_active":"2024-05-21T01:19:58.603922+0000","last_became_peered":"2024-05-21T01:19:58.603922+0000","last_unstale":"2024-05-21T01:26:38.425435+0000","last_undegraded":"2024-05-21T01:26:38.425435+0000","last_fullsized":"2024-05-21T01:26:38.425435+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":300,"log_dups_size":0,"ondisk_log_size":300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:55:18.226031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":170,"num_read_kb":696320,"num_write":288,"num_write_kb":786432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:17.490671+0000","last_change":"2024-05-21T01:19:54.569315+0000","last_active":"2024-05-21T01:24:17.490671+0000","last_peered":"2024-05-21T01:24:17.490671+0000","last_clean":"2024-05-21T01:24:17.490671+0000","last_became_active":"2024-05-21T01:19:54.568232+0000","last_became_peered":"2024-05-21T01:19:54.568232+0000","last_unstale":"2024-05-21T01:24:17.490671+0000","last_undegraded":"2024-05-21T01:24:17.490671+0000","last_fullsized":"2024-05-21T01:24:17.490671+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:19:01.819418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"25'4","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:14.556346+0000","last_change":"2024-05-21T01:19:53.525301+0000","last_active":"2024-05-21T01:24:14.556346+0000","last_peered":"2024-05-21T01:24:14.556346+0000","last_clean":"2024-05-21T01:24:14.556346+0000","last_became_active":"2024-05-21T01:19:53.525010+0000","last_became_peered":"2024-05-21T01:19:53.525010+0000","last_unstale":"2024-05-21T01:24:14.556346+0000","last_undegraded":"2024-05-21T01:24:14.556346+0000","last_fullsized":"2024-05-21T01:24:14.556346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:53:11.316975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"27'273","reported_seq":422,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:38.408364+0000","last_change":"2024-05-21T01:19:58.590354+0000","last_active":"2024-05-21T01:26:38.408364+0000","last_peered":"2024-05-21T01:26:38.408364+0000","last_clean":"2024-05-21T01:26:38.408364+0000","last_became_active":"2024-05-21T01:19:58.589985+0000","last_became_peered":"2024-05-21T01:19:58.589985+0000","last_unstale":"2024-05-21T01:26:38.408364+0000","last_undegraded":"2024-05-21T01:26:38.408364+0000","last_fullsized":"2024-05-21T01:26:38.408364+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:08:09.222858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":524288,"num_write":249,"num_write_kb":679936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:17.490762+0000","last_change":"2024-05-21T01:19:54.555318+0000","last_active":"2024-05-21T01:24:17.490762+0000","last_peered":"2024-05-21T01:24:17.490762+0000","last_clean":"2024-05-21T01:24:17.490762+0000","last_became_active":"2024-05-21T01:19:54.552947+0000","last_became_peered":"2024-05-21T01:19:54.552947+0000","last_unstale":"2024-05-21T01:24:17.490762+0000","last_undegraded":"2024-05-21T01:24:17.490762+0000","last_fullsized":"2024-05-21T01:24:17.490762+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:29:24.153986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"27'30","reported_seq":59,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:32.740014+0000","last_change":"2024-05-21T01:19:53.525004+0000","last_active":"2024-05-21T01:26:32.740014+0000","last_peered":"2024-05-21T01:26:32.740014+0000","last_clean":"2024-05-21T01:26:32.740014+0000","last_became_active":"2024-05-21T01:19:53.521014+0000","last_became_peered":"2024-05-21T01:19:53.521014+0000","last_unstale":"2024-05-21T01:26:32.740014+0000","last_undegraded":"2024-05-21T01:26:32.740014+0000","last_fullsized":"2024-05-21T01:26:32.740014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:02:46.668320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"27'268","reported_seq":427,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:37.289842+0000","last_change":"2024-05-21T01:19:58.599880+0000","last_active":"2024-05-21T01:26:37.289842+0000","last_peered":"2024-05-21T01:26:37.289842+0000","last_clean":"2024-05-21T01:26:37.289842+0000","last_became_active":"2024-05-21T01:19:58.598712+0000","last_became_peered":"2024-05-21T01:19:58.598712+0000","last_unstale":"2024-05-21T01:26:37.289842+0000","last_undegraded":"2024-05-21T01:26:37.289842+0000","last_fullsized":"2024-05-21T01:26:37.289842+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":268,"log_dups_size":0,"ondisk_log_size":268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:43:05.995986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":138,"num_read_kb":565248,"num_write":255,"num_write_kb":720896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:08.507007+0000","last_change":"2024-05-21T01:19:54.576044+0000","last_active":"2024-05-21T01:24:08.507007+0000","last_peered":"2024-05-21T01:24:08.507007+0000","last_clean":"2024-05-21T01:24:08.507007+0000","last_became_active":"2024-05-21T01:19:54.575543+0000","last_became_peered":"2024-05-21T01:19:54.575543+0000","last_unstale":"2024-05-21T01:24:08.507007+0000","last_undegraded":"2024-05-21T01:24:08.507007+0000","last_fullsized":"2024-05-21T01:24:08.507007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T09:33:07.188470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"25'1","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:04.555386+0000","last_change":"2024-05-21T01:19:53.543705+0000","last_active":"2024-05-21T01:24:04.555386+0000","last_peered":"2024-05-21T01:24:04.555386+0000","last_clean":"2024-05-21T01:24:04.555386+0000","last_became_active":"2024-05-21T01:19:53.543450+0000","last_became_peered":"2024-05-21T01:19:53.543450+0000","last_unstale":"2024-05-21T01:24:04.555386+0000","last_undegraded":"2024-05-21T01:24:04.555386+0000","last_fullsized":"2024-05-21T01:24:04.555386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:05:49.465156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"27'267","reported_seq":424,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:38.308781+0000","last_change":"2024-05-21T01:19:58.612049+0000","last_active":"2024-05-21T01:26:38.308781+0000","last_peered":"2024-05-21T01:26:38.308781+0000","last_clean":"2024-05-21T01:26:38.308781+0000","last_became_active":"2024-05-21T01:19:58.610837+0000","last_became_peered":"2024-05-21T01:19:58.610837+0000","last_unstale":"2024-05-21T01:26:38.308781+0000","last_undegraded":"2024-05-21T01:26:38.308781+0000","last_fullsized":"2024-05-21T01:26:38.308781+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":267,"log_dups_size":0,"ondisk_log_size":267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:24:14.332056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":557056,"num_write":249,"num_write_kb":679936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:04.542429+0000","last_change":"2024-05-21T01:19:54.553083+0000","last_active":"2024-05-21T01:24:04.542429+0000","last_peered":"2024-05-21T01:24:04.542429+0000","last_clean":"2024-05-21T01:24:04.542429+0000","last_became_active":"2024-05-21T01:19:54.552812+0000","last_became_peered":"2024-05-21T01:19:54.552812+0000","last_unstale":"2024-05-21T01:24:04.542429+0000","last_undegraded":"2024-05-21T01:24:04.542429+0000","last_fullsized":"2024-05-21T01:24:04.542429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:37:25.835345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:03.497940+0000","last_change":"2024-05-21T01:19:53.551697+0000","last_active":"2024-05-21T01:24:03.497940+0000","last_peered":"2024-05-21T01:24:03.497940+0000","last_clean":"2024-05-21T01:24:03.497940+0000","last_became_active":"2024-05-21T01:19:53.550921+0000","last_became_peered":"2024-05-21T01:19:53.550921+0000","last_unstale":"2024-05-21T01:24:03.497940+0000","last_undegraded":"2024-05-21T01:24:03.497940+0000","last_fullsized":"2024-05-21T01:24:03.497940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T09:31:31.996638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"27'289","reported_seq":468,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:38.366664+0000","last_change":"2024-05-21T01:19:58.626472+0000","last_active":"2024-05-21T01:26:38.366664+0000","last_peered":"2024-05-21T01:26:38.366664+0000","last_clean":"2024-05-21T01:26:38.366664+0000","last_became_active":"2024-05-21T01:19:58.625720+0000","last_became_peered":"2024-05-21T01:19:58.625720+0000","last_unstale":"2024-05-21T01:26:38.366664+0000","last_undegraded":"2024-05-21T01:26:38.366664+0000","last_fullsized":"2024-05-21T01:26:38.366664+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":289,"log_dups_size":0,"ondisk_log_size":289,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:16:03.911585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":158,"num_read_kb":647168,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:04.508249+0000","last_change":"2024-05-21T01:19:54.547947+0000","last_active":"2024-05-21T01:24:04.508249+0000","last_peered":"2024-05-21T01:24:04.508249+0000","last_clean":"2024-05-21T01:24:04.508249+0000","last_became_active":"2024-05-21T01:19:54.547689+0000","last_became_peered":"2024-05-21T01:19:54.547689+0000","last_unstale":"2024-05-21T01:24:04.508249+0000","last_undegraded":"2024-05-21T01:24:04.508249+0000","last_fullsized":"2024-05-21T01:24:04.508249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:40:55.985899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"25'1","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:04.555333+0000","last_change":"2024-05-21T01:19:53.540973+0000","last_active":"2024-05-21T01:24:04.555333+0000","last_peered":"2024-05-21T01:24:04.555333+0000","last_clean":"2024-05-21T01:24:04.555333+0000","last_became_active":"2024-05-21T01:19:53.540670+0000","last_became_peered":"2024-05-21T01:19:53.540670+0000","last_unstale":"2024-05-21T01:24:04.555333+0000","last_undegraded":"2024-05-21T01:24:04.555333+0000","last_fullsized":"2024-05-21T01:24:04.555333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:08:21.802284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"27'277","reported_seq":446,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:38.380089+0000","last_change":"2024-05-21T01:19:58.611280+0000","last_active":"2024-05-21T01:26:38.380089+0000","last_peered":"2024-05-21T01:26:38.380089+0000","last_clean":"2024-05-21T01:26:38.380089+0000","last_became_active":"2024-05-21T01:19:58.610511+0000","last_became_peered":"2024-05-21T01:19:58.610511+0000","last_unstale":"2024-05-21T01:26:38.380089+0000","last_undegraded":"2024-05-21T01:26:38.380089+0000","last_fullsized":"2024-05-21T01:26:38.380089+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:49:19.660422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":606208,"num_write":264,"num_write_kb":720896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:23:58.496160+0000","last_change":"2024-05-21T01:19:54.572546+0000","last_active":"2024-05-21T01:23:58.496160+0000","last_peered":"2024-05-21T01:23:58.496160+0000","last_clean":"2024-05-21T01:23:58.496160+0000","last_became_active":"2024-05-21T01:19:54.572022+0000","last_became_peered":"2024-05-21T01:19:54.572022+0000","last_unstale":"2024-05-21T01:23:58.496160+0000","last_undegraded":"2024-05-21T01:23:58.496160+0000","last_fullsized":"2024-05-21T01:23:58.496160+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:50:08.351383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"27'8","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:35.052139+0000","last_change":"2024-05-21T01:19:53.556786+0000","last_active":"2024-05-21T01:26:35.052139+0000","last_peered":"2024-05-21T01:26:35.052139+0000","last_clean":"2024-05-21T01:26:35.052139+0000","last_became_active":"2024-05-21T01:19:53.556143+0000","last_became_peered":"2024-05-21T01:19:53.556143+0000","last_unstale":"2024-05-21T01:26:35.052139+0000","last_undegraded":"2024-05-21T01:26:35.052139+0000","last_fullsized":"2024-05-21T01:26:35.052139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:02:17.391701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":417,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"27'289","reported_seq":452,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:38.385695+0000","last_change":"2024-05-21T01:19:58.599203+0000","last_active":"2024-05-21T01:26:38.385695+0000","last_peered":"2024-05-21T01:26:38.385695+0000","last_clean":"2024-05-21T01:26:38.385695+0000","last_became_active":"2024-05-21T01:19:58.598175+0000","last_became_peered":"2024-05-21T01:19:58.598175+0000","last_unstale":"2024-05-21T01:26:38.385695+0000","last_undegraded":"2024-05-21T01:26:38.385695+0000","last_fullsized":"2024-05-21T01:26:38.385695+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":289,"log_dups_size":0,"ondisk_log_size":289,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:45:17.138090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":581632,"num_write":270,"num_write_kb":737280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:08.506876+0000","last_change":"2024-05-21T01:19:54.551092+0000","last_active":"2024-05-21T01:24:08.506876+0000","last_peered":"2024-05-21T01:24:08.506876+0000","last_clean":"2024-05-21T01:24:08.506876+0000","last_became_active":"2024-05-21T01:19:54.550338+0000","last_became_peered":"2024-05-21T01:19:54.550338+0000","last_unstale":"2024-05-21T01:24:08.506876+0000","last_undegraded":"2024-05-21T01:24:08.506876+0000","last_fullsized":"2024-05-21T01:24:08.506876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:29:13.540719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"25'3","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:23:54.554210+0000","last_change":"2024-05-21T01:19:53.554835+0000","last_active":"2024-05-21T01:23:54.554210+0000","last_peered":"2024-05-21T01:23:54.554210+0000","last_clean":"2024-05-21T01:23:54.554210+0000","last_became_active":"2024-05-21T01:19:53.554598+0000","last_became_peered":"2024-05-21T01:19:53.554598+0000","last_unstale":"2024-05-21T01:23:54.554210+0000","last_undegraded":"2024-05-21T01:23:54.554210+0000","last_fullsized":"2024-05-21T01:23:54.554210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:28:43.940978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"27'351","reported_seq":558,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:38.359893+0000","last_change":"2024-05-21T01:19:58.629747+0000","last_active":"2024-05-21T01:26:38.359893+0000","last_peered":"2024-05-21T01:26:38.359893+0000","last_clean":"2024-05-21T01:26:38.359893+0000","last_became_active":"2024-05-21T01:19:58.622106+0000","last_became_peered":"2024-05-21T01:19:58.622106+0000","last_unstale":"2024-05-21T01:26:38.359893+0000","last_undegraded":"2024-05-21T01:26:38.359893+0000","last_fullsized":"2024-05-21T01:26:38.359893+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:22:07.047914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":761856,"num_write":339,"num_write_kb":925696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:07.489038+0000","last_change":"2024-05-21T01:19:54.554303+0000","last_active":"2024-05-21T01:24:07.489038+0000","last_peered":"2024-05-21T01:24:07.489038+0000","last_clean":"2024-05-21T01:24:07.489038+0000","last_became_active":"2024-05-21T01:19:54.552126+0000","last_became_peered":"2024-05-21T01:19:54.552126+0000","last_unstale":"2024-05-21T01:24:07.489038+0000","last_undegraded":"2024-05-21T01:24:07.489038+0000","last_fullsized":"2024-05-21T01:24:07.489038+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:59:46.383359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"25'3","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:04.555354+0000","last_change":"2024-05-21T01:19:53.536580+0000","last_active":"2024-05-21T01:24:04.555354+0000","last_peered":"2024-05-21T01:24:04.555354+0000","last_clean":"2024-05-21T01:24:04.555354+0000","last_became_active":"2024-05-21T01:19:53.535105+0000","last_became_peered":"2024-05-21T01:19:53.535105+0000","last_unstale":"2024-05-21T01:24:04.555354+0000","last_undegraded":"2024-05-21T01:24:04.555354+0000","last_fullsized":"2024-05-21T01:24:04.555354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:58:05.019025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":125,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:23:49.506777+0000","last_change":"2024-05-21T01:19:49.490062+0000","last_active":"2024-05-21T01:23:49.506777+0000","last_peered":"2024-05-21T01:23:49.506777+0000","last_clean":"2024-05-21T01:23:49.506777+0000","last_became_active":"2024-05-21T01:19:49.488796+0000","last_became_peered":"2024-05-21T01:19:49.488796+0000","last_unstale":"2024-05-21T01:23:49.506777+0000","last_undegraded":"2024-05-21T01:23:49.506777+0000","last_fullsized":"2024-05-21T01:23:49.506777+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:47.457865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:47.457865+0000","last_clean_scrub_stamp":"2024-05-21T01:19:47.457865+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T09:37:06.199150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"27'292","reported_seq":468,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:38.382121+0000","last_change":"2024-05-21T01:19:58.590851+0000","last_active":"2024-05-21T01:26:38.382121+0000","last_peered":"2024-05-21T01:26:38.382121+0000","last_clean":"2024-05-21T01:26:38.382121+0000","last_became_active":"2024-05-21T01:19:58.589288+0000","last_became_peered":"2024-05-21T01:19:58.589288+0000","last_unstale":"2024-05-21T01:26:38.382121+0000","last_undegraded":"2024-05-21T01:26:38.382121+0000","last_fullsized":"2024-05-21T01:26:38.382121+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":292,"log_dups_size":0,"ondisk_log_size":292,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:36:46.992834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":155,"num_read_kb":634880,"num_write":276,"num_write_kb":753664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:24.595498+0000","last_change":"2024-05-21T01:19:54.543894+0000","last_active":"2024-05-21T01:24:24.595498+0000","last_peered":"2024-05-21T01:24:24.595498+0000","last_clean":"2024-05-21T01:24:24.595498+0000","last_became_active":"2024-05-21T01:19:54.543586+0000","last_became_peered":"2024-05-21T01:19:54.543586+0000","last_unstale":"2024-05-21T01:24:24.595498+0000","last_undegraded":"2024-05-21T01:24:24.595498+0000","last_fullsized":"2024-05-21T01:24:24.595498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:33:02.756634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"25'3","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:23.509317+0000","last_change":"2024-05-21T01:19:53.532115+0000","last_active":"2024-05-21T01:24:23.509317+0000","last_peered":"2024-05-21T01:24:23.509317+0000","last_clean":"2024-05-21T01:24:23.509317+0000","last_became_active":"2024-05-21T01:19:53.529879+0000","last_became_peered":"2024-05-21T01:19:53.529879+0000","last_unstale":"2024-05-21T01:24:23.509317+0000","last_undegraded":"2024-05-21T01:24:23.509317+0000","last_fullsized":"2024-05-21T01:24:23.509317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:42:07.436243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"27'301","reported_seq":482,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:38.332476+0000","last_change":"2024-05-21T01:19:58.604417+0000","last_active":"2024-05-21T01:26:38.332476+0000","last_peered":"2024-05-21T01:26:38.332476+0000","last_clean":"2024-05-21T01:26:38.332476+0000","last_became_active":"2024-05-21T01:19:58.603929+0000","last_became_peered":"2024-05-21T01:19:58.603929+0000","last_unstale":"2024-05-21T01:26:38.332476+0000","last_undegraded":"2024-05-21T01:26:38.332476+0000","last_fullsized":"2024-05-21T01:26:38.332476+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":301,"log_dups_size":0,"ondisk_log_size":301,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:15:59.031738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":655360,"num_write":279,"num_write_kb":761856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:24.532734+0000","last_change":"2024-05-21T01:19:54.542096+0000","last_active":"2024-05-21T01:24:24.532734+0000","last_peered":"2024-05-21T01:24:24.532734+0000","last_clean":"2024-05-21T01:24:24.532734+0000","last_became_active":"2024-05-21T01:19:54.541837+0000","last_became_peered":"2024-05-21T01:19:54.541837+0000","last_unstale":"2024-05-21T01:24:24.532734+0000","last_undegraded":"2024-05-21T01:24:24.532734+0000","last_fullsized":"2024-05-21T01:24:24.532734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:55:30.807311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:23.503932+0000","last_change":"2024-05-21T01:19:53.551697+0000","last_active":"2024-05-21T01:24:23.503932+0000","last_peered":"2024-05-21T01:24:23.503932+0000","last_clean":"2024-05-21T01:24:23.503932+0000","last_became_active":"2024-05-21T01:19:53.550893+0000","last_became_peered":"2024-05-21T01:19:53.550893+0000","last_unstale":"2024-05-21T01:24:23.503932+0000","last_undegraded":"2024-05-21T01:24:23.503932+0000","last_fullsized":"2024-05-21T01:24:23.503932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:42:20.295229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"27'271","reported_seq":433,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:38.398598+0000","last_change":"2024-05-21T01:19:58.628526+0000","last_active":"2024-05-21T01:26:38.398598+0000","last_peered":"2024-05-21T01:26:38.398598+0000","last_clean":"2024-05-21T01:26:38.398598+0000","last_became_active":"2024-05-21T01:19:58.620667+0000","last_became_peered":"2024-05-21T01:19:58.620667+0000","last_unstale":"2024-05-21T01:26:38.398598+0000","last_undegraded":"2024-05-21T01:26:38.398598+0000","last_fullsized":"2024-05-21T01:26:38.398598+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:46:22.396063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":581632,"num_write":261,"num_write_kb":712704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:24.532798+0000","last_change":"2024-05-21T01:19:54.532551+0000","last_active":"2024-05-21T01:24:24.532798+0000","last_peered":"2024-05-21T01:24:24.532798+0000","last_clean":"2024-05-21T01:24:24.532798+0000","last_became_active":"2024-05-21T01:19:54.532251+0000","last_became_peered":"2024-05-21T01:19:54.532251+0000","last_unstale":"2024-05-21T01:24:24.532798+0000","last_undegraded":"2024-05-21T01:24:24.532798+0000","last_fullsized":"2024-05-21T01:24:24.532798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:00:30.042781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:12.468593+0000","last_change":"2024-05-21T01:19:53.554659+0000","last_active":"2024-05-21T01:22:12.468593+0000","last_peered":"2024-05-21T01:22:12.468593+0000","last_clean":"2024-05-21T01:22:12.468593+0000","last_became_active":"2024-05-21T01:19:53.553953+0000","last_became_peered":"2024-05-21T01:19:53.553953+0000","last_unstale":"2024-05-21T01:22:12.468593+0000","last_undegraded":"2024-05-21T01:22:12.468593+0000","last_fullsized":"2024-05-21T01:22:12.468593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:31:13.091061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"27'333","reported_seq":524,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:38.339710+0000","last_change":"2024-05-21T01:19:58.593243+0000","last_active":"2024-05-21T01:26:38.339710+0000","last_peered":"2024-05-21T01:26:38.339710+0000","last_clean":"2024-05-21T01:26:38.339710+0000","last_became_active":"2024-05-21T01:19:58.592758+0000","last_became_peered":"2024-05-21T01:19:58.592758+0000","last_unstale":"2024-05-21T01:26:38.339710+0000","last_undegraded":"2024-05-21T01:26:38.339710+0000","last_fullsized":"2024-05-21T01:26:38.339710+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":333,"log_dups_size":0,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:46:17.877736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":170,"num_read_kb":696320,"num_write":318,"num_write_kb":868352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:24.563495+0000","last_change":"2024-05-21T01:19:54.538391+0000","last_active":"2024-05-21T01:24:24.563495+0000","last_peered":"2024-05-21T01:24:24.563495+0000","last_clean":"2024-05-21T01:24:24.563495+0000","last_became_active":"2024-05-21T01:19:54.538106+0000","last_became_peered":"2024-05-21T01:19:54.538106+0000","last_unstale":"2024-05-21T01:24:24.563495+0000","last_undegraded":"2024-05-21T01:24:24.563495+0000","last_fullsized":"2024-05-21T01:24:24.563495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:36:07.297496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"25'2","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:24.532813+0000","last_change":"2024-05-21T01:19:53.551917+0000","last_active":"2024-05-21T01:24:24.532813+0000","last_peered":"2024-05-21T01:24:24.532813+0000","last_clean":"2024-05-21T01:24:24.532813+0000","last_became_active":"2024-05-21T01:19:53.551608+0000","last_became_peered":"2024-05-21T01:19:53.551608+0000","last_unstale":"2024-05-21T01:24:24.532813+0000","last_undegraded":"2024-05-21T01:24:24.532813+0000","last_fullsized":"2024-05-21T01:24:24.532813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:20:54.093966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"27'274","reported_seq":430,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:37.753529+0000","last_change":"2024-05-21T01:19:58.613367+0000","last_active":"2024-05-21T01:26:37.753529+0000","last_peered":"2024-05-21T01:26:37.753529+0000","last_clean":"2024-05-21T01:26:37.753529+0000","last_became_active":"2024-05-21T01:19:58.612950+0000","last_became_peered":"2024-05-21T01:19:58.612950+0000","last_unstale":"2024-05-21T01:26:37.753529+0000","last_undegraded":"2024-05-21T01:26:37.753529+0000","last_fullsized":"2024-05-21T01:26:37.753529+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:32:12.365734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":135,"num_read_kb":552960,"num_write":258,"num_write_kb":704512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:14.476560+0000","last_change":"2024-05-21T01:19:54.548979+0000","last_active":"2024-05-21T01:22:14.476560+0000","last_peered":"2024-05-21T01:22:14.476560+0000","last_clean":"2024-05-21T01:22:14.476560+0000","last_became_active":"2024-05-21T01:19:54.548704+0000","last_became_peered":"2024-05-21T01:19:54.548704+0000","last_unstale":"2024-05-21T01:22:14.476560+0000","last_undegraded":"2024-05-21T01:22:14.476560+0000","last_fullsized":"2024-05-21T01:22:14.476560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:57:09.076705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"25'15","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:17.469218+0000","last_change":"2024-05-21T01:19:53.542425+0000","last_active":"2024-05-21T01:22:17.469218+0000","last_peered":"2024-05-21T01:22:17.469218+0000","last_clean":"2024-05-21T01:22:17.469218+0000","last_became_active":"2024-05-21T01:19:53.541577+0000","last_became_peered":"2024-05-21T01:19:53.541577+0000","last_unstale":"2024-05-21T01:22:17.469218+0000","last_undegraded":"2024-05-21T01:22:17.469218+0000","last_fullsized":"2024-05-21T01:22:17.469218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:47:54.892789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"27'384","reported_seq":612,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:38.426942+0000","last_change":"2024-05-21T01:20:43.554019+0000","last_active":"2024-05-21T01:26:38.426942+0000","last_peered":"2024-05-21T01:26:38.426942+0000","last_clean":"2024-05-21T01:26:38.426942+0000","last_became_active":"2024-05-21T01:20:43.553035+0000","last_became_peered":"2024-05-21T01:20:43.553035+0000","last_unstale":"2024-05-21T01:26:38.426942+0000","last_undegraded":"2024-05-21T01:26:38.426942+0000","last_fullsized":"2024-05-21T01:26:38.426942+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:00:23.785030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":201,"num_read_kb":823296,"num_write":360,"num_write_kb":983040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1,6],"acting":[5,0,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:14.467762+0000","last_change":"2024-05-21T01:19:54.575541+0000","last_active":"2024-05-21T01:22:14.467762+0000","last_peered":"2024-05-21T01:22:14.467762+0000","last_clean":"2024-05-21T01:22:14.467762+0000","last_became_active":"2024-05-21T01:19:54.575314+0000","last_became_peered":"2024-05-21T01:19:54.575314+0000","last_unstale":"2024-05-21T01:22:14.467762+0000","last_undegraded":"2024-05-21T01:22:14.467762+0000","last_fullsized":"2024-05-21T01:22:14.467762+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:02:36.840590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"25'3","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:14.483933+0000","last_change":"2024-05-21T01:19:53.523758+0000","last_active":"2024-05-21T01:22:14.483933+0000","last_peered":"2024-05-21T01:22:14.483933+0000","last_clean":"2024-05-21T01:22:14.483933+0000","last_became_active":"2024-05-21T01:19:53.523273+0000","last_became_peered":"2024-05-21T01:19:53.523273+0000","last_unstale":"2024-05-21T01:22:14.483933+0000","last_undegraded":"2024-05-21T01:22:14.483933+0000","last_fullsized":"2024-05-21T01:22:14.483933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:05:47.275193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"27'288","reported_seq":455,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:38.413187+0000","last_change":"2024-05-21T01:19:58.621996+0000","last_active":"2024-05-21T01:26:38.413187+0000","last_peered":"2024-05-21T01:26:38.413187+0000","last_clean":"2024-05-21T01:26:38.413187+0000","last_became_active":"2024-05-21T01:19:58.620552+0000","last_became_peered":"2024-05-21T01:19:58.620552+0000","last_unstale":"2024-05-21T01:26:38.413187+0000","last_undegraded":"2024-05-21T01:26:38.413187+0000","last_fullsized":"2024-05-21T01:26:38.413187+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:58:32.635003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":602112,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:14.476602+0000","last_change":"2024-05-21T01:19:54.557379+0000","last_active":"2024-05-21T01:22:14.476602+0000","last_peered":"2024-05-21T01:22:14.476602+0000","last_clean":"2024-05-21T01:22:14.476602+0000","last_became_active":"2024-05-21T01:19:54.550335+0000","last_became_peered":"2024-05-21T01:19:54.550335+0000","last_unstale":"2024-05-21T01:22:14.476602+0000","last_undegraded":"2024-05-21T01:22:14.476602+0000","last_fullsized":"2024-05-21T01:22:14.476602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:24:52.297888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"25'3","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:14.476584+0000","last_change":"2024-05-21T01:19:53.534431+0000","last_active":"2024-05-21T01:22:14.476584+0000","last_peered":"2024-05-21T01:22:14.476584+0000","last_clean":"2024-05-21T01:22:14.476584+0000","last_became_active":"2024-05-21T01:19:53.534174+0000","last_became_peered":"2024-05-21T01:19:53.534174+0000","last_unstale":"2024-05-21T01:22:14.476584+0000","last_undegraded":"2024-05-21T01:22:14.476584+0000","last_fullsized":"2024-05-21T01:22:14.476584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:42:04.743914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"27'287","reported_seq":453,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:37.857440+0000","last_change":"2024-05-21T01:19:58.609289+0000","last_active":"2024-05-21T01:26:37.857440+0000","last_peered":"2024-05-21T01:26:37.857440+0000","last_clean":"2024-05-21T01:26:37.857440+0000","last_became_active":"2024-05-21T01:19:58.608371+0000","last_became_peered":"2024-05-21T01:19:58.608371+0000","last_unstale":"2024-05-21T01:26:37.857440+0000","last_undegraded":"2024-05-21T01:26:37.857440+0000","last_fullsized":"2024-05-21T01:26:37.857440+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":287,"log_dups_size":0,"ondisk_log_size":287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:27:36.997803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":598016,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"27'1","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:42.739115+0000","last_change":"2024-05-21T01:19:54.551617+0000","last_active":"2024-05-21T01:22:42.739115+0000","last_peered":"2024-05-21T01:22:42.739115+0000","last_clean":"2024-05-21T01:22:42.739115+0000","last_became_active":"2024-05-21T01:19:54.550865+0000","last_became_peered":"2024-05-21T01:19:54.550865+0000","last_unstale":"2024-05-21T01:22:42.739115+0000","last_undegraded":"2024-05-21T01:22:42.739115+0000","last_fullsized":"2024-05-21T01:22:42.739115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:32:44.168265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"25'6","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:17.471297+0000","last_change":"2024-05-21T01:19:53.535936+0000","last_active":"2024-05-21T01:22:17.471297+0000","last_peered":"2024-05-21T01:22:17.471297+0000","last_clean":"2024-05-21T01:22:17.471297+0000","last_became_active":"2024-05-21T01:19:53.535143+0000","last_became_peered":"2024-05-21T01:19:53.535143+0000","last_unstale":"2024-05-21T01:22:17.471297+0000","last_undegraded":"2024-05-21T01:22:17.471297+0000","last_fullsized":"2024-05-21T01:22:17.471297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:50:51.433726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"27'338","reported_seq":542,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:37.816577+0000","last_change":"2024-05-21T01:19:58.622615+0000","last_active":"2024-05-21T01:26:37.816577+0000","last_peered":"2024-05-21T01:26:37.816577+0000","last_clean":"2024-05-21T01:26:37.816577+0000","last_became_active":"2024-05-21T01:19:58.622250+0000","last_became_peered":"2024-05-21T01:19:58.622250+0000","last_unstale":"2024-05-21T01:26:37.816577+0000","last_undegraded":"2024-05-21T01:26:37.816577+0000","last_fullsized":"2024-05-21T01:26:37.816577+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:05:22.913945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":184,"num_read_kb":753664,"num_write":327,"num_write_kb":892928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:19.484407+0000","last_change":"2024-05-21T01:19:54.558348+0000","last_active":"2024-05-21T01:22:19.484407+0000","last_peered":"2024-05-21T01:22:19.484407+0000","last_clean":"2024-05-21T01:22:19.484407+0000","last_became_active":"2024-05-21T01:19:54.558095+0000","last_became_peered":"2024-05-21T01:19:54.558095+0000","last_unstale":"2024-05-21T01:22:19.484407+0000","last_undegraded":"2024-05-21T01:22:19.484407+0000","last_fullsized":"2024-05-21T01:22:19.484407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:43:48.625583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'1401","reported_seq":1429,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:38.100574+0000","last_change":"2024-05-21T01:19:53.534947+0000","last_active":"2024-05-21T01:26:38.100574+0000","last_peered":"2024-05-21T01:26:38.100574+0000","last_clean":"2024-05-21T01:26:38.100574+0000","last_became_active":"2024-05-21T01:19:53.534616+0000","last_became_peered":"2024-05-21T01:19:53.534616+0000","last_unstale":"2024-05-21T01:26:38.100574+0000","last_undegraded":"2024-05-21T01:26:38.100574+0000","last_fullsized":"2024-05-21T01:26:38.100574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":1401,"log_dups_size":0,"ondisk_log_size":1401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:01:25.372035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2840812,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1401,"num_write_kb":2941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"27'292","reported_seq":472,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:37.447318+0000","last_change":"2024-05-21T01:19:58.617970+0000","last_active":"2024-05-21T01:26:37.447318+0000","last_peered":"2024-05-21T01:26:37.447318+0000","last_clean":"2024-05-21T01:26:37.447318+0000","last_became_active":"2024-05-21T01:19:58.617061+0000","last_became_peered":"2024-05-21T01:19:58.617061+0000","last_unstale":"2024-05-21T01:26:37.447318+0000","last_undegraded":"2024-05-21T01:26:37.447318+0000","last_fullsized":"2024-05-21T01:26:37.447318+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":292,"log_dups_size":0,"ondisk_log_size":292,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:48:50.703577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":160,"num_read_kb":655360,"num_write":276,"num_write_kb":786432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:14.476618+0000","last_change":"2024-05-21T01:19:54.557175+0000","last_active":"2024-05-21T01:22:14.476618+0000","last_peered":"2024-05-21T01:22:14.476618+0000","last_clean":"2024-05-21T01:22:14.476618+0000","last_became_active":"2024-05-21T01:19:54.556933+0000","last_became_peered":"2024-05-21T01:19:54.556933+0000","last_unstale":"2024-05-21T01:22:14.476618+0000","last_undegraded":"2024-05-21T01:22:14.476618+0000","last_fullsized":"2024-05-21T01:22:14.476618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:15:44.089544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"27'7","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:23:09.625489+0000","last_change":"2024-05-21T01:19:53.536780+0000","last_active":"2024-05-21T01:23:09.625489+0000","last_peered":"2024-05-21T01:23:09.625489+0000","last_clean":"2024-05-21T01:23:09.625489+0000","last_became_active":"2024-05-21T01:19:53.535768+0000","last_became_peered":"2024-05-21T01:19:53.535768+0000","last_unstale":"2024-05-21T01:23:09.625489+0000","last_undegraded":"2024-05-21T01:23:09.625489+0000","last_fullsized":"2024-05-21T01:23:09.625489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:04:14.732801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"27'320","reported_seq":514,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:38.342272+0000","last_change":"2024-05-21T01:19:58.606532+0000","last_active":"2024-05-21T01:26:38.342272+0000","last_peered":"2024-05-21T01:26:38.342272+0000","last_clean":"2024-05-21T01:26:38.342272+0000","last_became_active":"2024-05-21T01:19:58.606180+0000","last_became_peered":"2024-05-21T01:19:58.606180+0000","last_unstale":"2024-05-21T01:26:38.342272+0000","last_undegraded":"2024-05-21T01:26:38.342272+0000","last_fullsized":"2024-05-21T01:26:38.342272+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:25:31.161427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":174,"num_read_kb":712704,"num_write":297,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:23.483713+0000","last_change":"2024-05-21T01:19:54.571280+0000","last_active":"2024-05-21T01:22:23.483713+0000","last_peered":"2024-05-21T01:22:23.483713+0000","last_clean":"2024-05-21T01:22:23.483713+0000","last_became_active":"2024-05-21T01:19:54.568778+0000","last_became_peered":"2024-05-21T01:19:54.568778+0000","last_unstale":"2024-05-21T01:22:23.483713+0000","last_undegraded":"2024-05-21T01:22:23.483713+0000","last_fullsized":"2024-05-21T01:22:23.483713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:43:16.583632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"25'2","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:19.484415+0000","last_change":"2024-05-21T01:19:53.530770+0000","last_active":"2024-05-21T01:22:19.484415+0000","last_peered":"2024-05-21T01:22:19.484415+0000","last_clean":"2024-05-21T01:22:19.484415+0000","last_became_active":"2024-05-21T01:19:53.526431+0000","last_became_peered":"2024-05-21T01:19:53.526431+0000","last_unstale":"2024-05-21T01:22:19.484415+0000","last_undegraded":"2024-05-21T01:22:19.484415+0000","last_fullsized":"2024-05-21T01:22:19.484415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:08:59.892029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"27'308","reported_seq":482,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:37.507162+0000","last_change":"2024-05-21T01:19:58.611576+0000","last_active":"2024-05-21T01:26:37.507162+0000","last_peered":"2024-05-21T01:26:37.507162+0000","last_clean":"2024-05-21T01:26:37.507162+0000","last_became_active":"2024-05-21T01:19:58.610838+0000","last_became_peered":"2024-05-21T01:19:58.610838+0000","last_unstale":"2024-05-21T01:26:37.507162+0000","last_undegraded":"2024-05-21T01:26:37.507162+0000","last_fullsized":"2024-05-21T01:26:37.507162+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":308,"log_dups_size":0,"ondisk_log_size":308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:07:31.736640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":154,"num_read_kb":630784,"num_write":289,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:19.468434+0000","last_change":"2024-05-21T01:19:54.552709+0000","last_active":"2024-05-21T01:22:19.468434+0000","last_peered":"2024-05-21T01:22:19.468434+0000","last_clean":"2024-05-21T01:22:19.468434+0000","last_became_active":"2024-05-21T01:19:54.547898+0000","last_became_peered":"2024-05-21T01:19:54.547898+0000","last_unstale":"2024-05-21T01:22:19.468434+0000","last_undegraded":"2024-05-21T01:22:19.468434+0000","last_fullsized":"2024-05-21T01:22:19.468434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:20:17.933506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"27'4","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:42.723905+0000","last_change":"2024-05-21T01:19:53.534507+0000","last_active":"2024-05-21T01:22:42.723905+0000","last_peered":"2024-05-21T01:22:42.723905+0000","last_clean":"2024-05-21T01:22:42.723905+0000","last_became_active":"2024-05-21T01:19:53.534036+0000","last_became_peered":"2024-05-21T01:19:53.534036+0000","last_unstale":"2024-05-21T01:22:42.723905+0000","last_undegraded":"2024-05-21T01:22:42.723905+0000","last_fullsized":"2024-05-21T01:22:42.723905+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:01:08.218098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"27'333","reported_seq":527,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:37.225760+0000","last_change":"2024-05-21T01:19:58.608135+0000","last_active":"2024-05-21T01:26:37.225760+0000","last_peered":"2024-05-21T01:26:37.225760+0000","last_clean":"2024-05-21T01:26:37.225760+0000","last_became_active":"2024-05-21T01:19:58.607242+0000","last_became_peered":"2024-05-21T01:19:58.607242+0000","last_unstale":"2024-05-21T01:26:37.225760+0000","last_undegraded":"2024-05-21T01:26:37.225760+0000","last_fullsized":"2024-05-21T01:26:37.225760+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":333,"log_dups_size":0,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:05:26.197876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":174,"num_read_kb":712704,"num_write":318,"num_write_kb":892928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"27'274","reported_seq":451,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:37.505912+0000","last_change":"2024-05-21T01:19:58.624883+0000","last_active":"2024-05-21T01:26:37.505912+0000","last_peered":"2024-05-21T01:26:37.505912+0000","last_clean":"2024-05-21T01:26:37.505912+0000","last_became_active":"2024-05-21T01:19:58.623991+0000","last_became_peered":"2024-05-21T01:19:58.623991+0000","last_unstale":"2024-05-21T01:26:37.505912+0000","last_undegraded":"2024-05-21T01:26:37.505912+0000","last_fullsized":"2024-05-21T01:26:37.505912+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:29:26.251376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":156,"num_read_kb":638976,"num_write":260,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"27'1","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:47.497400+0000","last_change":"2024-05-21T01:19:54.549215+0000","last_active":"2024-05-21T01:24:47.497400+0000","last_peered":"2024-05-21T01:24:47.497400+0000","last_clean":"2024-05-21T01:24:47.497400+0000","last_became_active":"2024-05-21T01:19:54.548426+0000","last_became_peered":"2024-05-21T01:19:54.548426+0000","last_unstale":"2024-05-21T01:24:47.497400+0000","last_undegraded":"2024-05-21T01:24:47.497400+0000","last_fullsized":"2024-05-21T01:24:47.497400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:10:10.800391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"25'1","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:19.477048+0000","last_change":"2024-05-21T01:19:53.526106+0000","last_active":"2024-05-21T01:22:19.477048+0000","last_peered":"2024-05-21T01:22:19.477048+0000","last_clean":"2024-05-21T01:22:19.477048+0000","last_became_active":"2024-05-21T01:19:53.525786+0000","last_became_peered":"2024-05-21T01:19:53.525786+0000","last_unstale":"2024-05-21T01:22:19.477048+0000","last_undegraded":"2024-05-21T01:22:19.477048+0000","last_fullsized":"2024-05-21T01:22:19.477048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:01:05.180803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"27'277","reported_seq":450,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:38.397676+0000","last_change":"2024-05-21T01:19:58.615481+0000","last_active":"2024-05-21T01:26:38.397676+0000","last_peered":"2024-05-21T01:26:38.397676+0000","last_clean":"2024-05-21T01:26:38.397676+0000","last_became_active":"2024-05-21T01:19:58.614879+0000","last_became_peered":"2024-05-21T01:19:58.614879+0000","last_unstale":"2024-05-21T01:26:38.397676+0000","last_undegraded":"2024-05-21T01:26:38.397676+0000","last_fullsized":"2024-05-21T01:26:38.397676+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:45:57.208342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":622592,"num_write":267,"num_write_kb":729088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:23.483559+0000","last_change":"2024-05-21T01:19:54.570650+0000","last_active":"2024-05-21T01:22:23.483559+0000","last_peered":"2024-05-21T01:22:23.483559+0000","last_clean":"2024-05-21T01:22:23.483559+0000","last_became_active":"2024-05-21T01:19:54.570034+0000","last_became_peered":"2024-05-21T01:19:54.570034+0000","last_unstale":"2024-05-21T01:22:23.483559+0000","last_undegraded":"2024-05-21T01:22:23.483559+0000","last_fullsized":"2024-05-21T01:22:23.483559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:01:05.887729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"25'2","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:18.478669+0000","last_change":"2024-05-21T01:19:53.532017+0000","last_active":"2024-05-21T01:22:18.478669+0000","last_peered":"2024-05-21T01:22:18.478669+0000","last_clean":"2024-05-21T01:22:18.478669+0000","last_became_active":"2024-05-21T01:19:53.529457+0000","last_became_peered":"2024-05-21T01:19:53.529457+0000","last_unstale":"2024-05-21T01:22:18.478669+0000","last_undegraded":"2024-05-21T01:22:18.478669+0000","last_fullsized":"2024-05-21T01:22:18.478669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:58:03.979929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"25'3","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:24.486665+0000","last_change":"2024-05-21T01:19:53.525620+0000","last_active":"2024-05-21T01:22:24.486665+0000","last_peered":"2024-05-21T01:22:24.486665+0000","last_clean":"2024-05-21T01:22:24.486665+0000","last_became_active":"2024-05-21T01:19:53.525315+0000","last_became_peered":"2024-05-21T01:19:53.525315+0000","last_unstale":"2024-05-21T01:22:24.486665+0000","last_undegraded":"2024-05-21T01:22:24.486665+0000","last_fullsized":"2024-05-21T01:22:24.486665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:30:38.075463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:27.470739+0000","last_change":"2024-05-21T01:19:54.555344+0000","last_active":"2024-05-21T01:22:27.470739+0000","last_peered":"2024-05-21T01:22:27.470739+0000","last_clean":"2024-05-21T01:22:27.470739+0000","last_became_active":"2024-05-21T01:19:54.552817+0000","last_became_peered":"2024-05-21T01:19:54.552817+0000","last_unstale":"2024-05-21T01:22:27.470739+0000","last_undegraded":"2024-05-21T01:22:27.470739+0000","last_fullsized":"2024-05-21T01:22:27.470739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:10:03.810064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"27'306","reported_seq":496,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:37.366700+0000","last_change":"2024-05-21T01:19:58.619520+0000","last_active":"2024-05-21T01:26:37.366700+0000","last_peered":"2024-05-21T01:26:37.366700+0000","last_clean":"2024-05-21T01:26:37.366700+0000","last_became_active":"2024-05-21T01:19:58.617165+0000","last_became_peered":"2024-05-21T01:19:58.617165+0000","last_unstale":"2024-05-21T01:26:37.366700+0000","last_undegraded":"2024-05-21T01:26:37.366700+0000","last_fullsized":"2024-05-21T01:26:37.366700+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":306,"log_dups_size":0,"ondisk_log_size":306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T13:07:51.530746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":170,"num_read_kb":696320,"num_write":287,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"25'6","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:23.483608+0000","last_change":"2024-05-21T01:19:53.551547+0000","last_active":"2024-05-21T01:22:23.483608+0000","last_peered":"2024-05-21T01:22:23.483608+0000","last_clean":"2024-05-21T01:22:23.483608+0000","last_became_active":"2024-05-21T01:19:53.550931+0000","last_became_peered":"2024-05-21T01:19:53.550931+0000","last_unstale":"2024-05-21T01:22:23.483608+0000","last_undegraded":"2024-05-21T01:22:23.483608+0000","last_fullsized":"2024-05-21T01:22:23.483608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:13:47.329230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:24.468719+0000","last_change":"2024-05-21T01:19:54.574552+0000","last_active":"2024-05-21T01:22:24.468719+0000","last_peered":"2024-05-21T01:22:24.468719+0000","last_clean":"2024-05-21T01:22:24.468719+0000","last_became_active":"2024-05-21T01:19:54.574246+0000","last_became_peered":"2024-05-21T01:19:54.574246+0000","last_unstale":"2024-05-21T01:22:24.468719+0000","last_undegraded":"2024-05-21T01:22:24.468719+0000","last_fullsized":"2024-05-21T01:22:24.468719+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:23:33.685798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"27'316","reported_seq":508,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:37.411321+0000","last_change":"2024-05-21T01:19:58.624400+0000","last_active":"2024-05-21T01:26:37.411321+0000","last_peered":"2024-05-21T01:26:37.411321+0000","last_clean":"2024-05-21T01:26:37.411321+0000","last_became_active":"2024-05-21T01:19:58.623388+0000","last_became_peered":"2024-05-21T01:19:58.623388+0000","last_unstale":"2024-05-21T01:26:37.411321+0000","last_undegraded":"2024-05-21T01:26:37.411321+0000","last_fullsized":"2024-05-21T01:26:37.411321+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":316,"log_dups_size":0,"ondisk_log_size":316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:59:30.019393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":172,"num_read_kb":704512,"num_write":302,"num_write_kb":851968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:04.542395+0000","last_change":"2024-05-21T01:19:54.553262+0000","last_active":"2024-05-21T01:24:04.542395+0000","last_peered":"2024-05-21T01:24:04.542395+0000","last_clean":"2024-05-21T01:24:04.542395+0000","last_became_active":"2024-05-21T01:19:54.553060+0000","last_became_peered":"2024-05-21T01:19:54.553060+0000","last_unstale":"2024-05-21T01:24:04.542395+0000","last_undegraded":"2024-05-21T01:24:04.542395+0000","last_fullsized":"2024-05-21T01:24:04.542395+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:18:14.077480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:07.486721+0000","last_change":"2024-05-21T01:19:54.566851+0000","last_active":"2024-05-21T01:24:07.486721+0000","last_peered":"2024-05-21T01:24:07.486721+0000","last_clean":"2024-05-21T01:24:07.486721+0000","last_became_active":"2024-05-21T01:19:54.565573+0000","last_became_peered":"2024-05-21T01:19:54.565573+0000","last_unstale":"2024-05-21T01:24:07.486721+0000","last_undegraded":"2024-05-21T01:24:07.486721+0000","last_fullsized":"2024-05-21T01:24:07.486721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:51:30.883954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:04.555306+0000","last_change":"2024-05-21T01:19:54.566934+0000","last_active":"2024-05-21T01:24:04.555306+0000","last_peered":"2024-05-21T01:24:04.555306+0000","last_clean":"2024-05-21T01:24:04.555306+0000","last_became_active":"2024-05-21T01:19:54.566503+0000","last_became_peered":"2024-05-21T01:19:54.566503+0000","last_unstale":"2024-05-21T01:24:04.555306+0000","last_undegraded":"2024-05-21T01:24:04.555306+0000","last_fullsized":"2024-05-21T01:24:04.555306+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:14:54.262165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:08.498777+0000","last_change":"2024-05-21T01:19:54.573091+0000","last_active":"2024-05-21T01:24:08.498777+0000","last_peered":"2024-05-21T01:24:08.498777+0000","last_clean":"2024-05-21T01:24:08.498777+0000","last_became_active":"2024-05-21T01:19:54.572366+0000","last_became_peered":"2024-05-21T01:19:54.572366+0000","last_unstale":"2024-05-21T01:24:08.498777+0000","last_undegraded":"2024-05-21T01:24:08.498777+0000","last_fullsized":"2024-05-21T01:24:08.498777+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:10:09.353807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:18.508498+0000","last_change":"2024-05-21T01:19:54.563339+0000","last_active":"2024-05-21T01:24:18.508498+0000","last_peered":"2024-05-21T01:24:18.508498+0000","last_clean":"2024-05-21T01:24:18.508498+0000","last_became_active":"2024-05-21T01:19:54.557934+0000","last_became_peered":"2024-05-21T01:19:54.557934+0000","last_unstale":"2024-05-21T01:24:18.508498+0000","last_undegraded":"2024-05-21T01:24:18.508498+0000","last_fullsized":"2024-05-21T01:24:18.508498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:46:21.598689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:18.508542+0000","last_change":"2024-05-21T01:19:54.553551+0000","last_active":"2024-05-21T01:24:18.508542+0000","last_peered":"2024-05-21T01:24:18.508542+0000","last_clean":"2024-05-21T01:24:18.508542+0000","last_became_active":"2024-05-21T01:19:54.552812+0000","last_became_peered":"2024-05-21T01:19:54.552812+0000","last_unstale":"2024-05-21T01:24:18.508542+0000","last_undegraded":"2024-05-21T01:24:18.508542+0000","last_fullsized":"2024-05-21T01:24:18.508542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:27:41.166606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:14.543296+0000","last_change":"2024-05-21T01:19:54.548604+0000","last_active":"2024-05-21T01:24:14.543296+0000","last_peered":"2024-05-21T01:24:14.543296+0000","last_clean":"2024-05-21T01:24:14.543296+0000","last_became_active":"2024-05-21T01:19:54.548263+0000","last_became_peered":"2024-05-21T01:19:54.548263+0000","last_unstale":"2024-05-21T01:24:14.543296+0000","last_undegraded":"2024-05-21T01:24:14.543296+0000","last_fullsized":"2024-05-21T01:24:14.543296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:33:55.302088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:18.503082+0000","last_change":"2024-05-21T01:19:54.573995+0000","last_active":"2024-05-21T01:24:18.503082+0000","last_peered":"2024-05-21T01:24:18.503082+0000","last_clean":"2024-05-21T01:24:18.503082+0000","last_became_active":"2024-05-21T01:19:54.570373+0000","last_became_peered":"2024-05-21T01:19:54.570373+0000","last_unstale":"2024-05-21T01:24:18.503082+0000","last_undegraded":"2024-05-21T01:24:18.503082+0000","last_fullsized":"2024-05-21T01:24:18.503082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:44:23.194713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:14.556285+0000","last_change":"2024-05-21T01:19:54.575196+0000","last_active":"2024-05-21T01:24:14.556285+0000","last_peered":"2024-05-21T01:24:14.556285+0000","last_clean":"2024-05-21T01:24:14.556285+0000","last_became_active":"2024-05-21T01:19:54.574945+0000","last_became_peered":"2024-05-21T01:19:54.574945+0000","last_unstale":"2024-05-21T01:24:14.556285+0000","last_undegraded":"2024-05-21T01:24:14.556285+0000","last_fullsized":"2024-05-21T01:24:14.556285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:52:56.244771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:13.481163+0000","last_change":"2024-05-21T01:19:54.566719+0000","last_active":"2024-05-21T01:22:13.481163+0000","last_peered":"2024-05-21T01:22:13.481163+0000","last_clean":"2024-05-21T01:22:13.481163+0000","last_became_active":"2024-05-21T01:19:54.565922+0000","last_became_peered":"2024-05-21T01:19:54.565922+0000","last_unstale":"2024-05-21T01:22:13.481163+0000","last_undegraded":"2024-05-21T01:22:13.481163+0000","last_fullsized":"2024-05-21T01:22:13.481163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:39:19.454688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:24.517869+0000","last_change":"2024-05-21T01:19:54.536815+0000","last_active":"2024-05-21T01:24:24.517869+0000","last_peered":"2024-05-21T01:24:24.517869+0000","last_clean":"2024-05-21T01:24:24.517869+0000","last_became_active":"2024-05-21T01:19:54.535957+0000","last_became_peered":"2024-05-21T01:19:54.535957+0000","last_unstale":"2024-05-21T01:24:24.517869+0000","last_undegraded":"2024-05-21T01:24:24.517869+0000","last_fullsized":"2024-05-21T01:24:24.517869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:24:53.906256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:12.468542+0000","last_change":"2024-05-21T01:19:54.552466+0000","last_active":"2024-05-21T01:22:12.468542+0000","last_peered":"2024-05-21T01:22:12.468542+0000","last_clean":"2024-05-21T01:22:12.468542+0000","last_became_active":"2024-05-21T01:19:54.551790+0000","last_became_peered":"2024-05-21T01:19:54.551790+0000","last_unstale":"2024-05-21T01:22:12.468542+0000","last_undegraded":"2024-05-21T01:22:12.468542+0000","last_fullsized":"2024-05-21T01:22:12.468542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:24:34.737707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:24.532708+0000","last_change":"2024-05-21T01:19:54.535314+0000","last_active":"2024-05-21T01:24:24.532708+0000","last_peered":"2024-05-21T01:24:24.532708+0000","last_clean":"2024-05-21T01:24:24.532708+0000","last_became_active":"2024-05-21T01:19:54.534793+0000","last_became_peered":"2024-05-21T01:19:54.534793+0000","last_unstale":"2024-05-21T01:24:24.532708+0000","last_undegraded":"2024-05-21T01:24:24.532708+0000","last_fullsized":"2024-05-21T01:24:24.532708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:52:35.492250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:24.595517+0000","last_change":"2024-05-21T01:19:54.556323+0000","last_active":"2024-05-21T01:24:24.595517+0000","last_peered":"2024-05-21T01:24:24.595517+0000","last_clean":"2024-05-21T01:24:24.595517+0000","last_became_active":"2024-05-21T01:19:54.556043+0000","last_became_peered":"2024-05-21T01:19:54.556043+0000","last_unstale":"2024-05-21T01:24:24.595517+0000","last_undegraded":"2024-05-21T01:24:24.595517+0000","last_fullsized":"2024-05-21T01:24:24.595517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:34:02.068527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:17.471339+0000","last_change":"2024-05-21T01:19:54.567457+0000","last_active":"2024-05-21T01:22:17.471339+0000","last_peered":"2024-05-21T01:22:17.471339+0000","last_clean":"2024-05-21T01:22:17.471339+0000","last_became_active":"2024-05-21T01:19:54.565326+0000","last_became_peered":"2024-05-21T01:19:54.565326+0000","last_unstale":"2024-05-21T01:22:17.471339+0000","last_undegraded":"2024-05-21T01:22:17.471339+0000","last_fullsized":"2024-05-21T01:22:17.471339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:11:05.775389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:14.476659+0000","last_change":"2024-05-21T01:19:54.562078+0000","last_active":"2024-05-21T01:22:14.476659+0000","last_peered":"2024-05-21T01:22:14.476659+0000","last_clean":"2024-05-21T01:22:14.476659+0000","last_became_active":"2024-05-21T01:19:54.558286+0000","last_became_peered":"2024-05-21T01:19:54.558286+0000","last_unstale":"2024-05-21T01:22:14.476659+0000","last_undegraded":"2024-05-21T01:22:14.476659+0000","last_fullsized":"2024-05-21T01:22:14.476659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T09:09:58.360014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:14.476530+0000","last_change":"2024-05-21T01:19:54.548274+0000","last_active":"2024-05-21T01:22:14.476530+0000","last_peered":"2024-05-21T01:22:14.476530+0000","last_clean":"2024-05-21T01:22:14.476530+0000","last_became_active":"2024-05-21T01:19:54.548079+0000","last_became_peered":"2024-05-21T01:19:54.548079+0000","last_unstale":"2024-05-21T01:22:14.476530+0000","last_undegraded":"2024-05-21T01:22:14.476530+0000","last_fullsized":"2024-05-21T01:22:14.476530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:49:03.296571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:18.482423+0000","last_change":"2024-05-21T01:19:54.568211+0000","last_active":"2024-05-21T01:22:18.482423+0000","last_peered":"2024-05-21T01:22:18.482423+0000","last_clean":"2024-05-21T01:22:18.482423+0000","last_became_active":"2024-05-21T01:19:54.567512+0000","last_became_peered":"2024-05-21T01:19:54.567512+0000","last_unstale":"2024-05-21T01:22:18.482423+0000","last_undegraded":"2024-05-21T01:22:18.482423+0000","last_fullsized":"2024-05-21T01:22:18.482423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:32:18.004763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:18.478735+0000","last_change":"2024-05-21T01:19:54.556683+0000","last_active":"2024-05-21T01:22:18.478735+0000","last_peered":"2024-05-21T01:22:18.478735+0000","last_clean":"2024-05-21T01:22:18.478735+0000","last_became_active":"2024-05-21T01:19:54.555947+0000","last_became_peered":"2024-05-21T01:19:54.555947+0000","last_unstale":"2024-05-21T01:22:18.478735+0000","last_undegraded":"2024-05-21T01:22:18.478735+0000","last_fullsized":"2024-05-21T01:22:18.478735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:59:04.593946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:23.479642+0000","last_change":"2024-05-21T01:19:54.560218+0000","last_active":"2024-05-21T01:22:23.479642+0000","last_peered":"2024-05-21T01:22:23.479642+0000","last_clean":"2024-05-21T01:22:23.479642+0000","last_became_active":"2024-05-21T01:19:54.557787+0000","last_became_peered":"2024-05-21T01:19:54.557787+0000","last_unstale":"2024-05-21T01:22:23.479642+0000","last_undegraded":"2024-05-21T01:22:23.479642+0000","last_fullsized":"2024-05-21T01:22:23.479642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:05:48.282563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:19.484381+0000","last_change":"2024-05-21T01:19:54.535096+0000","last_active":"2024-05-21T01:22:19.484381+0000","last_peered":"2024-05-21T01:22:19.484381+0000","last_clean":"2024-05-21T01:22:19.484381+0000","last_became_active":"2024-05-21T01:19:54.534472+0000","last_became_peered":"2024-05-21T01:19:54.534472+0000","last_unstale":"2024-05-21T01:22:19.484381+0000","last_undegraded":"2024-05-21T01:22:19.484381+0000","last_fullsized":"2024-05-21T01:22:19.484381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:05:40.018457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:19.484397+0000","last_change":"2024-05-21T01:19:54.546352+0000","last_active":"2024-05-21T01:22:19.484397+0000","last_peered":"2024-05-21T01:22:19.484397+0000","last_clean":"2024-05-21T01:22:19.484397+0000","last_became_active":"2024-05-21T01:19:54.546055+0000","last_became_peered":"2024-05-21T01:19:54.546055+0000","last_unstale":"2024-05-21T01:22:19.484397+0000","last_undegraded":"2024-05-21T01:22:19.484397+0000","last_fullsized":"2024-05-21T01:22:19.484397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:14:56.268312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"27'1","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:23:12.478847+0000","last_change":"2024-05-21T01:20:43.551219+0000","last_active":"2024-05-21T01:23:12.478847+0000","last_peered":"2024-05-21T01:23:12.478847+0000","last_clean":"2024-05-21T01:23:12.478847+0000","last_became_active":"2024-05-21T01:20:43.550179+0000","last_became_peered":"2024-05-21T01:20:43.550179+0000","last_unstale":"2024-05-21T01:23:12.478847+0000","last_undegraded":"2024-05-21T01:23:12.478847+0000","last_fullsized":"2024-05-21T01:23:12.478847+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:00:31.919441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:19.468196+0000","last_change":"2024-05-21T01:19:54.548954+0000","last_active":"2024-05-21T01:22:19.468196+0000","last_peered":"2024-05-21T01:22:19.468196+0000","last_clean":"2024-05-21T01:22:19.468196+0000","last_became_active":"2024-05-21T01:19:54.547528+0000","last_became_peered":"2024-05-21T01:19:54.547528+0000","last_unstale":"2024-05-21T01:22:19.468196+0000","last_undegraded":"2024-05-21T01:22:19.468196+0000","last_fullsized":"2024-05-21T01:22:19.468196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:47:24.598610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:28.484197+0000","last_change":"2024-05-21T01:19:54.575256+0000","last_active":"2024-05-21T01:22:28.484197+0000","last_peered":"2024-05-21T01:22:28.484197+0000","last_clean":"2024-05-21T01:22:28.484197+0000","last_became_active":"2024-05-21T01:19:54.570119+0000","last_became_peered":"2024-05-21T01:19:54.570119+0000","last_unstale":"2024-05-21T01:22:28.484197+0000","last_undegraded":"2024-05-21T01:22:28.484197+0000","last_fullsized":"2024-05-21T01:22:28.484197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:10:02.800110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:24.484926+0000","last_change":"2024-05-21T01:19:54.550134+0000","last_active":"2024-05-21T01:22:24.484926+0000","last_peered":"2024-05-21T01:22:24.484926+0000","last_clean":"2024-05-21T01:22:24.484926+0000","last_became_active":"2024-05-21T01:19:54.549617+0000","last_became_peered":"2024-05-21T01:19:54.549617+0000","last_unstale":"2024-05-21T01:22:24.484926+0000","last_undegraded":"2024-05-21T01:22:24.484926+0000","last_fullsized":"2024-05-21T01:22:24.484926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:34:59.845458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:24.469102+0000","last_change":"2024-05-21T01:19:54.555653+0000","last_active":"2024-05-21T01:22:24.469102+0000","last_peered":"2024-05-21T01:22:24.469102+0000","last_clean":"2024-05-21T01:22:24.469102+0000","last_became_active":"2024-05-21T01:19:54.555274+0000","last_became_peered":"2024-05-21T01:19:54.555274+0000","last_unstale":"2024-05-21T01:22:24.469102+0000","last_undegraded":"2024-05-21T01:22:24.469102+0000","last_fullsized":"2024-05-21T01:22:24.469102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:43:43.237853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:24.484953+0000","last_change":"2024-05-21T01:19:54.568866+0000","last_active":"2024-05-21T01:22:24.484953+0000","last_peered":"2024-05-21T01:22:24.484953+0000","last_clean":"2024-05-21T01:22:24.484953+0000","last_became_active":"2024-05-21T01:19:54.568605+0000","last_became_peered":"2024-05-21T01:19:54.568605+0000","last_unstale":"2024-05-21T01:22:24.484953+0000","last_undegraded":"2024-05-21T01:22:24.484953+0000","last_fullsized":"2024-05-21T01:22:24.484953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:21:20.820620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:23:54.541542+0000","last_change":"2024-05-21T01:19:54.557468+0000","last_active":"2024-05-21T01:23:54.541542+0000","last_peered":"2024-05-21T01:23:54.541542+0000","last_clean":"2024-05-21T01:23:54.541542+0000","last_became_active":"2024-05-21T01:19:54.554976+0000","last_became_peered":"2024-05-21T01:19:54.554976+0000","last_unstale":"2024-05-21T01:23:54.541542+0000","last_undegraded":"2024-05-21T01:23:54.541542+0000","last_fullsized":"2024-05-21T01:23:54.541542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:25:08.737348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:08.498825+0000","last_change":"2024-05-21T01:19:54.566991+0000","last_active":"2024-05-21T01:24:08.498825+0000","last_peered":"2024-05-21T01:24:08.498825+0000","last_clean":"2024-05-21T01:24:08.498825+0000","last_became_active":"2024-05-21T01:19:54.566349+0000","last_became_peered":"2024-05-21T01:19:54.566349+0000","last_unstale":"2024-05-21T01:24:08.498825+0000","last_undegraded":"2024-05-21T01:24:08.498825+0000","last_fullsized":"2024-05-21T01:24:08.498825+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:25:43.468081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:08.498850+0000","last_change":"2024-05-21T01:19:54.576100+0000","last_active":"2024-05-21T01:24:08.498850+0000","last_peered":"2024-05-21T01:24:08.498850+0000","last_clean":"2024-05-21T01:24:08.498850+0000","last_became_active":"2024-05-21T01:19:54.574914+0000","last_became_peered":"2024-05-21T01:19:54.574914+0000","last_unstale":"2024-05-21T01:24:08.498850+0000","last_undegraded":"2024-05-21T01:24:08.498850+0000","last_fullsized":"2024-05-21T01:24:08.498850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:29:30.730283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:04.508300+0000","last_change":"2024-05-21T01:19:54.546570+0000","last_active":"2024-05-21T01:24:04.508300+0000","last_peered":"2024-05-21T01:24:04.508300+0000","last_clean":"2024-05-21T01:24:04.508300+0000","last_became_active":"2024-05-21T01:19:54.546284+0000","last_became_peered":"2024-05-21T01:19:54.546284+0000","last_unstale":"2024-05-21T01:24:04.508300+0000","last_undegraded":"2024-05-21T01:24:04.508300+0000","last_fullsized":"2024-05-21T01:24:04.508300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:36:30.219522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":369098752,"num_objects":88,"num_object_clones":0,"num_object_copies":352,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":5128,"num_read_kb":21004288,"num_write":9128,"num_write_kb":25165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45219840,"data_stored":723517440,"data_compressed":35826240,"data_compressed_allocated":45219840,"data_compressed_original":723517440,"omap_allocated":0,"internal_metadata":0},"log_size":9643,"ondisk_log_size":9643,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2845007,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":1580,"num_write_kb":3000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":5840896,"data_stored":5682172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1542,"ondisk_log_size":1542,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66932,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509527,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49516,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94322324,"statfs":{"total":96636764160,"available":96586059776,"internally_reserved":0,"allocated":299008,"data_stored":117691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":50395592},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509527,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48124,"kb_used_data":3060,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94323716,"statfs":{"total":96636764160,"available":96587485184,"internally_reserved":0,"allocated":3133440,"data_stored":2953815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509525,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49572,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94322268,"statfs":{"total":96636764160,"available":96586002432,"internally_reserved":0,"allocated":356352,"data_stored":706993,"data_compressed":33466,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509525,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35632,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336208,"statfs":{"total":96636764160,"available":96600276992,"internally_reserved":0,"allocated":303104,"data_stored":117781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542230,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56296,"kb_used_data":7072,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94315544,"statfs":{"total":96636764160,"available":96579117056,"internally_reserved":0,"allocated":7241728,"data_stored":111266983,"data_compressed":5474816,"data_compressed_allocated":6946816,"data_compressed_original":111149056,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542230,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63348,"kb_used_data":18284,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94308492,"statfs":{"total":96636764160,"available":96571895808,"internally_reserved":0,"allocated":18722816,"data_stored":294309502,"data_compressed":14325786,"data_compressed_allocated":18395136,"data_compressed_original":294174720,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,1,1,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574933,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":119288,"kb_used_data":70064,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94252552,"statfs":{"total":96636764160,"available":96514613248,"internally_reserved":0,"allocated":71745536,"data_stored":1143065540,"data_compressed":56865920,"data_compressed_allocated":71434240,"data_compressed_original":1142947840,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574933,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":110548,"kb_used_data":61324,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94261292,"statfs":{"total":96636764160,"available":96523563008,"internally_reserved":0,"allocated":62795776,"data_stored":957155163,"data_compressed":47020064,"data_compressed_allocated":59637760,"data_compressed_original":954204160,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33466,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33466,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2854912,"data_stored":2840846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":2875392,"data_stored":2834538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20054016,"data_stored":320864256,"data_compressed":15825312,"data_compressed_allocated":20054016,"data_compressed_original":320864256,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":25165824,"data_stored":402653184,"data_compressed":20000928,"data_compressed_allocated":25165824,"data_compressed_original":402653184,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-21T01:26:41.020 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-21T01:26:41.020 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-21T01:26:41.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.197+0000 7fadb6800640 1 Processor -- start 2024-05-21T01:26:41.201 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.197+0000 7fadb6800640 1 -- start start 2024-05-21T01:26:41.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.197+0000 7fadb6800640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fadb006f5d0 0x7fadb00c8a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:41.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.197+0000 7fadb6800640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fadb015ce40 0x7fadb0072d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:41.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.197+0000 7fadb6800640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadb0072550 con 0x7fadb006f9b0 2024-05-21T01:26:41.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.197+0000 7fadb6800640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7fadb0159100 con 0x7fadb015ce40 2024-05-21T01:26:41.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.197+0000 7fadb6800640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fadb01593e0 con 0x7fadb006f5d0 2024-05-21T01:26:41.202 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.197+0000 7fadafe00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fadb015ce40 0x7fadb0072d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:41.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.197+0000 7fadafe00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fadb015ce40 0x7fadb0072d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48092/0 (socket says 172.21.15.63:48092) 2024-05-21T01:26:41.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.197+0000 7fadafe00640 1 -- 172.21.15.63:0/875924529 learned_addr learned my addr 172.21.15.63:0/875924529 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:26:41.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.197+0000 7fadaf400640 1 --2- 172.21.15.63:0/875924529 >> v2:172.21.15.131:3300/0 conn(0x7fadb006f5d0 0x7fadb00c8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:41.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.197+0000 7fadafe00640 1 -- 172.21.15.63:0/875924529 >> v2:172.21.15.131:3300/0 conn(0x7fadb006f5d0 msgr2=0x7fadb00c8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:26:41.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.197+0000 7fadafe00640 1 --2- 172.21.15.63:0/875924529 >> v2:172.21.15.131:3300/0 conn(0x7fadb006f5d0 0x7fadb00c8a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:41.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.197+0000 7fadafe00640 1 -- 172.21.15.63:0/875924529 >> v1:172.21.15.131:6789/0 conn(0x7fadb006f9b0 legacy=0x7fadb0152a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:41.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.197+0000 7fadafe00640 1 -- 172.21.15.63:0/875924529 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadb01596c0 con 0x7fadb015ce40 2024-05-21T01:26:41.203 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.197+0000 7fadaf400640 1 --2- 172.21.15.63:0/875924529 >> v2:172.21.15.131:3300/0 conn(0x7fadb006f5d0 0x7fadb00c8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T01:26:41.205 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.201+0000 7fadafe00640 1 --2- 172.21.15.63:0/875924529 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fadb015ce40 0x7fadb0072d20 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fadb00caef0 tx=0x7fada801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28692b197f752e9f server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:41.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.201+0000 7fadaea00640 1 -- 172.21.15.63:0/875924529 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fada80a57a0 con 0x7fadb015ce40 2024-05-21T01:26:41.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.201+0000 7fadaea00640 1 -- 172.21.15.63:0/875924529 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fada80a5940 con 0x7fadb015ce40 2024-05-21T01:26:41.206 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.201+0000 7fadaea00640 1 -- 172.21.15.63:0/875924529 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fada80a5d10 con 0x7fadb015ce40 2024-05-21T01:26:41.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.201+0000 7fadb6800640 1 -- 172.21.15.63:0/875924529 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fadb015ce40 msgr2=0x7fadb0072d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:41.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.201+0000 7fadb6800640 1 --2- 172.21.15.63:0/875924529 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fadb015ce40 0x7fadb0072d20 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fadb00caef0 tx=0x7fada801c9f0 comp rx=0 tx=0).stop 2024-05-21T01:26:41.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.201+0000 7fadb6800640 1 -- 172.21.15.63:0/875924529 shutdown_connections 2024-05-21T01:26:41.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.201+0000 7fadb6800640 1 --2- 172.21.15.63:0/875924529 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fadb015ce40 0x7fadb0072d20 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:41.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.201+0000 7fadb6800640 1 --2- 172.21.15.63:0/875924529 >> v2:172.21.15.131:3300/0 conn(0x7fadb006f5d0 0x7fadb00c8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:41.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.201+0000 7fadb6800640 1 -- 172.21.15.63:0/875924529 >> 172.21.15.63:0/875924529 conn(0x7fadb0068460 msgr2=0x7fadb0068870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:26:41.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.201+0000 7fadb6800640 1 -- 172.21.15.63:0/875924529 shutdown_connections 2024-05-21T01:26:41.207 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.201+0000 7fadb6800640 1 -- 172.21.15.63:0/875924529 wait complete. 2024-05-21T01:26:41.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.205+0000 7fadb6800640 1 Processor -- start 2024-05-21T01:26:41.208 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.205+0000 7fadb6800640 1 -- start start 2024-05-21T01:26:41.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.205+0000 7fadb6800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fadb006f5d0 0x7fadb006c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:41.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.205+0000 7fadb6800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fadb006f9b0 0x7fadb0159fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:41.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.205+0000 7fadb6800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fadb015ce40 0x7fadb015a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:41.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.205+0000 7fadb6800640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fadb0153150 con 0x7fadb015ce40 2024-05-21T01:26:41.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.205+0000 7fadb6800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fadb0073670 con 0x7fadb006f9b0 2024-05-21T01:26:41.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.205+0000 7fadb6800640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fadb01532d0 con 0x7fadb006f5d0 2024-05-21T01:26:41.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.205+0000 7fadafe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fadb015ce40 0x7fadb015a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:41.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.205+0000 7fadafe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fadb015ce40 0x7fadb015a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48100/0 (socket says 172.21.15.63:48100) 2024-05-21T01:26:41.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.205+0000 7fadafe00640 1 -- 172.21.15.63:0/280694460 learned_addr learned my addr 172.21.15.63:0/280694460 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:26:41.210 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.205+0000 7fada7e00640 1 --2- 172.21.15.63:0/280694460 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fadb006f9b0 0x7fadb0159fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:41.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.205+0000 7fadaf400640 1 --2- 172.21.15.63:0/280694460 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fadb006f5d0 0x7fadb006c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:41.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.205+0000 7fadafe00640 1 -- 172.21.15.63:0/280694460 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fadb006f5d0 msgr2=0x7fadb006c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:41.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.205+0000 7fadafe00640 1 --2- 172.21.15.63:0/280694460 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fadb006f5d0 0x7fadb006c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:41.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.205+0000 7fadafe00640 1 -- 172.21.15.63:0/280694460 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fadb006f9b0 msgr2=0x7fadb0159fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:41.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.205+0000 7fadafe00640 1 --2- 172.21.15.63:0/280694460 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fadb006f9b0 0x7fadb0159fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:41.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.205+0000 7fadafe00640 1 -- 172.21.15.63:0/280694460 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadb0075ac0 con 0x7fadb015ce40 2024-05-21T01:26:41.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.205+0000 7fadaf400640 1 --2- 172.21.15.63:0/280694460 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fadb006f5d0 0x7fadb006c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T01:26:41.211 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.205+0000 7fadafe00640 1 --2- 172.21.15.63:0/280694460 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fadb015ce40 0x7fadb015a520 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fada8019600 tx=0x7fada8019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:41.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.205+0000 7fada7400640 1 -- 172.21.15.63:0/280694460 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fada80b8670 con 0x7fadb015ce40 2024-05-21T01:26:41.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.205+0000 7fada7400640 1 -- 172.21.15.63:0/280694460 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fada80be070 con 0x7fadb015ce40 2024-05-21T01:26:41.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.205+0000 7fada7400640 1 -- 172.21.15.63:0/280694460 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fada80b8a50 con 0x7fadb015ce40 2024-05-21T01:26:41.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.205+0000 7fadb6800640 1 -- 172.21.15.63:0/280694460 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadb01513a0 con 0x7fadb015ce40 2024-05-21T01:26:41.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.205+0000 7fadb6800640 1 -- 172.21.15.63:0/280694460 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadb0151960 con 0x7fadb015ce40 2024-05-21T01:26:41.212 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.205+0000 7fadb6800640 1 -- 172.21.15.63:0/280694460 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadb00507f0 con 0x7fadb015ce40 2024-05-21T01:26:41.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.209+0000 7fada7400640 1 -- 172.21.15.63:0/280694460 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7fada80b8bf0 con 0x7fadb015ce40 2024-05-21T01:26:41.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.209+0000 7fada7400640 1 --2- 172.21.15.63:0/280694460 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fad8c06f400 0x7fad8c0718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:41.213 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.209+0000 7fada7400640 1 -- 172.21.15.63:0/280694460 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7fada812a790 con 0x7fadb015ce40 2024-05-21T01:26:41.214 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.209+0000 7fadaf400640 1 --2- 172.21.15.63:0/280694460 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fad8c06f400 0x7fad8c0718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:41.215 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.209+0000 7fadaf400640 1 --2- 172.21.15.63:0/280694460 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fad8c06f400 0x7fad8c0718c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fada000b990 tx=0x7fada0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:41.217 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.213+0000 7fada7400640 1 -- 172.21.15.63:0/280694460 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fada80165e0 con 0x7fadb015ce40 2024-05-21T01:26:41.381 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.377+0000 7fadb6800640 1 -- 172.21.15.63:0/280694460 --> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fadb0159d40 con 0x7fad8c06f400 2024-05-21T01:26:41.404 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.401+0000 7fada7400640 1 -- 172.21.15.63:0/280694460 <== mgr.4103 v2:172.21.15.131:6832/921953667 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+333957 (secure 0 0 0) 0x7fadb0159d40 con 0x7fad8c06f400 2024-05-21T01:26:41.408 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-05-21T01:26:41.409 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-05-21T01:26:41.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.405+0000 7fadb6800640 1 -- 172.21.15.63:0/280694460 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fad8c06f400 msgr2=0x7fad8c0718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:41.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.405+0000 7fadb6800640 1 --2- 172.21.15.63:0/280694460 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fad8c06f400 0x7fad8c0718c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fada000b990 tx=0x7fada0008040 comp rx=0 tx=0).stop 2024-05-21T01:26:41.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.405+0000 7fadb6800640 1 -- 172.21.15.63:0/280694460 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fadb015ce40 msgr2=0x7fadb015a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:41.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.405+0000 7fadb6800640 1 --2- 172.21.15.63:0/280694460 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fadb015ce40 0x7fadb015a520 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fada8019600 tx=0x7fada8019790 comp rx=0 tx=0).stop 2024-05-21T01:26:41.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.405+0000 7fadb6800640 1 -- 172.21.15.63:0/280694460 shutdown_connections 2024-05-21T01:26:41.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.405+0000 7fadb6800640 1 --2- 172.21.15.63:0/280694460 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fad8c06f400 0x7fad8c0718c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:41.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.405+0000 7fadb6800640 1 --2- 172.21.15.63:0/280694460 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fadb015ce40 0x7fadb015a520 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:41.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.405+0000 7fadb6800640 1 --2- 172.21.15.63:0/280694460 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fadb006f9b0 0x7fadb0159fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:41.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.405+0000 7fadb6800640 1 --2- 172.21.15.63:0/280694460 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fadb006f5d0 0x7fadb006c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:41.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.405+0000 7fadb6800640 1 -- 172.21.15.63:0/280694460 >> 172.21.15.63:0/280694460 conn(0x7fadb0068460 msgr2=0x7fadb00cdd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:26:41.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.405+0000 7fadb6800640 1 -- 172.21.15.63:0/280694460 shutdown_connections 2024-05-21T01:26:41.411 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.405+0000 7fadb6800640 1 -- 172.21.15.63:0/280694460 wait complete. 2024-05-21T01:26:41.429 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":227,"stamp":"2024-05-21T01:26:40.609651+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":372534127,"num_objects":151,"num_object_clones":0,"num_object_copies":478,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":151,"num_whiteouts":0,"num_read":5197,"num_read_kb":21004346,"num_write":10809,"num_write_kb":25170452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11260,"ondisk_log_size":11260,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":532324,"kb_used_data":160740,"kb_used_omap":12,"kb_used_meta":371507,"kb_avail":754442396,"statfs":{"total":773094113280,"available":772549013504,"internally_reserved":0,"allocated":164597760,"data_stored":2509693468,"data_compressed":123720052,"data_compressed_allocated":156459008,"data_compressed_original":2503049216,"omap_allocated":12750,"internal_metadata":380423730},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,1,2,1,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-10368304695,"num_objects":-2472,"num_object_clones":0,"num_object_copies":-9888,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2472,"num_whiteouts":0,"num_read":64,"num_read_kb":258049,"num_write":2484,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004944"},"pg_stats":[{"pgid":"2.1f","version":"25'9","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:07.489107+0000","last_change":"2024-05-21T01:19:53.545236+0000","last_active":"2024-05-21T01:24:07.489107+0000","last_peered":"2024-05-21T01:24:07.489107+0000","last_clean":"2024-05-21T01:24:07.489107+0000","last_became_active":"2024-05-21T01:19:53.544469+0000","last_became_peered":"2024-05-21T01:19:53.544469+0000","last_unstale":"2024-05-21T01:24:07.489107+0000","last_undegraded":"2024-05-21T01:24:07.489107+0000","last_fullsized":"2024-05-21T01:24:07.489107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:33:09.421287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:23:58.496231+0000","last_change":"2024-05-21T01:19:54.568235+0000","last_active":"2024-05-21T01:23:58.496231+0000","last_peered":"2024-05-21T01:23:58.496231+0000","last_clean":"2024-05-21T01:23:58.496231+0000","last_became_active":"2024-05-21T01:19:54.567245+0000","last_became_peered":"2024-05-21T01:19:54.567245+0000","last_unstale":"2024-05-21T01:23:58.496231+0000","last_undegraded":"2024-05-21T01:23:58.496231+0000","last_fullsized":"2024-05-21T01:23:58.496231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:39:51.222819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"27'318","reported_seq":514,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:37.507383+0000","last_change":"2024-05-21T01:19:58.618772+0000","last_active":"2024-05-21T01:26:37.507383+0000","last_peered":"2024-05-21T01:26:37.507383+0000","last_clean":"2024-05-21T01:26:37.507383+0000","last_became_active":"2024-05-21T01:19:58.617757+0000","last_became_peered":"2024-05-21T01:19:58.617757+0000","last_unstale":"2024-05-21T01:26:37.507383+0000","last_undegraded":"2024-05-21T01:26:37.507383+0000","last_fullsized":"2024-05-21T01:26:37.507383+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":318,"log_dups_size":0,"ondisk_log_size":318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T13:07:31.666521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":176,"num_read_kb":720896,"num_write":297,"num_write_kb":835584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"25'2","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:23:53.495690+0000","last_change":"2024-05-21T01:19:53.551775+0000","last_active":"2024-05-21T01:23:53.495690+0000","last_peered":"2024-05-21T01:23:53.495690+0000","last_clean":"2024-05-21T01:23:53.495690+0000","last_became_active":"2024-05-21T01:19:53.551049+0000","last_became_peered":"2024-05-21T01:19:53.551049+0000","last_unstale":"2024-05-21T01:23:53.495690+0000","last_undegraded":"2024-05-21T01:23:53.495690+0000","last_fullsized":"2024-05-21T01:23:53.495690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:49:02.289202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:08.498886+0000","last_change":"2024-05-21T01:19:54.573420+0000","last_active":"2024-05-21T01:24:08.498886+0000","last_peered":"2024-05-21T01:24:08.498886+0000","last_clean":"2024-05-21T01:24:08.498886+0000","last_became_active":"2024-05-21T01:19:54.569573+0000","last_became_peered":"2024-05-21T01:19:54.569573+0000","last_unstale":"2024-05-21T01:24:08.498886+0000","last_undegraded":"2024-05-21T01:24:08.498886+0000","last_fullsized":"2024-05-21T01:24:08.498886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:00:12.257816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"27'351","reported_seq":567,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:38.381342+0000","last_change":"2024-05-21T01:19:58.604490+0000","last_active":"2024-05-21T01:26:38.381342+0000","last_peered":"2024-05-21T01:26:38.381342+0000","last_clean":"2024-05-21T01:26:38.381342+0000","last_became_active":"2024-05-21T01:19:58.604108+0000","last_became_peered":"2024-05-21T01:19:58.604108+0000","last_unstale":"2024-05-21T01:26:38.381342+0000","last_undegraded":"2024-05-21T01:26:38.381342+0000","last_fullsized":"2024-05-21T01:26:38.381342+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:11:10.963073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":196,"num_read_kb":802816,"num_write":339,"num_write_kb":925696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"27'5","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:42.721812+0000","last_change":"2024-05-21T01:19:53.525403+0000","last_active":"2024-05-21T01:22:42.721812+0000","last_peered":"2024-05-21T01:22:42.721812+0000","last_clean":"2024-05-21T01:22:42.721812+0000","last_became_active":"2024-05-21T01:19:53.521265+0000","last_became_peered":"2024-05-21T01:19:53.521265+0000","last_unstale":"2024-05-21T01:22:42.721812+0000","last_undegraded":"2024-05-21T01:22:42.721812+0000","last_fullsized":"2024-05-21T01:22:42.721812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:52:16.488269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:24.468744+0000","last_change":"2024-05-21T01:19:54.536436+0000","last_active":"2024-05-21T01:22:24.468744+0000","last_peered":"2024-05-21T01:22:24.468744+0000","last_clean":"2024-05-21T01:22:24.468744+0000","last_became_active":"2024-05-21T01:19:54.536061+0000","last_became_peered":"2024-05-21T01:19:54.536061+0000","last_unstale":"2024-05-21T01:22:24.468744+0000","last_undegraded":"2024-05-21T01:22:24.468744+0000","last_fullsized":"2024-05-21T01:22:24.468744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:48:23.811712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"27'291","reported_seq":460,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:38.327934+0000","last_change":"2024-05-21T01:19:58.623087+0000","last_active":"2024-05-21T01:26:38.327934+0000","last_peered":"2024-05-21T01:26:38.327934+0000","last_clean":"2024-05-21T01:26:38.327934+0000","last_became_active":"2024-05-21T01:19:58.622672+0000","last_became_peered":"2024-05-21T01:19:58.622672+0000","last_unstale":"2024-05-21T01:26:38.327934+0000","last_undegraded":"2024-05-21T01:26:38.327934+0000","last_fullsized":"2024-05-21T01:26:38.327934+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:45:49.241750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":149,"num_read_kb":610304,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:24.484977+0000","last_change":"2024-05-21T01:19:53.522497+0000","last_active":"2024-05-21T01:22:24.484977+0000","last_peered":"2024-05-21T01:22:24.484977+0000","last_clean":"2024-05-21T01:22:24.484977+0000","last_became_active":"2024-05-21T01:19:53.521684+0000","last_became_peered":"2024-05-21T01:19:53.521684+0000","last_unstale":"2024-05-21T01:22:24.484977+0000","last_undegraded":"2024-05-21T01:22:24.484977+0000","last_fullsized":"2024-05-21T01:22:24.484977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:18:17.808255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:24.486725+0000","last_change":"2024-05-21T01:19:54.549512+0000","last_active":"2024-05-21T01:22:24.486725+0000","last_peered":"2024-05-21T01:22:24.486725+0000","last_clean":"2024-05-21T01:22:24.486725+0000","last_became_active":"2024-05-21T01:19:54.549291+0000","last_became_peered":"2024-05-21T01:19:54.549291+0000","last_unstale":"2024-05-21T01:22:24.486725+0000","last_undegraded":"2024-05-21T01:22:24.486725+0000","last_fullsized":"2024-05-21T01:22:24.486725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:48:34.571236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"27'271","reported_seq":433,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:38.303196+0000","last_change":"2024-05-21T01:19:58.614748+0000","last_active":"2024-05-21T01:26:38.303196+0000","last_peered":"2024-05-21T01:26:38.303196+0000","last_clean":"2024-05-21T01:26:38.303196+0000","last_became_active":"2024-05-21T01:19:58.614313+0000","last_became_peered":"2024-05-21T01:19:58.614313+0000","last_unstale":"2024-05-21T01:26:38.303196+0000","last_undegraded":"2024-05-21T01:26:38.303196+0000","last_fullsized":"2024-05-21T01:26:38.303196+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:45:34.204591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":581632,"num_write":252,"num_write_kb":688128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:14.556315+0000","last_change":"2024-05-21T01:19:54.545467+0000","last_active":"2024-05-21T01:24:14.556315+0000","last_peered":"2024-05-21T01:24:14.556315+0000","last_clean":"2024-05-21T01:24:14.556315+0000","last_became_active":"2024-05-21T01:19:54.545181+0000","last_became_peered":"2024-05-21T01:19:54.545181+0000","last_unstale":"2024-05-21T01:24:14.556315+0000","last_undegraded":"2024-05-21T01:24:14.556315+0000","last_fullsized":"2024-05-21T01:24:14.556315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:43:15.387067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"27'5","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:24.595463+0000","last_change":"2024-05-21T01:19:53.536139+0000","last_active":"2024-05-21T01:24:24.595463+0000","last_peered":"2024-05-21T01:24:24.595463+0000","last_clean":"2024-05-21T01:24:24.595463+0000","last_became_active":"2024-05-21T01:19:53.535899+0000","last_became_peered":"2024-05-21T01:19:53.535899+0000","last_unstale":"2024-05-21T01:24:24.595463+0000","last_undegraded":"2024-05-21T01:24:24.595463+0000","last_fullsized":"2024-05-21T01:24:24.595463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:40:12.033744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"27'326","reported_seq":527,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:38.371289+0000","last_change":"2024-05-21T01:19:58.621487+0000","last_active":"2024-05-21T01:26:38.371289+0000","last_peered":"2024-05-21T01:26:38.371289+0000","last_clean":"2024-05-21T01:26:38.371289+0000","last_became_active":"2024-05-21T01:19:58.621083+0000","last_became_peered":"2024-05-21T01:19:58.621083+0000","last_unstale":"2024-05-21T01:26:38.371289+0000","last_undegraded":"2024-05-21T01:26:38.371289+0000","last_fullsized":"2024-05-21T01:26:38.371289+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:18:44.587274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":181,"num_read_kb":741376,"num_write":309,"num_write_kb":843776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:12.470739+0000","last_change":"2024-05-21T01:19:54.572420+0000","last_active":"2024-05-21T01:22:12.470739+0000","last_peered":"2024-05-21T01:22:12.470739+0000","last_clean":"2024-05-21T01:22:12.470739+0000","last_became_active":"2024-05-21T01:19:54.571863+0000","last_became_peered":"2024-05-21T01:19:54.571863+0000","last_unstale":"2024-05-21T01:22:12.470739+0000","last_undegraded":"2024-05-21T01:22:12.470739+0000","last_fullsized":"2024-05-21T01:22:12.470739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:13:52.491903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"27'3","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:13.507766+0000","last_change":"2024-05-21T01:19:53.553351+0000","last_active":"2024-05-21T01:24:13.507766+0000","last_peered":"2024-05-21T01:24:13.507766+0000","last_clean":"2024-05-21T01:24:13.507766+0000","last_became_active":"2024-05-21T01:19:53.552694+0000","last_became_peered":"2024-05-21T01:19:53.552694+0000","last_unstale":"2024-05-21T01:24:13.507766+0000","last_undegraded":"2024-05-21T01:24:13.507766+0000","last_fullsized":"2024-05-21T01:24:13.507766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:46:55.273278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"27'300","reported_seq":488,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:38.313014+0000","last_change":"2024-05-21T01:19:58.594904+0000","last_active":"2024-05-21T01:26:38.313014+0000","last_peered":"2024-05-21T01:26:38.313014+0000","last_clean":"2024-05-21T01:26:38.313014+0000","last_became_active":"2024-05-21T01:19:58.594450+0000","last_became_peered":"2024-05-21T01:19:58.594450+0000","last_unstale":"2024-05-21T01:26:38.313014+0000","last_undegraded":"2024-05-21T01:26:38.313014+0000","last_fullsized":"2024-05-21T01:26:38.313014+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":300,"log_dups_size":0,"ondisk_log_size":300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:37:30.286986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":688128,"num_write":291,"num_write_kb":794624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:17.490540+0000","last_change":"2024-05-21T01:19:54.554750+0000","last_active":"2024-05-21T01:24:17.490540+0000","last_peered":"2024-05-21T01:24:17.490540+0000","last_clean":"2024-05-21T01:24:17.490540+0000","last_became_active":"2024-05-21T01:19:54.551583+0000","last_became_peered":"2024-05-21T01:19:54.551583+0000","last_unstale":"2024-05-21T01:24:17.490540+0000","last_undegraded":"2024-05-21T01:24:17.490540+0000","last_fullsized":"2024-05-21T01:24:17.490540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:37:19.564099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"25'3","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:17.490604+0000","last_change":"2024-05-21T01:19:53.523277+0000","last_active":"2024-05-21T01:24:17.490604+0000","last_peered":"2024-05-21T01:24:17.490604+0000","last_clean":"2024-05-21T01:24:17.490604+0000","last_became_active":"2024-05-21T01:19:53.522525+0000","last_became_peered":"2024-05-21T01:19:53.522525+0000","last_unstale":"2024-05-21T01:24:17.490604+0000","last_undegraded":"2024-05-21T01:24:17.490604+0000","last_fullsized":"2024-05-21T01:24:17.490604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:23:59.949781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"27'278","reported_seq":456,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:37.503134+0000","last_change":"2024-05-21T01:19:58.615575+0000","last_active":"2024-05-21T01:26:37.503134+0000","last_peered":"2024-05-21T01:26:37.503134+0000","last_clean":"2024-05-21T01:26:37.503134+0000","last_became_active":"2024-05-21T01:19:58.614401+0000","last_became_peered":"2024-05-21T01:19:58.614401+0000","last_unstale":"2024-05-21T01:26:37.503134+0000","last_undegraded":"2024-05-21T01:26:37.503134+0000","last_fullsized":"2024-05-21T01:26:37.503134+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":278,"log_dups_size":0,"ondisk_log_size":278,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:51:09.839503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":158,"num_read_kb":647168,"num_write":259,"num_write_kb":729088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:14.556307+0000","last_change":"2024-05-21T01:19:54.555489+0000","last_active":"2024-05-21T01:24:14.556307+0000","last_peered":"2024-05-21T01:24:14.556307+0000","last_clean":"2024-05-21T01:24:14.556307+0000","last_became_active":"2024-05-21T01:19:54.555227+0000","last_became_peered":"2024-05-21T01:19:54.555227+0000","last_unstale":"2024-05-21T01:24:14.556307+0000","last_undegraded":"2024-05-21T01:24:14.556307+0000","last_fullsized":"2024-05-21T01:24:14.556307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:00:22.873520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"25'2","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:14.509091+0000","last_change":"2024-05-21T01:19:53.520840+0000","last_active":"2024-05-21T01:24:14.509091+0000","last_peered":"2024-05-21T01:24:14.509091+0000","last_clean":"2024-05-21T01:24:14.509091+0000","last_became_active":"2024-05-21T01:19:53.520540+0000","last_became_peered":"2024-05-21T01:19:53.520540+0000","last_unstale":"2024-05-21T01:24:14.509091+0000","last_undegraded":"2024-05-21T01:24:14.509091+0000","last_fullsized":"2024-05-21T01:24:14.509091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:08:36.426465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"27'300","reported_seq":490,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:38.425435+0000","last_change":"2024-05-21T01:19:58.604357+0000","last_active":"2024-05-21T01:26:38.425435+0000","last_peered":"2024-05-21T01:26:38.425435+0000","last_clean":"2024-05-21T01:26:38.425435+0000","last_became_active":"2024-05-21T01:19:58.603922+0000","last_became_peered":"2024-05-21T01:19:58.603922+0000","last_unstale":"2024-05-21T01:26:38.425435+0000","last_undegraded":"2024-05-21T01:26:38.425435+0000","last_fullsized":"2024-05-21T01:26:38.425435+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":300,"log_dups_size":0,"ondisk_log_size":300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:55:18.226031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":170,"num_read_kb":696320,"num_write":288,"num_write_kb":786432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:17.490671+0000","last_change":"2024-05-21T01:19:54.569315+0000","last_active":"2024-05-21T01:24:17.490671+0000","last_peered":"2024-05-21T01:24:17.490671+0000","last_clean":"2024-05-21T01:24:17.490671+0000","last_became_active":"2024-05-21T01:19:54.568232+0000","last_became_peered":"2024-05-21T01:19:54.568232+0000","last_unstale":"2024-05-21T01:24:17.490671+0000","last_undegraded":"2024-05-21T01:24:17.490671+0000","last_fullsized":"2024-05-21T01:24:17.490671+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:19:01.819418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"25'4","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:14.556346+0000","last_change":"2024-05-21T01:19:53.525301+0000","last_active":"2024-05-21T01:24:14.556346+0000","last_peered":"2024-05-21T01:24:14.556346+0000","last_clean":"2024-05-21T01:24:14.556346+0000","last_became_active":"2024-05-21T01:19:53.525010+0000","last_became_peered":"2024-05-21T01:19:53.525010+0000","last_unstale":"2024-05-21T01:24:14.556346+0000","last_undegraded":"2024-05-21T01:24:14.556346+0000","last_fullsized":"2024-05-21T01:24:14.556346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:53:11.316975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"27'273","reported_seq":422,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:38.408364+0000","last_change":"2024-05-21T01:19:58.590354+0000","last_active":"2024-05-21T01:26:38.408364+0000","last_peered":"2024-05-21T01:26:38.408364+0000","last_clean":"2024-05-21T01:26:38.408364+0000","last_became_active":"2024-05-21T01:19:58.589985+0000","last_became_peered":"2024-05-21T01:19:58.589985+0000","last_unstale":"2024-05-21T01:26:38.408364+0000","last_undegraded":"2024-05-21T01:26:38.408364+0000","last_fullsized":"2024-05-21T01:26:38.408364+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:08:09.222858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":524288,"num_write":249,"num_write_kb":679936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:17.490762+0000","last_change":"2024-05-21T01:19:54.555318+0000","last_active":"2024-05-21T01:24:17.490762+0000","last_peered":"2024-05-21T01:24:17.490762+0000","last_clean":"2024-05-21T01:24:17.490762+0000","last_became_active":"2024-05-21T01:19:54.552947+0000","last_became_peered":"2024-05-21T01:19:54.552947+0000","last_unstale":"2024-05-21T01:24:17.490762+0000","last_undegraded":"2024-05-21T01:24:17.490762+0000","last_fullsized":"2024-05-21T01:24:17.490762+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:29:24.153986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"27'30","reported_seq":59,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:32.740014+0000","last_change":"2024-05-21T01:19:53.525004+0000","last_active":"2024-05-21T01:26:32.740014+0000","last_peered":"2024-05-21T01:26:32.740014+0000","last_clean":"2024-05-21T01:26:32.740014+0000","last_became_active":"2024-05-21T01:19:53.521014+0000","last_became_peered":"2024-05-21T01:19:53.521014+0000","last_unstale":"2024-05-21T01:26:32.740014+0000","last_undegraded":"2024-05-21T01:26:32.740014+0000","last_fullsized":"2024-05-21T01:26:32.740014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:02:46.668320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":56,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"27'268","reported_seq":427,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:37.289842+0000","last_change":"2024-05-21T01:19:58.599880+0000","last_active":"2024-05-21T01:26:37.289842+0000","last_peered":"2024-05-21T01:26:37.289842+0000","last_clean":"2024-05-21T01:26:37.289842+0000","last_became_active":"2024-05-21T01:19:58.598712+0000","last_became_peered":"2024-05-21T01:19:58.598712+0000","last_unstale":"2024-05-21T01:26:37.289842+0000","last_undegraded":"2024-05-21T01:26:37.289842+0000","last_fullsized":"2024-05-21T01:26:37.289842+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":268,"log_dups_size":0,"ondisk_log_size":268,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:43:05.995986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":138,"num_read_kb":565248,"num_write":255,"num_write_kb":720896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:08.507007+0000","last_change":"2024-05-21T01:19:54.576044+0000","last_active":"2024-05-21T01:24:08.507007+0000","last_peered":"2024-05-21T01:24:08.507007+0000","last_clean":"2024-05-21T01:24:08.507007+0000","last_became_active":"2024-05-21T01:19:54.575543+0000","last_became_peered":"2024-05-21T01:19:54.575543+0000","last_unstale":"2024-05-21T01:24:08.507007+0000","last_undegraded":"2024-05-21T01:24:08.507007+0000","last_fullsized":"2024-05-21T01:24:08.507007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T09:33:07.188470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"25'1","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:04.555386+0000","last_change":"2024-05-21T01:19:53.543705+0000","last_active":"2024-05-21T01:24:04.555386+0000","last_peered":"2024-05-21T01:24:04.555386+0000","last_clean":"2024-05-21T01:24:04.555386+0000","last_became_active":"2024-05-21T01:19:53.543450+0000","last_became_peered":"2024-05-21T01:19:53.543450+0000","last_unstale":"2024-05-21T01:24:04.555386+0000","last_undegraded":"2024-05-21T01:24:04.555386+0000","last_fullsized":"2024-05-21T01:24:04.555386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:05:49.465156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"27'267","reported_seq":424,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:38.308781+0000","last_change":"2024-05-21T01:19:58.612049+0000","last_active":"2024-05-21T01:26:38.308781+0000","last_peered":"2024-05-21T01:26:38.308781+0000","last_clean":"2024-05-21T01:26:38.308781+0000","last_became_active":"2024-05-21T01:19:58.610837+0000","last_became_peered":"2024-05-21T01:19:58.610837+0000","last_unstale":"2024-05-21T01:26:38.308781+0000","last_undegraded":"2024-05-21T01:26:38.308781+0000","last_fullsized":"2024-05-21T01:26:38.308781+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":267,"log_dups_size":0,"ondisk_log_size":267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:24:14.332056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":557056,"num_write":249,"num_write_kb":679936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:04.542429+0000","last_change":"2024-05-21T01:19:54.553083+0000","last_active":"2024-05-21T01:24:04.542429+0000","last_peered":"2024-05-21T01:24:04.542429+0000","last_clean":"2024-05-21T01:24:04.542429+0000","last_became_active":"2024-05-21T01:19:54.552812+0000","last_became_peered":"2024-05-21T01:19:54.552812+0000","last_unstale":"2024-05-21T01:24:04.542429+0000","last_undegraded":"2024-05-21T01:24:04.542429+0000","last_fullsized":"2024-05-21T01:24:04.542429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:37:25.835345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:03.497940+0000","last_change":"2024-05-21T01:19:53.551697+0000","last_active":"2024-05-21T01:24:03.497940+0000","last_peered":"2024-05-21T01:24:03.497940+0000","last_clean":"2024-05-21T01:24:03.497940+0000","last_became_active":"2024-05-21T01:19:53.550921+0000","last_became_peered":"2024-05-21T01:19:53.550921+0000","last_unstale":"2024-05-21T01:24:03.497940+0000","last_undegraded":"2024-05-21T01:24:03.497940+0000","last_fullsized":"2024-05-21T01:24:03.497940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T09:31:31.996638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"27'289","reported_seq":468,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:38.366664+0000","last_change":"2024-05-21T01:19:58.626472+0000","last_active":"2024-05-21T01:26:38.366664+0000","last_peered":"2024-05-21T01:26:38.366664+0000","last_clean":"2024-05-21T01:26:38.366664+0000","last_became_active":"2024-05-21T01:19:58.625720+0000","last_became_peered":"2024-05-21T01:19:58.625720+0000","last_unstale":"2024-05-21T01:26:38.366664+0000","last_undegraded":"2024-05-21T01:26:38.366664+0000","last_fullsized":"2024-05-21T01:26:38.366664+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":289,"log_dups_size":0,"ondisk_log_size":289,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:16:03.911585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":158,"num_read_kb":647168,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:04.508249+0000","last_change":"2024-05-21T01:19:54.547947+0000","last_active":"2024-05-21T01:24:04.508249+0000","last_peered":"2024-05-21T01:24:04.508249+0000","last_clean":"2024-05-21T01:24:04.508249+0000","last_became_active":"2024-05-21T01:19:54.547689+0000","last_became_peered":"2024-05-21T01:19:54.547689+0000","last_unstale":"2024-05-21T01:24:04.508249+0000","last_undegraded":"2024-05-21T01:24:04.508249+0000","last_fullsized":"2024-05-21T01:24:04.508249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:40:55.985899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"25'1","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:04.555333+0000","last_change":"2024-05-21T01:19:53.540973+0000","last_active":"2024-05-21T01:24:04.555333+0000","last_peered":"2024-05-21T01:24:04.555333+0000","last_clean":"2024-05-21T01:24:04.555333+0000","last_became_active":"2024-05-21T01:19:53.540670+0000","last_became_peered":"2024-05-21T01:19:53.540670+0000","last_unstale":"2024-05-21T01:24:04.555333+0000","last_undegraded":"2024-05-21T01:24:04.555333+0000","last_fullsized":"2024-05-21T01:24:04.555333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:08:21.802284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"27'277","reported_seq":446,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:38.380089+0000","last_change":"2024-05-21T01:19:58.611280+0000","last_active":"2024-05-21T01:26:38.380089+0000","last_peered":"2024-05-21T01:26:38.380089+0000","last_clean":"2024-05-21T01:26:38.380089+0000","last_became_active":"2024-05-21T01:19:58.610511+0000","last_became_peered":"2024-05-21T01:19:58.610511+0000","last_unstale":"2024-05-21T01:26:38.380089+0000","last_undegraded":"2024-05-21T01:26:38.380089+0000","last_fullsized":"2024-05-21T01:26:38.380089+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:49:19.660422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":606208,"num_write":264,"num_write_kb":720896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:23:58.496160+0000","last_change":"2024-05-21T01:19:54.572546+0000","last_active":"2024-05-21T01:23:58.496160+0000","last_peered":"2024-05-21T01:23:58.496160+0000","last_clean":"2024-05-21T01:23:58.496160+0000","last_became_active":"2024-05-21T01:19:54.572022+0000","last_became_peered":"2024-05-21T01:19:54.572022+0000","last_unstale":"2024-05-21T01:23:58.496160+0000","last_undegraded":"2024-05-21T01:23:58.496160+0000","last_fullsized":"2024-05-21T01:23:58.496160+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:50:08.351383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"27'8","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:35.052139+0000","last_change":"2024-05-21T01:19:53.556786+0000","last_active":"2024-05-21T01:26:35.052139+0000","last_peered":"2024-05-21T01:26:35.052139+0000","last_clean":"2024-05-21T01:26:35.052139+0000","last_became_active":"2024-05-21T01:19:53.556143+0000","last_became_peered":"2024-05-21T01:19:53.556143+0000","last_unstale":"2024-05-21T01:26:35.052139+0000","last_undegraded":"2024-05-21T01:26:35.052139+0000","last_fullsized":"2024-05-21T01:26:35.052139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:02:17.391701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":417,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"27'289","reported_seq":452,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:38.385695+0000","last_change":"2024-05-21T01:19:58.599203+0000","last_active":"2024-05-21T01:26:38.385695+0000","last_peered":"2024-05-21T01:26:38.385695+0000","last_clean":"2024-05-21T01:26:38.385695+0000","last_became_active":"2024-05-21T01:19:58.598175+0000","last_became_peered":"2024-05-21T01:19:58.598175+0000","last_unstale":"2024-05-21T01:26:38.385695+0000","last_undegraded":"2024-05-21T01:26:38.385695+0000","last_fullsized":"2024-05-21T01:26:38.385695+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":289,"log_dups_size":0,"ondisk_log_size":289,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:45:17.138090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":581632,"num_write":270,"num_write_kb":737280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:08.506876+0000","last_change":"2024-05-21T01:19:54.551092+0000","last_active":"2024-05-21T01:24:08.506876+0000","last_peered":"2024-05-21T01:24:08.506876+0000","last_clean":"2024-05-21T01:24:08.506876+0000","last_became_active":"2024-05-21T01:19:54.550338+0000","last_became_peered":"2024-05-21T01:19:54.550338+0000","last_unstale":"2024-05-21T01:24:08.506876+0000","last_undegraded":"2024-05-21T01:24:08.506876+0000","last_fullsized":"2024-05-21T01:24:08.506876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:29:13.540719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"25'3","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:23:54.554210+0000","last_change":"2024-05-21T01:19:53.554835+0000","last_active":"2024-05-21T01:23:54.554210+0000","last_peered":"2024-05-21T01:23:54.554210+0000","last_clean":"2024-05-21T01:23:54.554210+0000","last_became_active":"2024-05-21T01:19:53.554598+0000","last_became_peered":"2024-05-21T01:19:53.554598+0000","last_unstale":"2024-05-21T01:23:54.554210+0000","last_undegraded":"2024-05-21T01:23:54.554210+0000","last_fullsized":"2024-05-21T01:23:54.554210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:28:43.940978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"27'351","reported_seq":558,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:38.359893+0000","last_change":"2024-05-21T01:19:58.629747+0000","last_active":"2024-05-21T01:26:38.359893+0000","last_peered":"2024-05-21T01:26:38.359893+0000","last_clean":"2024-05-21T01:26:38.359893+0000","last_became_active":"2024-05-21T01:19:58.622106+0000","last_became_peered":"2024-05-21T01:19:58.622106+0000","last_unstale":"2024-05-21T01:26:38.359893+0000","last_undegraded":"2024-05-21T01:26:38.359893+0000","last_fullsized":"2024-05-21T01:26:38.359893+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:22:07.047914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":761856,"num_write":339,"num_write_kb":925696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:07.489038+0000","last_change":"2024-05-21T01:19:54.554303+0000","last_active":"2024-05-21T01:24:07.489038+0000","last_peered":"2024-05-21T01:24:07.489038+0000","last_clean":"2024-05-21T01:24:07.489038+0000","last_became_active":"2024-05-21T01:19:54.552126+0000","last_became_peered":"2024-05-21T01:19:54.552126+0000","last_unstale":"2024-05-21T01:24:07.489038+0000","last_undegraded":"2024-05-21T01:24:07.489038+0000","last_fullsized":"2024-05-21T01:24:07.489038+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:59:46.383359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"25'3","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:04.555354+0000","last_change":"2024-05-21T01:19:53.536580+0000","last_active":"2024-05-21T01:24:04.555354+0000","last_peered":"2024-05-21T01:24:04.555354+0000","last_clean":"2024-05-21T01:24:04.555354+0000","last_became_active":"2024-05-21T01:19:53.535105+0000","last_became_peered":"2024-05-21T01:19:53.535105+0000","last_unstale":"2024-05-21T01:24:04.555354+0000","last_undegraded":"2024-05-21T01:24:04.555354+0000","last_fullsized":"2024-05-21T01:24:04.555354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:58:05.019025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":125,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:23:49.506777+0000","last_change":"2024-05-21T01:19:49.490062+0000","last_active":"2024-05-21T01:23:49.506777+0000","last_peered":"2024-05-21T01:23:49.506777+0000","last_clean":"2024-05-21T01:23:49.506777+0000","last_became_active":"2024-05-21T01:19:49.488796+0000","last_became_peered":"2024-05-21T01:19:49.488796+0000","last_unstale":"2024-05-21T01:23:49.506777+0000","last_undegraded":"2024-05-21T01:23:49.506777+0000","last_fullsized":"2024-05-21T01:23:49.506777+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:47.457865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:47.457865+0000","last_clean_scrub_stamp":"2024-05-21T01:19:47.457865+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T09:37:06.199150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"27'292","reported_seq":468,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:38.382121+0000","last_change":"2024-05-21T01:19:58.590851+0000","last_active":"2024-05-21T01:26:38.382121+0000","last_peered":"2024-05-21T01:26:38.382121+0000","last_clean":"2024-05-21T01:26:38.382121+0000","last_became_active":"2024-05-21T01:19:58.589288+0000","last_became_peered":"2024-05-21T01:19:58.589288+0000","last_unstale":"2024-05-21T01:26:38.382121+0000","last_undegraded":"2024-05-21T01:26:38.382121+0000","last_fullsized":"2024-05-21T01:26:38.382121+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":292,"log_dups_size":0,"ondisk_log_size":292,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:36:46.992834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":155,"num_read_kb":634880,"num_write":276,"num_write_kb":753664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:24.595498+0000","last_change":"2024-05-21T01:19:54.543894+0000","last_active":"2024-05-21T01:24:24.595498+0000","last_peered":"2024-05-21T01:24:24.595498+0000","last_clean":"2024-05-21T01:24:24.595498+0000","last_became_active":"2024-05-21T01:19:54.543586+0000","last_became_peered":"2024-05-21T01:19:54.543586+0000","last_unstale":"2024-05-21T01:24:24.595498+0000","last_undegraded":"2024-05-21T01:24:24.595498+0000","last_fullsized":"2024-05-21T01:24:24.595498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:33:02.756634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"25'3","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:23.509317+0000","last_change":"2024-05-21T01:19:53.532115+0000","last_active":"2024-05-21T01:24:23.509317+0000","last_peered":"2024-05-21T01:24:23.509317+0000","last_clean":"2024-05-21T01:24:23.509317+0000","last_became_active":"2024-05-21T01:19:53.529879+0000","last_became_peered":"2024-05-21T01:19:53.529879+0000","last_unstale":"2024-05-21T01:24:23.509317+0000","last_undegraded":"2024-05-21T01:24:23.509317+0000","last_fullsized":"2024-05-21T01:24:23.509317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:42:07.436243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"27'301","reported_seq":482,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:38.332476+0000","last_change":"2024-05-21T01:19:58.604417+0000","last_active":"2024-05-21T01:26:38.332476+0000","last_peered":"2024-05-21T01:26:38.332476+0000","last_clean":"2024-05-21T01:26:38.332476+0000","last_became_active":"2024-05-21T01:19:58.603929+0000","last_became_peered":"2024-05-21T01:19:58.603929+0000","last_unstale":"2024-05-21T01:26:38.332476+0000","last_undegraded":"2024-05-21T01:26:38.332476+0000","last_fullsized":"2024-05-21T01:26:38.332476+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":301,"log_dups_size":0,"ondisk_log_size":301,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:15:59.031738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":655360,"num_write":279,"num_write_kb":761856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:24.532734+0000","last_change":"2024-05-21T01:19:54.542096+0000","last_active":"2024-05-21T01:24:24.532734+0000","last_peered":"2024-05-21T01:24:24.532734+0000","last_clean":"2024-05-21T01:24:24.532734+0000","last_became_active":"2024-05-21T01:19:54.541837+0000","last_became_peered":"2024-05-21T01:19:54.541837+0000","last_unstale":"2024-05-21T01:24:24.532734+0000","last_undegraded":"2024-05-21T01:24:24.532734+0000","last_fullsized":"2024-05-21T01:24:24.532734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:55:30.807311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:23.503932+0000","last_change":"2024-05-21T01:19:53.551697+0000","last_active":"2024-05-21T01:24:23.503932+0000","last_peered":"2024-05-21T01:24:23.503932+0000","last_clean":"2024-05-21T01:24:23.503932+0000","last_became_active":"2024-05-21T01:19:53.550893+0000","last_became_peered":"2024-05-21T01:19:53.550893+0000","last_unstale":"2024-05-21T01:24:23.503932+0000","last_undegraded":"2024-05-21T01:24:23.503932+0000","last_fullsized":"2024-05-21T01:24:23.503932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:42:20.295229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"27'271","reported_seq":433,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:38.398598+0000","last_change":"2024-05-21T01:19:58.628526+0000","last_active":"2024-05-21T01:26:38.398598+0000","last_peered":"2024-05-21T01:26:38.398598+0000","last_clean":"2024-05-21T01:26:38.398598+0000","last_became_active":"2024-05-21T01:19:58.620667+0000","last_became_peered":"2024-05-21T01:19:58.620667+0000","last_unstale":"2024-05-21T01:26:38.398598+0000","last_undegraded":"2024-05-21T01:26:38.398598+0000","last_fullsized":"2024-05-21T01:26:38.398598+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:46:22.396063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":581632,"num_write":261,"num_write_kb":712704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:24.532798+0000","last_change":"2024-05-21T01:19:54.532551+0000","last_active":"2024-05-21T01:24:24.532798+0000","last_peered":"2024-05-21T01:24:24.532798+0000","last_clean":"2024-05-21T01:24:24.532798+0000","last_became_active":"2024-05-21T01:19:54.532251+0000","last_became_peered":"2024-05-21T01:19:54.532251+0000","last_unstale":"2024-05-21T01:24:24.532798+0000","last_undegraded":"2024-05-21T01:24:24.532798+0000","last_fullsized":"2024-05-21T01:24:24.532798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:00:30.042781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:12.468593+0000","last_change":"2024-05-21T01:19:53.554659+0000","last_active":"2024-05-21T01:22:12.468593+0000","last_peered":"2024-05-21T01:22:12.468593+0000","last_clean":"2024-05-21T01:22:12.468593+0000","last_became_active":"2024-05-21T01:19:53.553953+0000","last_became_peered":"2024-05-21T01:19:53.553953+0000","last_unstale":"2024-05-21T01:22:12.468593+0000","last_undegraded":"2024-05-21T01:22:12.468593+0000","last_fullsized":"2024-05-21T01:22:12.468593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:31:13.091061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"27'333","reported_seq":524,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:38.339710+0000","last_change":"2024-05-21T01:19:58.593243+0000","last_active":"2024-05-21T01:26:38.339710+0000","last_peered":"2024-05-21T01:26:38.339710+0000","last_clean":"2024-05-21T01:26:38.339710+0000","last_became_active":"2024-05-21T01:19:58.592758+0000","last_became_peered":"2024-05-21T01:19:58.592758+0000","last_unstale":"2024-05-21T01:26:38.339710+0000","last_undegraded":"2024-05-21T01:26:38.339710+0000","last_fullsized":"2024-05-21T01:26:38.339710+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":333,"log_dups_size":0,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:46:17.877736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":170,"num_read_kb":696320,"num_write":318,"num_write_kb":868352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:24.563495+0000","last_change":"2024-05-21T01:19:54.538391+0000","last_active":"2024-05-21T01:24:24.563495+0000","last_peered":"2024-05-21T01:24:24.563495+0000","last_clean":"2024-05-21T01:24:24.563495+0000","last_became_active":"2024-05-21T01:19:54.538106+0000","last_became_peered":"2024-05-21T01:19:54.538106+0000","last_unstale":"2024-05-21T01:24:24.563495+0000","last_undegraded":"2024-05-21T01:24:24.563495+0000","last_fullsized":"2024-05-21T01:24:24.563495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:36:07.297496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"25'2","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:24.532813+0000","last_change":"2024-05-21T01:19:53.551917+0000","last_active":"2024-05-21T01:24:24.532813+0000","last_peered":"2024-05-21T01:24:24.532813+0000","last_clean":"2024-05-21T01:24:24.532813+0000","last_became_active":"2024-05-21T01:19:53.551608+0000","last_became_peered":"2024-05-21T01:19:53.551608+0000","last_unstale":"2024-05-21T01:24:24.532813+0000","last_undegraded":"2024-05-21T01:24:24.532813+0000","last_fullsized":"2024-05-21T01:24:24.532813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:20:54.093966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"27'274","reported_seq":430,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:37.753529+0000","last_change":"2024-05-21T01:19:58.613367+0000","last_active":"2024-05-21T01:26:37.753529+0000","last_peered":"2024-05-21T01:26:37.753529+0000","last_clean":"2024-05-21T01:26:37.753529+0000","last_became_active":"2024-05-21T01:19:58.612950+0000","last_became_peered":"2024-05-21T01:19:58.612950+0000","last_unstale":"2024-05-21T01:26:37.753529+0000","last_undegraded":"2024-05-21T01:26:37.753529+0000","last_fullsized":"2024-05-21T01:26:37.753529+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:32:12.365734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":135,"num_read_kb":552960,"num_write":258,"num_write_kb":704512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:14.476560+0000","last_change":"2024-05-21T01:19:54.548979+0000","last_active":"2024-05-21T01:22:14.476560+0000","last_peered":"2024-05-21T01:22:14.476560+0000","last_clean":"2024-05-21T01:22:14.476560+0000","last_became_active":"2024-05-21T01:19:54.548704+0000","last_became_peered":"2024-05-21T01:19:54.548704+0000","last_unstale":"2024-05-21T01:22:14.476560+0000","last_undegraded":"2024-05-21T01:22:14.476560+0000","last_fullsized":"2024-05-21T01:22:14.476560+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:57:09.076705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"25'15","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:17.469218+0000","last_change":"2024-05-21T01:19:53.542425+0000","last_active":"2024-05-21T01:22:17.469218+0000","last_peered":"2024-05-21T01:22:17.469218+0000","last_clean":"2024-05-21T01:22:17.469218+0000","last_became_active":"2024-05-21T01:19:53.541577+0000","last_became_peered":"2024-05-21T01:19:53.541577+0000","last_unstale":"2024-05-21T01:22:17.469218+0000","last_undegraded":"2024-05-21T01:22:17.469218+0000","last_fullsized":"2024-05-21T01:22:17.469218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:47:54.892789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"27'384","reported_seq":612,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:38.426942+0000","last_change":"2024-05-21T01:20:43.554019+0000","last_active":"2024-05-21T01:26:38.426942+0000","last_peered":"2024-05-21T01:26:38.426942+0000","last_clean":"2024-05-21T01:26:38.426942+0000","last_became_active":"2024-05-21T01:20:43.553035+0000","last_became_peered":"2024-05-21T01:20:43.553035+0000","last_unstale":"2024-05-21T01:26:38.426942+0000","last_undegraded":"2024-05-21T01:26:38.426942+0000","last_fullsized":"2024-05-21T01:26:38.426942+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:00:23.785030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":201,"num_read_kb":823296,"num_write":360,"num_write_kb":983040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1,6],"acting":[5,0,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:14.467762+0000","last_change":"2024-05-21T01:19:54.575541+0000","last_active":"2024-05-21T01:22:14.467762+0000","last_peered":"2024-05-21T01:22:14.467762+0000","last_clean":"2024-05-21T01:22:14.467762+0000","last_became_active":"2024-05-21T01:19:54.575314+0000","last_became_peered":"2024-05-21T01:19:54.575314+0000","last_unstale":"2024-05-21T01:22:14.467762+0000","last_undegraded":"2024-05-21T01:22:14.467762+0000","last_fullsized":"2024-05-21T01:22:14.467762+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:02:36.840590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"25'3","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:14.483933+0000","last_change":"2024-05-21T01:19:53.523758+0000","last_active":"2024-05-21T01:22:14.483933+0000","last_peered":"2024-05-21T01:22:14.483933+0000","last_clean":"2024-05-21T01:22:14.483933+0000","last_became_active":"2024-05-21T01:19:53.523273+0000","last_became_peered":"2024-05-21T01:19:53.523273+0000","last_unstale":"2024-05-21T01:22:14.483933+0000","last_undegraded":"2024-05-21T01:22:14.483933+0000","last_fullsized":"2024-05-21T01:22:14.483933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:05:47.275193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"27'288","reported_seq":455,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:38.413187+0000","last_change":"2024-05-21T01:19:58.621996+0000","last_active":"2024-05-21T01:26:38.413187+0000","last_peered":"2024-05-21T01:26:38.413187+0000","last_clean":"2024-05-21T01:26:38.413187+0000","last_became_active":"2024-05-21T01:19:58.620552+0000","last_became_peered":"2024-05-21T01:19:58.620552+0000","last_unstale":"2024-05-21T01:26:38.413187+0000","last_undegraded":"2024-05-21T01:26:38.413187+0000","last_fullsized":"2024-05-21T01:26:38.413187+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:58:32.635003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":602112,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:14.476602+0000","last_change":"2024-05-21T01:19:54.557379+0000","last_active":"2024-05-21T01:22:14.476602+0000","last_peered":"2024-05-21T01:22:14.476602+0000","last_clean":"2024-05-21T01:22:14.476602+0000","last_became_active":"2024-05-21T01:19:54.550335+0000","last_became_peered":"2024-05-21T01:19:54.550335+0000","last_unstale":"2024-05-21T01:22:14.476602+0000","last_undegraded":"2024-05-21T01:22:14.476602+0000","last_fullsized":"2024-05-21T01:22:14.476602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:24:52.297888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"25'3","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:14.476584+0000","last_change":"2024-05-21T01:19:53.534431+0000","last_active":"2024-05-21T01:22:14.476584+0000","last_peered":"2024-05-21T01:22:14.476584+0000","last_clean":"2024-05-21T01:22:14.476584+0000","last_became_active":"2024-05-21T01:19:53.534174+0000","last_became_peered":"2024-05-21T01:19:53.534174+0000","last_unstale":"2024-05-21T01:22:14.476584+0000","last_undegraded":"2024-05-21T01:22:14.476584+0000","last_fullsized":"2024-05-21T01:22:14.476584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:42:04.743914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"27'287","reported_seq":453,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:37.857440+0000","last_change":"2024-05-21T01:19:58.609289+0000","last_active":"2024-05-21T01:26:37.857440+0000","last_peered":"2024-05-21T01:26:37.857440+0000","last_clean":"2024-05-21T01:26:37.857440+0000","last_became_active":"2024-05-21T01:19:58.608371+0000","last_became_peered":"2024-05-21T01:19:58.608371+0000","last_unstale":"2024-05-21T01:26:37.857440+0000","last_undegraded":"2024-05-21T01:26:37.857440+0000","last_fullsized":"2024-05-21T01:26:37.857440+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":287,"log_dups_size":0,"ondisk_log_size":287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:27:36.997803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":598016,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"27'1","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:42.739115+0000","last_change":"2024-05-21T01:19:54.551617+0000","last_active":"2024-05-21T01:22:42.739115+0000","last_peered":"2024-05-21T01:22:42.739115+0000","last_clean":"2024-05-21T01:22:42.739115+0000","last_became_active":"2024-05-21T01:19:54.550865+0000","last_became_peered":"2024-05-21T01:19:54.550865+0000","last_unstale":"2024-05-21T01:22:42.739115+0000","last_undegraded":"2024-05-21T01:22:42.739115+0000","last_fullsized":"2024-05-21T01:22:42.739115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:32:44.168265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"25'6","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:17.471297+0000","last_change":"2024-05-21T01:19:53.535936+0000","last_active":"2024-05-21T01:22:17.471297+0000","last_peered":"2024-05-21T01:22:17.471297+0000","last_clean":"2024-05-21T01:22:17.471297+0000","last_became_active":"2024-05-21T01:19:53.535143+0000","last_became_peered":"2024-05-21T01:19:53.535143+0000","last_unstale":"2024-05-21T01:22:17.471297+0000","last_undegraded":"2024-05-21T01:22:17.471297+0000","last_fullsized":"2024-05-21T01:22:17.471297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:50:51.433726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"27'338","reported_seq":542,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:37.816577+0000","last_change":"2024-05-21T01:19:58.622615+0000","last_active":"2024-05-21T01:26:37.816577+0000","last_peered":"2024-05-21T01:26:37.816577+0000","last_clean":"2024-05-21T01:26:37.816577+0000","last_became_active":"2024-05-21T01:19:58.622250+0000","last_became_peered":"2024-05-21T01:19:58.622250+0000","last_unstale":"2024-05-21T01:26:37.816577+0000","last_undegraded":"2024-05-21T01:26:37.816577+0000","last_fullsized":"2024-05-21T01:26:37.816577+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:05:22.913945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":184,"num_read_kb":753664,"num_write":327,"num_write_kb":892928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:19.484407+0000","last_change":"2024-05-21T01:19:54.558348+0000","last_active":"2024-05-21T01:22:19.484407+0000","last_peered":"2024-05-21T01:22:19.484407+0000","last_clean":"2024-05-21T01:22:19.484407+0000","last_became_active":"2024-05-21T01:19:54.558095+0000","last_became_peered":"2024-05-21T01:19:54.558095+0000","last_unstale":"2024-05-21T01:22:19.484407+0000","last_undegraded":"2024-05-21T01:22:19.484407+0000","last_fullsized":"2024-05-21T01:22:19.484407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:43:48.625583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'1401","reported_seq":1429,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:38.100574+0000","last_change":"2024-05-21T01:19:53.534947+0000","last_active":"2024-05-21T01:26:38.100574+0000","last_peered":"2024-05-21T01:26:38.100574+0000","last_clean":"2024-05-21T01:26:38.100574+0000","last_became_active":"2024-05-21T01:19:53.534616+0000","last_became_peered":"2024-05-21T01:19:53.534616+0000","last_unstale":"2024-05-21T01:26:38.100574+0000","last_undegraded":"2024-05-21T01:26:38.100574+0000","last_fullsized":"2024-05-21T01:26:38.100574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":1401,"log_dups_size":0,"ondisk_log_size":1401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:01:25.372035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2840812,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1401,"num_write_kb":2941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"27'292","reported_seq":472,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:37.447318+0000","last_change":"2024-05-21T01:19:58.617970+0000","last_active":"2024-05-21T01:26:37.447318+0000","last_peered":"2024-05-21T01:26:37.447318+0000","last_clean":"2024-05-21T01:26:37.447318+0000","last_became_active":"2024-05-21T01:19:58.617061+0000","last_became_peered":"2024-05-21T01:19:58.617061+0000","last_unstale":"2024-05-21T01:26:37.447318+0000","last_undegraded":"2024-05-21T01:26:37.447318+0000","last_fullsized":"2024-05-21T01:26:37.447318+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":292,"log_dups_size":0,"ondisk_log_size":292,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:48:50.703577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":160,"num_read_kb":655360,"num_write":276,"num_write_kb":786432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:14.476618+0000","last_change":"2024-05-21T01:19:54.557175+0000","last_active":"2024-05-21T01:22:14.476618+0000","last_peered":"2024-05-21T01:22:14.476618+0000","last_clean":"2024-05-21T01:22:14.476618+0000","last_became_active":"2024-05-21T01:19:54.556933+0000","last_became_peered":"2024-05-21T01:19:54.556933+0000","last_unstale":"2024-05-21T01:22:14.476618+0000","last_undegraded":"2024-05-21T01:22:14.476618+0000","last_fullsized":"2024-05-21T01:22:14.476618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:15:44.089544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"27'7","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:23:09.625489+0000","last_change":"2024-05-21T01:19:53.536780+0000","last_active":"2024-05-21T01:23:09.625489+0000","last_peered":"2024-05-21T01:23:09.625489+0000","last_clean":"2024-05-21T01:23:09.625489+0000","last_became_active":"2024-05-21T01:19:53.535768+0000","last_became_peered":"2024-05-21T01:19:53.535768+0000","last_unstale":"2024-05-21T01:23:09.625489+0000","last_undegraded":"2024-05-21T01:23:09.625489+0000","last_fullsized":"2024-05-21T01:23:09.625489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:04:14.732801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"27'320","reported_seq":514,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:38.342272+0000","last_change":"2024-05-21T01:19:58.606532+0000","last_active":"2024-05-21T01:26:38.342272+0000","last_peered":"2024-05-21T01:26:38.342272+0000","last_clean":"2024-05-21T01:26:38.342272+0000","last_became_active":"2024-05-21T01:19:58.606180+0000","last_became_peered":"2024-05-21T01:19:58.606180+0000","last_unstale":"2024-05-21T01:26:38.342272+0000","last_undegraded":"2024-05-21T01:26:38.342272+0000","last_fullsized":"2024-05-21T01:26:38.342272+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:25:31.161427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":174,"num_read_kb":712704,"num_write":297,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:23.483713+0000","last_change":"2024-05-21T01:19:54.571280+0000","last_active":"2024-05-21T01:22:23.483713+0000","last_peered":"2024-05-21T01:22:23.483713+0000","last_clean":"2024-05-21T01:22:23.483713+0000","last_became_active":"2024-05-21T01:19:54.568778+0000","last_became_peered":"2024-05-21T01:19:54.568778+0000","last_unstale":"2024-05-21T01:22:23.483713+0000","last_undegraded":"2024-05-21T01:22:23.483713+0000","last_fullsized":"2024-05-21T01:22:23.483713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:43:16.583632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"25'2","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:19.484415+0000","last_change":"2024-05-21T01:19:53.530770+0000","last_active":"2024-05-21T01:22:19.484415+0000","last_peered":"2024-05-21T01:22:19.484415+0000","last_clean":"2024-05-21T01:22:19.484415+0000","last_became_active":"2024-05-21T01:19:53.526431+0000","last_became_peered":"2024-05-21T01:19:53.526431+0000","last_unstale":"2024-05-21T01:22:19.484415+0000","last_undegraded":"2024-05-21T01:22:19.484415+0000","last_fullsized":"2024-05-21T01:22:19.484415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:08:59.892029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"27'308","reported_seq":482,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:37.507162+0000","last_change":"2024-05-21T01:19:58.611576+0000","last_active":"2024-05-21T01:26:37.507162+0000","last_peered":"2024-05-21T01:26:37.507162+0000","last_clean":"2024-05-21T01:26:37.507162+0000","last_became_active":"2024-05-21T01:19:58.610838+0000","last_became_peered":"2024-05-21T01:19:58.610838+0000","last_unstale":"2024-05-21T01:26:37.507162+0000","last_undegraded":"2024-05-21T01:26:37.507162+0000","last_fullsized":"2024-05-21T01:26:37.507162+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":308,"log_dups_size":0,"ondisk_log_size":308,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:07:31.736640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":154,"num_read_kb":630784,"num_write":289,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:19.468434+0000","last_change":"2024-05-21T01:19:54.552709+0000","last_active":"2024-05-21T01:22:19.468434+0000","last_peered":"2024-05-21T01:22:19.468434+0000","last_clean":"2024-05-21T01:22:19.468434+0000","last_became_active":"2024-05-21T01:19:54.547898+0000","last_became_peered":"2024-05-21T01:19:54.547898+0000","last_unstale":"2024-05-21T01:22:19.468434+0000","last_undegraded":"2024-05-21T01:22:19.468434+0000","last_fullsized":"2024-05-21T01:22:19.468434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:20:17.933506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"27'4","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:42.723905+0000","last_change":"2024-05-21T01:19:53.534507+0000","last_active":"2024-05-21T01:22:42.723905+0000","last_peered":"2024-05-21T01:22:42.723905+0000","last_clean":"2024-05-21T01:22:42.723905+0000","last_became_active":"2024-05-21T01:19:53.534036+0000","last_became_peered":"2024-05-21T01:19:53.534036+0000","last_unstale":"2024-05-21T01:22:42.723905+0000","last_undegraded":"2024-05-21T01:22:42.723905+0000","last_fullsized":"2024-05-21T01:22:42.723905+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:01:08.218098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"27'333","reported_seq":527,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:37.225760+0000","last_change":"2024-05-21T01:19:58.608135+0000","last_active":"2024-05-21T01:26:37.225760+0000","last_peered":"2024-05-21T01:26:37.225760+0000","last_clean":"2024-05-21T01:26:37.225760+0000","last_became_active":"2024-05-21T01:19:58.607242+0000","last_became_peered":"2024-05-21T01:19:58.607242+0000","last_unstale":"2024-05-21T01:26:37.225760+0000","last_undegraded":"2024-05-21T01:26:37.225760+0000","last_fullsized":"2024-05-21T01:26:37.225760+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":333,"log_dups_size":0,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:05:26.197876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":174,"num_read_kb":712704,"num_write":318,"num_write_kb":892928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"27'274","reported_seq":451,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:37.505912+0000","last_change":"2024-05-21T01:19:58.624883+0000","last_active":"2024-05-21T01:26:37.505912+0000","last_peered":"2024-05-21T01:26:37.505912+0000","last_clean":"2024-05-21T01:26:37.505912+0000","last_became_active":"2024-05-21T01:19:58.623991+0000","last_became_peered":"2024-05-21T01:19:58.623991+0000","last_unstale":"2024-05-21T01:26:37.505912+0000","last_undegraded":"2024-05-21T01:26:37.505912+0000","last_fullsized":"2024-05-21T01:26:37.505912+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:29:26.251376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":156,"num_read_kb":638976,"num_write":260,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"27'1","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:47.497400+0000","last_change":"2024-05-21T01:19:54.549215+0000","last_active":"2024-05-21T01:24:47.497400+0000","last_peered":"2024-05-21T01:24:47.497400+0000","last_clean":"2024-05-21T01:24:47.497400+0000","last_became_active":"2024-05-21T01:19:54.548426+0000","last_became_peered":"2024-05-21T01:19:54.548426+0000","last_unstale":"2024-05-21T01:24:47.497400+0000","last_undegraded":"2024-05-21T01:24:47.497400+0000","last_fullsized":"2024-05-21T01:24:47.497400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:10:10.800391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"25'1","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:19.477048+0000","last_change":"2024-05-21T01:19:53.526106+0000","last_active":"2024-05-21T01:22:19.477048+0000","last_peered":"2024-05-21T01:22:19.477048+0000","last_clean":"2024-05-21T01:22:19.477048+0000","last_became_active":"2024-05-21T01:19:53.525786+0000","last_became_peered":"2024-05-21T01:19:53.525786+0000","last_unstale":"2024-05-21T01:22:19.477048+0000","last_undegraded":"2024-05-21T01:22:19.477048+0000","last_fullsized":"2024-05-21T01:22:19.477048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:01:05.180803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"27'277","reported_seq":450,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:38.397676+0000","last_change":"2024-05-21T01:19:58.615481+0000","last_active":"2024-05-21T01:26:38.397676+0000","last_peered":"2024-05-21T01:26:38.397676+0000","last_clean":"2024-05-21T01:26:38.397676+0000","last_became_active":"2024-05-21T01:19:58.614879+0000","last_became_peered":"2024-05-21T01:19:58.614879+0000","last_unstale":"2024-05-21T01:26:38.397676+0000","last_undegraded":"2024-05-21T01:26:38.397676+0000","last_fullsized":"2024-05-21T01:26:38.397676+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:45:57.208342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":622592,"num_write":267,"num_write_kb":729088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:23.483559+0000","last_change":"2024-05-21T01:19:54.570650+0000","last_active":"2024-05-21T01:22:23.483559+0000","last_peered":"2024-05-21T01:22:23.483559+0000","last_clean":"2024-05-21T01:22:23.483559+0000","last_became_active":"2024-05-21T01:19:54.570034+0000","last_became_peered":"2024-05-21T01:19:54.570034+0000","last_unstale":"2024-05-21T01:22:23.483559+0000","last_undegraded":"2024-05-21T01:22:23.483559+0000","last_fullsized":"2024-05-21T01:22:23.483559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:01:05.887729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"25'2","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:18.478669+0000","last_change":"2024-05-21T01:19:53.532017+0000","last_active":"2024-05-21T01:22:18.478669+0000","last_peered":"2024-05-21T01:22:18.478669+0000","last_clean":"2024-05-21T01:22:18.478669+0000","last_became_active":"2024-05-21T01:19:53.529457+0000","last_became_peered":"2024-05-21T01:19:53.529457+0000","last_unstale":"2024-05-21T01:22:18.478669+0000","last_undegraded":"2024-05-21T01:22:18.478669+0000","last_fullsized":"2024-05-21T01:22:18.478669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:58:03.979929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"25'3","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:24.486665+0000","last_change":"2024-05-21T01:19:53.525620+0000","last_active":"2024-05-21T01:22:24.486665+0000","last_peered":"2024-05-21T01:22:24.486665+0000","last_clean":"2024-05-21T01:22:24.486665+0000","last_became_active":"2024-05-21T01:19:53.525315+0000","last_became_peered":"2024-05-21T01:19:53.525315+0000","last_unstale":"2024-05-21T01:22:24.486665+0000","last_undegraded":"2024-05-21T01:22:24.486665+0000","last_fullsized":"2024-05-21T01:22:24.486665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:30:38.075463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:27.470739+0000","last_change":"2024-05-21T01:19:54.555344+0000","last_active":"2024-05-21T01:22:27.470739+0000","last_peered":"2024-05-21T01:22:27.470739+0000","last_clean":"2024-05-21T01:22:27.470739+0000","last_became_active":"2024-05-21T01:19:54.552817+0000","last_became_peered":"2024-05-21T01:19:54.552817+0000","last_unstale":"2024-05-21T01:22:27.470739+0000","last_undegraded":"2024-05-21T01:22:27.470739+0000","last_fullsized":"2024-05-21T01:22:27.470739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:10:03.810064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"27'306","reported_seq":496,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:37.366700+0000","last_change":"2024-05-21T01:19:58.619520+0000","last_active":"2024-05-21T01:26:37.366700+0000","last_peered":"2024-05-21T01:26:37.366700+0000","last_clean":"2024-05-21T01:26:37.366700+0000","last_became_active":"2024-05-21T01:19:58.617165+0000","last_became_peered":"2024-05-21T01:19:58.617165+0000","last_unstale":"2024-05-21T01:26:37.366700+0000","last_undegraded":"2024-05-21T01:26:37.366700+0000","last_fullsized":"2024-05-21T01:26:37.366700+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":306,"log_dups_size":0,"ondisk_log_size":306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T13:07:51.530746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":170,"num_read_kb":696320,"num_write":287,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"25'6","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:23.483608+0000","last_change":"2024-05-21T01:19:53.551547+0000","last_active":"2024-05-21T01:22:23.483608+0000","last_peered":"2024-05-21T01:22:23.483608+0000","last_clean":"2024-05-21T01:22:23.483608+0000","last_became_active":"2024-05-21T01:19:53.550931+0000","last_became_peered":"2024-05-21T01:19:53.550931+0000","last_unstale":"2024-05-21T01:22:23.483608+0000","last_undegraded":"2024-05-21T01:22:23.483608+0000","last_fullsized":"2024-05-21T01:22:23.483608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:13:47.329230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:24.468719+0000","last_change":"2024-05-21T01:19:54.574552+0000","last_active":"2024-05-21T01:22:24.468719+0000","last_peered":"2024-05-21T01:22:24.468719+0000","last_clean":"2024-05-21T01:22:24.468719+0000","last_became_active":"2024-05-21T01:19:54.574246+0000","last_became_peered":"2024-05-21T01:19:54.574246+0000","last_unstale":"2024-05-21T01:22:24.468719+0000","last_undegraded":"2024-05-21T01:22:24.468719+0000","last_fullsized":"2024-05-21T01:22:24.468719+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:23:33.685798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"27'316","reported_seq":508,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:37.411321+0000","last_change":"2024-05-21T01:19:58.624400+0000","last_active":"2024-05-21T01:26:37.411321+0000","last_peered":"2024-05-21T01:26:37.411321+0000","last_clean":"2024-05-21T01:26:37.411321+0000","last_became_active":"2024-05-21T01:19:58.623388+0000","last_became_peered":"2024-05-21T01:19:58.623388+0000","last_unstale":"2024-05-21T01:26:37.411321+0000","last_undegraded":"2024-05-21T01:26:37.411321+0000","last_fullsized":"2024-05-21T01:26:37.411321+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":316,"log_dups_size":0,"ondisk_log_size":316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:59:30.019393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":172,"num_read_kb":704512,"num_write":302,"num_write_kb":851968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:04.542395+0000","last_change":"2024-05-21T01:19:54.553262+0000","last_active":"2024-05-21T01:24:04.542395+0000","last_peered":"2024-05-21T01:24:04.542395+0000","last_clean":"2024-05-21T01:24:04.542395+0000","last_became_active":"2024-05-21T01:19:54.553060+0000","last_became_peered":"2024-05-21T01:19:54.553060+0000","last_unstale":"2024-05-21T01:24:04.542395+0000","last_undegraded":"2024-05-21T01:24:04.542395+0000","last_fullsized":"2024-05-21T01:24:04.542395+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:18:14.077480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:07.486721+0000","last_change":"2024-05-21T01:19:54.566851+0000","last_active":"2024-05-21T01:24:07.486721+0000","last_peered":"2024-05-21T01:24:07.486721+0000","last_clean":"2024-05-21T01:24:07.486721+0000","last_became_active":"2024-05-21T01:19:54.565573+0000","last_became_peered":"2024-05-21T01:19:54.565573+0000","last_unstale":"2024-05-21T01:24:07.486721+0000","last_undegraded":"2024-05-21T01:24:07.486721+0000","last_fullsized":"2024-05-21T01:24:07.486721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:51:30.883954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:04.555306+0000","last_change":"2024-05-21T01:19:54.566934+0000","last_active":"2024-05-21T01:24:04.555306+0000","last_peered":"2024-05-21T01:24:04.555306+0000","last_clean":"2024-05-21T01:24:04.555306+0000","last_became_active":"2024-05-21T01:19:54.566503+0000","last_became_peered":"2024-05-21T01:19:54.566503+0000","last_unstale":"2024-05-21T01:24:04.555306+0000","last_undegraded":"2024-05-21T01:24:04.555306+0000","last_fullsized":"2024-05-21T01:24:04.555306+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:14:54.262165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:08.498777+0000","last_change":"2024-05-21T01:19:54.573091+0000","last_active":"2024-05-21T01:24:08.498777+0000","last_peered":"2024-05-21T01:24:08.498777+0000","last_clean":"2024-05-21T01:24:08.498777+0000","last_became_active":"2024-05-21T01:19:54.572366+0000","last_became_peered":"2024-05-21T01:19:54.572366+0000","last_unstale":"2024-05-21T01:24:08.498777+0000","last_undegraded":"2024-05-21T01:24:08.498777+0000","last_fullsized":"2024-05-21T01:24:08.498777+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:10:09.353807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:18.508498+0000","last_change":"2024-05-21T01:19:54.563339+0000","last_active":"2024-05-21T01:24:18.508498+0000","last_peered":"2024-05-21T01:24:18.508498+0000","last_clean":"2024-05-21T01:24:18.508498+0000","last_became_active":"2024-05-21T01:19:54.557934+0000","last_became_peered":"2024-05-21T01:19:54.557934+0000","last_unstale":"2024-05-21T01:24:18.508498+0000","last_undegraded":"2024-05-21T01:24:18.508498+0000","last_fullsized":"2024-05-21T01:24:18.508498+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:46:21.598689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:18.508542+0000","last_change":"2024-05-21T01:19:54.553551+0000","last_active":"2024-05-21T01:24:18.508542+0000","last_peered":"2024-05-21T01:24:18.508542+0000","last_clean":"2024-05-21T01:24:18.508542+0000","last_became_active":"2024-05-21T01:19:54.552812+0000","last_became_peered":"2024-05-21T01:19:54.552812+0000","last_unstale":"2024-05-21T01:24:18.508542+0000","last_undegraded":"2024-05-21T01:24:18.508542+0000","last_fullsized":"2024-05-21T01:24:18.508542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:27:41.166606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:14.543296+0000","last_change":"2024-05-21T01:19:54.548604+0000","last_active":"2024-05-21T01:24:14.543296+0000","last_peered":"2024-05-21T01:24:14.543296+0000","last_clean":"2024-05-21T01:24:14.543296+0000","last_became_active":"2024-05-21T01:19:54.548263+0000","last_became_peered":"2024-05-21T01:19:54.548263+0000","last_unstale":"2024-05-21T01:24:14.543296+0000","last_undegraded":"2024-05-21T01:24:14.543296+0000","last_fullsized":"2024-05-21T01:24:14.543296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:33:55.302088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:18.503082+0000","last_change":"2024-05-21T01:19:54.573995+0000","last_active":"2024-05-21T01:24:18.503082+0000","last_peered":"2024-05-21T01:24:18.503082+0000","last_clean":"2024-05-21T01:24:18.503082+0000","last_became_active":"2024-05-21T01:19:54.570373+0000","last_became_peered":"2024-05-21T01:19:54.570373+0000","last_unstale":"2024-05-21T01:24:18.503082+0000","last_undegraded":"2024-05-21T01:24:18.503082+0000","last_fullsized":"2024-05-21T01:24:18.503082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:44:23.194713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:14.556285+0000","last_change":"2024-05-21T01:19:54.575196+0000","last_active":"2024-05-21T01:24:14.556285+0000","last_peered":"2024-05-21T01:24:14.556285+0000","last_clean":"2024-05-21T01:24:14.556285+0000","last_became_active":"2024-05-21T01:19:54.574945+0000","last_became_peered":"2024-05-21T01:19:54.574945+0000","last_unstale":"2024-05-21T01:24:14.556285+0000","last_undegraded":"2024-05-21T01:24:14.556285+0000","last_fullsized":"2024-05-21T01:24:14.556285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:52:56.244771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:13.481163+0000","last_change":"2024-05-21T01:19:54.566719+0000","last_active":"2024-05-21T01:22:13.481163+0000","last_peered":"2024-05-21T01:22:13.481163+0000","last_clean":"2024-05-21T01:22:13.481163+0000","last_became_active":"2024-05-21T01:19:54.565922+0000","last_became_peered":"2024-05-21T01:19:54.565922+0000","last_unstale":"2024-05-21T01:22:13.481163+0000","last_undegraded":"2024-05-21T01:22:13.481163+0000","last_fullsized":"2024-05-21T01:22:13.481163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:39:19.454688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:24.517869+0000","last_change":"2024-05-21T01:19:54.536815+0000","last_active":"2024-05-21T01:24:24.517869+0000","last_peered":"2024-05-21T01:24:24.517869+0000","last_clean":"2024-05-21T01:24:24.517869+0000","last_became_active":"2024-05-21T01:19:54.535957+0000","last_became_peered":"2024-05-21T01:19:54.535957+0000","last_unstale":"2024-05-21T01:24:24.517869+0000","last_undegraded":"2024-05-21T01:24:24.517869+0000","last_fullsized":"2024-05-21T01:24:24.517869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:24:53.906256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:12.468542+0000","last_change":"2024-05-21T01:19:54.552466+0000","last_active":"2024-05-21T01:22:12.468542+0000","last_peered":"2024-05-21T01:22:12.468542+0000","last_clean":"2024-05-21T01:22:12.468542+0000","last_became_active":"2024-05-21T01:19:54.551790+0000","last_became_peered":"2024-05-21T01:19:54.551790+0000","last_unstale":"2024-05-21T01:22:12.468542+0000","last_undegraded":"2024-05-21T01:22:12.468542+0000","last_fullsized":"2024-05-21T01:22:12.468542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:24:34.737707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:24.532708+0000","last_change":"2024-05-21T01:19:54.535314+0000","last_active":"2024-05-21T01:24:24.532708+0000","last_peered":"2024-05-21T01:24:24.532708+0000","last_clean":"2024-05-21T01:24:24.532708+0000","last_became_active":"2024-05-21T01:19:54.534793+0000","last_became_peered":"2024-05-21T01:19:54.534793+0000","last_unstale":"2024-05-21T01:24:24.532708+0000","last_undegraded":"2024-05-21T01:24:24.532708+0000","last_fullsized":"2024-05-21T01:24:24.532708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:52:35.492250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:24.595517+0000","last_change":"2024-05-21T01:19:54.556323+0000","last_active":"2024-05-21T01:24:24.595517+0000","last_peered":"2024-05-21T01:24:24.595517+0000","last_clean":"2024-05-21T01:24:24.595517+0000","last_became_active":"2024-05-21T01:19:54.556043+0000","last_became_peered":"2024-05-21T01:19:54.556043+0000","last_unstale":"2024-05-21T01:24:24.595517+0000","last_undegraded":"2024-05-21T01:24:24.595517+0000","last_fullsized":"2024-05-21T01:24:24.595517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:34:02.068527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:17.471339+0000","last_change":"2024-05-21T01:19:54.567457+0000","last_active":"2024-05-21T01:22:17.471339+0000","last_peered":"2024-05-21T01:22:17.471339+0000","last_clean":"2024-05-21T01:22:17.471339+0000","last_became_active":"2024-05-21T01:19:54.565326+0000","last_became_peered":"2024-05-21T01:19:54.565326+0000","last_unstale":"2024-05-21T01:22:17.471339+0000","last_undegraded":"2024-05-21T01:22:17.471339+0000","last_fullsized":"2024-05-21T01:22:17.471339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:11:05.775389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:14.476659+0000","last_change":"2024-05-21T01:19:54.562078+0000","last_active":"2024-05-21T01:22:14.476659+0000","last_peered":"2024-05-21T01:22:14.476659+0000","last_clean":"2024-05-21T01:22:14.476659+0000","last_became_active":"2024-05-21T01:19:54.558286+0000","last_became_peered":"2024-05-21T01:19:54.558286+0000","last_unstale":"2024-05-21T01:22:14.476659+0000","last_undegraded":"2024-05-21T01:22:14.476659+0000","last_fullsized":"2024-05-21T01:22:14.476659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T09:09:58.360014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:14.476530+0000","last_change":"2024-05-21T01:19:54.548274+0000","last_active":"2024-05-21T01:22:14.476530+0000","last_peered":"2024-05-21T01:22:14.476530+0000","last_clean":"2024-05-21T01:22:14.476530+0000","last_became_active":"2024-05-21T01:19:54.548079+0000","last_became_peered":"2024-05-21T01:19:54.548079+0000","last_unstale":"2024-05-21T01:22:14.476530+0000","last_undegraded":"2024-05-21T01:22:14.476530+0000","last_fullsized":"2024-05-21T01:22:14.476530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:49:03.296571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:18.482423+0000","last_change":"2024-05-21T01:19:54.568211+0000","last_active":"2024-05-21T01:22:18.482423+0000","last_peered":"2024-05-21T01:22:18.482423+0000","last_clean":"2024-05-21T01:22:18.482423+0000","last_became_active":"2024-05-21T01:19:54.567512+0000","last_became_peered":"2024-05-21T01:19:54.567512+0000","last_unstale":"2024-05-21T01:22:18.482423+0000","last_undegraded":"2024-05-21T01:22:18.482423+0000","last_fullsized":"2024-05-21T01:22:18.482423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:32:18.004763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:18.478735+0000","last_change":"2024-05-21T01:19:54.556683+0000","last_active":"2024-05-21T01:22:18.478735+0000","last_peered":"2024-05-21T01:22:18.478735+0000","last_clean":"2024-05-21T01:22:18.478735+0000","last_became_active":"2024-05-21T01:19:54.555947+0000","last_became_peered":"2024-05-21T01:19:54.555947+0000","last_unstale":"2024-05-21T01:22:18.478735+0000","last_undegraded":"2024-05-21T01:22:18.478735+0000","last_fullsized":"2024-05-21T01:22:18.478735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:59:04.593946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:23.479642+0000","last_change":"2024-05-21T01:19:54.560218+0000","last_active":"2024-05-21T01:22:23.479642+0000","last_peered":"2024-05-21T01:22:23.479642+0000","last_clean":"2024-05-21T01:22:23.479642+0000","last_became_active":"2024-05-21T01:19:54.557787+0000","last_became_peered":"2024-05-21T01:19:54.557787+0000","last_unstale":"2024-05-21T01:22:23.479642+0000","last_undegraded":"2024-05-21T01:22:23.479642+0000","last_fullsized":"2024-05-21T01:22:23.479642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:05:48.282563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:19.484381+0000","last_change":"2024-05-21T01:19:54.535096+0000","last_active":"2024-05-21T01:22:19.484381+0000","last_peered":"2024-05-21T01:22:19.484381+0000","last_clean":"2024-05-21T01:22:19.484381+0000","last_became_active":"2024-05-21T01:19:54.534472+0000","last_became_peered":"2024-05-21T01:19:54.534472+0000","last_unstale":"2024-05-21T01:22:19.484381+0000","last_undegraded":"2024-05-21T01:22:19.484381+0000","last_fullsized":"2024-05-21T01:22:19.484381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:05:40.018457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:19.484397+0000","last_change":"2024-05-21T01:19:54.546352+0000","last_active":"2024-05-21T01:22:19.484397+0000","last_peered":"2024-05-21T01:22:19.484397+0000","last_clean":"2024-05-21T01:22:19.484397+0000","last_became_active":"2024-05-21T01:19:54.546055+0000","last_became_peered":"2024-05-21T01:19:54.546055+0000","last_unstale":"2024-05-21T01:22:19.484397+0000","last_undegraded":"2024-05-21T01:22:19.484397+0000","last_fullsized":"2024-05-21T01:22:19.484397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:14:56.268312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"27'1","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:23:12.478847+0000","last_change":"2024-05-21T01:20:43.551219+0000","last_active":"2024-05-21T01:23:12.478847+0000","last_peered":"2024-05-21T01:23:12.478847+0000","last_clean":"2024-05-21T01:23:12.478847+0000","last_became_active":"2024-05-21T01:20:43.550179+0000","last_became_peered":"2024-05-21T01:20:43.550179+0000","last_unstale":"2024-05-21T01:23:12.478847+0000","last_undegraded":"2024-05-21T01:23:12.478847+0000","last_fullsized":"2024-05-21T01:23:12.478847+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:00:31.919441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:19.468196+0000","last_change":"2024-05-21T01:19:54.548954+0000","last_active":"2024-05-21T01:22:19.468196+0000","last_peered":"2024-05-21T01:22:19.468196+0000","last_clean":"2024-05-21T01:22:19.468196+0000","last_became_active":"2024-05-21T01:19:54.547528+0000","last_became_peered":"2024-05-21T01:19:54.547528+0000","last_unstale":"2024-05-21T01:22:19.468196+0000","last_undegraded":"2024-05-21T01:22:19.468196+0000","last_fullsized":"2024-05-21T01:22:19.468196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:47:24.598610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:28.484197+0000","last_change":"2024-05-21T01:19:54.575256+0000","last_active":"2024-05-21T01:22:28.484197+0000","last_peered":"2024-05-21T01:22:28.484197+0000","last_clean":"2024-05-21T01:22:28.484197+0000","last_became_active":"2024-05-21T01:19:54.570119+0000","last_became_peered":"2024-05-21T01:19:54.570119+0000","last_unstale":"2024-05-21T01:22:28.484197+0000","last_undegraded":"2024-05-21T01:22:28.484197+0000","last_fullsized":"2024-05-21T01:22:28.484197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:10:02.800110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:24.484926+0000","last_change":"2024-05-21T01:19:54.550134+0000","last_active":"2024-05-21T01:22:24.484926+0000","last_peered":"2024-05-21T01:22:24.484926+0000","last_clean":"2024-05-21T01:22:24.484926+0000","last_became_active":"2024-05-21T01:19:54.549617+0000","last_became_peered":"2024-05-21T01:19:54.549617+0000","last_unstale":"2024-05-21T01:22:24.484926+0000","last_undegraded":"2024-05-21T01:22:24.484926+0000","last_fullsized":"2024-05-21T01:22:24.484926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:34:59.845458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:24.469102+0000","last_change":"2024-05-21T01:19:54.555653+0000","last_active":"2024-05-21T01:22:24.469102+0000","last_peered":"2024-05-21T01:22:24.469102+0000","last_clean":"2024-05-21T01:22:24.469102+0000","last_became_active":"2024-05-21T01:19:54.555274+0000","last_became_peered":"2024-05-21T01:19:54.555274+0000","last_unstale":"2024-05-21T01:22:24.469102+0000","last_undegraded":"2024-05-21T01:22:24.469102+0000","last_fullsized":"2024-05-21T01:22:24.469102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:43:43.237853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:24.484953+0000","last_change":"2024-05-21T01:19:54.568866+0000","last_active":"2024-05-21T01:22:24.484953+0000","last_peered":"2024-05-21T01:22:24.484953+0000","last_clean":"2024-05-21T01:22:24.484953+0000","last_became_active":"2024-05-21T01:19:54.568605+0000","last_became_peered":"2024-05-21T01:19:54.568605+0000","last_unstale":"2024-05-21T01:22:24.484953+0000","last_undegraded":"2024-05-21T01:22:24.484953+0000","last_fullsized":"2024-05-21T01:22:24.484953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:21:20.820620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:23:54.541542+0000","last_change":"2024-05-21T01:19:54.557468+0000","last_active":"2024-05-21T01:23:54.541542+0000","last_peered":"2024-05-21T01:23:54.541542+0000","last_clean":"2024-05-21T01:23:54.541542+0000","last_became_active":"2024-05-21T01:19:54.554976+0000","last_became_peered":"2024-05-21T01:19:54.554976+0000","last_unstale":"2024-05-21T01:23:54.541542+0000","last_undegraded":"2024-05-21T01:23:54.541542+0000","last_fullsized":"2024-05-21T01:23:54.541542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:25:08.737348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:08.498825+0000","last_change":"2024-05-21T01:19:54.566991+0000","last_active":"2024-05-21T01:24:08.498825+0000","last_peered":"2024-05-21T01:24:08.498825+0000","last_clean":"2024-05-21T01:24:08.498825+0000","last_became_active":"2024-05-21T01:19:54.566349+0000","last_became_peered":"2024-05-21T01:19:54.566349+0000","last_unstale":"2024-05-21T01:24:08.498825+0000","last_undegraded":"2024-05-21T01:24:08.498825+0000","last_fullsized":"2024-05-21T01:24:08.498825+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:25:43.468081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:08.498850+0000","last_change":"2024-05-21T01:19:54.576100+0000","last_active":"2024-05-21T01:24:08.498850+0000","last_peered":"2024-05-21T01:24:08.498850+0000","last_clean":"2024-05-21T01:24:08.498850+0000","last_became_active":"2024-05-21T01:19:54.574914+0000","last_became_peered":"2024-05-21T01:19:54.574914+0000","last_unstale":"2024-05-21T01:24:08.498850+0000","last_undegraded":"2024-05-21T01:24:08.498850+0000","last_fullsized":"2024-05-21T01:24:08.498850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:29:30.730283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:04.508300+0000","last_change":"2024-05-21T01:19:54.546570+0000","last_active":"2024-05-21T01:24:04.508300+0000","last_peered":"2024-05-21T01:24:04.508300+0000","last_clean":"2024-05-21T01:24:04.508300+0000","last_became_active":"2024-05-21T01:19:54.546284+0000","last_became_peered":"2024-05-21T01:19:54.546284+0000","last_unstale":"2024-05-21T01:24:04.508300+0000","last_undegraded":"2024-05-21T01:24:04.508300+0000","last_fullsized":"2024-05-21T01:24:04.508300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:36:30.219522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":369098752,"num_objects":88,"num_object_clones":0,"num_object_copies":352,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":5128,"num_read_kb":21004288,"num_write":9128,"num_write_kb":25165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45219840,"data_stored":723517440,"data_compressed":35826240,"data_compressed_allocated":45219840,"data_compressed_original":723517440,"omap_allocated":0,"internal_metadata":0},"log_size":9643,"ondisk_log_size":9643,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2845007,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":1580,"num_write_kb":3000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":5840896,"data_stored":5682172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1542,"ondisk_log_size":1542,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66932,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509527,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49516,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94322324,"statfs":{"total":96636764160,"available":96586059776,"internally_reserved":0,"allocated":299008,"data_stored":117691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":50395592},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509527,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48124,"kb_used_data":3060,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94323716,"statfs":{"total":96636764160,"available":96587485184,"internally_reserved":0,"allocated":3133440,"data_stored":2953815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509525,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49572,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94322268,"statfs":{"total":96636764160,"available":96586002432,"internally_reserved":0,"allocated":356352,"data_stored":706993,"data_compressed":33466,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509525,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35632,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336208,"statfs":{"total":96636764160,"available":96600276992,"internally_reserved":0,"allocated":303104,"data_stored":117781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542230,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56296,"kb_used_data":7072,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94315544,"statfs":{"total":96636764160,"available":96579117056,"internally_reserved":0,"allocated":7241728,"data_stored":111266983,"data_compressed":5474816,"data_compressed_allocated":6946816,"data_compressed_original":111149056,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542230,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63348,"kb_used_data":18284,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94308492,"statfs":{"total":96636764160,"available":96571895808,"internally_reserved":0,"allocated":18722816,"data_stored":294309502,"data_compressed":14325786,"data_compressed_allocated":18395136,"data_compressed_original":294174720,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,1,1,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574933,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":119288,"kb_used_data":70064,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94252552,"statfs":{"total":96636764160,"available":96514613248,"internally_reserved":0,"allocated":71745536,"data_stored":1143065540,"data_compressed":56865920,"data_compressed_allocated":71434240,"data_compressed_original":1142947840,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574933,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":110548,"kb_used_data":61324,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94261292,"statfs":{"total":96636764160,"available":96523563008,"internally_reserved":0,"allocated":62795776,"data_stored":957155163,"data_compressed":47020064,"data_compressed_allocated":59637760,"data_compressed_original":954204160,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33466,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33466,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2854912,"data_stored":2840846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":2875392,"data_stored":2834538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20054016,"data_stored":320864256,"data_compressed":15825312,"data_compressed_allocated":20054016,"data_compressed_original":320864256,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":25165824,"data_stored":402653184,"data_compressed":20000928,"data_compressed_allocated":25165824,"data_compressed_original":402653184,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-21T01:26:41.433 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-21T01:26:41.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.609+0000 7f648da00640 1 Processor -- start 2024-05-21T01:26:41.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.609+0000 7f648da00640 1 -- start start 2024-05-21T01:26:41.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.609+0000 7f648da00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6488156450 0x7f648815d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:41.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.609+0000 7f648da00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6488071d50 con 0x7f6488156070 2024-05-21T01:26:41.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.609+0000 7f648da00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f648815bf20 con 0x7f648806f080 2024-05-21T01:26:41.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.609+0000 7f648da00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f648815c1e0 con 0x7f6488156450 2024-05-21T01:26:41.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.609+0000 7f6486a00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f6488156070 0x7f6488071640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37508/0 (socket says 172.21.15.63:37508) 2024-05-21T01:26:41.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.609+0000 7f6486a00640 1 -- 172.21.15.63:0/295400031 learned_addr learned my addr 172.21.15.63:0/295400031 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-05-21T01:26:41.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.609+0000 7f6487400640 1 --2- 172.21.15.63:0/295400031 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6488156450 0x7f648815d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:41.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.609+0000 7f6486000640 1 -- 172.21.15.63:0/295400031 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 926761495 0 0) 0x7f6488071d50 con 0x7f6488156070 2024-05-21T01:26:41.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.609+0000 7f6486000640 1 -- 172.21.15.63:0/295400031 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f646c003530 con 0x7f6488156070 2024-05-21T01:26:41.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.609+0000 7f6486000640 1 -- 172.21.15.63:0/295400031 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2238023879 0 0) 0x7f646c003530 con 0x7f6488156070 2024-05-21T01:26:41.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.609+0000 7f6486000640 1 -- 172.21.15.63:0/295400031 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6488156450 msgr2=0x7f648815d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:26:41.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.609+0000 7f6486000640 1 --2- 172.21.15.63:0/295400031 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6488156450 0x7f648815d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:41.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.609+0000 7f6486000640 1 -- 172.21.15.63:0/295400031 >> v1:172.21.15.131:6789/0 conn(0x7f648806f080 legacy=0x7f64880cf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:41.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.609+0000 7f6486000640 1 -- 172.21.15.63:0/295400031 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f648815c4c0 con 0x7f6488156070 2024-05-21T01:26:41.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.609+0000 7f6486000640 1 -- 172.21.15.63:0/295400031 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 466403955 0 0) 0x7f6478001720 con 0x7f6488156070 2024-05-21T01:26:41.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.609+0000 7f6486000640 1 -- 172.21.15.63:0/295400031 >> v1:172.21.15.63:6789/0 conn(0x7f6488156070 legacy=0x7f6488071640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:41.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.609+0000 7f6486000640 1 --2- 172.21.15.63:0/295400031 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6488156450 0x7f646c003a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:41.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.609+0000 7f6486000640 1 --2- 172.21.15.63:0/295400031 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f646c004010 0x7f646c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:41.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.609+0000 7f6486000640 1 --2- 172.21.15.63:0/295400031 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f646c004d50 0x7f646c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:41.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.609+0000 7f6486000640 1 -- 172.21.15.63:0/295400031 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f648815c1e0 con 0x7f646c004010 2024-05-21T01:26:41.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.609+0000 7f6486000640 1 -- 172.21.15.63:0/295400031 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f646c00bb60 con 0x7f646c004d50 2024-05-21T01:26:41.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.609+0000 7f6486000640 1 -- 172.21.15.63:0/295400031 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f646c00bd60 con 0x7f6488156450 2024-05-21T01:26:41.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.613+0000 7f647fe00640 1 --2- 172.21.15.63:0/295400031 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f646c004010 0x7f646c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:41.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.613+0000 7f6486a00640 1 --2- 172.21.15.63:0/295400031 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6488156450 0x7f646c003a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:41.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.613+0000 7f6487400640 1 --2- 172.21.15.63:0/295400031 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f646c004d50 0x7f646c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:41.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.613+0000 7f647fe00640 1 -- 172.21.15.63:0/295400031 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6488156450 msgr2=0x7f646c003a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:26:41.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.613+0000 7f647fe00640 1 --2- 172.21.15.63:0/295400031 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6488156450 0x7f646c003a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:41.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.613+0000 7f647fe00640 1 -- 172.21.15.63:0/295400031 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f646c004d50 msgr2=0x7f646c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:26:41.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.613+0000 7f647fe00640 1 --2- 172.21.15.63:0/295400031 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f646c004d50 0x7f646c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:41.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.613+0000 7f647fe00640 1 -- 172.21.15.63:0/295400031 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f646c003530 con 0x7f646c004010 2024-05-21T01:26:41.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.613+0000 7f647fe00640 1 --2- 172.21.15.63:0/295400031 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f646c004010 0x7f646c004810 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f6470001790 tx=0x7f647001c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=437e4e43a49075d7 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:41.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.613+0000 7f6486000640 1 -- 172.21.15.63:0/295400031 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64700013e0 con 0x7f646c004010 2024-05-21T01:26:41.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.613+0000 7f6486000640 1 -- 172.21.15.63:0/295400031 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64700052d0 con 0x7f646c004010 2024-05-21T01:26:41.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.613+0000 7f6486000640 1 -- 172.21.15.63:0/295400031 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6470003840 con 0x7f646c004010 2024-05-21T01:26:41.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.617+0000 7f648da00640 1 -- 172.21.15.63:0/295400031 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f646c004010 msgr2=0x7f646c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:41.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.617+0000 7f648da00640 1 --2- 172.21.15.63:0/295400031 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f646c004010 0x7f646c004810 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f6470001790 tx=0x7f647001c3a0 comp rx=0 tx=0).stop 2024-05-21T01:26:41.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.617+0000 7f6487400640 1 -- 172.21.15.63:0/295400031 reap_dead start 2024-05-21T01:26:41.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.617+0000 7f648da00640 1 -- 172.21.15.63:0/295400031 shutdown_connections 2024-05-21T01:26:41.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.617+0000 7f648da00640 1 -- 172.21.15.63:0/295400031 >> 172.21.15.63:0/295400031 conn(0x7f64880735f0 msgr2=0x7f6488073a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:26:41.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.617+0000 7f648da00640 1 -- 172.21.15.63:0/295400031 shutdown_connections 2024-05-21T01:26:41.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.617+0000 7f648da00640 1 -- 172.21.15.63:0/295400031 wait complete. 2024-05-21T01:26:41.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.617+0000 7f648da00640 1 Processor -- start 2024-05-21T01:26:41.621 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.617+0000 7f648da00640 1 -- start start 2024-05-21T01:26:41.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.617+0000 7f648da00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f646c004010 0x7f64881f4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:41.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.617+0000 7f648da00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f64880cec60 0x7f6488150a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:41.623 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.617+0000 7f648da00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6488150f40 0x7f64881e5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:41.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.617+0000 7f648da00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f648815cd60 con 0x7f6488150f40 2024-05-21T01:26:41.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.617+0000 7f648da00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f648815ca80 con 0x7f64880cec60 2024-05-21T01:26:41.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.617+0000 7f648da00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f648806dfc0 con 0x7f646c004010 2024-05-21T01:26:41.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.617+0000 7f6487400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6488150f40 0x7f64881e5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:41.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.617+0000 7f6487400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6488150f40 0x7f64881e5330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48118/0 (socket says 172.21.15.63:48118) 2024-05-21T01:26:41.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.617+0000 7f6487400640 1 -- 172.21.15.63:0/1669257549 learned_addr learned my addr 172.21.15.63:0/1669257549 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:26:41.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.617+0000 7f6486a00640 1 --2- 172.21.15.63:0/1669257549 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f646c004010 0x7f64881f4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:41.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.617+0000 7f647fe00640 1 --2- 172.21.15.63:0/1669257549 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f64880cec60 0x7f6488150a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:41.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.617+0000 7f6487400640 1 -- 172.21.15.63:0/1669257549 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f646c004010 msgr2=0x7f64881f4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:41.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.617+0000 7f6487400640 1 --2- 172.21.15.63:0/1669257549 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f646c004010 0x7f64881f4da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:41.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.617+0000 7f6487400640 1 -- 172.21.15.63:0/1669257549 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f64880cec60 msgr2=0x7f6488150a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:41.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.617+0000 7f6487400640 1 --2- 172.21.15.63:0/1669257549 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f64880cec60 0x7f6488150a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:41.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.617+0000 7f6487400640 1 -- 172.21.15.63:0/1669257549 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64881f1990 con 0x7f6488150f40 2024-05-21T01:26:41.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.617+0000 7f6487400640 1 --2- 172.21.15.63:0/1669257549 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6488150f40 0x7f64881e5330 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f64880ca2b0 tx=0x7f648000f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:41.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.621+0000 7f647ea00640 1 -- 172.21.15.63:0/1669257549 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f648000fd10 con 0x7f6488150f40 2024-05-21T01:26:41.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.621+0000 7f647ea00640 1 -- 172.21.15.63:0/1669257549 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6480015430 con 0x7f6488150f40 2024-05-21T01:26:41.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.621+0000 7f648da00640 1 -- 172.21.15.63:0/1669257549 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64880d0350 con 0x7f6488150f40 2024-05-21T01:26:41.625 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.621+0000 7f647ea00640 1 -- 172.21.15.63:0/1669257549 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6480015820 con 0x7f6488150f40 2024-05-21T01:26:41.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.621+0000 7f648da00640 1 -- 172.21.15.63:0/1669257549 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64881f1c30 con 0x7f6488150f40 2024-05-21T01:26:41.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.621+0000 7f648da00640 1 -- 172.21.15.63:0/1669257549 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64880507f0 con 0x7f6488150f40 2024-05-21T01:26:41.626 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.621+0000 7f647ea00640 1 -- 172.21.15.63:0/1669257549 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7f64800159c0 con 0x7f6488150f40 2024-05-21T01:26:41.627 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.621+0000 7f647ea00640 1 --2- 172.21.15.63:0/1669257549 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f646406f400 0x7f64640718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:41.627 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.621+0000 7f647ea00640 1 -- 172.21.15.63:0/1669257549 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f6480090320 con 0x7f6488150f40 2024-05-21T01:26:41.627 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.621+0000 7f6486a00640 1 --2- 172.21.15.63:0/1669257549 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f646406f400 0x7f64640718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:41.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.625+0000 7f6486a00640 1 --2- 172.21.15.63:0/1669257549 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f646406f400 0x7f64640718c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6478007fd0 tx=0x7f6478007980 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:41.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.625+0000 7f647ea00640 1 -- 172.21.15.63:0/1669257549 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f6480019030 con 0x7f6488150f40 2024-05-21T01:26:41.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.793+0000 7f648da00640 1 -- 172.21.15.63:0/1669257549 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6488159880 con 0x7f6488150f40 2024-05-21T01:26:41.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.797+0000 7f647ea00640 1 -- 172.21.15.63:0/1669257549 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18578 (secure 0 0 0) 0x7f6480010040 con 0x7f6488150f40 2024-05-21T01:26:41.801 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-05-21T01:26:41.801 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":27,"fsid":"9a7cbd84-ceb2-41c8-8b6e-ab931f86c51a","created":"2024-05-21T01:19:37.688082+0000","modified":"2024-05-21T01:20:43.525252+0000","last_up_change":"2024-05-21T01:19:48.472107+0000","last_in_change":"2024-05-21T01:19:39.973975+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-21T01:19:46.485266+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-21T01:19:52.032741+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-21T01:19:52.867322+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-21T01:19:56.562363+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cda28135-00bb-4194-adcb-e0abf3ae43f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":3740454920},{"type":"v1","addr":"172.21.15.63:6801","nonce":3740454920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":3740454920},{"type":"v1","addr":"172.21.15.63:6804","nonce":3740454920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":3740454920},{"type":"v1","addr":"172.21.15.63:6812","nonce":3740454920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":3740454920},{"type":"v1","addr":"172.21.15.63:6808","nonce":3740454920}]},"public_addr":"172.21.15.63:6801/3740454920","cluster_addr":"172.21.15.63:6804/3740454920","heartbeat_back_addr":"172.21.15.63:6812/3740454920","heartbeat_front_addr":"172.21.15.63:6808/3740454920","state":["exists","up"]},{"osd":1,"uuid":"4aeb370d-ec2f-4a91-b17b-035fd72bdaea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6803","nonce":896993303},{"type":"v1","addr":"172.21.15.63:6805","nonce":896993303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6807","nonce":896993303},{"type":"v1","addr":"172.21.15.63:6809","nonce":896993303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":896993303},{"type":"v1","addr":"172.21.15.63:6816","nonce":896993303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6811","nonce":896993303},{"type":"v1","addr":"172.21.15.63:6813","nonce":896993303}]},"public_addr":"172.21.15.63:6805/896993303","cluster_addr":"172.21.15.63:6809/896993303","heartbeat_back_addr":"172.21.15.63:6816/896993303","heartbeat_front_addr":"172.21.15.63:6813/896993303","state":["exists","up"]},{"osd":2,"uuid":"8368b112-35a3-43cf-ad1c-803f05708091","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":845807419},{"type":"v1","addr":"172.21.15.63:6817","nonce":845807419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":845807419},{"type":"v1","addr":"172.21.15.63:6819","nonce":845807419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":845807419},{"type":"v1","addr":"172.21.15.63:6823","nonce":845807419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":845807419},{"type":"v1","addr":"172.21.15.63:6821","nonce":845807419}]},"public_addr":"172.21.15.63:6817/845807419","cluster_addr":"172.21.15.63:6819/845807419","heartbeat_back_addr":"172.21.15.63:6823/845807419","heartbeat_front_addr":"172.21.15.63:6821/845807419","state":["exists","up"]},{"osd":3,"uuid":"26208950-e3ca-4b9a-94cd-c159453a5dfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":521563809},{"type":"v1","addr":"172.21.15.63:6825","nonce":521563809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":521563809},{"type":"v1","addr":"172.21.15.63:6827","nonce":521563809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":521563809},{"type":"v1","addr":"172.21.15.63:6831","nonce":521563809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":521563809},{"type":"v1","addr":"172.21.15.63:6829","nonce":521563809}]},"public_addr":"172.21.15.63:6825/521563809","cluster_addr":"172.21.15.63:6827/521563809","heartbeat_back_addr":"172.21.15.63:6831/521563809","heartbeat_front_addr":"172.21.15.63:6829/521563809","state":["exists","up"]},{"osd":4,"uuid":"d8c93283-1e10-4419-9934-d5048c5d0ad1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":2660673588},{"type":"v1","addr":"172.21.15.131:6801","nonce":2660673588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":2660673588},{"type":"v1","addr":"172.21.15.131:6803","nonce":2660673588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":2660673588},{"type":"v1","addr":"172.21.15.131:6807","nonce":2660673588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":2660673588},{"type":"v1","addr":"172.21.15.131:6805","nonce":2660673588}]},"public_addr":"172.21.15.131:6801/2660673588","cluster_addr":"172.21.15.131:6803/2660673588","heartbeat_back_addr":"172.21.15.131:6807/2660673588","heartbeat_front_addr":"172.21.15.131:6805/2660673588","state":["exists","up"]},{"osd":5,"uuid":"93a6fe9b-eaa6-4474-bf9b-ae0571feacf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6809","nonce":2508702891},{"type":"v1","addr":"172.21.15.131:6811","nonce":2508702891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6813","nonce":2508702891},{"type":"v1","addr":"172.21.15.131:6815","nonce":2508702891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6821","nonce":2508702891},{"type":"v1","addr":"172.21.15.131:6823","nonce":2508702891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6817","nonce":2508702891},{"type":"v1","addr":"172.21.15.131:6819","nonce":2508702891}]},"public_addr":"172.21.15.131:6811/2508702891","cluster_addr":"172.21.15.131:6815/2508702891","heartbeat_back_addr":"172.21.15.131:6823/2508702891","heartbeat_front_addr":"172.21.15.131:6819/2508702891","state":["exists","up"]},{"osd":6,"uuid":"e05e6c8c-2dda-49ab-8116-5ea9038d0f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":614380392},{"type":"v1","addr":"172.21.15.131:6810","nonce":614380392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":614380392},{"type":"v1","addr":"172.21.15.131:6814","nonce":614380392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":614380392},{"type":"v1","addr":"172.21.15.131:6822","nonce":614380392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":614380392},{"type":"v1","addr":"172.21.15.131:6818","nonce":614380392}]},"public_addr":"172.21.15.131:6810/614380392","cluster_addr":"172.21.15.131:6814/614380392","heartbeat_back_addr":"172.21.15.131:6822/614380392","heartbeat_front_addr":"172.21.15.131:6818/614380392","state":["exists","up"]},{"osd":7,"uuid":"0b393e5e-eeef-4e32-b23a-d405a8b0e7b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":4219797450},{"type":"v1","addr":"172.21.15.131:6825","nonce":4219797450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":4219797450},{"type":"v1","addr":"172.21.15.131:6827","nonce":4219797450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":4219797450},{"type":"v1","addr":"172.21.15.131:6831","nonce":4219797450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":4219797450},{"type":"v1","addr":"172.21.15.131:6829","nonce":4219797450}]},"public_addr":"172.21.15.131:6825/4219797450","cluster_addr":"172.21.15.131:6827/4219797450","heartbeat_back_addr":"172.21.15.131:6831/4219797450","heartbeat_front_addr":"172.21.15.131:6829/4219797450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.647841+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.912560+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.684614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.936286+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.380500+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.553497+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.517866+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.310320+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.36","mappings":[{"from":0,"to":7}]},{"pgid":"4.16","mappings":[{"from":7,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-21T01:26:41.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.797+0000 7f648da00640 1 -- 172.21.15.63:0/1669257549 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f646406f400 msgr2=0x7f64640718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:41.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.797+0000 7f648da00640 1 --2- 172.21.15.63:0/1669257549 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f646406f400 0x7f64640718c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6478007fd0 tx=0x7f6478007980 comp rx=0 tx=0).stop 2024-05-21T01:26:41.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.797+0000 7f648da00640 1 -- 172.21.15.63:0/1669257549 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6488150f40 msgr2=0x7f64881e5330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:41.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.797+0000 7f648da00640 1 --2- 172.21.15.63:0/1669257549 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6488150f40 0x7f64881e5330 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f64880ca2b0 tx=0x7f648000f1b0 comp rx=0 tx=0).stop 2024-05-21T01:26:41.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.797+0000 7f648da00640 1 -- 172.21.15.63:0/1669257549 shutdown_connections 2024-05-21T01:26:41.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.797+0000 7f648da00640 1 --2- 172.21.15.63:0/1669257549 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f646406f400 0x7f64640718c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:41.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.797+0000 7f648da00640 1 --2- 172.21.15.63:0/1669257549 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6488150f40 0x7f64881e5330 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:41.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.797+0000 7f648da00640 1 --2- 172.21.15.63:0/1669257549 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f64880cec60 0x7f6488150a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:41.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.797+0000 7f648da00640 1 --2- 172.21.15.63:0/1669257549 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f646c004010 0x7f64881f4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:41.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.797+0000 7f648da00640 1 -- 172.21.15.63:0/1669257549 >> 172.21.15.63:0/1669257549 conn(0x7f64880735f0 msgr2=0x7f648815d8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:26:41.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.797+0000 7f648da00640 1 -- 172.21.15.63:0/1669257549 shutdown_connections 2024-05-21T01:26:41.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:41.797+0000 7f648da00640 1 -- 172.21.15.63:0/1669257549 wait complete. 2024-05-21T01:26:42.823 INFO:tasks.ceph:Scrubbing osd.0 2024-05-21T01:26:42.824 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-05-21T01:26:42.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:42.977+0000 7f8131a00640 1 Processor -- start 2024-05-21T01:26:42.981 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:42.977+0000 7f8131a00640 1 -- start start 2024-05-21T01:26:42.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:42.977+0000 7f8131a00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f812c159cb0 0x7f812c0735e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:42.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:42.977+0000 7f8131a00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f812c073b20 0x7f812c06d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:42.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:42.977+0000 7f8131a00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f812c1543e0 con 0x7f812c154000 2024-05-21T01:26:42.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:42.977+0000 7f8131a00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f812c15d2a0 con 0x7f812c073b20 2024-05-21T01:26:42.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:42.977+0000 7f8131a00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f812c15b1a0 con 0x7f812c159cb0 2024-05-21T01:26:42.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:42.977+0000 7f812b400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f812c073b20 0x7f812c06d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:42.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:42.977+0000 7f812b400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f812c073b20 0x7f812c06d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48120/0 (socket says 172.21.15.63:48120) 2024-05-21T01:26:42.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:42.977+0000 7f812aa00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f812c154000 0x7f812c15da10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37516/0 (socket says 172.21.15.63:37516) 2024-05-21T01:26:42.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:42.977+0000 7f812b400640 1 -- 172.21.15.63:0/3709378031 learned_addr learned my addr 172.21.15.63:0/3709378031 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:26:42.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:42.977+0000 7f8122000640 1 --2- 172.21.15.63:0/3709378031 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f812c159cb0 0x7f812c0735e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:42.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:42.977+0000 7f812b400640 1 -- 172.21.15.63:0/3709378031 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f812c159cb0 msgr2=0x7f812c0735e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:26:42.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:42.977+0000 7f812b400640 1 --2- 172.21.15.63:0/3709378031 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f812c159cb0 0x7f812c0735e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:42.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:42.977+0000 7f812b400640 1 -- 172.21.15.63:0/3709378031 >> v1:172.21.15.63:6789/0 conn(0x7f812c154000 legacy=0x7f812c15da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:42.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:42.977+0000 7f812b400640 1 -- 172.21.15.63:0/3709378031 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f812c15a1f0 con 0x7f812c073b20 2024-05-21T01:26:42.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:42.977+0000 7f812a000640 1 -- 172.21.15.63:0/3709378031 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2067828046 0 0) 0x7f811c001120 con 0x7f812c154000 2024-05-21T01:26:42.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:42.981+0000 7f812b400640 1 --2- 172.21.15.63:0/3709378031 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f812c073b20 0x7f812c06d240 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f8124009e50 tx=0x7f812401ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39838edcf223212d server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:42.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:42.981+0000 7f812a000640 1 -- 172.21.15.63:0/3709378031 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81240a5920 con 0x7f812c073b20 2024-05-21T01:26:42.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:42.981+0000 7f812a000640 1 -- 172.21.15.63:0/3709378031 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81240a5ac0 con 0x7f812c073b20 2024-05-21T01:26:42.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:42.981+0000 7f812a000640 1 -- 172.21.15.63:0/3709378031 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81240ad3f0 con 0x7f812c073b20 2024-05-21T01:26:42.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:42.981+0000 7f8131a00640 1 -- 172.21.15.63:0/3709378031 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f812c073b20 msgr2=0x7f812c06d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:42.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:42.981+0000 7f8131a00640 1 --2- 172.21.15.63:0/3709378031 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f812c073b20 0x7f812c06d240 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f8124009e50 tx=0x7f812401ca30 comp rx=0 tx=0).stop 2024-05-21T01:26:42.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:42.981+0000 7f8131a00640 1 -- 172.21.15.63:0/3709378031 shutdown_connections 2024-05-21T01:26:42.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:42.981+0000 7f8131a00640 1 --2- 172.21.15.63:0/3709378031 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f812c073b20 0x7f812c06d240 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:42.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:42.981+0000 7f8131a00640 1 --2- 172.21.15.63:0/3709378031 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f812c159cb0 0x7f812c0735e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:42.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:42.981+0000 7f8131a00640 1 -- 172.21.15.63:0/3709378031 >> 172.21.15.63:0/3709378031 conn(0x7f812c06efc0 msgr2=0x7f812c06f3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:26:42.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:42.981+0000 7f8131a00640 1 -- 172.21.15.63:0/3709378031 shutdown_connections 2024-05-21T01:26:42.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:42.981+0000 7f8131a00640 1 -- 172.21.15.63:0/3709378031 wait complete. 2024-05-21T01:26:42.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:42.985+0000 7f8131a00640 1 Processor -- start 2024-05-21T01:26:42.988 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:42.985+0000 7f8131a00640 1 -- start start 2024-05-21T01:26:42.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:42.985+0000 7f8131a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f812c073b20 0x7f812c162a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:42.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:42.985+0000 7f8131a00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f812c154000 0x7f812c150ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:42.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:42.985+0000 7f8131a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f812c159cb0 0x7f812c151000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:42.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:42.985+0000 7f8131a00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f812c15d4f0 con 0x7f812c159cb0 2024-05-21T01:26:42.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:42.985+0000 7f8131a00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f812c15aa90 con 0x7f812c073b20 2024-05-21T01:26:42.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:42.985+0000 7f8131a00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f812c15e120 con 0x7f812c154000 2024-05-21T01:26:42.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:42.985+0000 7f812b400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f812c159cb0 0x7f812c151000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:42.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:42.985+0000 7f812b400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f812c159cb0 0x7f812c151000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48130/0 (socket says 172.21.15.63:48130) 2024-05-21T01:26:42.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:42.985+0000 7f812b400640 1 -- 172.21.15.63:0/3700760765 learned_addr learned my addr 172.21.15.63:0/3700760765 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:26:42.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:42.985+0000 7f8122000640 1 --2- 172.21.15.63:0/3700760765 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f812c154000 0x7f812c150ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:42.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:42.985+0000 7f812aa00640 1 --2- 172.21.15.63:0/3700760765 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f812c073b20 0x7f812c162a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:42.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:42.985+0000 7f812b400640 1 -- 172.21.15.63:0/3700760765 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f812c154000 msgr2=0x7f812c150ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:42.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:42.985+0000 7f812b400640 1 --2- 172.21.15.63:0/3700760765 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f812c154000 0x7f812c150ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:42.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:42.985+0000 7f812b400640 1 -- 172.21.15.63:0/3700760765 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f812c073b20 msgr2=0x7f812c162a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:42.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:42.985+0000 7f812b400640 1 --2- 172.21.15.63:0/3700760765 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f812c073b20 0x7f812c162a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:42.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:42.985+0000 7f812b400640 1 -- 172.21.15.63:0/3700760765 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f812c1f8470 con 0x7f812c159cb0 2024-05-21T01:26:42.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:42.985+0000 7f812aa00640 1 --2- 172.21.15.63:0/3700760765 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f812c073b20 0x7f812c162a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T01:26:42.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:42.985+0000 7f812b400640 1 --2- 172.21.15.63:0/3700760765 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f812c159cb0 0x7f812c151000 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f81240af040 tx=0x7f81240197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:42.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:42.985+0000 7f8123400640 1 -- 172.21.15.63:0/3700760765 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81240a5920 con 0x7f812c159cb0 2024-05-21T01:26:42.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:42.985+0000 7f8123400640 1 -- 172.21.15.63:0/3700760765 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81240be070 con 0x7f812c159cb0 2024-05-21T01:26:42.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:42.985+0000 7f8123400640 1 -- 172.21.15.63:0/3700760765 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8124009510 con 0x7f812c159cb0 2024-05-21T01:26:42.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:42.985+0000 7f8131a00640 1 -- 172.21.15.63:0/3700760765 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f812c1f8710 con 0x7f812c159cb0 2024-05-21T01:26:42.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:42.985+0000 7f8131a00640 1 -- 172.21.15.63:0/3700760765 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f812c1f8cd0 con 0x7f812c159cb0 2024-05-21T01:26:42.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:42.985+0000 7f8131a00640 1 -- 172.21.15.63:0/3700760765 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f812c1f6510 con 0x7f812c159cb0 2024-05-21T01:26:42.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:42.989+0000 7f8123400640 1 -- 172.21.15.63:0/3700760765 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7f81240b86b0 con 0x7f812c159cb0 2024-05-21T01:26:42.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:42.989+0000 7f8123400640 1 --2- 172.21.15.63:0/3700760765 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f810806f400 0x7f81080718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:42.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:42.989+0000 7f8123400640 1 -- 172.21.15.63:0/3700760765 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f812412b5f0 con 0x7f812c159cb0 2024-05-21T01:26:42.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:42.989+0000 7f8123400640 1 --2- 172.21.15.63:0/3700760765 >> [v2:172.21.15.63:6800/3740454920,v1:172.21.15.63:6801/3740454920] conn(0x7f8108078bb0 0x7f810807b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:42.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:42.989+0000 7f8123400640 1 -- 172.21.15.63:0/3700760765 --> [v2:172.21.15.63:6800/3740454920,v1:172.21.15.63:6801/3740454920] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f81240a5ac0 con 0x7f8108078bb0 2024-05-21T01:26:42.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:42.989+0000 7f8123400640 1 -- 172.21.15.63:0/3700760765 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f812412b9a0 con 0x7f812c159cb0 2024-05-21T01:26:42.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:42.989+0000 7f812aa00640 1 --2- 172.21.15.63:0/3700760765 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f810806f400 0x7f81080718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:42.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:42.989+0000 7f8122000640 1 --2- 172.21.15.63:0/3700760765 >> [v2:172.21.15.63:6800/3740454920,v1:172.21.15.63:6801/3740454920] conn(0x7f8108078bb0 0x7f810807b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:42.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:42.989+0000 7f8122000640 1 --2- 172.21.15.63:0/3700760765 >> [v2:172.21.15.63:6800/3740454920,v1:172.21.15.63:6801/3740454920] conn(0x7f8108078bb0 0x7f810807b030 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:42.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:42.989+0000 7f812aa00640 1 --2- 172.21.15.63:0/3700760765 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f810806f400 0x7f81080718c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f811c007fd0 tx=0x7f811c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:42.995 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:42.989+0000 7f8123400640 1 -- 172.21.15.63:0/3700760765 <== osd.0 v2:172.21.15.63:6800/3740454920 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f81240a5ac0 con 0x7f8108078bb0 2024-05-21T01:26:43.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.005+0000 7f8131a00640 1 -- 172.21.15.63:0/3700760765 --> [v2:172.21.15.63:6800/3740454920,v1:172.21.15.63:6801/3740454920] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f812c06c1a0 con 0x7f8108078bb0 2024-05-21T01:26:43.009 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.005+0000 7f8123400640 1 -- 172.21.15.63:0/3700760765 <== osd.0 v2:172.21.15.63:6800/3740454920 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f812c06c1a0 con 0x7f8108078bb0 2024-05-21T01:26:43.009 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-05-21T01:26:43.009 INFO:teuthology.orchestra.run.smithi063.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-21T01:26:43.009 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-05-21T01:26:43.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.005+0000 7f8131a00640 1 -- 172.21.15.63:0/3700760765 >> [v2:172.21.15.63:6800/3740454920,v1:172.21.15.63:6801/3740454920] conn(0x7f8108078bb0 msgr2=0x7f810807b030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:43.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.005+0000 7f8131a00640 1 --2- 172.21.15.63:0/3700760765 >> [v2:172.21.15.63:6800/3740454920,v1:172.21.15.63:6801/3740454920] conn(0x7f8108078bb0 0x7f810807b030 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:43.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.005+0000 7f8131a00640 1 -- 172.21.15.63:0/3700760765 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f810806f400 msgr2=0x7f81080718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:43.010 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.005+0000 7f8131a00640 1 --2- 172.21.15.63:0/3700760765 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f810806f400 0x7f81080718c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f811c007fd0 tx=0x7f811c009040 comp rx=0 tx=0).stop 2024-05-21T01:26:43.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.005+0000 7f8131a00640 1 -- 172.21.15.63:0/3700760765 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f812c159cb0 msgr2=0x7f812c151000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:43.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.005+0000 7f8131a00640 1 --2- 172.21.15.63:0/3700760765 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f812c159cb0 0x7f812c151000 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f81240af040 tx=0x7f81240197d0 comp rx=0 tx=0).stop 2024-05-21T01:26:43.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.005+0000 7f812b400640 1 -- 172.21.15.63:0/3700760765 reap_dead start 2024-05-21T01:26:43.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.005+0000 7f8131a00640 1 -- 172.21.15.63:0/3700760765 shutdown_connections 2024-05-21T01:26:43.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.005+0000 7f8131a00640 1 -- 172.21.15.63:0/3700760765 >> 172.21.15.63:0/3700760765 conn(0x7f812c06efc0 msgr2=0x7f812c15da10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:26:43.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.005+0000 7f8131a00640 1 -- 172.21.15.63:0/3700760765 shutdown_connections 2024-05-21T01:26:43.011 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.005+0000 7f8131a00640 1 -- 172.21.15.63:0/3700760765 wait complete. 2024-05-21T01:26:43.027 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-05-21T01:26:43.169 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.165+0000 7fb77b200640 1 Processor -- start 2024-05-21T01:26:43.170 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.165+0000 7fb77b200640 1 -- start start 2024-05-21T01:26:43.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.165+0000 7fb77b200640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb774158480 0x7fb774072810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:43.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.165+0000 7fb77b200640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fb7740cd8c0 0x7fb774072d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:43.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.165+0000 7fb77b200640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb774158930 con 0x7fb7740cd4e0 2024-05-21T01:26:43.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.165+0000 7fb77b200640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7fb774158c10 con 0x7fb774158480 2024-05-21T01:26:43.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.165+0000 7fb77b200640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fb774158ef0 con 0x7fb7740cd8c0 2024-05-21T01:26:43.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.165+0000 7fb76b400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb774158480 0x7fb774072810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:43.171 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.165+0000 7fb76b400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb774158480 0x7fb774072810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48140/0 (socket says 172.21.15.63:48140) 2024-05-21T01:26:43.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.165+0000 7fb76b400640 1 -- 172.21.15.63:0/2233429690 learned_addr learned my addr 172.21.15.63:0/2233429690 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:26:43.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.165+0000 7fb779200640 1 --2- 172.21.15.63:0/2233429690 >> v2:172.21.15.131:3300/0 conn(0x7fb7740cd8c0 0x7fb774072d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:43.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.165+0000 7fb76b400640 1 -- 172.21.15.63:0/2233429690 >> v2:172.21.15.131:3300/0 conn(0x7fb7740cd8c0 msgr2=0x7fb774072d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:26:43.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.165+0000 7fb76b400640 1 --2- 172.21.15.63:0/2233429690 >> v2:172.21.15.131:3300/0 conn(0x7fb7740cd8c0 0x7fb774072d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:43.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.165+0000 7fb76b400640 1 -- 172.21.15.63:0/2233429690 >> v1:172.21.15.131:6789/0 conn(0x7fb7740cd4e0 legacy=0x7fb7740717e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:43.172 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.165+0000 7fb76b400640 1 -- 172.21.15.63:0/2233429690 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7741591d0 con 0x7fb774158480 2024-05-21T01:26:43.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.169+0000 7fb76b400640 1 --2- 172.21.15.63:0/2233429690 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb774158480 0x7fb774072810 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fb77406d560 tx=0x7fb75c01f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edee7e85d1b539d server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:43.174 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.169+0000 7fb773400640 1 -- 172.21.15.63:0/2233429690 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb75c0b4070 con 0x7fb774158480 2024-05-21T01:26:43.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.169+0000 7fb773400640 1 -- 172.21.15.63:0/2233429690 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb75c0af400 con 0x7fb774158480 2024-05-21T01:26:43.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.169+0000 7fb773400640 1 -- 172.21.15.63:0/2233429690 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb75c0af7d0 con 0x7fb774158480 2024-05-21T01:26:43.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.169+0000 7fb77b200640 1 -- 172.21.15.63:0/2233429690 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb774158480 msgr2=0x7fb774072810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:43.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.169+0000 7fb77b200640 1 --2- 172.21.15.63:0/2233429690 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb774158480 0x7fb774072810 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fb77406d560 tx=0x7fb75c01f1e0 comp rx=0 tx=0).stop 2024-05-21T01:26:43.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.169+0000 7fb77b200640 1 -- 172.21.15.63:0/2233429690 shutdown_connections 2024-05-21T01:26:43.175 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.169+0000 7fb77b200640 1 --2- 172.21.15.63:0/2233429690 >> v2:172.21.15.131:3300/0 conn(0x7fb7740cd8c0 0x7fb774072d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:43.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.169+0000 7fb77b200640 1 --2- 172.21.15.63:0/2233429690 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb774158480 0x7fb774072810 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:43.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.169+0000 7fb77b200640 1 -- 172.21.15.63:0/2233429690 >> 172.21.15.63:0/2233429690 conn(0x7fb774068460 msgr2=0x7fb774068870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:26:43.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.169+0000 7fb77b200640 1 -- 172.21.15.63:0/2233429690 shutdown_connections 2024-05-21T01:26:43.176 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.169+0000 7fb77b200640 1 -- 172.21.15.63:0/2233429690 wait complete. 2024-05-21T01:26:43.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.173+0000 7fb77b200640 1 Processor -- start 2024-05-21T01:26:43.177 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.173+0000 7fb77b200640 1 -- start start 2024-05-21T01:26:43.178 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.173+0000 7fb77b200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb7740cd4e0 0x7fb7741f5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:43.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.173+0000 7fb77b200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb7740cd8c0 0x7fb7741576d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:43.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.173+0000 7fb77b200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb774158480 0x7fb774148e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:43.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.173+0000 7fb77b200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fb774072070 con 0x7fb7740cd8c0 2024-05-21T01:26:43.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.173+0000 7fb77b200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fb774071ef0 con 0x7fb7740cd4e0 2024-05-21T01:26:43.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.173+0000 7fb77b200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fb7740c9000 con 0x7fb774158480 2024-05-21T01:26:43.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.173+0000 7fb76b400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb7740cd8c0 0x7fb7741576d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:43.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.173+0000 7fb76b400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb7740cd8c0 0x7fb7741576d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48156/0 (socket says 172.21.15.63:48156) 2024-05-21T01:26:43.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.173+0000 7fb76b400640 1 -- 172.21.15.63:0/2005596548 learned_addr learned my addr 172.21.15.63:0/2005596548 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:26:43.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.173+0000 7fb773e00640 1 --2- 172.21.15.63:0/2005596548 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb7740cd4e0 0x7fb7741f5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:43.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.173+0000 7fb779200640 1 --2- 172.21.15.63:0/2005596548 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb774158480 0x7fb774148e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:43.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.173+0000 7fb76b400640 1 -- 172.21.15.63:0/2005596548 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb774158480 msgr2=0x7fb774148e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:43.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.173+0000 7fb76b400640 1 --2- 172.21.15.63:0/2005596548 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb774158480 0x7fb774148e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:43.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.173+0000 7fb76b400640 1 -- 172.21.15.63:0/2005596548 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb7740cd4e0 msgr2=0x7fb7741f5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:43.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.173+0000 7fb76b400640 1 --2- 172.21.15.63:0/2005596548 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb7740cd4e0 0x7fb7741f5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:43.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.173+0000 7fb76b400640 1 -- 172.21.15.63:0/2005596548 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb774072d20 con 0x7fb7740cd8c0 2024-05-21T01:26:43.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.173+0000 7fb76b400640 1 --2- 172.21.15.63:0/2005596548 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb7740cd8c0 0x7fb7741576d0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fb75c009040 tx=0x7fb75c01bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:43.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.173+0000 7fb770c00640 1 -- 172.21.15.63:0/2005596548 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb75c0b4040 con 0x7fb7740cd8c0 2024-05-21T01:26:43.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.173+0000 7fb770c00640 1 -- 172.21.15.63:0/2005596548 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb75c0afe50 con 0x7fb7740cd8c0 2024-05-21T01:26:43.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.173+0000 7fb77b200640 1 -- 172.21.15.63:0/2005596548 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb77414b470 con 0x7fb7740cd8c0 2024-05-21T01:26:43.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.173+0000 7fb770c00640 1 -- 172.21.15.63:0/2005596548 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb75c009510 con 0x7fb7740cd8c0 2024-05-21T01:26:43.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.173+0000 7fb77b200640 1 -- 172.21.15.63:0/2005596548 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7740c5000 con 0x7fb7740cd8c0 2024-05-21T01:26:43.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.177+0000 7fb77b200640 1 -- 172.21.15.63:0/2005596548 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7740507f0 con 0x7fb7740cd8c0 2024-05-21T01:26:43.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.177+0000 7fb770c00640 1 -- 172.21.15.63:0/2005596548 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7fb75c0c3020 con 0x7fb7740cd8c0 2024-05-21T01:26:43.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.177+0000 7fb770c00640 1 --2- 172.21.15.63:0/2005596548 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fb75006f400 0x7fb7500718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:43.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.177+0000 7fb770c00640 1 -- 172.21.15.63:0/2005596548 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7fb75c12d1d0 con 0x7fb7740cd8c0 2024-05-21T01:26:43.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.177+0000 7fb773e00640 1 --2- 172.21.15.63:0/2005596548 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fb75006f400 0x7fb7500718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:43.184 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.177+0000 7fb773e00640 1 --2- 172.21.15.63:0/2005596548 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fb75006f400 0x7fb7500718c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb7640016f0 tx=0x7fb764009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:43.187 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.181+0000 7fb770c00640 1 -- 172.21.15.63:0/2005596548 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fb75c0ca020 con 0x7fb7740cd8c0 2024-05-21T01:26:43.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.345+0000 7fb77b200640 1 -- 172.21.15.63:0/2005596548 --> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7fb7740c7580 con 0x7fb75006f400 2024-05-21T01:26:43.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.349+0000 7fb770c00640 1 -- 172.21.15.63:0/2005596548 <== mgr.4103 v2:172.21.15.131:6832/921953667 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fb7740c7580 con 0x7fb75006f400 2024-05-21T01:26:43.352 INFO:teuthology.orchestra.run.smithi063.stderr:instructed osd(s) 0 to deep-scrub 2024-05-21T01:26:43.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.349+0000 7fb77b200640 1 -- 172.21.15.63:0/2005596548 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fb75006f400 msgr2=0x7fb7500718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:43.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.349+0000 7fb77b200640 1 --2- 172.21.15.63:0/2005596548 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fb75006f400 0x7fb7500718c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb7640016f0 tx=0x7fb764009040 comp rx=0 tx=0).stop 2024-05-21T01:26:43.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.349+0000 7fb77b200640 1 -- 172.21.15.63:0/2005596548 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb7740cd8c0 msgr2=0x7fb7741576d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:43.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.349+0000 7fb77b200640 1 --2- 172.21.15.63:0/2005596548 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb7740cd8c0 0x7fb7741576d0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fb75c009040 tx=0x7fb75c01bf80 comp rx=0 tx=0).stop 2024-05-21T01:26:43.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.349+0000 7fb77b200640 1 -- 172.21.15.63:0/2005596548 shutdown_connections 2024-05-21T01:26:43.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.349+0000 7fb77b200640 1 --2- 172.21.15.63:0/2005596548 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fb75006f400 0x7fb7500718c0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:43.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.349+0000 7fb77b200640 1 --2- 172.21.15.63:0/2005596548 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb774158480 0x7fb774148e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:43.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.349+0000 7fb77b200640 1 --2- 172.21.15.63:0/2005596548 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb7740cd8c0 0x7fb7741576d0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:43.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.349+0000 7fb77b200640 1 --2- 172.21.15.63:0/2005596548 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb7740cd4e0 0x7fb7741f5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:43.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.349+0000 7fb77b200640 1 -- 172.21.15.63:0/2005596548 >> 172.21.15.63:0/2005596548 conn(0x7fb774068460 msgr2=0x7fb774144030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:26:43.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.349+0000 7fb77b200640 1 -- 172.21.15.63:0/2005596548 shutdown_connections 2024-05-21T01:26:43.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.349+0000 7fb77b200640 1 -- 172.21.15.63:0/2005596548 wait complete. 2024-05-21T01:26:43.373 INFO:tasks.ceph:Scrubbing osd.1 2024-05-21T01:26:43.373 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-05-21T01:26:43.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.513+0000 7fc371400640 1 Processor -- start 2024-05-21T01:26:43.519 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.513+0000 7fc371400640 1 -- start start 2024-05-21T01:26:43.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.517+0000 7fc371400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc36c155e00 0x7fc36c0c9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:43.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.517+0000 7fc371400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fc36c06f2e0 0x7fc36c06d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:43.520 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.517+0000 7fc371400640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc36c15bc80 con 0x7fc36c0736a0 2024-05-21T01:26:43.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.517+0000 7fc371400640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fc36c15bf60 con 0x7fc36c06f2e0 2024-05-21T01:26:43.521 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.517+0000 7fc371400640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fc36c15c240 con 0x7fc36c155e00 2024-05-21T01:26:43.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.517+0000 7fc36be00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc36c155e00 0x7fc36c0c9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:43.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.517+0000 7fc36b400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fc36c06f2e0 0x7fc36c06d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:43.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.517+0000 7fc370a00640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fc36c0736a0 0x7fc36c15f160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.63:46170/0 (socket says 172.21.15.63:46170) 2024-05-21T01:26:43.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.517+0000 7fc370a00640 1 -- 172.21.15.63:0/2979656929 learned_addr learned my addr 172.21.15.63:0/2979656929 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-05-21T01:26:43.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.517+0000 7fc36aa00640 1 -- 172.21.15.63:0/2979656929 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1216427316 0 0) 0x7fc36c15bc80 con 0x7fc36c0736a0 2024-05-21T01:26:43.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.517+0000 7fc36aa00640 1 -- 172.21.15.63:0/2979656929 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc350003530 con 0x7fc36c0736a0 2024-05-21T01:26:43.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.517+0000 7fc36be00640 1 -- 172.21.15.63:0/2979656929 >> v2:172.21.15.131:3300/0 conn(0x7fc36c06f2e0 msgr2=0x7fc36c06d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:26:43.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.517+0000 7fc36be00640 1 --2- 172.21.15.63:0/2979656929 >> v2:172.21.15.131:3300/0 conn(0x7fc36c06f2e0 0x7fc36c06d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:43.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.517+0000 7fc36be00640 1 -- 172.21.15.63:0/2979656929 >> v1:172.21.15.131:6789/0 conn(0x7fc36c0736a0 legacy=0x7fc36c15f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:43.522 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.517+0000 7fc36be00640 1 -- 172.21.15.63:0/2979656929 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc36c15c520 con 0x7fc36c155e00 2024-05-21T01:26:43.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.521+0000 7fc36be00640 1 --2- 172.21.15.63:0/2979656929 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc36c155e00 0x7fc36c0c9c30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc35c0097c0 tx=0x7fc35c01ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8a4e5e82153edd5 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:43.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.521+0000 7fc36aa00640 1 -- 172.21.15.63:0/2979656929 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc35c0b5070 con 0x7fc36c155e00 2024-05-21T01:26:43.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.521+0000 7fc36aa00640 1 -- 172.21.15.63:0/2979656929 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc35c0a8990 con 0x7fc36c155e00 2024-05-21T01:26:43.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.521+0000 7fc36aa00640 1 -- 172.21.15.63:0/2979656929 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc35c0a8d60 con 0x7fc36c155e00 2024-05-21T01:26:43.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.521+0000 7fc371400640 1 -- 172.21.15.63:0/2979656929 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc36c155e00 msgr2=0x7fc36c0c9c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:43.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.521+0000 7fc371400640 1 --2- 172.21.15.63:0/2979656929 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc36c155e00 0x7fc36c0c9c30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc35c0097c0 tx=0x7fc35c01ec90 comp rx=0 tx=0).stop 2024-05-21T01:26:43.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.521+0000 7fc371400640 1 -- 172.21.15.63:0/2979656929 shutdown_connections 2024-05-21T01:26:43.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.521+0000 7fc371400640 1 --2- 172.21.15.63:0/2979656929 >> v2:172.21.15.131:3300/0 conn(0x7fc36c06f2e0 0x7fc36c06d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:43.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.521+0000 7fc371400640 1 --2- 172.21.15.63:0/2979656929 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc36c155e00 0x7fc36c0c9c30 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:43.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.521+0000 7fc371400640 1 -- 172.21.15.63:0/2979656929 >> 172.21.15.63:0/2979656929 conn(0x7fc36c068290 msgr2=0x7fc36c0686a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:26:43.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.521+0000 7fc371400640 1 -- 172.21.15.63:0/2979656929 shutdown_connections 2024-05-21T01:26:43.526 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.521+0000 7fc371400640 1 -- 172.21.15.63:0/2979656929 wait complete. 2024-05-21T01:26:43.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.521+0000 7fc371400640 1 Processor -- start 2024-05-21T01:26:43.527 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.521+0000 7fc371400640 1 -- start start 2024-05-21T01:26:43.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.525+0000 7fc371400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc36c06f2e0 0x7fc36c154030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:43.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.525+0000 7fc371400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc36c0736a0 0x7fc36c14ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:43.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.525+0000 7fc371400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc36c155e00 0x7fc36c14f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:43.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.525+0000 7fc371400640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fc36c15f870 con 0x7fc36c155e00 2024-05-21T01:26:43.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.525+0000 7fc371400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fc36c1561e0 con 0x7fc36c0736a0 2024-05-21T01:26:43.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.525+0000 7fc371400640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fc36c15f9f0 con 0x7fc36c06f2e0 2024-05-21T01:26:43.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.525+0000 7fc370a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc36c155e00 0x7fc36c14f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:43.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.525+0000 7fc370a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc36c155e00 0x7fc36c14f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48162/0 (socket says 172.21.15.63:48162) 2024-05-21T01:26:43.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.525+0000 7fc370a00640 1 -- 172.21.15.63:0/621124715 learned_addr learned my addr 172.21.15.63:0/621124715 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:26:43.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.525+0000 7fc36be00640 1 --2- 172.21.15.63:0/621124715 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc36c06f2e0 0x7fc36c154030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:43.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.525+0000 7fc36b400640 1 --2- 172.21.15.63:0/621124715 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc36c0736a0 0x7fc36c14ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:43.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.525+0000 7fc370a00640 1 -- 172.21.15.63:0/621124715 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc36c06f2e0 msgr2=0x7fc36c154030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:43.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.525+0000 7fc370a00640 1 --2- 172.21.15.63:0/621124715 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc36c06f2e0 0x7fc36c154030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:43.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.525+0000 7fc370a00640 1 -- 172.21.15.63:0/621124715 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc36c0736a0 msgr2=0x7fc36c14ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:43.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.525+0000 7fc370a00640 1 --2- 172.21.15.63:0/621124715 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc36c0736a0 0x7fc36c14ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:43.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.525+0000 7fc370a00640 1 -- 172.21.15.63:0/621124715 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc36c15ee50 con 0x7fc36c155e00 2024-05-21T01:26:43.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.525+0000 7fc370a00640 1 --2- 172.21.15.63:0/621124715 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc36c155e00 0x7fc36c14f180 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fc36400cb70 tx=0x7fc36400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:43.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.525+0000 7fc363e00640 1 -- 172.21.15.63:0/621124715 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc36400ad40 con 0x7fc36c155e00 2024-05-21T01:26:43.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.525+0000 7fc363e00640 1 -- 172.21.15.63:0/621124715 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc364012400 con 0x7fc36c155e00 2024-05-21T01:26:43.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.525+0000 7fc371400640 1 -- 172.21.15.63:0/621124715 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc36c15d7e0 con 0x7fc36c155e00 2024-05-21T01:26:43.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.525+0000 7fc363e00640 1 -- 172.21.15.63:0/621124715 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3640127b0 con 0x7fc36c155e00 2024-05-21T01:26:43.531 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.525+0000 7fc371400640 1 -- 172.21.15.63:0/621124715 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc36c15dda0 con 0x7fc36c155e00 2024-05-21T01:26:43.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.525+0000 7fc371400640 1 -- 172.21.15.63:0/621124715 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc36c06c0c0 con 0x7fc36c155e00 2024-05-21T01:26:43.532 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.529+0000 7fc363e00640 1 -- 172.21.15.63:0/621124715 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7fc364012950 con 0x7fc36c155e00 2024-05-21T01:26:43.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.529+0000 7fc363e00640 1 --2- 172.21.15.63:0/621124715 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fc34c06f400 0x7fc34c0718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:43.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.529+0000 7fc363e00640 1 -- 172.21.15.63:0/621124715 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7fc36408faa0 con 0x7fc36c155e00 2024-05-21T01:26:43.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.529+0000 7fc363e00640 1 --2- 172.21.15.63:0/621124715 >> [v2:172.21.15.63:6803/896993303,v1:172.21.15.63:6805/896993303] conn(0x7fc34c078bb0 0x7fc34c07b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:43.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.529+0000 7fc363e00640 1 -- 172.21.15.63:0/621124715 --> [v2:172.21.15.63:6803/896993303,v1:172.21.15.63:6805/896993303] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc34c07b700 con 0x7fc34c078bb0 2024-05-21T01:26:43.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.529+0000 7fc363e00640 1 -- 172.21.15.63:0/621124715 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc3640942a0 con 0x7fc36c155e00 2024-05-21T01:26:43.533 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.529+0000 7fc36be00640 1 --2- 172.21.15.63:0/621124715 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fc34c06f400 0x7fc34c0718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:43.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.529+0000 7fc36b400640 1 --2- 172.21.15.63:0/621124715 >> [v2:172.21.15.63:6803/896993303,v1:172.21.15.63:6805/896993303] conn(0x7fc34c078bb0 0x7fc34c07b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:43.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.529+0000 7fc36b400640 1 --2- 172.21.15.63:0/621124715 >> [v2:172.21.15.63:6803/896993303,v1:172.21.15.63:6805/896993303] conn(0x7fc34c078bb0 0x7fc34c07b030 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:43.534 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.529+0000 7fc36be00640 1 --2- 172.21.15.63:0/621124715 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fc34c06f400 0x7fc34c0718c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc35c0b2000 tx=0x7fc35c0aa070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:43.535 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.529+0000 7fc363e00640 1 -- 172.21.15.63:0/621124715 <== osd.1 v2:172.21.15.63:6803/896993303 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc34c07b700 con 0x7fc34c078bb0 2024-05-21T01:26:43.548 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.545+0000 7fc371400640 1 -- 172.21.15.63:0/621124715 --> [v2:172.21.15.63:6803/896993303,v1:172.21.15.63:6805/896993303] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc36c06df10 con 0x7fc34c078bb0 2024-05-21T01:26:43.548 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.545+0000 7fc363e00640 1 -- 172.21.15.63:0/621124715 <== osd.1 v2:172.21.15.63:6803/896993303 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fc36c06df10 con 0x7fc34c078bb0 2024-05-21T01:26:43.548 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-05-21T01:26:43.549 INFO:teuthology.orchestra.run.smithi063.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-21T01:26:43.549 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-05-21T01:26:43.549 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.545+0000 7fc371400640 1 -- 172.21.15.63:0/621124715 >> [v2:172.21.15.63:6803/896993303,v1:172.21.15.63:6805/896993303] conn(0x7fc34c078bb0 msgr2=0x7fc34c07b030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:43.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.545+0000 7fc371400640 1 --2- 172.21.15.63:0/621124715 >> [v2:172.21.15.63:6803/896993303,v1:172.21.15.63:6805/896993303] conn(0x7fc34c078bb0 0x7fc34c07b030 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:43.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.545+0000 7fc371400640 1 -- 172.21.15.63:0/621124715 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fc34c06f400 msgr2=0x7fc34c0718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:43.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.545+0000 7fc371400640 1 --2- 172.21.15.63:0/621124715 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fc34c06f400 0x7fc34c0718c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc35c0b2000 tx=0x7fc35c0aa070 comp rx=0 tx=0).stop 2024-05-21T01:26:43.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.545+0000 7fc371400640 1 -- 172.21.15.63:0/621124715 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc36c155e00 msgr2=0x7fc36c14f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:43.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.545+0000 7fc371400640 1 --2- 172.21.15.63:0/621124715 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc36c155e00 0x7fc36c14f180 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fc36400cb70 tx=0x7fc36400a430 comp rx=0 tx=0).stop 2024-05-21T01:26:43.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.545+0000 7fc370a00640 1 -- 172.21.15.63:0/621124715 reap_dead start 2024-05-21T01:26:43.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.545+0000 7fc371400640 1 -- 172.21.15.63:0/621124715 shutdown_connections 2024-05-21T01:26:43.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.545+0000 7fc371400640 1 -- 172.21.15.63:0/621124715 >> 172.21.15.63:0/621124715 conn(0x7fc36c068290 msgr2=0x7fc36c159820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:26:43.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.545+0000 7fc371400640 1 -- 172.21.15.63:0/621124715 shutdown_connections 2024-05-21T01:26:43.550 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.545+0000 7fc371400640 1 -- 172.21.15.63:0/621124715 wait complete. 2024-05-21T01:26:43.567 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-05-21T01:26:43.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.705+0000 7f7f86000640 1 Processor -- start 2024-05-21T01:26:43.710 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.705+0000 7f7f86000640 1 -- start start 2024-05-21T01:26:43.712 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.705+0000 7f7f86000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f7f800cf790 0x7f7f800c69a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:43.712 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.705+0000 7f7f86000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7f800cfb70 0x7f7f80153b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:43.712 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.705+0000 7f7f86000640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f800c8be0 con 0x7f7f800ca810 2024-05-21T01:26:43.712 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.705+0000 7f7f86000640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f7f800c8e80 con 0x7f7f800cf790 2024-05-21T01:26:43.712 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.705+0000 7f7f86000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f7f800c9160 con 0x7f7f800cfb70 2024-05-21T01:26:43.712 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.709+0000 7f7f7fe00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f7f800ca810 0x7f7f80159e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37532/0 (socket says 172.21.15.63:37532) 2024-05-21T01:26:43.712 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.709+0000 7f7f7fe00640 1 -- 172.21.15.63:0/562167563 learned_addr learned my addr 172.21.15.63:0/562167563 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-05-21T01:26:43.712 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.709+0000 7f7f7f400640 1 --2- 172.21.15.63:0/562167563 >> v2:172.21.15.131:3300/0 conn(0x7f7f800cf790 0x7f7f800c69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:43.712 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.709+0000 7f7f77e00640 1 --2- 172.21.15.63:0/562167563 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7f800cfb70 0x7f7f80153b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:43.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.709+0000 7f7f7ea00640 1 -- 172.21.15.63:0/562167563 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2225381531 0 0) 0x7f7f800c8be0 con 0x7f7f800ca810 2024-05-21T01:26:43.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.709+0000 7f7f7ea00640 1 -- 172.21.15.63:0/562167563 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f64003530 con 0x7f7f800ca810 2024-05-21T01:26:43.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.709+0000 7f7f7f400640 1 -- 172.21.15.63:0/562167563 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7f800cfb70 msgr2=0x7f7f80153b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:26:43.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.709+0000 7f7f7f400640 1 --2- 172.21.15.63:0/562167563 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7f800cfb70 0x7f7f80153b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:43.713 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.709+0000 7f7f7f400640 1 -- 172.21.15.63:0/562167563 >> v1:172.21.15.63:6789/0 conn(0x7f7f800ca810 legacy=0x7f7f80159e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:43.714 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.709+0000 7f7f7f400640 1 -- 172.21.15.63:0/562167563 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f800c9440 con 0x7f7f800cf790 2024-05-21T01:26:43.715 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.709+0000 7f7f7f400640 1 --2- 172.21.15.63:0/562167563 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7f800cf790 0x7f7f800c69a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7f700097c0 tx=0x7f7f7001c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2960b8807494566 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:43.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.713+0000 7f7f7ea00640 1 -- 172.21.15.63:0/562167563 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f700b0070 con 0x7f7f800cf790 2024-05-21T01:26:43.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.713+0000 7f7f7ea00640 1 -- 172.21.15.63:0/562167563 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f700ab600 con 0x7f7f800cf790 2024-05-21T01:26:43.716 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.713+0000 7f7f7ea00640 1 -- 172.21.15.63:0/562167563 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f700ab9d0 con 0x7f7f800cf790 2024-05-21T01:26:43.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.713+0000 7f7f86000640 1 -- 172.21.15.63:0/562167563 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7f800cf790 msgr2=0x7f7f800c69a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:43.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.713+0000 7f7f86000640 1 --2- 172.21.15.63:0/562167563 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7f800cf790 0x7f7f800c69a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7f700097c0 tx=0x7f7f7001c410 comp rx=0 tx=0).stop 2024-05-21T01:26:43.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.713+0000 7f7f86000640 1 -- 172.21.15.63:0/562167563 shutdown_connections 2024-05-21T01:26:43.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.713+0000 7f7f86000640 1 --2- 172.21.15.63:0/562167563 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7f800cfb70 0x7f7f80153b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:43.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.713+0000 7f7f86000640 1 --2- 172.21.15.63:0/562167563 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7f800cf790 0x7f7f800c69a0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:43.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.713+0000 7f7f86000640 1 -- 172.21.15.63:0/562167563 >> 172.21.15.63:0/562167563 conn(0x7f7f800735f0 msgr2=0x7f7f80073a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:26:43.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.713+0000 7f7f86000640 1 -- 172.21.15.63:0/562167563 shutdown_connections 2024-05-21T01:26:43.717 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.713+0000 7f7f86000640 1 -- 172.21.15.63:0/562167563 wait complete. 2024-05-21T01:26:43.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.713+0000 7f7f86000640 1 Processor -- start 2024-05-21T01:26:43.718 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.713+0000 7f7f86000640 1 -- start start 2024-05-21T01:26:43.719 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.713+0000 7f7f86000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7f800ca810 0x7f7f800cc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:43.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.713+0000 7f7f86000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7f800cf790 0x7f7f8014f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:43.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.713+0000 7f7f86000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7f800cfb70 0x7f7f8014b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:43.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.713+0000 7f7f86000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f7f80154410 con 0x7f7f800ca810 2024-05-21T01:26:43.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.713+0000 7f7f86000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f7f80154290 con 0x7f7f800cf790 2024-05-21T01:26:43.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.713+0000 7f7f86000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f7f80166ec0 con 0x7f7f800cfb70 2024-05-21T01:26:43.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.713+0000 7f7f7f400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7f800ca810 0x7f7f800cc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:43.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.713+0000 7f7f7f400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7f800ca810 0x7f7f800cc9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48164/0 (socket says 172.21.15.63:48164) 2024-05-21T01:26:43.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.713+0000 7f7f7f400640 1 -- 172.21.15.63:0/74259361 learned_addr learned my addr 172.21.15.63:0/74259361 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:26:43.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.713+0000 7f7f77e00640 1 --2- 172.21.15.63:0/74259361 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7f800cf790 0x7f7f8014f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:43.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.713+0000 7f7f7fe00640 1 --2- 172.21.15.63:0/74259361 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7f800cfb70 0x7f7f8014b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:43.720 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.717+0000 7f7f7f400640 1 -- 172.21.15.63:0/74259361 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7f800cfb70 msgr2=0x7f7f8014b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:43.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.717+0000 7f7f7f400640 1 --2- 172.21.15.63:0/74259361 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7f800cfb70 0x7f7f8014b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:43.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.717+0000 7f7f7f400640 1 -- 172.21.15.63:0/74259361 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7f800cf790 msgr2=0x7f7f8014f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:43.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.717+0000 7f7f7f400640 1 --2- 172.21.15.63:0/74259361 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7f800cf790 0x7f7f8014f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:43.721 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.717+0000 7f7f7f400640 1 -- 172.21.15.63:0/74259361 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f8014d240 con 0x7f7f800ca810 2024-05-21T01:26:43.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.717+0000 7f7f7f400640 1 --2- 172.21.15.63:0/74259361 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7f800ca810 0x7f7f800cc9a0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f7f7001a040 tx=0x7f7f7001ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:43.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.717+0000 7f7f77400640 1 -- 172.21.15.63:0/74259361 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f700b0050 con 0x7f7f800ca810 2024-05-21T01:26:43.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.717+0000 7f7f77400640 1 -- 172.21.15.63:0/74259361 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f700b1040 con 0x7f7f800ca810 2024-05-21T01:26:43.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.717+0000 7f7f77400640 1 -- 172.21.15.63:0/74259361 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f70006e20 con 0x7f7f800ca810 2024-05-21T01:26:43.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.717+0000 7f7f86000640 1 -- 172.21.15.63:0/74259361 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f801f3040 con 0x7f7f800ca810 2024-05-21T01:26:43.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.717+0000 7f7f86000640 1 -- 172.21.15.63:0/74259361 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f801f3600 con 0x7f7f800ca810 2024-05-21T01:26:43.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.717+0000 7f7f86000640 1 -- 172.21.15.63:0/74259361 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f800507f0 con 0x7f7f800ca810 2024-05-21T01:26:43.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.717+0000 7f7f77400640 1 -- 172.21.15.63:0/74259361 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7f7f700be030 con 0x7f7f800ca810 2024-05-21T01:26:43.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.717+0000 7f7f77400640 1 --2- 172.21.15.63:0/74259361 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f7f5c06f430 0x7f7f5c0718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:43.723 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.717+0000 7f7f77400640 1 -- 172.21.15.63:0/74259361 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f7f70128ea0 con 0x7f7f800ca810 2024-05-21T01:26:43.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.721+0000 7f7f77e00640 1 --2- 172.21.15.63:0/74259361 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f7f5c06f430 0x7f7f5c0718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:43.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.721+0000 7f7f77e00640 1 --2- 172.21.15.63:0/74259361 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f7f5c06f430 0x7f7f5c0718f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7f801442a0 tx=0x7f7f68008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:43.727 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.721+0000 7f7f77400640 1 -- 172.21.15.63:0/74259361 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f7f70016090 con 0x7f7f800ca810 2024-05-21T01:26:43.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.889+0000 7f7f86000640 1 -- 172.21.15.63:0/74259361 --> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f7f801f3de0 con 0x7f7f5c06f430 2024-05-21T01:26:43.894 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.889+0000 7f7f77400640 1 -- 172.21.15.63:0/74259361 <== mgr.4103 v2:172.21.15.131:6832/921953667 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f7f801f3de0 con 0x7f7f5c06f430 2024-05-21T01:26:43.894 INFO:teuthology.orchestra.run.smithi063.stderr:instructed osd(s) 1 to deep-scrub 2024-05-21T01:26:43.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.893+0000 7f7f86000640 1 -- 172.21.15.63:0/74259361 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f7f5c06f430 msgr2=0x7f7f5c0718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:43.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.893+0000 7f7f86000640 1 --2- 172.21.15.63:0/74259361 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f7f5c06f430 0x7f7f5c0718f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7f801442a0 tx=0x7f7f68008040 comp rx=0 tx=0).stop 2024-05-21T01:26:43.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.893+0000 7f7f86000640 1 -- 172.21.15.63:0/74259361 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7f800ca810 msgr2=0x7f7f800cc9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:43.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.893+0000 7f7f86000640 1 --2- 172.21.15.63:0/74259361 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7f800ca810 0x7f7f800cc9a0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f7f7001a040 tx=0x7f7f7001ac50 comp rx=0 tx=0).stop 2024-05-21T01:26:43.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.893+0000 7f7f86000640 1 -- 172.21.15.63:0/74259361 shutdown_connections 2024-05-21T01:26:43.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.893+0000 7f7f86000640 1 --2- 172.21.15.63:0/74259361 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f7f5c06f430 0x7f7f5c0718f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:43.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.893+0000 7f7f86000640 1 --2- 172.21.15.63:0/74259361 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7f800cfb70 0x7f7f8014b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:43.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.893+0000 7f7f86000640 1 --2- 172.21.15.63:0/74259361 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7f800cf790 0x7f7f8014f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:43.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.893+0000 7f7f86000640 1 --2- 172.21.15.63:0/74259361 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7f800ca810 0x7f7f800cc9a0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:43.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.893+0000 7f7f86000640 1 -- 172.21.15.63:0/74259361 >> 172.21.15.63:0/74259361 conn(0x7f7f800735f0 msgr2=0x7f7f80150a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:26:43.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.893+0000 7f7f86000640 1 -- 172.21.15.63:0/74259361 shutdown_connections 2024-05-21T01:26:43.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:43.893+0000 7f7f86000640 1 -- 172.21.15.63:0/74259361 wait complete. 2024-05-21T01:26:43.917 INFO:tasks.ceph:Scrubbing osd.2 2024-05-21T01:26:43.918 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-05-21T01:26:44.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.057+0000 7f6eef400640 1 Processor -- start 2024-05-21T01:26:44.063 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.057+0000 7f6eef400640 1 -- start start 2024-05-21T01:26:44.064 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.061+0000 7f6eef400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6ee8159cb0 0x7f6ee80735e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:44.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.061+0000 7f6eef400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f6ee8073b20 0x7f6ee806d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:44.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.061+0000 7f6eef400640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ee81543e0 con 0x7f6ee8154000 2024-05-21T01:26:44.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.061+0000 7f6eef400640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f6ee815d2a0 con 0x7f6ee8073b20 2024-05-21T01:26:44.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.061+0000 7f6eef400640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f6ee815b1a0 con 0x7f6ee8159cb0 2024-05-21T01:26:44.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.061+0000 7f6eeca00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f6ee8154000 0x7f6ee815da10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37542/0 (socket says 172.21.15.63:37542) 2024-05-21T01:26:44.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.061+0000 7f6eeca00640 1 -- 172.21.15.63:0/1042992184 learned_addr learned my addr 172.21.15.63:0/1042992184 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-05-21T01:26:44.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.061+0000 7f6eed400640 1 --2- 172.21.15.63:0/1042992184 >> v2:172.21.15.131:3300/0 conn(0x7f6ee8073b20 0x7f6ee806d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:44.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.061+0000 7f6edfe00640 1 --2- 172.21.15.63:0/1042992184 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6ee8159cb0 0x7f6ee80735e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:44.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.061+0000 7f6ee7e00640 1 -- 172.21.15.63:0/1042992184 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2499829574 0 0) 0x7f6ed8001120 con 0x7f6ee8154000 2024-05-21T01:26:44.065 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.061+0000 7f6ee7e00640 1 -- 172.21.15.63:0/1042992184 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ecc003530 con 0x7f6ee8154000 2024-05-21T01:26:44.066 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.061+0000 7f6ee7e00640 1 -- 172.21.15.63:0/1042992184 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1792618631 0 0) 0x7f6ecc003530 con 0x7f6ee8154000 2024-05-21T01:26:44.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.061+0000 7f6ee7e00640 1 -- 172.21.15.63:0/1042992184 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6ee8159cb0 msgr2=0x7f6ee80735e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:26:44.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.061+0000 7f6ee7e00640 1 --2- 172.21.15.63:0/1042992184 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6ee8159cb0 0x7f6ee80735e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:44.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.061+0000 7f6ee7e00640 1 -- 172.21.15.63:0/1042992184 >> v2:172.21.15.131:3300/0 conn(0x7f6ee8073b20 msgr2=0x7f6ee806d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:26:44.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.061+0000 7f6ee7e00640 1 --2- 172.21.15.63:0/1042992184 >> v2:172.21.15.131:3300/0 conn(0x7f6ee8073b20 0x7f6ee806d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:44.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.061+0000 7f6ee7e00640 1 -- 172.21.15.63:0/1042992184 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ee815a1f0 con 0x7f6ee8154000 2024-05-21T01:26:44.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.061+0000 7f6ee7e00640 1 -- 172.21.15.63:0/1042992184 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 466403955 0 0) 0x7f6ed80018d0 con 0x7f6ee8154000 2024-05-21T01:26:44.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.061+0000 7f6ee7e00640 1 -- 172.21.15.63:0/1042992184 >> v1:172.21.15.63:6789/0 conn(0x7f6ee8154000 legacy=0x7f6ee815da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:44.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.061+0000 7f6ee7e00640 1 --2- 172.21.15.63:0/1042992184 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ecc003a10 0x7f6ecc003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:44.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.061+0000 7f6ee7e00640 1 --2- 172.21.15.63:0/1042992184 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6ee8159cb0 0x7f6ecc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:44.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.061+0000 7f6ee7e00640 1 --2- 172.21.15.63:0/1042992184 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6ecc004d50 0x7f6ecc0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:44.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.061+0000 7f6ee7e00640 1 -- 172.21.15.63:0/1042992184 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee815d2a0 con 0x7f6ecc003a10 2024-05-21T01:26:44.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.061+0000 7f6ee7e00640 1 -- 172.21.15.63:0/1042992184 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee815b1a0 con 0x7f6ecc004d50 2024-05-21T01:26:44.067 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.061+0000 7f6ee7e00640 1 -- 172.21.15.63:0/1042992184 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f6ecc00ba00 con 0x7f6ee8159cb0 2024-05-21T01:26:44.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.061+0000 7f6eeca00640 1 --2- 172.21.15.63:0/1042992184 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ecc003a10 0x7f6ecc003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:44.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.061+0000 7f6edfe00640 1 --2- 172.21.15.63:0/1042992184 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6ee8159cb0 0x7f6ecc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:44.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.061+0000 7f6eeca00640 1 -- 172.21.15.63:0/1042992184 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6ee8159cb0 msgr2=0x7f6ecc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:26:44.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.061+0000 7f6eeca00640 1 --2- 172.21.15.63:0/1042992184 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6ee8159cb0 0x7f6ecc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:44.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.061+0000 7f6eeca00640 1 -- 172.21.15.63:0/1042992184 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6ecc004d50 msgr2=0x7f6ecc0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:26:44.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.061+0000 7f6eed400640 1 --2- 172.21.15.63:0/1042992184 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6ecc004d50 0x7f6ecc0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:44.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.061+0000 7f6eeca00640 1 --2- 172.21.15.63:0/1042992184 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6ecc004d50 0x7f6ecc0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:44.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.061+0000 7f6eeca00640 1 -- 172.21.15.63:0/1042992184 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ecc003530 con 0x7f6ecc003a10 2024-05-21T01:26:44.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.061+0000 7f6eed400640 1 --2- 172.21.15.63:0/1042992184 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6ecc004d50 0x7f6ecc0051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T01:26:44.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.065+0000 7f6eeca00640 1 --2- 172.21.15.63:0/1042992184 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ecc003a10 0x7f6ecc003e30 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f6ed800c4c0 tx=0x7f6ed801cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd6b92b60d2f3fde server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:44.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.065+0000 7f6ee7e00640 1 -- 172.21.15.63:0/1042992184 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ed800c0e0 con 0x7f6ecc003a10 2024-05-21T01:26:44.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.065+0000 7f6ee7e00640 1 -- 172.21.15.63:0/1042992184 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ed80a9070 con 0x7f6ecc003a10 2024-05-21T01:26:44.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.065+0000 7f6ee7e00640 1 -- 172.21.15.63:0/1042992184 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ed8005d20 con 0x7f6ecc003a10 2024-05-21T01:26:44.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.065+0000 7f6eef400640 1 -- 172.21.15.63:0/1042992184 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ecc003a10 msgr2=0x7f6ecc003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:44.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.065+0000 7f6eef400640 1 --2- 172.21.15.63:0/1042992184 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ecc003a10 0x7f6ecc003e30 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f6ed800c4c0 tx=0x7f6ed801cc20 comp rx=0 tx=0).stop 2024-05-21T01:26:44.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.065+0000 7f6eed400640 1 -- 172.21.15.63:0/1042992184 reap_dead start 2024-05-21T01:26:44.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.065+0000 7f6eef400640 1 -- 172.21.15.63:0/1042992184 shutdown_connections 2024-05-21T01:26:44.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.065+0000 7f6eef400640 1 -- 172.21.15.63:0/1042992184 >> 172.21.15.63:0/1042992184 conn(0x7f6ee806efc0 msgr2=0x7f6ee806f3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:26:44.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.065+0000 7f6eef400640 1 -- 172.21.15.63:0/1042992184 shutdown_connections 2024-05-21T01:26:44.070 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.065+0000 7f6eef400640 1 -- 172.21.15.63:0/1042992184 wait complete. 2024-05-21T01:26:44.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.065+0000 7f6eef400640 1 Processor -- start 2024-05-21T01:26:44.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.065+0000 7f6eef400640 1 -- start start 2024-05-21T01:26:44.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.069+0000 7f6eef400640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6ecc003a10 0x7f6ee814c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:44.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.069+0000 7f6eef400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6ee8150c00 0x7f6ee8159290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:44.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.069+0000 7f6eef400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ee81597d0 0x7f6ee814ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:44.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.069+0000 7f6eef400640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee815d4f0 con 0x7f6ee81597d0 2024-05-21T01:26:44.073 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.069+0000 7f6eef400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee815aa90 con 0x7f6ee8150c00 2024-05-21T01:26:44.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.069+0000 7f6eef400640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f6ee815e120 con 0x7f6ecc003a10 2024-05-21T01:26:44.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.069+0000 7f6eed400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ee81597d0 0x7f6ee814ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:44.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.069+0000 7f6eed400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ee81597d0 0x7f6ee814ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48172/0 (socket says 172.21.15.63:48172) 2024-05-21T01:26:44.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.069+0000 7f6eed400640 1 -- 172.21.15.63:0/1464944973 learned_addr learned my addr 172.21.15.63:0/1464944973 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:26:44.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.069+0000 7f6eeca00640 1 --2- 172.21.15.63:0/1464944973 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6ecc003a10 0x7f6ee814c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:44.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.069+0000 7f6edfe00640 1 --2- 172.21.15.63:0/1464944973 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6ee8150c00 0x7f6ee8159290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:44.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.069+0000 7f6eed400640 1 -- 172.21.15.63:0/1464944973 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6ecc003a10 msgr2=0x7f6ee814c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:44.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.069+0000 7f6eed400640 1 --2- 172.21.15.63:0/1464944973 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6ecc003a10 0x7f6ee814c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:44.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.069+0000 7f6eed400640 1 -- 172.21.15.63:0/1464944973 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6ee8150c00 msgr2=0x7f6ee8159290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:44.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.069+0000 7f6eed400640 1 --2- 172.21.15.63:0/1464944973 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6ee8150c00 0x7f6ee8159290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:44.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.069+0000 7f6eed400640 1 -- 172.21.15.63:0/1464944973 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ee814e340 con 0x7f6ee81597d0 2024-05-21T01:26:44.074 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.069+0000 7f6eed400640 1 --2- 172.21.15.63:0/1464944973 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ee81597d0 0x7f6ee814ff70 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f6ee806e460 tx=0x7f6ee000f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:44.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.069+0000 7f6ee5600640 1 -- 172.21.15.63:0/1464944973 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee001c070 con 0x7f6ee81597d0 2024-05-21T01:26:44.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.069+0000 7f6ee5600640 1 -- 172.21.15.63:0/1464944973 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ee0017400 con 0x7f6ee81597d0 2024-05-21T01:26:44.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.069+0000 7f6ee5600640 1 -- 172.21.15.63:0/1464944973 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee00177d0 con 0x7f6ee81597d0 2024-05-21T01:26:44.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.069+0000 7f6eef400640 1 -- 172.21.15.63:0/1464944973 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ee814e620 con 0x7f6ee81597d0 2024-05-21T01:26:44.075 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.069+0000 7f6eef400640 1 -- 172.21.15.63:0/1464944973 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ee814c5f0 con 0x7f6ee81597d0 2024-05-21T01:26:44.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.069+0000 7f6eef400640 1 -- 172.21.15.63:0/1464944973 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6ee8157680 con 0x7f6ee81597d0 2024-05-21T01:26:44.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.073+0000 7f6ee5600640 1 -- 172.21.15.63:0/1464944973 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7f6ee001f070 con 0x7f6ee81597d0 2024-05-21T01:26:44.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.073+0000 7f6ee5600640 1 --2- 172.21.15.63:0/1464944973 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f6ec406f400 0x7f6ec40718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:44.076 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.073+0000 7f6ee5600640 1 -- 172.21.15.63:0/1464944973 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f6ee008f650 con 0x7f6ee81597d0 2024-05-21T01:26:44.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.073+0000 7f6ee5600640 1 --2- 172.21.15.63:0/1464944973 >> [v2:172.21.15.63:6815/845807419,v1:172.21.15.63:6817/845807419] conn(0x7f6ec4078bc0 0x7f6ec407b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:44.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.073+0000 7f6ee5600640 1 -- 172.21.15.63:0/1464944973 --> [v2:172.21.15.63:6815/845807419,v1:172.21.15.63:6817/845807419] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6ee00020c0 con 0x7f6ec4078bc0 2024-05-21T01:26:44.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.073+0000 7f6ee5600640 1 -- 172.21.15.63:0/1464944973 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f6ee0096050 con 0x7f6ee81597d0 2024-05-21T01:26:44.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.073+0000 7f6eeca00640 1 --2- 172.21.15.63:0/1464944973 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f6ec406f400 0x7f6ec40718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:44.077 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.073+0000 7f6edfe00640 1 --2- 172.21.15.63:0/1464944973 >> [v2:172.21.15.63:6815/845807419,v1:172.21.15.63:6817/845807419] conn(0x7f6ec4078bc0 0x7f6ec407b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:44.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.073+0000 7f6edfe00640 1 --2- 172.21.15.63:0/1464944973 >> [v2:172.21.15.63:6815/845807419,v1:172.21.15.63:6817/845807419] conn(0x7f6ec4078bc0 0x7f6ec407b040 crc :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:44.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.073+0000 7f6eeca00640 1 --2- 172.21.15.63:0/1464944973 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f6ec406f400 0x7f6ec40718c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6ed80ab000 tx=0x7f6ed80b1040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:44.078 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.073+0000 7f6ee5600640 1 -- 172.21.15.63:0/1464944973 <== osd.2 v2:172.21.15.63:6815/845807419 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6ee00020c0 con 0x7f6ec4078bc0 2024-05-21T01:26:44.091 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.085+0000 7f6eef400640 1 -- 172.21.15.63:0/1464944973 --> [v2:172.21.15.63:6815/845807419,v1:172.21.15.63:6817/845807419] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f6ee80c5ee0 con 0x7f6ec4078bc0 2024-05-21T01:26:44.092 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.089+0000 7f6ee5600640 1 -- 172.21.15.63:0/1464944973 <== osd.2 v2:172.21.15.63:6815/845807419 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f6ee80c5ee0 con 0x7f6ec4078bc0 2024-05-21T01:26:44.092 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-05-21T01:26:44.092 INFO:teuthology.orchestra.run.smithi063.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-21T01:26:44.092 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-05-21T01:26:44.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.089+0000 7f6eef400640 1 -- 172.21.15.63:0/1464944973 >> [v2:172.21.15.63:6815/845807419,v1:172.21.15.63:6817/845807419] conn(0x7f6ec4078bc0 msgr2=0x7f6ec407b040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:44.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.089+0000 7f6eef400640 1 --2- 172.21.15.63:0/1464944973 >> [v2:172.21.15.63:6815/845807419,v1:172.21.15.63:6817/845807419] conn(0x7f6ec4078bc0 0x7f6ec407b040 crc :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:44.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.089+0000 7f6eef400640 1 -- 172.21.15.63:0/1464944973 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f6ec406f400 msgr2=0x7f6ec40718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:44.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.089+0000 7f6eef400640 1 --2- 172.21.15.63:0/1464944973 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f6ec406f400 0x7f6ec40718c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6ed80ab000 tx=0x7f6ed80b1040 comp rx=0 tx=0).stop 2024-05-21T01:26:44.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.089+0000 7f6eef400640 1 -- 172.21.15.63:0/1464944973 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ee81597d0 msgr2=0x7f6ee814ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:44.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.089+0000 7f6eef400640 1 --2- 172.21.15.63:0/1464944973 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6ee81597d0 0x7f6ee814ff70 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f6ee806e460 tx=0x7f6ee000f4a0 comp rx=0 tx=0).stop 2024-05-21T01:26:44.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.089+0000 7f6eed400640 1 -- 172.21.15.63:0/1464944973 reap_dead start 2024-05-21T01:26:44.093 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.089+0000 7f6eef400640 1 -- 172.21.15.63:0/1464944973 shutdown_connections 2024-05-21T01:26:44.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.089+0000 7f6eef400640 1 -- 172.21.15.63:0/1464944973 >> 172.21.15.63:0/1464944973 conn(0x7f6ee806efc0 msgr2=0x7f6ee814ec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:26:44.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.089+0000 7f6eef400640 1 -- 172.21.15.63:0/1464944973 shutdown_connections 2024-05-21T01:26:44.094 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.089+0000 7f6eef400640 1 -- 172.21.15.63:0/1464944973 wait complete. 2024-05-21T01:26:44.111 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-05-21T01:26:44.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.249+0000 7f1615800640 1 Processor -- start 2024-05-21T01:26:44.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.249+0000 7f1615800640 1 -- start start 2024-05-21T01:26:44.254 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.249+0000 7f1615800640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f161006f5d0 0x7f16100c8a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:44.254 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.249+0000 7f1615800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f161006f9b0 0x7f1610152a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:44.254 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.249+0000 7f1615800640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1610072550 con 0x7f161015ce40 2024-05-21T01:26:44.254 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.249+0000 7f1615800640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f1610159100 con 0x7f161006f5d0 2024-05-21T01:26:44.254 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.249+0000 7f1615800640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f16101593e0 con 0x7f161006f9b0 2024-05-21T01:26:44.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.249+0000 7f160f400640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f161015ce40 0x7f1610072d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37548/0 (socket says 172.21.15.63:37548) 2024-05-21T01:26:44.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.249+0000 7f160f400640 1 -- 172.21.15.63:0/2325345920 learned_addr learned my addr 172.21.15.63:0/2325345920 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-05-21T01:26:44.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.249+0000 7f160ea00640 1 --2- 172.21.15.63:0/2325345920 >> v2:172.21.15.131:3300/0 conn(0x7f161006f5d0 0x7f16100c8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:44.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.249+0000 7f1607e00640 1 --2- 172.21.15.63:0/2325345920 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f161006f9b0 0x7f1610152a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:44.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.249+0000 7f160e000640 1 -- 172.21.15.63:0/2325345920 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1644659647 0 0) 0x7f1610072550 con 0x7f161015ce40 2024-05-21T01:26:44.255 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.249+0000 7f160e000640 1 -- 172.21.15.63:0/2325345920 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f15f4003530 con 0x7f161015ce40 2024-05-21T01:26:44.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.249+0000 7f160ea00640 1 -- 172.21.15.63:0/2325345920 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f161006f9b0 msgr2=0x7f1610152a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:26:44.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.249+0000 7f160ea00640 1 --2- 172.21.15.63:0/2325345920 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f161006f9b0 0x7f1610152a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:44.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.249+0000 7f160ea00640 1 -- 172.21.15.63:0/2325345920 >> v1:172.21.15.63:6789/0 conn(0x7f161015ce40 legacy=0x7f1610072d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:44.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.249+0000 7f160ea00640 1 -- 172.21.15.63:0/2325345920 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16101596c0 con 0x7f161006f5d0 2024-05-21T01:26:44.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.253+0000 7f160ea00640 1 --2- 172.21.15.63:0/2325345920 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f161006f5d0 0x7f16100c8a20 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f16000097c0 tx=0x7f160001c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2504728ef9e8f39b server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:44.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.253+0000 7f160e000640 1 -- 172.21.15.63:0/2325345920 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16000b2070 con 0x7f161006f5d0 2024-05-21T01:26:44.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.253+0000 7f160e000640 1 -- 172.21.15.63:0/2325345920 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16000ad640 con 0x7f161006f5d0 2024-05-21T01:26:44.258 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.253+0000 7f160e000640 1 -- 172.21.15.63:0/2325345920 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16000ada10 con 0x7f161006f5d0 2024-05-21T01:26:44.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.253+0000 7f1615800640 1 -- 172.21.15.63:0/2325345920 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f161006f5d0 msgr2=0x7f16100c8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:44.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.253+0000 7f1615800640 1 --2- 172.21.15.63:0/2325345920 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f161006f5d0 0x7f16100c8a20 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f16000097c0 tx=0x7f160001c4a0 comp rx=0 tx=0).stop 2024-05-21T01:26:44.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.253+0000 7f1615800640 1 -- 172.21.15.63:0/2325345920 shutdown_connections 2024-05-21T01:26:44.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.253+0000 7f1615800640 1 --2- 172.21.15.63:0/2325345920 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f161006f9b0 0x7f1610152a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:44.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.253+0000 7f1615800640 1 --2- 172.21.15.63:0/2325345920 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f161006f5d0 0x7f16100c8a20 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:44.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.253+0000 7f1615800640 1 -- 172.21.15.63:0/2325345920 >> 172.21.15.63:0/2325345920 conn(0x7f1610068460 msgr2=0x7f1610068870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:26:44.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.253+0000 7f1615800640 1 -- 172.21.15.63:0/2325345920 shutdown_connections 2024-05-21T01:26:44.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.253+0000 7f1615800640 1 -- 172.21.15.63:0/2325345920 wait complete. 2024-05-21T01:26:44.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.257+0000 7f1615800640 1 Processor -- start 2024-05-21T01:26:44.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.257+0000 7f1615800640 1 -- start start 2024-05-21T01:26:44.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.257+0000 7f1615800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f161006f5d0 0x7f16101f84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:44.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.257+0000 7f1615800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f161006f9b0 0x7f1610157580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:44.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.257+0000 7f1615800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f161015ce40 0x7f1610157ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:44.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.257+0000 7f1615800640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f1610153100 con 0x7f161006f9b0 2024-05-21T01:26:44.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.257+0000 7f1615800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f1610152f80 con 0x7f161006f5d0 2024-05-21T01:26:44.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.257+0000 7f1615800640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f1610153280 con 0x7f161015ce40 2024-05-21T01:26:44.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.257+0000 7f1607e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f161006f9b0 0x7f1610157580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:44.262 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.257+0000 7f1607e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f161006f9b0 0x7f1610157580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48174/0 (socket says 172.21.15.63:48174) 2024-05-21T01:26:44.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.257+0000 7f1607e00640 1 -- 172.21.15.63:0/1160613421 learned_addr learned my addr 172.21.15.63:0/1160613421 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:26:44.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.257+0000 7f160ea00640 1 --2- 172.21.15.63:0/1160613421 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f161006f5d0 0x7f16101f84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:44.263 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.257+0000 7f160f400640 1 --2- 172.21.15.63:0/1160613421 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f161015ce40 0x7f1610157ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:44.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.257+0000 7f1607e00640 1 -- 172.21.15.63:0/1160613421 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f161015ce40 msgr2=0x7f1610157ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:44.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.257+0000 7f1607e00640 1 --2- 172.21.15.63:0/1160613421 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f161015ce40 0x7f1610157ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:44.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.257+0000 7f1607e00640 1 -- 172.21.15.63:0/1160613421 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f161006f5d0 msgr2=0x7f16101f84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:44.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.257+0000 7f1607e00640 1 --2- 172.21.15.63:0/1160613421 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f161006f5d0 0x7f16101f84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:44.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.257+0000 7f1607e00640 1 -- 172.21.15.63:0/1160613421 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16101f9160 con 0x7f161006f9b0 2024-05-21T01:26:44.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.257+0000 7f160f400640 1 --2- 172.21.15.63:0/1160613421 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f161015ce40 0x7f1610157ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T01:26:44.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.257+0000 7f1607e00640 1 --2- 172.21.15.63:0/1160613421 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f161006f9b0 0x7f1610157580 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f15f800e960 tx=0x7f15f800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:44.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.257+0000 7f1606a00640 1 -- 172.21.15.63:0/1160613421 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15f8017070 con 0x7f161006f9b0 2024-05-21T01:26:44.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.257+0000 7f1606a00640 1 -- 172.21.15.63:0/1160613421 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15f800ca00 con 0x7f161006f9b0 2024-05-21T01:26:44.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.257+0000 7f1606a00640 1 -- 172.21.15.63:0/1160613421 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15f800cdb0 con 0x7f161006f9b0 2024-05-21T01:26:44.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.257+0000 7f1615800640 1 -- 172.21.15.63:0/1160613421 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16100c9ce0 con 0x7f161006f9b0 2024-05-21T01:26:44.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.257+0000 7f1615800640 1 -- 172.21.15.63:0/1160613421 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16101f8e80 con 0x7f161006f9b0 2024-05-21T01:26:44.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.261+0000 7f1615800640 1 -- 172.21.15.63:0/1160613421 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16100507f0 con 0x7f161006f9b0 2024-05-21T01:26:44.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.261+0000 7f1606a00640 1 -- 172.21.15.63:0/1160613421 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7f15f801a070 con 0x7f161006f9b0 2024-05-21T01:26:44.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.261+0000 7f1606a00640 1 --2- 172.21.15.63:0/1160613421 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f15ec06f430 0x7f15ec0718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:44.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.261+0000 7f1606a00640 1 -- 172.21.15.63:0/1160613421 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f15f808f580 con 0x7f161006f9b0 2024-05-21T01:26:44.266 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.261+0000 7f160ea00640 1 --2- 172.21.15.63:0/1160613421 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f15ec06f430 0x7f15ec0718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:44.267 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.261+0000 7f160ea00640 1 --2- 172.21.15.63:0/1160613421 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f15ec06f430 0x7f15ec0718f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f16000af000 tx=0x7f1600008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:44.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.265+0000 7f1606a00640 1 -- 172.21.15.63:0/1160613421 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f16101f9160 con 0x7f161006f9b0 2024-05-21T01:26:44.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.429+0000 7f1615800640 1 -- 172.21.15.63:0/1160613421 --> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f16100c9750 con 0x7f15ec06f430 2024-05-21T01:26:44.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.433+0000 7f1606a00640 1 -- 172.21.15.63:0/1160613421 <== mgr.4103 v2:172.21.15.131:6832/921953667 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f16100c9750 con 0x7f15ec06f430 2024-05-21T01:26:44.437 INFO:teuthology.orchestra.run.smithi063.stderr:instructed osd(s) 2 to deep-scrub 2024-05-21T01:26:44.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.433+0000 7f1615800640 1 -- 172.21.15.63:0/1160613421 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f15ec06f430 msgr2=0x7f15ec0718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:44.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.433+0000 7f1615800640 1 --2- 172.21.15.63:0/1160613421 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f15ec06f430 0x7f15ec0718f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f16000af000 tx=0x7f1600008040 comp rx=0 tx=0).stop 2024-05-21T01:26:44.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.433+0000 7f1615800640 1 -- 172.21.15.63:0/1160613421 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f161006f9b0 msgr2=0x7f1610157580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:44.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.433+0000 7f1615800640 1 --2- 172.21.15.63:0/1160613421 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f161006f9b0 0x7f1610157580 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f15f800e960 tx=0x7f15f800ee20 comp rx=0 tx=0).stop 2024-05-21T01:26:44.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.433+0000 7f1615800640 1 -- 172.21.15.63:0/1160613421 shutdown_connections 2024-05-21T01:26:44.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.433+0000 7f1615800640 1 --2- 172.21.15.63:0/1160613421 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f15ec06f430 0x7f15ec0718f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:44.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.433+0000 7f1615800640 1 --2- 172.21.15.63:0/1160613421 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f161015ce40 0x7f1610157ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:44.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.433+0000 7f1615800640 1 --2- 172.21.15.63:0/1160613421 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f161006f9b0 0x7f1610157580 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:44.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.433+0000 7f1615800640 1 --2- 172.21.15.63:0/1160613421 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f161006f5d0 0x7f16101f84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:44.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.433+0000 7f1615800640 1 -- 172.21.15.63:0/1160613421 >> 172.21.15.63:0/1160613421 conn(0x7f1610068460 msgr2=0x7f161015bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:26:44.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.433+0000 7f1615800640 1 -- 172.21.15.63:0/1160613421 shutdown_connections 2024-05-21T01:26:44.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.433+0000 7f1615800640 1 -- 172.21.15.63:0/1160613421 wait complete. 2024-05-21T01:26:44.459 INFO:tasks.ceph:Scrubbing osd.3 2024-05-21T01:26:44.459 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-05-21T01:26:44.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.601+0000 7f0493600640 1 Processor -- start 2024-05-21T01:26:44.605 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.601+0000 7f0493600640 1 -- start start 2024-05-21T01:26:44.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.601+0000 7f0493600640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f048c153f60 0x7f048c159a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:44.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.601+0000 7f0493600640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f048c0c9e10 0x7f048c073c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:44.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.601+0000 7f0493600640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f048c0cbc30 con 0x7f048c071d50 2024-05-21T01:26:44.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.601+0000 7f0493600640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f048c0cad50 con 0x7f048c153f60 2024-05-21T01:26:44.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.601+0000 7f0493600640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f048c0ca740 con 0x7f048c0c9e10 2024-05-21T01:26:44.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.601+0000 7f0483e00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f048c071d50 0x7f048c0734f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37550/0 (socket says 172.21.15.63:37550) 2024-05-21T01:26:44.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.601+0000 7f0483e00640 1 -- 172.21.15.63:0/2219743977 learned_addr learned my addr 172.21.15.63:0/2219743977 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-05-21T01:26:44.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.601+0000 7f0490c00640 1 --2- 172.21.15.63:0/2219743977 >> v2:172.21.15.131:3300/0 conn(0x7f048c153f60 0x7f048c159a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:44.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.601+0000 7f0491600640 1 --2- 172.21.15.63:0/2219743977 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f048c0c9e10 0x7f048c073c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:44.607 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.601+0000 7f048be00640 1 -- 172.21.15.63:0/2219743977 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1038512599 0 0) 0x7f048c0cbc30 con 0x7f048c071d50 2024-05-21T01:26:44.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.601+0000 7f048be00640 1 -- 172.21.15.63:0/2219743977 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0470003530 con 0x7f048c071d50 2024-05-21T01:26:44.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.601+0000 7f0490c00640 1 -- 172.21.15.63:0/2219743977 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f048c0c9e10 msgr2=0x7f048c073c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:26:44.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.601+0000 7f0490c00640 1 --2- 172.21.15.63:0/2219743977 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f048c0c9e10 0x7f048c073c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:44.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.601+0000 7f0490c00640 1 -- 172.21.15.63:0/2219743977 >> v1:172.21.15.63:6789/0 conn(0x7f048c071d50 legacy=0x7f048c0734f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:44.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.601+0000 7f048be00640 1 -- 172.21.15.63:0/2219743977 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2341034755 0 0) 0x7f0470003530 con 0x7f048c071d50 2024-05-21T01:26:44.608 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.601+0000 7f0490c00640 1 -- 172.21.15.63:0/2219743977 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f048c0cb670 con 0x7f048c153f60 2024-05-21T01:26:44.610 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.605+0000 7f0490c00640 1 --2- 172.21.15.63:0/2219743977 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f048c153f60 0x7f048c159a80 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f047c0097a0 tx=0x7f047c01c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a03732120e9660bc server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:44.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.605+0000 7f048be00640 1 -- 172.21.15.63:0/2219743977 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f047c0b0070 con 0x7f048c153f60 2024-05-21T01:26:44.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.605+0000 7f048be00640 1 -- 172.21.15.63:0/2219743977 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f047c0ab400 con 0x7f048c153f60 2024-05-21T01:26:44.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.605+0000 7f048be00640 1 -- 172.21.15.63:0/2219743977 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f047c0a4e60 con 0x7f048c153f60 2024-05-21T01:26:44.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.605+0000 7f0493600640 1 -- 172.21.15.63:0/2219743977 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f048c153f60 msgr2=0x7f048c159a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:44.611 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.605+0000 7f0493600640 1 --2- 172.21.15.63:0/2219743977 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f048c153f60 0x7f048c159a80 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f047c0097a0 tx=0x7f047c01c3a0 comp rx=0 tx=0).stop 2024-05-21T01:26:44.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.605+0000 7f0493600640 1 -- 172.21.15.63:0/2219743977 shutdown_connections 2024-05-21T01:26:44.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.605+0000 7f0493600640 1 --2- 172.21.15.63:0/2219743977 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f048c0c9e10 0x7f048c073c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:44.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.605+0000 7f0493600640 1 --2- 172.21.15.63:0/2219743977 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f048c153f60 0x7f048c159a80 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:44.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.605+0000 7f0493600640 1 -- 172.21.15.63:0/2219743977 >> 172.21.15.63:0/2219743977 conn(0x7f048c0cf410 msgr2=0x7f048c0cf820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:26:44.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.605+0000 7f0493600640 1 -- 172.21.15.63:0/2219743977 shutdown_connections 2024-05-21T01:26:44.612 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.605+0000 7f0493600640 1 -- 172.21.15.63:0/2219743977 wait complete. 2024-05-21T01:26:44.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.609+0000 7f0493600640 1 Processor -- start 2024-05-21T01:26:44.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.609+0000 7f0493600640 1 -- start start 2024-05-21T01:26:44.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.609+0000 7f0493600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f048c071d50 0x7f048c0ce350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:44.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.609+0000 7f0493600640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f048c0c9e10 0x7f048c1f80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:44.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.609+0000 7f0493600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f048c153f60 0x7f048c1f85f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:44.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.609+0000 7f0493600640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f048c0cb1e0 con 0x7f048c153f60 2024-05-21T01:26:44.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.609+0000 7f0493600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f048c074920 con 0x7f048c071d50 2024-05-21T01:26:44.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.609+0000 7f0493600640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f048c1441e0 con 0x7f048c0c9e10 2024-05-21T01:26:44.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.609+0000 7f0491600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f048c153f60 0x7f048c1f85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:44.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.609+0000 7f0491600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f048c153f60 0x7f048c1f85f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48180/0 (socket says 172.21.15.63:48180) 2024-05-21T01:26:44.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.609+0000 7f0491600640 1 -- 172.21.15.63:0/412291670 learned_addr learned my addr 172.21.15.63:0/412291670 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:26:44.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.609+0000 7f0490c00640 1 --2- 172.21.15.63:0/412291670 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f048c071d50 0x7f048c0ce350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:44.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.609+0000 7f0483e00640 1 --2- 172.21.15.63:0/412291670 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f048c0c9e10 0x7f048c1f80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:44.615 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.609+0000 7f0491600640 1 -- 172.21.15.63:0/412291670 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f048c0c9e10 msgr2=0x7f048c1f80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:44.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.609+0000 7f0491600640 1 --2- 172.21.15.63:0/412291670 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f048c0c9e10 0x7f048c1f80b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:44.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.609+0000 7f0491600640 1 -- 172.21.15.63:0/412291670 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f048c071d50 msgr2=0x7f048c0ce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:44.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.609+0000 7f0491600640 1 --2- 172.21.15.63:0/412291670 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f048c071d50 0x7f048c0ce350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:44.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.609+0000 7f0491600640 1 -- 172.21.15.63:0/412291670 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f048c14e040 con 0x7f048c153f60 2024-05-21T01:26:44.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.609+0000 7f0483e00640 1 --2- 172.21.15.63:0/412291670 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f048c0c9e10 0x7f048c1f80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T01:26:44.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.609+0000 7f0491600640 1 --2- 172.21.15.63:0/412291670 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f048c153f60 0x7f048c1f85f0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f048400efc0 tx=0x7f048400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:44.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.609+0000 7f0489600640 1 -- 172.21.15.63:0/412291670 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0484018020 con 0x7f048c153f60 2024-05-21T01:26:44.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.609+0000 7f0489600640 1 -- 172.21.15.63:0/412291670 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0484014480 con 0x7f048c153f60 2024-05-21T01:26:44.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.609+0000 7f0489600640 1 -- 172.21.15.63:0/412291670 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0484014870 con 0x7f048c153f60 2024-05-21T01:26:44.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.609+0000 7f0493600640 1 -- 172.21.15.63:0/412291670 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f048c0cd2b0 con 0x7f048c153f60 2024-05-21T01:26:44.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.609+0000 7f0493600640 1 -- 172.21.15.63:0/412291670 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f048c0cd870 con 0x7f048c153f60 2024-05-21T01:26:44.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.613+0000 7f0493600640 1 -- 172.21.15.63:0/412291670 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f048c06c1a0 con 0x7f048c153f60 2024-05-21T01:26:44.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.613+0000 7f0489600640 1 -- 172.21.15.63:0/412291670 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7f048401b020 con 0x7f048c153f60 2024-05-21T01:26:44.618 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.613+0000 7f0489600640 1 --2- 172.21.15.63:0/412291670 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f046806f400 0x7f04680718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:44.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.613+0000 7f0489600640 1 -- 172.21.15.63:0/412291670 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f0484090d30 con 0x7f048c153f60 2024-05-21T01:26:44.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.613+0000 7f0489600640 1 --2- 172.21.15.63:0/412291670 >> [v2:172.21.15.63:6824/521563809,v1:172.21.15.63:6825/521563809] conn(0x7f0468078bc0 0x7f046807b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:44.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.613+0000 7f0489600640 1 -- 172.21.15.63:0/412291670 --> [v2:172.21.15.63:6824/521563809,v1:172.21.15.63:6825/521563809] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f046807b710 con 0x7f0468078bc0 2024-05-21T01:26:44.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.613+0000 7f0489600640 1 -- 172.21.15.63:0/412291670 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f04840911c0 con 0x7f048c153f60 2024-05-21T01:26:44.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.613+0000 7f0490c00640 1 --2- 172.21.15.63:0/412291670 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f046806f400 0x7f04680718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:44.619 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.613+0000 7f0483e00640 1 --2- 172.21.15.63:0/412291670 >> [v2:172.21.15.63:6824/521563809,v1:172.21.15.63:6825/521563809] conn(0x7f0468078bc0 0x7f046807b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:44.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.613+0000 7f0483e00640 1 --2- 172.21.15.63:0/412291670 >> [v2:172.21.15.63:6824/521563809,v1:172.21.15.63:6825/521563809] conn(0x7f0468078bc0 0x7f046807b040 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:44.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.613+0000 7f0490c00640 1 --2- 172.21.15.63:0/412291670 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f046806f400 0x7f04680718c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f047c0ad000 tx=0x7f047c0a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:44.620 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.617+0000 7f0489600640 1 -- 172.21.15.63:0/412291670 <== osd.3 v2:172.21.15.63:6824/521563809 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f046807b710 con 0x7f0468078bc0 2024-05-21T01:26:44.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.629+0000 7f0493600640 1 -- 172.21.15.63:0/412291670 --> [v2:172.21.15.63:6824/521563809,v1:172.21.15.63:6825/521563809] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f048c074600 con 0x7f0468078bc0 2024-05-21T01:26:44.633 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.629+0000 7f0489600640 1 -- 172.21.15.63:0/412291670 <== osd.3 v2:172.21.15.63:6824/521563809 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f048c074600 con 0x7f0468078bc0 2024-05-21T01:26:44.634 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-05-21T01:26:44.634 INFO:teuthology.orchestra.run.smithi063.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-21T01:26:44.634 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-05-21T01:26:44.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.629+0000 7f0493600640 1 -- 172.21.15.63:0/412291670 >> [v2:172.21.15.63:6824/521563809,v1:172.21.15.63:6825/521563809] conn(0x7f0468078bc0 msgr2=0x7f046807b040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:44.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.629+0000 7f0493600640 1 --2- 172.21.15.63:0/412291670 >> [v2:172.21.15.63:6824/521563809,v1:172.21.15.63:6825/521563809] conn(0x7f0468078bc0 0x7f046807b040 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:44.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.629+0000 7f0493600640 1 -- 172.21.15.63:0/412291670 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f046806f400 msgr2=0x7f04680718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:44.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.629+0000 7f0493600640 1 --2- 172.21.15.63:0/412291670 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f046806f400 0x7f04680718c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f047c0ad000 tx=0x7f047c0a6000 comp rx=0 tx=0).stop 2024-05-21T01:26:44.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.629+0000 7f0493600640 1 -- 172.21.15.63:0/412291670 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f048c153f60 msgr2=0x7f048c1f85f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:44.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.629+0000 7f0493600640 1 --2- 172.21.15.63:0/412291670 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f048c153f60 0x7f048c1f85f0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f048400efc0 tx=0x7f048400c490 comp rx=0 tx=0).stop 2024-05-21T01:26:44.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.629+0000 7f0491600640 1 -- 172.21.15.63:0/412291670 reap_dead start 2024-05-21T01:26:44.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.629+0000 7f0493600640 1 -- 172.21.15.63:0/412291670 shutdown_connections 2024-05-21T01:26:44.635 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.629+0000 7f0493600640 1 -- 172.21.15.63:0/412291670 >> 172.21.15.63:0/412291670 conn(0x7f048c0cf410 msgr2=0x7f048c0739d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:26:44.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.629+0000 7f0493600640 1 -- 172.21.15.63:0/412291670 shutdown_connections 2024-05-21T01:26:44.636 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.629+0000 7f0493600640 1 -- 172.21.15.63:0/412291670 wait complete. 2024-05-21T01:26:44.653 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-05-21T01:26:44.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.793+0000 7fe13d000640 1 Processor -- start 2024-05-21T01:26:44.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.793+0000 7fe13d000640 1 -- start start 2024-05-21T01:26:44.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.793+0000 7fe13d000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe138073cf0 0x7fe13806d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:44.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.793+0000 7fe13d000640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe138072920 con 0x7fe138155d00 2024-05-21T01:26:44.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.793+0000 7fe13d000640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe13815be60 con 0x7fe1380731b0 2024-05-21T01:26:44.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.793+0000 7fe13d000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fe13815cd30 con 0x7fe138073cf0 2024-05-21T01:26:44.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.793+0000 7fe135e00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fe138155d00 0x7fe13815c620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37556/0 (socket says 172.21.15.63:37556) 2024-05-21T01:26:44.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.793+0000 7fe135e00640 1 -- 172.21.15.63:0/632350431 learned_addr learned my addr 172.21.15.63:0/632350431 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-05-21T01:26:44.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.793+0000 7fe12fe00640 1 --2- 172.21.15.63:0/632350431 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe138073cf0 0x7fe13806d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:44.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.793+0000 7fe135400640 1 -- 172.21.15.63:0/632350431 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4131434584 0 0) 0x7fe138072920 con 0x7fe138155d00 2024-05-21T01:26:44.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.793+0000 7fe135400640 1 -- 172.21.15.63:0/632350431 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe11c003530 con 0x7fe138155d00 2024-05-21T01:26:44.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.793+0000 7fe135400640 1 -- 172.21.15.63:0/632350431 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1563286725 0 0) 0x7fe13815be60 con 0x7fe1380731b0 2024-05-21T01:26:44.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.793+0000 7fe135400640 1 -- 172.21.15.63:0/632350431 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe138072920 con 0x7fe1380731b0 2024-05-21T01:26:44.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.793+0000 7fe135400640 1 -- 172.21.15.63:0/632350431 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2141296193 0 0) 0x7fe11c003530 con 0x7fe138155d00 2024-05-21T01:26:44.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.793+0000 7fe135400640 1 -- 172.21.15.63:0/632350431 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe138073cf0 msgr2=0x7fe13806d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:26:44.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.793+0000 7fe135400640 1 --2- 172.21.15.63:0/632350431 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe138073cf0 0x7fe13806d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:44.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.793+0000 7fe135400640 1 -- 172.21.15.63:0/632350431 >> v1:172.21.15.131:6789/0 conn(0x7fe1380731b0 legacy=0x7fe1381666d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:44.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.793+0000 7fe135400640 1 -- 172.21.15.63:0/632350431 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe138074310 con 0x7fe138155d00 2024-05-21T01:26:44.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.793+0000 7fe135400640 1 -- 172.21.15.63:0/632350431 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 466403955 0 0) 0x7fe128001700 con 0x7fe138155d00 2024-05-21T01:26:44.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.793+0000 7fe135400640 1 -- 172.21.15.63:0/632350431 >> v1:172.21.15.63:6789/0 conn(0x7fe138155d00 legacy=0x7fe13815c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:44.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.793+0000 7fe135400640 1 --2- 172.21.15.63:0/632350431 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe138073cf0 0x7fe11c003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:44.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.793+0000 7fe135400640 1 --2- 172.21.15.63:0/632350431 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe11c0041d0 0x7fe11c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:44.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.793+0000 7fe135400640 1 --2- 172.21.15.63:0/632350431 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe11c004d50 0x7fe11c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:44.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.793+0000 7fe135400640 1 -- 172.21.15.63:0/632350431 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe13815cd30 con 0x7fe11c004d50 2024-05-21T01:26:44.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.793+0000 7fe135400640 1 -- 172.21.15.63:0/632350431 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fe11c00bb90 con 0x7fe11c0041d0 2024-05-21T01:26:44.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.793+0000 7fe135400640 1 -- 172.21.15.63:0/632350431 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fe11c00bd90 con 0x7fe138073cf0 2024-05-21T01:26:44.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.793+0000 7fe136800640 1 --2- 172.21.15.63:0/632350431 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe11c004d50 0x7fe11c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:44.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.797+0000 7fe12fe00640 1 --2- 172.21.15.63:0/632350431 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe11c0041d0 0x7fe11c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:44.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.797+0000 7fe135e00640 1 --2- 172.21.15.63:0/632350431 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe138073cf0 0x7fe11c003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:44.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.797+0000 7fe136800640 1 -- 172.21.15.63:0/632350431 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe138073cf0 msgr2=0x7fe11c003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:26:44.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.797+0000 7fe136800640 1 --2- 172.21.15.63:0/632350431 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe138073cf0 0x7fe11c003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:44.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.797+0000 7fe136800640 1 -- 172.21.15.63:0/632350431 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe11c0041d0 msgr2=0x7fe11c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:26:44.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.797+0000 7fe136800640 1 --2- 172.21.15.63:0/632350431 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe11c0041d0 0x7fe11c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:44.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.797+0000 7fe136800640 1 -- 172.21.15.63:0/632350431 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe11c003530 con 0x7fe11c004d50 2024-05-21T01:26:44.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.797+0000 7fe136800640 1 --2- 172.21.15.63:0/632350431 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe11c004d50 0x7fe11c0051d0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fe1300020b0 tx=0x7fe13001c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4cb119c2cb9b853 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:44.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.797+0000 7fe135400640 1 -- 172.21.15.63:0/632350431 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe130001c50 con 0x7fe11c004d50 2024-05-21T01:26:44.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.797+0000 7fe135400640 1 -- 172.21.15.63:0/632350431 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe130006d60 con 0x7fe11c004d50 2024-05-21T01:26:44.803 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.797+0000 7fe135400640 1 -- 172.21.15.63:0/632350431 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe130003bc0 con 0x7fe11c004d50 2024-05-21T01:26:44.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.797+0000 7fe13d000640 1 -- 172.21.15.63:0/632350431 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe11c004d50 msgr2=0x7fe11c0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:44.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.797+0000 7fe13d000640 1 --2- 172.21.15.63:0/632350431 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe11c004d50 0x7fe11c0051d0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fe1300020b0 tx=0x7fe13001c920 comp rx=0 tx=0).stop 2024-05-21T01:26:44.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.797+0000 7fe136800640 1 -- 172.21.15.63:0/632350431 reap_dead start 2024-05-21T01:26:44.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.801+0000 7fe13d000640 1 -- 172.21.15.63:0/632350431 shutdown_connections 2024-05-21T01:26:44.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.801+0000 7fe13d000640 1 -- 172.21.15.63:0/632350431 >> 172.21.15.63:0/632350431 conn(0x7fe1380cae00 msgr2=0x7fe1380cb210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:26:44.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.801+0000 7fe13d000640 1 -- 172.21.15.63:0/632350431 shutdown_connections 2024-05-21T01:26:44.804 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.801+0000 7fe13d000640 1 -- 172.21.15.63:0/632350431 wait complete. 2024-05-21T01:26:44.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.801+0000 7fe13d000640 1 Processor -- start 2024-05-21T01:26:44.805 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.801+0000 7fe13d000640 1 -- start start 2024-05-21T01:26:44.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.801+0000 7fe13d000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1380ca240 0x7fe138158280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:44.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.801+0000 7fe13d000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe13814f1b0 0x7fe1381587c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:44.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.801+0000 7fe13d000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe1380ca620 0x7fe13814f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:44.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.801+0000 7fe13d000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe1380748d0 con 0x7fe1380ca240 2024-05-21T01:26:44.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.801+0000 7fe13d000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fe13815c100 con 0x7fe1380ca620 2024-05-21T01:26:44.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.801+0000 7fe13d000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fe1380725e0 con 0x7fe13814f1b0 2024-05-21T01:26:44.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.801+0000 7fe135e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1380ca240 0x7fe138158280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:44.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.801+0000 7fe135e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1380ca240 0x7fe138158280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48196/0 (socket says 172.21.15.63:48196) 2024-05-21T01:26:44.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.801+0000 7fe135e00640 1 -- 172.21.15.63:0/4021361047 learned_addr learned my addr 172.21.15.63:0/4021361047 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:26:44.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.801+0000 7fe136800640 1 --2- 172.21.15.63:0/4021361047 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe1380ca620 0x7fe13814f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:44.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.801+0000 7fe12fe00640 1 --2- 172.21.15.63:0/4021361047 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe13814f1b0 0x7fe1381587c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:44.808 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.801+0000 7fe135e00640 1 -- 172.21.15.63:0/4021361047 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe13814f1b0 msgr2=0x7fe1381587c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:44.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.801+0000 7fe135e00640 1 --2- 172.21.15.63:0/4021361047 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe13814f1b0 0x7fe1381587c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:44.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.801+0000 7fe135e00640 1 -- 172.21.15.63:0/4021361047 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe1380ca620 msgr2=0x7fe13814f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:44.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.801+0000 7fe135e00640 1 --2- 172.21.15.63:0/4021361047 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe1380ca620 0x7fe13814f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:44.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.801+0000 7fe135e00640 1 -- 172.21.15.63:0/4021361047 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1381f1aa0 con 0x7fe1380ca240 2024-05-21T01:26:44.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.801+0000 7fe136800640 1 --2- 172.21.15.63:0/4021361047 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe1380ca620 0x7fe13814f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T01:26:44.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.801+0000 7fe135e00640 1 --2- 172.21.15.63:0/4021361047 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1380ca240 0x7fe138158280 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fe128007340 tx=0x7fe128004f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:44.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.801+0000 7fe12e000640 1 -- 172.21.15.63:0/4021361047 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe12800f9c0 con 0x7fe1380ca240 2024-05-21T01:26:44.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.801+0000 7fe12e000640 1 -- 172.21.15.63:0/4021361047 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe128018070 con 0x7fe1380ca240 2024-05-21T01:26:44.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.801+0000 7fe13d000640 1 -- 172.21.15.63:0/4021361047 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1381596a0 con 0x7fe1380ca240 2024-05-21T01:26:44.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.801+0000 7fe12e000640 1 -- 172.21.15.63:0/4021361047 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe12800fda0 con 0x7fe1380ca240 2024-05-21T01:26:44.809 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.805+0000 7fe13d000640 1 -- 172.21.15.63:0/4021361047 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1381f1ff0 con 0x7fe1380ca240 2024-05-21T01:26:44.810 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.805+0000 7fe13d000640 1 -- 172.21.15.63:0/4021361047 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1381f25e0 con 0x7fe1380ca240 2024-05-21T01:26:44.810 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.805+0000 7fe12e000640 1 -- 172.21.15.63:0/4021361047 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7fe12801d460 con 0x7fe1380ca240 2024-05-21T01:26:44.810 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.805+0000 7fe12e000640 1 --2- 172.21.15.63:0/4021361047 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fe11406f400 0x7fe1140718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:44.810 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.805+0000 7fe12e000640 1 -- 172.21.15.63:0/4021361047 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7fe12808f700 con 0x7fe1380ca240 2024-05-21T01:26:44.811 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.805+0000 7fe12fe00640 1 --2- 172.21.15.63:0/4021361047 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fe11406f400 0x7fe1140718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:44.812 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.809+0000 7fe12fe00640 1 --2- 172.21.15.63:0/4021361047 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fe11406f400 0x7fe1140718c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe1380cdc70 tx=0x7fe120008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:44.814 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.809+0000 7fe12e000640 1 -- 172.21.15.63:0/4021361047 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fe1381596a0 con 0x7fe1380ca240 2024-05-21T01:26:44.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.973+0000 7fe13d000640 1 -- 172.21.15.63:0/4021361047 --> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7fe138072f90 con 0x7fe11406f400 2024-05-21T01:26:44.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.977+0000 7fe12e000640 1 -- 172.21.15.63:0/4021361047 <== mgr.4103 v2:172.21.15.131:6832/921953667 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fe138072f90 con 0x7fe11406f400 2024-05-21T01:26:44.981 INFO:teuthology.orchestra.run.smithi063.stderr:instructed osd(s) 3 to deep-scrub 2024-05-21T01:26:44.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.977+0000 7fe13d000640 1 -- 172.21.15.63:0/4021361047 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fe11406f400 msgr2=0x7fe1140718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:44.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.977+0000 7fe13d000640 1 --2- 172.21.15.63:0/4021361047 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fe11406f400 0x7fe1140718c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe1380cdc70 tx=0x7fe120008040 comp rx=0 tx=0).stop 2024-05-21T01:26:44.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.977+0000 7fe13d000640 1 -- 172.21.15.63:0/4021361047 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1380ca240 msgr2=0x7fe138158280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:44.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.977+0000 7fe13d000640 1 --2- 172.21.15.63:0/4021361047 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1380ca240 0x7fe138158280 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fe128007340 tx=0x7fe128004f90 comp rx=0 tx=0).stop 2024-05-21T01:26:44.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.977+0000 7fe13d000640 1 -- 172.21.15.63:0/4021361047 shutdown_connections 2024-05-21T01:26:44.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.977+0000 7fe13d000640 1 --2- 172.21.15.63:0/4021361047 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fe11406f400 0x7fe1140718c0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:44.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.977+0000 7fe13d000640 1 --2- 172.21.15.63:0/4021361047 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe1380ca620 0x7fe13814f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:44.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.977+0000 7fe13d000640 1 --2- 172.21.15.63:0/4021361047 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe13814f1b0 0x7fe1381587c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:44.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.977+0000 7fe13d000640 1 --2- 172.21.15.63:0/4021361047 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe1380ca240 0x7fe138158280 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:44.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.977+0000 7fe13d000640 1 -- 172.21.15.63:0/4021361047 >> 172.21.15.63:0/4021361047 conn(0x7fe1380cae00 msgr2=0x7fe13815b080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:26:44.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.977+0000 7fe13d000640 1 -- 172.21.15.63:0/4021361047 shutdown_connections 2024-05-21T01:26:44.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:44.977+0000 7fe13d000640 1 -- 172.21.15.63:0/4021361047 wait complete. 2024-05-21T01:26:45.003 INFO:tasks.ceph:Scrubbing osd.4 2024-05-21T01:26:45.003 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-05-21T01:26:45.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.145+0000 7f2184c00640 1 Processor -- start 2024-05-21T01:26:45.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.145+0000 7f2184c00640 1 -- start start 2024-05-21T01:26:45.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.145+0000 7f2184c00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2180152cb0 0x7f21800cb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:45.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.145+0000 7f2184c00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f2180153090 0x7f21800cb730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:45.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.145+0000 7f2184c00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2180159b20 con 0x7f2180071ab0 2024-05-21T01:26:45.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.145+0000 7f2184c00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f2180071590 con 0x7f2180153090 2024-05-21T01:26:45.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.145+0000 7f2184c00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f2180159610 con 0x7f2180152cb0 2024-05-21T01:26:45.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.145+0000 7f217e800640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f2180071ab0 0x7f21800ccff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37572/0 (socket says 172.21.15.63:37572) 2024-05-21T01:26:45.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.145+0000 7f217e800640 1 -- 172.21.15.63:0/3048336323 learned_addr learned my addr 172.21.15.63:0/3048336323 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-05-21T01:26:45.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.145+0000 7f2177e00640 1 --2- 172.21.15.63:0/3048336323 >> v2:172.21.15.131:3300/0 conn(0x7f2180153090 0x7f21800cb730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:45.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.145+0000 7f217de00640 1 --2- 172.21.15.63:0/3048336323 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2180152cb0 0x7f21800cb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:45.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.145+0000 7f217d400640 1 -- 172.21.15.63:0/3048336323 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1376261906 0 0) 0x7f2180159b20 con 0x7f2180071ab0 2024-05-21T01:26:45.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.145+0000 7f217d400640 1 -- 172.21.15.63:0/3048336323 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2164003530 con 0x7f2180071ab0 2024-05-21T01:26:45.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.145+0000 7f2177e00640 1 -- 172.21.15.63:0/3048336323 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2180152cb0 msgr2=0x7f21800cb1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:26:45.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.145+0000 7f2177e00640 1 --2- 172.21.15.63:0/3048336323 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2180152cb0 0x7f21800cb1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:45.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.145+0000 7f2177e00640 1 -- 172.21.15.63:0/3048336323 >> v1:172.21.15.63:6789/0 conn(0x7f2180071ab0 legacy=0x7f21800ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:45.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.145+0000 7f217d400640 1 -- 172.21.15.63:0/3048336323 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1025729041 0 0) 0x7f2164003530 con 0x7f2180071ab0 2024-05-21T01:26:45.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.145+0000 7f2177e00640 1 -- 172.21.15.63:0/3048336323 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2180072150 con 0x7f2180153090 2024-05-21T01:26:45.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.145+0000 7f217de00640 1 --2- 172.21.15.63:0/3048336323 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2180152cb0 0x7f21800cb1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-21T01:26:45.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.149+0000 7f2177e00640 1 --2- 172.21.15.63:0/3048336323 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2180153090 0x7f21800cb730 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f21680097c0 tx=0x7f216801eb50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2d0680c757fd16f server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:45.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.149+0000 7f217d400640 1 -- 172.21.15.63:0/3048336323 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21680b5070 con 0x7f2180153090 2024-05-21T01:26:45.154 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.149+0000 7f217d400640 1 -- 172.21.15.63:0/3048336323 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21680a85d0 con 0x7f2180153090 2024-05-21T01:26:45.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.149+0000 7f217d400640 1 -- 172.21.15.63:0/3048336323 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2178001a80 con 0x7f2180153090 2024-05-21T01:26:45.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.149+0000 7f2184c00640 1 -- 172.21.15.63:0/3048336323 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2180153090 msgr2=0x7f21800cb730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:45.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.149+0000 7f2184c00640 1 --2- 172.21.15.63:0/3048336323 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2180153090 0x7f21800cb730 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f21680097c0 tx=0x7f216801eb50 comp rx=0 tx=0).stop 2024-05-21T01:26:45.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.149+0000 7f2184c00640 1 -- 172.21.15.63:0/3048336323 shutdown_connections 2024-05-21T01:26:45.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.149+0000 7f2184c00640 1 --2- 172.21.15.63:0/3048336323 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2180153090 0x7f21800cb730 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:45.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.149+0000 7f2184c00640 1 --2- 172.21.15.63:0/3048336323 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2180152cb0 0x7f21800cb1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:45.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.149+0000 7f2184c00640 1 -- 172.21.15.63:0/3048336323 >> 172.21.15.63:0/3048336323 conn(0x7f218006efc0 msgr2=0x7f218006f3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:26:45.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.149+0000 7f2184c00640 1 -- 172.21.15.63:0/3048336323 shutdown_connections 2024-05-21T01:26:45.156 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.149+0000 7f2184c00640 1 -- 172.21.15.63:0/3048336323 wait complete. 2024-05-21T01:26:45.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.153+0000 7f2184c00640 1 Processor -- start 2024-05-21T01:26:45.157 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.153+0000 7f2184c00640 1 -- start start 2024-05-21T01:26:45.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.153+0000 7f2184c00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2180071ab0 0x7f218015c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:45.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.153+0000 7f2184c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2180152cb0 0x7f218014abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:45.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.153+0000 7f2184c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2180153a10 0x7f21801f0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:45.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.153+0000 7f2184c00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f21800cc510 con 0x7f2180152cb0 2024-05-21T01:26:45.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.153+0000 7f2184c00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f21800cc880 con 0x7f2180153a10 2024-05-21T01:26:45.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.153+0000 7f2184c00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f2180072520 con 0x7f2180071ab0 2024-05-21T01:26:45.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.153+0000 7f2177e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2180152cb0 0x7f218014abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:45.158 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.153+0000 7f2177e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2180152cb0 0x7f218014abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48202/0 (socket says 172.21.15.63:48202) 2024-05-21T01:26:45.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.153+0000 7f2177e00640 1 -- 172.21.15.63:0/3123290124 learned_addr learned my addr 172.21.15.63:0/3123290124 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:26:45.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.153+0000 7f217e800640 1 --2- 172.21.15.63:0/3123290124 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2180153a10 0x7f21801f0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:45.159 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.153+0000 7f217de00640 1 --2- 172.21.15.63:0/3123290124 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2180071ab0 0x7f218015c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:45.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.153+0000 7f2177e00640 1 -- 172.21.15.63:0/3123290124 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2180071ab0 msgr2=0x7f218015c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:45.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.153+0000 7f2177e00640 1 --2- 172.21.15.63:0/3123290124 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2180071ab0 0x7f218015c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:45.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.153+0000 7f2177e00640 1 -- 172.21.15.63:0/3123290124 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2180153a10 msgr2=0x7f21801f0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:45.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.153+0000 7f2177e00640 1 --2- 172.21.15.63:0/3123290124 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2180153a10 0x7f21801f0ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:45.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.153+0000 7f2177e00640 1 -- 172.21.15.63:0/3123290124 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2180153fe0 con 0x7f2180152cb0 2024-05-21T01:26:45.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.153+0000 7f2177e00640 1 --2- 172.21.15.63:0/3123290124 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2180152cb0 0x7f218014abd0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f21680b3040 tx=0x7f216801b950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:45.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.153+0000 7f2176000640 1 -- 172.21.15.63:0/3123290124 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21680bf070 con 0x7f2180152cb0 2024-05-21T01:26:45.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.153+0000 7f2176000640 1 -- 172.21.15.63:0/3123290124 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21680a8980 con 0x7f2180152cb0 2024-05-21T01:26:45.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.153+0000 7f2184c00640 1 -- 172.21.15.63:0/3123290124 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21801542c0 con 0x7f2180152cb0 2024-05-21T01:26:45.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.153+0000 7f2176000640 1 -- 172.21.15.63:0/3123290124 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21680b5040 con 0x7f2180152cb0 2024-05-21T01:26:45.160 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.153+0000 7f2184c00640 1 -- 172.21.15.63:0/3123290124 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21801f04a0 con 0x7f2180152cb0 2024-05-21T01:26:45.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.157+0000 7f2184c00640 1 -- 172.21.15.63:0/3123290124 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f21800c4ab0 con 0x7f2180152cb0 2024-05-21T01:26:45.161 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.157+0000 7f2176000640 1 -- 172.21.15.63:0/3123290124 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7f21680c2070 con 0x7f2180152cb0 2024-05-21T01:26:45.162 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.157+0000 7f2176000640 1 --2- 172.21.15.63:0/3123290124 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f215c06f400 0x7f215c0718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:45.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.157+0000 7f2176000640 1 -- 172.21.15.63:0/3123290124 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f216812bcc0 con 0x7f2180152cb0 2024-05-21T01:26:45.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.157+0000 7f2176000640 1 --2- 172.21.15.63:0/3123290124 >> [v2:172.21.15.131:6800/2660673588,v1:172.21.15.131:6801/2660673588] conn(0x7f215c078bb0 0x7f215c07b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:45.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.157+0000 7f2176000640 1 -- 172.21.15.63:0/3123290124 --> [v2:172.21.15.131:6800/2660673588,v1:172.21.15.131:6801/2660673588] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f21680bcec0 con 0x7f215c078bb0 2024-05-21T01:26:45.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.157+0000 7f2176000640 1 -- 172.21.15.63:0/3123290124 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f216812e2e0 con 0x7f2180152cb0 2024-05-21T01:26:45.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.157+0000 7f217de00640 1 --2- 172.21.15.63:0/3123290124 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f215c06f400 0x7f215c0718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:45.163 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.157+0000 7f217e800640 1 --2- 172.21.15.63:0/3123290124 >> [v2:172.21.15.131:6800/2660673588,v1:172.21.15.131:6801/2660673588] conn(0x7f215c078bb0 0x7f215c07b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:45.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.161+0000 7f217de00640 1 --2- 172.21.15.63:0/3123290124 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f215c06f400 0x7f215c0718c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2170009580 tx=0x7f2170009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:45.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.161+0000 7f217e800640 1 --2- 172.21.15.63:0/3123290124 >> [v2:172.21.15.131:6800/2660673588,v1:172.21.15.131:6801/2660673588] conn(0x7f215c078bb0 0x7f215c07b030 crc :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:45.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.161+0000 7f2176000640 1 -- 172.21.15.63:0/3123290124 <== osd.4 v2:172.21.15.131:6800/2660673588 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f21680bcec0 con 0x7f215c078bb0 2024-05-21T01:26:45.179 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.173+0000 7f2184c00640 1 -- 172.21.15.63:0/3123290124 --> [v2:172.21.15.131:6800/2660673588,v1:172.21.15.131:6801/2660673588] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f2180073dd0 con 0x7f215c078bb0 2024-05-21T01:26:45.180 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.177+0000 7f2176000640 1 -- 172.21.15.63:0/3123290124 <== osd.4 v2:172.21.15.131:6800/2660673588 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f2180073dd0 con 0x7f215c078bb0 2024-05-21T01:26:45.180 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-05-21T01:26:45.180 INFO:teuthology.orchestra.run.smithi063.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-21T01:26:45.180 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-05-21T01:26:45.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.177+0000 7f2184c00640 1 -- 172.21.15.63:0/3123290124 >> [v2:172.21.15.131:6800/2660673588,v1:172.21.15.131:6801/2660673588] conn(0x7f215c078bb0 msgr2=0x7f215c07b030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:45.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.177+0000 7f2184c00640 1 --2- 172.21.15.63:0/3123290124 >> [v2:172.21.15.131:6800/2660673588,v1:172.21.15.131:6801/2660673588] conn(0x7f215c078bb0 0x7f215c07b030 crc :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:45.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.177+0000 7f2184c00640 1 -- 172.21.15.63:0/3123290124 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f215c06f400 msgr2=0x7f215c0718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:45.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.177+0000 7f2184c00640 1 --2- 172.21.15.63:0/3123290124 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f215c06f400 0x7f215c0718c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2170009580 tx=0x7f2170009190 comp rx=0 tx=0).stop 2024-05-21T01:26:45.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.177+0000 7f2184c00640 1 -- 172.21.15.63:0/3123290124 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2180152cb0 msgr2=0x7f218014abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:45.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.177+0000 7f2184c00640 1 --2- 172.21.15.63:0/3123290124 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2180152cb0 0x7f218014abd0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f21680b3040 tx=0x7f216801b950 comp rx=0 tx=0).stop 2024-05-21T01:26:45.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.177+0000 7f217e800640 1 -- 172.21.15.63:0/3123290124 reap_dead start 2024-05-21T01:26:45.181 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.177+0000 7f2184c00640 1 -- 172.21.15.63:0/3123290124 shutdown_connections 2024-05-21T01:26:45.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.177+0000 7f2184c00640 1 -- 172.21.15.63:0/3123290124 >> 172.21.15.63:0/3123290124 conn(0x7f218006efc0 msgr2=0x7f218006c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:26:45.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.177+0000 7f2184c00640 1 -- 172.21.15.63:0/3123290124 shutdown_connections 2024-05-21T01:26:45.182 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.177+0000 7f2184c00640 1 -- 172.21.15.63:0/3123290124 wait complete. 2024-05-21T01:26:45.198 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-05-21T01:26:45.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.337+0000 7f50d0000640 1 Processor -- start 2024-05-21T01:26:45.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.337+0000 7f50d0000640 1 -- start start 2024-05-21T01:26:45.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.337+0000 7f50d0000640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f50c806f5d0 0x7f50c80c8a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:45.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.337+0000 7f50d0000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f50c815ce40 0x7f50c8072d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:45.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.337+0000 7f50d0000640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50c8072550 con 0x7f50c806f9b0 2024-05-21T01:26:45.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.337+0000 7f50d0000640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f50c8159100 con 0x7f50c806f5d0 2024-05-21T01:26:45.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.337+0000 7f50d0000640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f50c81593e0 con 0x7f50c815ce40 2024-05-21T01:26:45.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.337+0000 7f50cd600640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f50c806f5d0 0x7f50c80c8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:45.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.337+0000 7f50cd600640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f50c806f5d0 0x7f50c80c8a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48210/0 (socket says 172.21.15.63:48210) 2024-05-21T01:26:45.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.337+0000 7f50cd600640 1 -- 172.21.15.63:0/614193101 learned_addr learned my addr 172.21.15.63:0/614193101 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:26:45.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.337+0000 7f50ce000640 1 --2- 172.21.15.63:0/614193101 >> v2:172.21.15.131:3300/0 conn(0x7f50c815ce40 0x7f50c8072d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:45.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.337+0000 7f50cd600640 1 -- 172.21.15.63:0/614193101 >> v2:172.21.15.131:3300/0 conn(0x7f50c815ce40 msgr2=0x7f50c8072d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:26:45.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.337+0000 7f50cd600640 1 --2- 172.21.15.63:0/614193101 >> v2:172.21.15.131:3300/0 conn(0x7f50c815ce40 0x7f50c8072d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:45.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.337+0000 7f50cd600640 1 -- 172.21.15.63:0/614193101 >> v1:172.21.15.131:6789/0 conn(0x7f50c806f9b0 legacy=0x7f50c8152a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:26:45.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.337+0000 7f50cd600640 1 -- 172.21.15.63:0/614193101 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50c81596c0 con 0x7f50c806f5d0 2024-05-21T01:26:45.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.341+0000 7f50cd600640 1 --2- 172.21.15.63:0/614193101 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50c806f5d0 0x7f50c80c8a20 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f50c80cadd0 tx=0x7f50bc01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfcf4106a0328507 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:45.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.341+0000 7f50c7e00640 1 -- 172.21.15.63:0/614193101 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50bc0b1070 con 0x7f50c806f5d0 2024-05-21T01:26:45.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.341+0000 7f50c7e00640 1 -- 172.21.15.63:0/614193101 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50bc0ac630 con 0x7f50c806f5d0 2024-05-21T01:26:45.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.341+0000 7f50c7e00640 1 -- 172.21.15.63:0/614193101 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50bc0a8050 con 0x7f50c806f5d0 2024-05-21T01:26:45.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.341+0000 7f50d0000640 1 -- 172.21.15.63:0/614193101 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50c806f5d0 msgr2=0x7f50c80c8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:45.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.341+0000 7f50d0000640 1 --2- 172.21.15.63:0/614193101 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50c806f5d0 0x7f50c80c8a20 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f50c80cadd0 tx=0x7f50bc01c520 comp rx=0 tx=0).stop 2024-05-21T01:26:45.348 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.341+0000 7f50d0000640 1 -- 172.21.15.63:0/614193101 shutdown_connections 2024-05-21T01:26:45.348 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.341+0000 7f50d0000640 1 --2- 172.21.15.63:0/614193101 >> v2:172.21.15.131:3300/0 conn(0x7f50c815ce40 0x7f50c8072d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:45.348 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.341+0000 7f50d0000640 1 --2- 172.21.15.63:0/614193101 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50c806f5d0 0x7f50c80c8a20 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:45.348 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.341+0000 7f50d0000640 1 -- 172.21.15.63:0/614193101 >> 172.21.15.63:0/614193101 conn(0x7f50c8068460 msgr2=0x7f50c8068870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:26:45.348 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.341+0000 7f50d0000640 1 -- 172.21.15.63:0/614193101 shutdown_connections 2024-05-21T01:26:45.348 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.341+0000 7f50d0000640 1 -- 172.21.15.63:0/614193101 wait complete. 2024-05-21T01:26:45.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.345+0000 7f50d0000640 1 Processor -- start 2024-05-21T01:26:45.349 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.345+0000 7f50d0000640 1 -- start start 2024-05-21T01:26:45.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.345+0000 7f50d0000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f50c806f5d0 0x7f50c8162120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:45.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.345+0000 7f50d0000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50c806f9b0 0x7f50c8146750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:45.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.345+0000 7f50d0000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f50c815ce40 0x7f50c814f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:45.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.345+0000 7f50d0000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f50c8153150 con 0x7f50c806f9b0 2024-05-21T01:26:45.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.345+0000 7f50d0000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f50c8073670 con 0x7f50c806f5d0 2024-05-21T01:26:45.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.345+0000 7f50d0000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f50c81532d0 con 0x7f50c815ce40 2024-05-21T01:26:45.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.345+0000 7f50ccc00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50c806f9b0 0x7f50c8146750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:45.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.345+0000 7f50ccc00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50c806f9b0 0x7f50c8146750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48222/0 (socket says 172.21.15.63:48222) 2024-05-21T01:26:45.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.345+0000 7f50ccc00640 1 -- 172.21.15.63:0/2855532756 learned_addr learned my addr 172.21.15.63:0/2855532756 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:26:45.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.345+0000 7f50cd600640 1 --2- 172.21.15.63:0/2855532756 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f50c806f5d0 0x7f50c8162120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:45.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.345+0000 7f50ce000640 1 --2- 172.21.15.63:0/2855532756 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f50c815ce40 0x7f50c814f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:45.351 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.345+0000 7f50ccc00640 1 -- 172.21.15.63:0/2855532756 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f50c815ce40 msgr2=0x7f50c814f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:45.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.345+0000 7f50ccc00640 1 --2- 172.21.15.63:0/2855532756 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f50c815ce40 0x7f50c814f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:45.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.345+0000 7f50ccc00640 1 -- 172.21.15.63:0/2855532756 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f50c806f5d0 msgr2=0x7f50c8162120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:45.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.345+0000 7f50ccc00640 1 --2- 172.21.15.63:0/2855532756 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f50c806f5d0 0x7f50c8162120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:45.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.345+0000 7f50ccc00640 1 -- 172.21.15.63:0/2855532756 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50c8162660 con 0x7f50c806f9b0 2024-05-21T01:26:45.352 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.345+0000 7f50ccc00640 1 --2- 172.21.15.63:0/2855532756 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50c806f9b0 0x7f50c8146750 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f50b400b410 tx=0x7f50b400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:45.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.345+0000 7f50c5600640 1 -- 172.21.15.63:0/2855532756 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50b4015030 con 0x7f50c806f9b0 2024-05-21T01:26:45.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.345+0000 7f50c5600640 1 -- 172.21.15.63:0/2855532756 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50b4004020 con 0x7f50c806f9b0 2024-05-21T01:26:45.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.345+0000 7f50d0000640 1 -- 172.21.15.63:0/2855532756 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50c81f5f10 con 0x7f50c806f9b0 2024-05-21T01:26:45.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.345+0000 7f50c5600640 1 -- 172.21.15.63:0/2855532756 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50b4004410 con 0x7f50c806f9b0 2024-05-21T01:26:45.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.345+0000 7f50d0000640 1 -- 172.21.15.63:0/2855532756 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50c8163080 con 0x7f50c806f9b0 2024-05-21T01:26:45.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.349+0000 7f50d0000640 1 -- 172.21.15.63:0/2855532756 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50c80507f0 con 0x7f50c806f9b0 2024-05-21T01:26:45.353 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.349+0000 7f50c5600640 1 -- 172.21.15.63:0/2855532756 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7f50b4018070 con 0x7f50c806f9b0 2024-05-21T01:26:45.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.349+0000 7f50c5600640 1 --2- 172.21.15.63:0/2855532756 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f50a806f430 0x7f50a80718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:45.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.349+0000 7f50c5600640 1 -- 172.21.15.63:0/2855532756 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f50b408f130 con 0x7f50c806f9b0 2024-05-21T01:26:45.354 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.349+0000 7f50cd600640 1 --2- 172.21.15.63:0/2855532756 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f50a806f430 0x7f50a80718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:45.355 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.349+0000 7f50cd600640 1 --2- 172.21.15.63:0/2855532756 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f50a806f430 0x7f50a80718f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f50bc0ae000 tx=0x7f50bc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:45.358 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.353+0000 7f50c5600640 1 -- 172.21.15.63:0/2855532756 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f50b405bca0 con 0x7f50c806f9b0 2024-05-21T01:26:45.524 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.517+0000 7f50d0000640 1 -- 172.21.15.63:0/2855532756 --> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f50c8162b50 con 0x7f50a806f430 2024-05-21T01:26:45.525 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.521+0000 7f50c5600640 1 -- 172.21.15.63:0/2855532756 <== mgr.4103 v2:172.21.15.131:6832/921953667 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f50c8162b50 con 0x7f50a806f430 2024-05-21T01:26:45.525 INFO:teuthology.orchestra.run.smithi063.stderr:instructed osd(s) 4 to deep-scrub 2024-05-21T01:26:45.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.521+0000 7f50d0000640 1 -- 172.21.15.63:0/2855532756 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f50a806f430 msgr2=0x7f50a80718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:45.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.521+0000 7f50d0000640 1 --2- 172.21.15.63:0/2855532756 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f50a806f430 0x7f50a80718f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f50bc0ae000 tx=0x7f50bc009040 comp rx=0 tx=0).stop 2024-05-21T01:26:45.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.521+0000 7f50d0000640 1 -- 172.21.15.63:0/2855532756 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50c806f9b0 msgr2=0x7f50c8146750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:45.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.521+0000 7f50d0000640 1 --2- 172.21.15.63:0/2855532756 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50c806f9b0 0x7f50c8146750 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f50b400b410 tx=0x7f50b400b8d0 comp rx=0 tx=0).stop 2024-05-21T01:26:45.529 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.521+0000 7f50d0000640 1 -- 172.21.15.63:0/2855532756 shutdown_connections 2024-05-21T01:26:45.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.521+0000 7f50d0000640 1 --2- 172.21.15.63:0/2855532756 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f50a806f430 0x7f50a80718f0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:45.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.521+0000 7f50d0000640 1 --2- 172.21.15.63:0/2855532756 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f50c815ce40 0x7f50c814f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:45.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.521+0000 7f50d0000640 1 --2- 172.21.15.63:0/2855532756 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f50c806f9b0 0x7f50c8146750 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:45.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.521+0000 7f50d0000640 1 --2- 172.21.15.63:0/2855532756 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f50c806f5d0 0x7f50c8162120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:45.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.521+0000 7f50d0000640 1 -- 172.21.15.63:0/2855532756 >> 172.21.15.63:0/2855532756 conn(0x7f50c8068460 msgr2=0x7f50c815c160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:26:45.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.521+0000 7f50d0000640 1 -- 172.21.15.63:0/2855532756 shutdown_connections 2024-05-21T01:26:45.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.521+0000 7f50d0000640 1 -- 172.21.15.63:0/2855532756 wait complete. 2024-05-21T01:26:45.546 INFO:tasks.ceph:Scrubbing osd.5 2024-05-21T01:26:45.546 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-05-21T01:26:45.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.689+0000 7f6905000640 1 Processor -- start 2024-05-21T01:26:45.692 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.689+0000 7f6905000640 1 -- start start 2024-05-21T01:26:45.693 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.689+0000 7f6905000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f69000c8700 0x7f690015d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:45.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.689+0000 7f6905000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6900070a20 0x7f6900070e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:45.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.689+0000 7f6905000640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f690015d8d0 con 0x7f69001540c0 2024-05-21T01:26:45.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.689+0000 7f6905000640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f690015d6b0 con 0x7f69000c8700 2024-05-21T01:26:45.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.689+0000 7f6905000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f690015dbb0 con 0x7f6900070a20 2024-05-21T01:26:45.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.689+0000 7f68fd400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f69000c8700 0x7f690015d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:45.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.689+0000 7f68fde00640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f69001540c0 0x7f6900073e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.63:46186/0 (socket says 172.21.15.63:46186) 2024-05-21T01:26:45.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.689+0000 7f68fde00640 1 -- 172.21.15.63:0/2132376432 learned_addr learned my addr 172.21.15.63:0/2132376432 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-05-21T01:26:45.694 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.689+0000 7f68fe800640 1 --2- 172.21.15.63:0/2132376432 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6900070a20 0x7f6900070e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:45.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.689+0000 7f68fd400640 1 -- 172.21.15.63:0/2132376432 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6900070a20 msgr2=0x7f6900070e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:26:45.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.689+0000 7f68fd400640 1 --2- 172.21.15.63:0/2132376432 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6900070a20 0x7f6900070e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:45.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.689+0000 7f68fd400640 1 -- 172.21.15.63:0/2132376432 >> v1:172.21.15.131:6789/0 conn(0x7f69001540c0 legacy=0x7f6900073e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:45.695 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.689+0000 7f68fd400640 1 -- 172.21.15.63:0/2132376432 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f690015de90 con 0x7f69000c8700 2024-05-21T01:26:45.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.693+0000 7f68fd400640 1 --2- 172.21.15.63:0/2132376432 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f69000c8700 0x7f690015d170 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f68ec0097c0 tx=0x7f68ec01c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=49290605242fae server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:45.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.693+0000 7f68fca00640 1 -- 172.21.15.63:0/2132376432 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68ec0b0070 con 0x7f69000c8700 2024-05-21T01:26:45.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.693+0000 7f68fca00640 1 -- 172.21.15.63:0/2132376432 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68ec0ab600 con 0x7f69000c8700 2024-05-21T01:26:45.697 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.693+0000 7f68fca00640 1 -- 172.21.15.63:0/2132376432 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68ec0ab9d0 con 0x7f69000c8700 2024-05-21T01:26:45.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.693+0000 7f6905000640 1 -- 172.21.15.63:0/2132376432 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f69000c8700 msgr2=0x7f690015d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:45.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.693+0000 7f6905000640 1 --2- 172.21.15.63:0/2132376432 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f69000c8700 0x7f690015d170 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f68ec0097c0 tx=0x7f68ec01c410 comp rx=0 tx=0).stop 2024-05-21T01:26:45.698 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.693+0000 7f6905000640 1 -- 172.21.15.63:0/2132376432 shutdown_connections 2024-05-21T01:26:45.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.693+0000 7f6905000640 1 --2- 172.21.15.63:0/2132376432 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6900070a20 0x7f6900070e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:45.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.693+0000 7f6905000640 1 --2- 172.21.15.63:0/2132376432 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f69000c8700 0x7f690015d170 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:45.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.693+0000 7f6905000640 1 -- 172.21.15.63:0/2132376432 >> 172.21.15.63:0/2132376432 conn(0x7f69000cf480 msgr2=0x7f69000cf890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:26:45.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.693+0000 7f6905000640 1 -- 172.21.15.63:0/2132376432 shutdown_connections 2024-05-21T01:26:45.699 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.693+0000 7f6905000640 1 -- 172.21.15.63:0/2132376432 wait complete. 2024-05-21T01:26:45.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.693+0000 7f6905000640 1 Processor -- start 2024-05-21T01:26:45.700 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.697+0000 7f6905000640 1 -- start start 2024-05-21T01:26:45.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.697+0000 7f6905000640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6900070a20 0x7f6900152290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:45.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.697+0000 7f6905000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f69000c8700 0x7f69001453a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:45.702 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.697+0000 7f6905000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f69001540c0 0x7f6900142ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:45.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.697+0000 7f6905000640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f6900166ea0 con 0x7f69000c8700 2024-05-21T01:26:45.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.697+0000 7f6905000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f6900166d20 con 0x7f69001540c0 2024-05-21T01:26:45.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.697+0000 7f6905000640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f6900167020 con 0x7f6900070a20 2024-05-21T01:26:45.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.697+0000 7f68fd400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f69000c8700 0x7f69001453a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:45.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.697+0000 7f68fd400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f69000c8700 0x7f69001453a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48224/0 (socket says 172.21.15.63:48224) 2024-05-21T01:26:45.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.697+0000 7f68fd400640 1 -- 172.21.15.63:0/2929126577 learned_addr learned my addr 172.21.15.63:0/2929126577 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:26:45.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.697+0000 7f68fde00640 1 --2- 172.21.15.63:0/2929126577 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6900070a20 0x7f6900152290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:45.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.697+0000 7f68fe800640 1 --2- 172.21.15.63:0/2929126577 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f69001540c0 0x7f6900142ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:45.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.697+0000 7f68fd400640 1 -- 172.21.15.63:0/2929126577 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6900070a20 msgr2=0x7f6900152290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:45.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.697+0000 7f68fd400640 1 --2- 172.21.15.63:0/2929126577 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6900070a20 0x7f6900152290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:45.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.697+0000 7f68fd400640 1 -- 172.21.15.63:0/2929126577 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f69001540c0 msgr2=0x7f6900142ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:45.703 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.697+0000 7f68fd400640 1 --2- 172.21.15.63:0/2929126577 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f69001540c0 0x7f6900142ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:45.704 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.697+0000 7f68fd400640 1 -- 172.21.15.63:0/2929126577 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6900146990 con 0x7f69000c8700 2024-05-21T01:26:45.704 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.697+0000 7f68fe800640 1 --2- 172.21.15.63:0/2929126577 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f69001540c0 0x7f6900142ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T01:26:45.704 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.697+0000 7f68fd400640 1 --2- 172.21.15.63:0/2929126577 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f69000c8700 0x7f69001453a0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f68ec01a040 tx=0x7f68ec0191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:45.704 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.697+0000 7f68f6000640 1 -- 172.21.15.63:0/2929126577 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68ec0b0040 con 0x7f69000c8700 2024-05-21T01:26:45.704 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.697+0000 7f68f6000640 1 -- 172.21.15.63:0/2929126577 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68ec0ab400 con 0x7f69000c8700 2024-05-21T01:26:45.704 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.697+0000 7f6905000640 1 -- 172.21.15.63:0/2929126577 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f690006f120 con 0x7f69000c8700 2024-05-21T01:26:45.704 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.697+0000 7f68f6000640 1 -- 172.21.15.63:0/2929126577 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68ec006e20 con 0x7f69000c8700 2024-05-21T01:26:45.704 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.697+0000 7f6905000640 1 -- 172.21.15.63:0/2929126577 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6900075f00 con 0x7f69000c8700 2024-05-21T01:26:45.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.697+0000 7f6905000640 1 -- 172.21.15.63:0/2929126577 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6900146740 con 0x7f69000c8700 2024-05-21T01:26:45.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.701+0000 7f68f6000640 1 -- 172.21.15.63:0/2929126577 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7f68ec0bb020 con 0x7f69000c8700 2024-05-21T01:26:45.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.701+0000 7f68f6000640 1 --2- 172.21.15.63:0/2929126577 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f68e006f400 0x7f68e00718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:45.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.701+0000 7f68f6000640 1 -- 172.21.15.63:0/2929126577 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f68ec128c00 con 0x7f69000c8700 2024-05-21T01:26:45.705 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.701+0000 7f68f6000640 1 --2- 172.21.15.63:0/2929126577 >> [v2:172.21.15.131:6809/2508702891,v1:172.21.15.131:6811/2508702891] conn(0x7f68e0078bc0 0x7f68e007b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:45.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.701+0000 7f68f6000640 1 -- 172.21.15.63:0/2929126577 --> [v2:172.21.15.131:6809/2508702891,v1:172.21.15.131:6811/2508702891] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f68ec00af30 con 0x7f68e0078bc0 2024-05-21T01:26:45.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.701+0000 7f68f6000640 1 -- 172.21.15.63:0/2929126577 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f68ec12f050 con 0x7f69000c8700 2024-05-21T01:26:45.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.701+0000 7f68fde00640 1 --2- 172.21.15.63:0/2929126577 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f68e006f400 0x7f68e00718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:45.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.701+0000 7f68fe800640 1 --2- 172.21.15.63:0/2929126577 >> [v2:172.21.15.131:6809/2508702891,v1:172.21.15.131:6811/2508702891] conn(0x7f68e0078bc0 0x7f68e007b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:45.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.701+0000 7f68fde00640 1 --2- 172.21.15.63:0/2929126577 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f68e006f400 0x7f68e00718c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f68f0000f70 tx=0x7f68f0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:45.706 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.701+0000 7f68fe800640 1 --2- 172.21.15.63:0/2929126577 >> [v2:172.21.15.131:6809/2508702891,v1:172.21.15.131:6811/2508702891] conn(0x7f68e0078bc0 0x7f68e007b040 crc :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:45.708 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.705+0000 7f68f6000640 1 -- 172.21.15.63:0/2929126577 <== osd.5 v2:172.21.15.131:6809/2508702891 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f68ec00af30 con 0x7f68e0078bc0 2024-05-21T01:26:45.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.717+0000 7f6905000640 1 -- 172.21.15.63:0/2929126577 --> [v2:172.21.15.131:6809/2508702891,v1:172.21.15.131:6811/2508702891] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f69000cccf0 con 0x7f68e0078bc0 2024-05-21T01:26:45.722 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.717+0000 7f68f6000640 1 -- 172.21.15.63:0/2929126577 <== osd.5 v2:172.21.15.131:6809/2508702891 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f69000cccf0 con 0x7f68e0078bc0 2024-05-21T01:26:45.723 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-05-21T01:26:45.723 INFO:teuthology.orchestra.run.smithi063.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-21T01:26:45.723 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-05-21T01:26:45.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.717+0000 7f6905000640 1 -- 172.21.15.63:0/2929126577 >> [v2:172.21.15.131:6809/2508702891,v1:172.21.15.131:6811/2508702891] conn(0x7f68e0078bc0 msgr2=0x7f68e007b040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:45.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.717+0000 7f6905000640 1 --2- 172.21.15.63:0/2929126577 >> [v2:172.21.15.131:6809/2508702891,v1:172.21.15.131:6811/2508702891] conn(0x7f68e0078bc0 0x7f68e007b040 crc :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:45.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.717+0000 7f6905000640 1 -- 172.21.15.63:0/2929126577 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f68e006f400 msgr2=0x7f68e00718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:45.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.717+0000 7f6905000640 1 --2- 172.21.15.63:0/2929126577 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f68e006f400 0x7f68e00718c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f68f0000f70 tx=0x7f68f0009040 comp rx=0 tx=0).stop 2024-05-21T01:26:45.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.717+0000 7f6905000640 1 -- 172.21.15.63:0/2929126577 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f69000c8700 msgr2=0x7f69001453a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:45.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.717+0000 7f6905000640 1 --2- 172.21.15.63:0/2929126577 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f69000c8700 0x7f69001453a0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f68ec01a040 tx=0x7f68ec0191b0 comp rx=0 tx=0).stop 2024-05-21T01:26:45.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.717+0000 7f68fe800640 1 -- 172.21.15.63:0/2929126577 reap_dead start 2024-05-21T01:26:45.724 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.717+0000 7f6905000640 1 -- 172.21.15.63:0/2929126577 shutdown_connections 2024-05-21T01:26:45.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.717+0000 7f6905000640 1 -- 172.21.15.63:0/2929126577 >> 172.21.15.63:0/2929126577 conn(0x7f69000cf480 msgr2=0x7f6900153380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:26:45.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.717+0000 7f6905000640 1 -- 172.21.15.63:0/2929126577 shutdown_connections 2024-05-21T01:26:45.725 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.717+0000 7f6905000640 1 -- 172.21.15.63:0/2929126577 wait complete. 2024-05-21T01:26:45.742 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-05-21T01:26:45.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.881+0000 7fd70d200640 1 Processor -- start 2024-05-21T01:26:45.885 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.881+0000 7fd70d200640 1 -- start start 2024-05-21T01:26:45.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.881+0000 7fd70d200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd7080cfb70 0x7fd708153b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:45.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.881+0000 7fd70d200640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd7080ca810 0x7fd708154080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:45.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.881+0000 7fd70d200640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7080c8be0 con 0x7fd7080cf790 2024-05-21T01:26:45.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.881+0000 7fd70d200640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fd7080c8e80 con 0x7fd7080ca810 2024-05-21T01:26:45.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.881+0000 7fd70d200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fd7080c9160 con 0x7fd7080cfb70 2024-05-21T01:26:45.886 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.881+0000 7fd705e00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fd7080cf790 0x7fd7080c69a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37576/0 (socket says 172.21.15.63:37576) 2024-05-21T01:26:45.887 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.881+0000 7fd705e00640 1 -- 172.21.15.63:0/2437218978 learned_addr learned my addr 172.21.15.63:0/2437218978 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-05-21T01:26:45.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.881+0000 7fd6ffe00640 1 --2- 172.21.15.63:0/2437218978 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd7080cfb70 0x7fd708153b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:45.888 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.881+0000 7fd706800640 1 --2- 172.21.15.63:0/2437218978 >> v2:172.21.15.131:3300/0 conn(0x7fd7080ca810 0x7fd708154080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:45.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.881+0000 7fd705400640 1 -- 172.21.15.63:0/2437218978 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3152977084 0 0) 0x7fd7080c8be0 con 0x7fd7080cf790 2024-05-21T01:26:45.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.881+0000 7fd705400640 1 -- 172.21.15.63:0/2437218978 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd6ec003530 con 0x7fd7080cf790 2024-05-21T01:26:45.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.881+0000 7fd705400640 1 -- 172.21.15.63:0/2437218978 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1423208877 0 0) 0x7fd6ec003530 con 0x7fd7080cf790 2024-05-21T01:26:45.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.881+0000 7fd705400640 1 -- 172.21.15.63:0/2437218978 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd7080cfb70 msgr2=0x7fd708153b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:26:45.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.881+0000 7fd705400640 1 --2- 172.21.15.63:0/2437218978 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd7080cfb70 0x7fd708153b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:45.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.881+0000 7fd705400640 1 -- 172.21.15.63:0/2437218978 >> v2:172.21.15.131:3300/0 conn(0x7fd7080ca810 msgr2=0x7fd708154080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:26:45.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.881+0000 7fd705400640 1 --2- 172.21.15.63:0/2437218978 >> v2:172.21.15.131:3300/0 conn(0x7fd7080ca810 0x7fd708154080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:45.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.881+0000 7fd705400640 1 -- 172.21.15.63:0/2437218978 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7080c9440 con 0x7fd7080cf790 2024-05-21T01:26:45.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.881+0000 7fd705400640 1 -- 172.21.15.63:0/2437218978 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 466403955 0 0) 0x7fd6f8001700 con 0x7fd7080cf790 2024-05-21T01:26:45.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.881+0000 7fd705400640 1 -- 172.21.15.63:0/2437218978 >> v1:172.21.15.63:6789/0 conn(0x7fd7080cf790 legacy=0x7fd7080c69a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:45.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.881+0000 7fd705400640 1 --2- 172.21.15.63:0/2437218978 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6ec003a10 0x7fd6ec003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:45.889 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.881+0000 7fd705400640 1 --2- 172.21.15.63:0/2437218978 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd7080cfb70 0x7fd6ec004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:45.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.881+0000 7fd705400640 1 --2- 172.21.15.63:0/2437218978 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd6ec004d50 0x7fd6ec0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:45.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.881+0000 7fd705400640 1 -- 172.21.15.63:0/2437218978 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fd7080c8e80 con 0x7fd6ec004d50 2024-05-21T01:26:45.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.881+0000 7fd705400640 1 -- 172.21.15.63:0/2437218978 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd7080c9160 con 0x7fd6ec003a10 2024-05-21T01:26:45.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.881+0000 7fd705400640 1 -- 172.21.15.63:0/2437218978 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fd6ec00ba50 con 0x7fd7080cfb70 2024-05-21T01:26:45.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.881+0000 7fd706800640 1 --2- 172.21.15.63:0/2437218978 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd6ec004d50 0x7fd6ec0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:45.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.881+0000 7fd705e00640 1 --2- 172.21.15.63:0/2437218978 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6ec003a10 0x7fd6ec003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:45.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.881+0000 7fd6ffe00640 1 --2- 172.21.15.63:0/2437218978 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd7080cfb70 0x7fd6ec004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:45.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.881+0000 7fd706800640 1 -- 172.21.15.63:0/2437218978 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd7080cfb70 msgr2=0x7fd6ec004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:26:45.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.885+0000 7fd706800640 1 --2- 172.21.15.63:0/2437218978 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd7080cfb70 0x7fd6ec004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:45.890 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.885+0000 7fd706800640 1 -- 172.21.15.63:0/2437218978 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6ec003a10 msgr2=0x7fd6ec003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:26:45.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.885+0000 7fd706800640 1 --2- 172.21.15.63:0/2437218978 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6ec003a10 0x7fd6ec003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:45.891 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.885+0000 7fd706800640 1 -- 172.21.15.63:0/2437218978 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6ec003530 con 0x7fd6ec004d50 2024-05-21T01:26:45.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.885+0000 7fd706800640 1 --2- 172.21.15.63:0/2437218978 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd6ec004d50 0x7fd6ec0051d0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fd700009fc0 tx=0x7fd70001ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bee290409d51c6c8 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:45.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.885+0000 7fd705400640 1 -- 172.21.15.63:0/2437218978 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7000b2070 con 0x7fd6ec004d50 2024-05-21T01:26:45.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.885+0000 7fd705400640 1 -- 172.21.15.63:0/2437218978 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7000a5bc0 con 0x7fd6ec004d50 2024-05-21T01:26:45.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.885+0000 7fd705400640 1 -- 172.21.15.63:0/2437218978 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd700009c10 con 0x7fd6ec004d50 2024-05-21T01:26:45.892 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.885+0000 7fd70d200640 1 -- 172.21.15.63:0/2437218978 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd6ec004d50 msgr2=0x7fd6ec0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:45.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.885+0000 7fd70d200640 1 --2- 172.21.15.63:0/2437218978 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd6ec004d50 0x7fd6ec0051d0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fd700009fc0 tx=0x7fd70001ccc0 comp rx=0 tx=0).stop 2024-05-21T01:26:45.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.885+0000 7fd706800640 1 -- 172.21.15.63:0/2437218978 reap_dead start 2024-05-21T01:26:45.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.885+0000 7fd70d200640 1 -- 172.21.15.63:0/2437218978 shutdown_connections 2024-05-21T01:26:45.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.885+0000 7fd70d200640 1 -- 172.21.15.63:0/2437218978 >> 172.21.15.63:0/2437218978 conn(0x7fd7080735f0 msgr2=0x7fd708073a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:26:45.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.885+0000 7fd70d200640 1 -- 172.21.15.63:0/2437218978 shutdown_connections 2024-05-21T01:26:45.893 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.885+0000 7fd70d200640 1 -- 172.21.15.63:0/2437218978 wait complete. 2024-05-21T01:26:45.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.889+0000 7fd70d200640 1 Processor -- start 2024-05-21T01:26:45.895 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.889+0000 7fd70d200640 1 -- start start 2024-05-21T01:26:45.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.889+0000 7fd70d200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6ec004d50 0x7fd70814ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:45.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.889+0000 7fd70d200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd7081f2cb0 0x7fd7081569e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:45.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.889+0000 7fd70d200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd7081e0510 0x7fd70814de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:45.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.889+0000 7fd70d200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fd7080c70b0 con 0x7fd7081f2cb0 2024-05-21T01:26:45.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.889+0000 7fd70d200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd7080c74a0 con 0x7fd6ec004d50 2024-05-21T01:26:45.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.889+0000 7fd70d200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fd7080c7230 con 0x7fd7081e0510 2024-05-21T01:26:45.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.889+0000 7fd6ffe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd7081f2cb0 0x7fd7081569e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:45.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.889+0000 7fd6ffe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd7081f2cb0 0x7fd7081569e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48236/0 (socket says 172.21.15.63:48236) 2024-05-21T01:26:45.896 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.889+0000 7fd6ffe00640 1 -- 172.21.15.63:0/1712531821 learned_addr learned my addr 172.21.15.63:0/1712531821 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:26:45.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.889+0000 7fd706800640 1 --2- 172.21.15.63:0/1712531821 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd7081e0510 0x7fd70814de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:45.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.889+0000 7fd705e00640 1 --2- 172.21.15.63:0/1712531821 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6ec004d50 0x7fd70814ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:45.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.889+0000 7fd6ffe00640 1 -- 172.21.15.63:0/1712531821 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd7081e0510 msgr2=0x7fd70814de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:45.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.889+0000 7fd6ffe00640 1 --2- 172.21.15.63:0/1712531821 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd7081e0510 0x7fd70814de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:45.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.889+0000 7fd6ffe00640 1 -- 172.21.15.63:0/1712531821 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6ec004d50 msgr2=0x7fd70814ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:45.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.889+0000 7fd6ffe00640 1 --2- 172.21.15.63:0/1712531821 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6ec004d50 0x7fd70814ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:45.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.889+0000 7fd6ffe00640 1 -- 172.21.15.63:0/1712531821 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7081556a0 con 0x7fd7081f2cb0 2024-05-21T01:26:45.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.889+0000 7fd6ffe00640 1 --2- 172.21.15.63:0/1712531821 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd7081f2cb0 0x7fd7081569e0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fd6f0011590 tx=0x7fd6f0011a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:45.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.889+0000 7fd6fe000640 1 -- 172.21.15.63:0/1712531821 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f0004220 con 0x7fd7081f2cb0 2024-05-21T01:26:45.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.889+0000 7fd6fe000640 1 -- 172.21.15.63:0/1712531821 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6f00043c0 con 0x7fd7081f2cb0 2024-05-21T01:26:45.897 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.889+0000 7fd6fe000640 1 -- 172.21.15.63:0/1712531821 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f0015870 con 0x7fd7081f2cb0 2024-05-21T01:26:45.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.889+0000 7fd70d200640 1 -- 172.21.15.63:0/1712531821 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd708155940 con 0x7fd7081f2cb0 2024-05-21T01:26:45.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.889+0000 7fd70d200640 1 -- 172.21.15.63:0/1712531821 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd708155f00 con 0x7fd7081f2cb0 2024-05-21T01:26:45.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.893+0000 7fd70d200640 1 -- 172.21.15.63:0/1712531821 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7080507f0 con 0x7fd7081f2cb0 2024-05-21T01:26:45.898 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.893+0000 7fd6fe000640 1 -- 172.21.15.63:0/1712531821 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7fd6f0015a10 con 0x7fd7081f2cb0 2024-05-21T01:26:45.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.893+0000 7fd6fe000640 1 --2- 172.21.15.63:0/1712531821 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fd6e406f430 0x7fd6e40718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:45.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.893+0000 7fd6fe000640 1 -- 172.21.15.63:0/1712531821 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7fd6f008fc70 con 0x7fd7081f2cb0 2024-05-21T01:26:45.899 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.893+0000 7fd705e00640 1 --2- 172.21.15.63:0/1712531821 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fd6e406f430 0x7fd6e40718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:45.900 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.897+0000 7fd705e00640 1 --2- 172.21.15.63:0/1712531821 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fd6e406f430 0x7fd6e40718f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd6f8001ec0 tx=0x7fd6f8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:45.903 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:45.897+0000 7fd6fe000640 1 -- 172.21.15.63:0/1712531821 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fd6f0019030 con 0x7fd7081f2cb0 2024-05-21T01:26:46.068 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.061+0000 7fd70d200640 1 -- 172.21.15.63:0/1712531821 --> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7fd70806c160 con 0x7fd6e406f430 2024-05-21T01:26:46.069 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.065+0000 7fd6fe000640 1 -- 172.21.15.63:0/1712531821 <== mgr.4103 v2:172.21.15.131:6832/921953667 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fd70806c160 con 0x7fd6e406f430 2024-05-21T01:26:46.069 INFO:teuthology.orchestra.run.smithi063.stderr:instructed osd(s) 5 to deep-scrub 2024-05-21T01:26:46.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.065+0000 7fd70d200640 1 -- 172.21.15.63:0/1712531821 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fd6e406f430 msgr2=0x7fd6e40718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:46.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.065+0000 7fd70d200640 1 --2- 172.21.15.63:0/1712531821 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fd6e406f430 0x7fd6e40718f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd6f8001ec0 tx=0x7fd6f8009040 comp rx=0 tx=0).stop 2024-05-21T01:26:46.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.065+0000 7fd70d200640 1 -- 172.21.15.63:0/1712531821 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd7081f2cb0 msgr2=0x7fd7081569e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:46.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.065+0000 7fd70d200640 1 --2- 172.21.15.63:0/1712531821 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd7081f2cb0 0x7fd7081569e0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fd6f0011590 tx=0x7fd6f0011a50 comp rx=0 tx=0).stop 2024-05-21T01:26:46.071 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.065+0000 7fd70d200640 1 -- 172.21.15.63:0/1712531821 shutdown_connections 2024-05-21T01:26:46.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.065+0000 7fd70d200640 1 --2- 172.21.15.63:0/1712531821 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fd6e406f430 0x7fd6e40718f0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:46.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.065+0000 7fd70d200640 1 --2- 172.21.15.63:0/1712531821 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd7081e0510 0x7fd70814de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:46.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.065+0000 7fd70d200640 1 --2- 172.21.15.63:0/1712531821 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd7081f2cb0 0x7fd7081569e0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:46.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.065+0000 7fd70d200640 1 --2- 172.21.15.63:0/1712531821 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6ec004d50 0x7fd70814ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:46.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.065+0000 7fd70d200640 1 -- 172.21.15.63:0/1712531821 >> 172.21.15.63:0/1712531821 conn(0x7fd7080735f0 msgr2=0x7fd7080ce950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:26:46.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.065+0000 7fd70d200640 1 -- 172.21.15.63:0/1712531821 shutdown_connections 2024-05-21T01:26:46.072 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.065+0000 7fd70d200640 1 -- 172.21.15.63:0/1712531821 wait complete. 2024-05-21T01:26:46.091 INFO:tasks.ceph:Scrubbing osd.6 2024-05-21T01:26:46.091 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-05-21T01:26:46.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.233+0000 7f1acfe00640 1 Processor -- start 2024-05-21T01:26:46.237 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.233+0000 7f1acfe00640 1 -- start start 2024-05-21T01:26:46.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.233+0000 7f1acfe00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f1ad0153bb0 0x7f1ad00c82c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:46.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.233+0000 7f1acfe00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ad00c88b0 con 0x7f1ad0074170 2024-05-21T01:26:46.238 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.233+0000 7f1acfe00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ad00719c0 con 0x7f1ad00c7160 2024-05-21T01:26:46.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.233+0000 7f1acfe00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f1ad0072260 con 0x7f1ad0153bb0 2024-05-21T01:26:46.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.233+0000 7f1ac7e00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f1ad0074170 0x7f1ad01598f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37580/0 (socket says 172.21.15.63:37580) 2024-05-21T01:26:46.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.233+0000 7f1ac7e00640 1 -- 172.21.15.63:0/2344715420 learned_addr learned my addr 172.21.15.63:0/2344715420 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-05-21T01:26:46.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.233+0000 7f1acea00640 1 --2- 172.21.15.63:0/2344715420 >> v2:172.21.15.131:3300/0 conn(0x7f1ad0153bb0 0x7f1ad00c82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:46.239 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.233+0000 7f1ace000640 1 -- 172.21.15.63:0/2344715420 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 489204001 0 0) 0x7f1ad00c88b0 con 0x7f1ad0074170 2024-05-21T01:26:46.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.233+0000 7f1ace000640 1 -- 172.21.15.63:0/2344715420 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1ab4003530 con 0x7f1ad0074170 2024-05-21T01:26:46.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.233+0000 7f1acea00640 1 -- 172.21.15.63:0/2344715420 >> v1:172.21.15.131:6789/0 conn(0x7f1ad00c7160 legacy=0x7f1ad00cdb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:46.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.233+0000 7f1ace000640 1 -- 172.21.15.63:0/2344715420 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3155842264 0 0) 0x7f1ab4003530 con 0x7f1ad0074170 2024-05-21T01:26:46.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.233+0000 7f1acea00640 1 -- 172.21.15.63:0/2344715420 >> v1:172.21.15.63:6789/0 conn(0x7f1ad0074170 legacy=0x7f1ad01598f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:46.240 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.233+0000 7f1acea00640 1 -- 172.21.15.63:0/2344715420 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ad0071ca0 con 0x7f1ad0153bb0 2024-05-21T01:26:46.242 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.237+0000 7f1acea00640 1 --2- 172.21.15.63:0/2344715420 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1ad0153bb0 0x7f1ad00c82c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1ac00097c0 tx=0x7f1ac001ebb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=202467566b678520 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:46.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.237+0000 7f1ace000640 1 -- 172.21.15.63:0/2344715420 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ac00b5070 con 0x7f1ad0153bb0 2024-05-21T01:26:46.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.237+0000 7f1ace000640 1 -- 172.21.15.63:0/2344715420 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ac00a8630 con 0x7f1ad0153bb0 2024-05-21T01:26:46.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.237+0000 7f1ace000640 1 -- 172.21.15.63:0/2344715420 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ab8001700 con 0x7f1ad0153bb0 2024-05-21T01:26:46.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.237+0000 7f1acfe00640 1 -- 172.21.15.63:0/2344715420 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1ad0153bb0 msgr2=0x7f1ad00c82c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:46.243 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.237+0000 7f1acfe00640 1 --2- 172.21.15.63:0/2344715420 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1ad0153bb0 0x7f1ad00c82c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1ac00097c0 tx=0x7f1ac001ebb0 comp rx=0 tx=0).stop 2024-05-21T01:26:46.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.237+0000 7f1acfe00640 1 -- 172.21.15.63:0/2344715420 shutdown_connections 2024-05-21T01:26:46.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.237+0000 7f1acfe00640 1 --2- 172.21.15.63:0/2344715420 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1ad0153bb0 0x7f1ad00c82c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:46.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.237+0000 7f1acfe00640 1 -- 172.21.15.63:0/2344715420 >> 172.21.15.63:0/2344715420 conn(0x7f1ad006f730 msgr2=0x7f1ad006fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:26:46.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.237+0000 7f1acfe00640 1 -- 172.21.15.63:0/2344715420 shutdown_connections 2024-05-21T01:26:46.244 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.237+0000 7f1acfe00640 1 -- 172.21.15.63:0/2344715420 wait complete. 2024-05-21T01:26:46.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.241+0000 7f1acfe00640 1 Processor -- start 2024-05-21T01:26:46.245 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.241+0000 7f1acfe00640 1 -- start start 2024-05-21T01:26:46.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.241+0000 7f1acfe00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1ad0074170 0x7f1ad01e4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:46.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.241+0000 7f1acfe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ad00c7160 0x7f1ad0142c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:46.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.241+0000 7f1acfe00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1ad0153bb0 0x7f1ad01520d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:46.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.241+0000 7f1acfe00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f1ad0073c50 con 0x7f1ad00c7160 2024-05-21T01:26:46.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.241+0000 7f1acfe00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f1ad0073970 con 0x7f1ad0074170 2024-05-21T01:26:46.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.241+0000 7f1acfe00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f1ad0153f90 con 0x7f1ad0153bb0 2024-05-21T01:26:46.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.241+0000 7f1ac7e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ad00c7160 0x7f1ad0142c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:46.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.241+0000 7f1ac7e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ad00c7160 0x7f1ad0142c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48238/0 (socket says 172.21.15.63:48238) 2024-05-21T01:26:46.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.241+0000 7f1ac7e00640 1 -- 172.21.15.63:0/2256324189 learned_addr learned my addr 172.21.15.63:0/2256324189 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:26:46.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.241+0000 7f1acea00640 1 --2- 172.21.15.63:0/2256324189 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1ad0074170 0x7f1ad01e4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:46.247 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.241+0000 7f1acf400640 1 --2- 172.21.15.63:0/2256324189 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1ad0153bb0 0x7f1ad01520d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:46.248 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.241+0000 7f1ac7e00640 1 -- 172.21.15.63:0/2256324189 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1ad0153bb0 msgr2=0x7f1ad01520d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:46.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.241+0000 7f1ac7e00640 1 --2- 172.21.15.63:0/2256324189 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1ad0153bb0 0x7f1ad01520d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:46.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.241+0000 7f1ac7e00640 1 -- 172.21.15.63:0/2256324189 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1ad0074170 msgr2=0x7f1ad01e4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:46.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.241+0000 7f1ac7e00640 1 --2- 172.21.15.63:0/2256324189 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1ad0074170 0x7f1ad01e4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:46.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.241+0000 7f1ac7e00640 1 -- 172.21.15.63:0/2256324189 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ad014eff0 con 0x7f1ad00c7160 2024-05-21T01:26:46.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.241+0000 7f1acea00640 1 --2- 172.21.15.63:0/2256324189 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1ad0074170 0x7f1ad01e4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T01:26:46.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.241+0000 7f1ac7e00640 1 --2- 172.21.15.63:0/2256324189 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ad00c7160 0x7f1ad0142c80 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f1ab800c730 tx=0x7f1ab800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:46.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.241+0000 7f1ac6a00640 1 -- 172.21.15.63:0/2256324189 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ab8005ae0 con 0x7f1ad00c7160 2024-05-21T01:26:46.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.245+0000 7f1ac6a00640 1 -- 172.21.15.63:0/2256324189 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ab8005c80 con 0x7f1ad00c7160 2024-05-21T01:26:46.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.245+0000 7f1ac6a00640 1 -- 172.21.15.63:0/2256324189 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ab8007290 con 0x7f1ad00c7160 2024-05-21T01:26:46.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.245+0000 7f1acfe00640 1 -- 172.21.15.63:0/2256324189 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ad00c5d80 con 0x7f1ad00c7160 2024-05-21T01:26:46.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.245+0000 7f1acfe00640 1 -- 172.21.15.63:0/2256324189 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ad00c6020 con 0x7f1ad00c7160 2024-05-21T01:26:46.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.245+0000 7f1acfe00640 1 -- 172.21.15.63:0/2256324189 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1ad006c0c0 con 0x7f1ad00c7160 2024-05-21T01:26:46.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.245+0000 7f1ac6a00640 1 -- 172.21.15.63:0/2256324189 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7f1ab8007430 con 0x7f1ad00c7160 2024-05-21T01:26:46.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.245+0000 7f1ac6a00640 1 --2- 172.21.15.63:0/2256324189 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f1aac06f430 0x7f1aac0718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:46.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.245+0000 7f1ac6a00640 1 -- 172.21.15.63:0/2256324189 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f1ab808fdf0 con 0x7f1ad00c7160 2024-05-21T01:26:46.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.245+0000 7f1ac6a00640 1 --2- 172.21.15.63:0/2256324189 >> [v2:172.21.15.131:6808/614380392,v1:172.21.15.131:6810/614380392] conn(0x7f1aac078be0 0x7f1aac07b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:46.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.245+0000 7f1ac6a00640 1 -- 172.21.15.63:0/2256324189 --> [v2:172.21.15.131:6808/614380392,v1:172.21.15.131:6810/614380392] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1ab8006e50 con 0x7f1aac078be0 2024-05-21T01:26:46.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.245+0000 7f1ac6a00640 1 -- 172.21.15.63:0/2256324189 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f1ab80901a0 con 0x7f1ad00c7160 2024-05-21T01:26:46.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.245+0000 7f1acea00640 1 --2- 172.21.15.63:0/2256324189 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f1aac06f430 0x7f1aac0718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:46.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.249+0000 7f1acf400640 1 --2- 172.21.15.63:0/2256324189 >> [v2:172.21.15.131:6808/614380392,v1:172.21.15.131:6810/614380392] conn(0x7f1aac078be0 0x7f1aac07b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:46.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.249+0000 7f1acea00640 1 --2- 172.21.15.63:0/2256324189 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f1aac06f430 0x7f1aac0718f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1ac00b2000 tx=0x7f1ac0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:46.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.249+0000 7f1acf400640 1 --2- 172.21.15.63:0/2256324189 >> [v2:172.21.15.131:6808/614380392,v1:172.21.15.131:6810/614380392] conn(0x7f1aac078be0 0x7f1aac07b060 crc :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:46.254 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.249+0000 7f1ac6a00640 1 -- 172.21.15.63:0/2256324189 <== osd.6 v2:172.21.15.131:6808/614380392 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1ab8006e50 con 0x7f1aac078be0 2024-05-21T01:26:46.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.265+0000 7f1acfe00640 1 -- 172.21.15.63:0/2256324189 --> [v2:172.21.15.131:6808/614380392,v1:172.21.15.131:6810/614380392] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f1ad00c43f0 con 0x7f1aac078be0 2024-05-21T01:26:46.268 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.265+0000 7f1ac6a00640 1 -- 172.21.15.63:0/2256324189 <== osd.6 v2:172.21.15.131:6808/614380392 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f1ad00c43f0 con 0x7f1aac078be0 2024-05-21T01:26:46.269 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-05-21T01:26:46.269 INFO:teuthology.orchestra.run.smithi063.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-21T01:26:46.269 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-05-21T01:26:46.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.265+0000 7f1acfe00640 1 -- 172.21.15.63:0/2256324189 >> [v2:172.21.15.131:6808/614380392,v1:172.21.15.131:6810/614380392] conn(0x7f1aac078be0 msgr2=0x7f1aac07b060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:46.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.265+0000 7f1acfe00640 1 --2- 172.21.15.63:0/2256324189 >> [v2:172.21.15.131:6808/614380392,v1:172.21.15.131:6810/614380392] conn(0x7f1aac078be0 0x7f1aac07b060 crc :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:46.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.265+0000 7f1acfe00640 1 -- 172.21.15.63:0/2256324189 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f1aac06f430 msgr2=0x7f1aac0718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:46.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.265+0000 7f1acfe00640 1 --2- 172.21.15.63:0/2256324189 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f1aac06f430 0x7f1aac0718f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1ac00b2000 tx=0x7f1ac0008040 comp rx=0 tx=0).stop 2024-05-21T01:26:46.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.265+0000 7f1acfe00640 1 -- 172.21.15.63:0/2256324189 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ad00c7160 msgr2=0x7f1ad0142c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:46.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.265+0000 7f1acfe00640 1 --2- 172.21.15.63:0/2256324189 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ad00c7160 0x7f1ad0142c80 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f1ab800c730 tx=0x7f1ab800cbf0 comp rx=0 tx=0).stop 2024-05-21T01:26:46.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.265+0000 7f1acf400640 1 -- 172.21.15.63:0/2256324189 reap_dead start 2024-05-21T01:26:46.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.265+0000 7f1acfe00640 1 -- 172.21.15.63:0/2256324189 shutdown_connections 2024-05-21T01:26:46.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.265+0000 7f1acfe00640 1 -- 172.21.15.63:0/2256324189 >> 172.21.15.63:0/2256324189 conn(0x7f1ad006f730 msgr2=0x7f1ad00cc7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:26:46.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.265+0000 7f1acfe00640 1 -- 172.21.15.63:0/2256324189 shutdown_connections 2024-05-21T01:26:46.270 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.265+0000 7f1acfe00640 1 -- 172.21.15.63:0/2256324189 wait complete. 2024-05-21T01:26:46.287 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-05-21T01:26:46.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.425+0000 7f69b4c00640 1 Processor -- start 2024-05-21T01:26:46.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.425+0000 7f69b4c00640 1 -- start start 2024-05-21T01:26:46.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.425+0000 7f69b4c00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f69b006f080 0x7f69b00cf530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:46.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.425+0000 7f69b4c00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f69b0156450 0x7f69b00cfa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:46.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.425+0000 7f69b4c00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69b0071d50 con 0x7f69b0156070 2024-05-21T01:26:46.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.425+0000 7f69b4c00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f69b015bf20 con 0x7f69b006f080 2024-05-21T01:26:46.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.425+0000 7f69b4c00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f69b015c1e0 con 0x7f69b0156450 2024-05-21T01:26:46.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.425+0000 7f69ad400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f69b006f080 0x7f69b00cf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:46.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.425+0000 7f69ae800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f69b0156450 0x7f69b00cfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:46.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.425+0000 7f69ae800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f69b0156450 0x7f69b00cfa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.63:37646/0 (socket says 172.21.15.63:37646) 2024-05-21T01:26:46.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.425+0000 7f69ae800640 1 -- 172.21.15.63:0/258896130 learned_addr learned my addr 172.21.15.63:0/258896130 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:26:46.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.425+0000 7f69ade00640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f69b0156070 0x7f69b0071640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.63:46208/0 (socket says 172.21.15.63:46208) 2024-05-21T01:26:46.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.429+0000 7f69ad400640 1 -- 172.21.15.63:0/258896130 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f69b0156450 msgr2=0x7f69b00cfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:26:46.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.429+0000 7f69ad400640 1 --2- 172.21.15.63:0/258896130 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f69b0156450 0x7f69b00cfa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:46.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.429+0000 7f69ad400640 1 -- 172.21.15.63:0/258896130 >> v1:172.21.15.131:6789/0 conn(0x7f69b0156070 legacy=0x7f69b0071640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:46.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.429+0000 7f69ad400640 1 -- 172.21.15.63:0/258896130 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69b015c4c0 con 0x7f69b006f080 2024-05-21T01:26:46.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.429+0000 7f69ad400640 1 --2- 172.21.15.63:0/258896130 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f69b006f080 0x7f69b00cf530 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f699c0097c0 tx=0x7f699c01c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36d274be0a93b474 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:46.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.429+0000 7f69aca00640 1 -- 172.21.15.63:0/258896130 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f699c0b0070 con 0x7f69b006f080 2024-05-21T01:26:46.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.429+0000 7f69aca00640 1 -- 172.21.15.63:0/258896130 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f699c0ab600 con 0x7f69b006f080 2024-05-21T01:26:46.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.429+0000 7f69aca00640 1 -- 172.21.15.63:0/258896130 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f699c0ab9d0 con 0x7f69b006f080 2024-05-21T01:26:46.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.429+0000 7f69b4c00640 1 -- 172.21.15.63:0/258896130 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f69b006f080 msgr2=0x7f69b00cf530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:46.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.429+0000 7f69b4c00640 1 --2- 172.21.15.63:0/258896130 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f69b006f080 0x7f69b00cf530 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f699c0097c0 tx=0x7f699c01c4a0 comp rx=0 tx=0).stop 2024-05-21T01:26:46.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.433+0000 7f69b4c00640 1 -- 172.21.15.63:0/258896130 shutdown_connections 2024-05-21T01:26:46.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.433+0000 7f69b4c00640 1 --2- 172.21.15.63:0/258896130 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f69b0156450 0x7f69b00cfa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:46.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.433+0000 7f69b4c00640 1 --2- 172.21.15.63:0/258896130 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f69b006f080 0x7f69b00cf530 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:46.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.433+0000 7f69b4c00640 1 -- 172.21.15.63:0/258896130 >> 172.21.15.63:0/258896130 conn(0x7f69b00735f0 msgr2=0x7f69b0073a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:26:46.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.433+0000 7f69b4c00640 1 -- 172.21.15.63:0/258896130 shutdown_connections 2024-05-21T01:26:46.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.433+0000 7f69b4c00640 1 -- 172.21.15.63:0/258896130 wait complete. 2024-05-21T01:26:46.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.433+0000 7f69b4c00640 1 Processor -- start 2024-05-21T01:26:46.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.433+0000 7f69b4c00640 1 -- start start 2024-05-21T01:26:46.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.433+0000 7f69b4c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f69b006f080 0x7f69b01f5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:46.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.433+0000 7f69b4c00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f69b0156070 0x7f69b01f8f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:46.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.433+0000 7f69b4c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f69b0156450 0x7f69b015fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:46.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.433+0000 7f69b4c00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f69b006e140 con 0x7f69b006f080 2024-05-21T01:26:46.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.433+0000 7f69b4c00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f69b006dfc0 con 0x7f69b0156450 2024-05-21T01:26:46.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.433+0000 7f69b4c00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f69b01688b0 con 0x7f69b0156070 2024-05-21T01:26:46.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.433+0000 7f69ade00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f69b006f080 0x7f69b01f5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:46.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.433+0000 7f69ade00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f69b006f080 0x7f69b01f5a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48242/0 (socket says 172.21.15.63:48242) 2024-05-21T01:26:46.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.433+0000 7f69ade00640 1 -- 172.21.15.63:0/2507496376 learned_addr learned my addr 172.21.15.63:0/2507496376 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:26:46.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.433+0000 7f69ad400640 1 --2- 172.21.15.63:0/2507496376 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f69b0156070 0x7f69b01f8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:46.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.433+0000 7f69ae800640 1 --2- 172.21.15.63:0/2507496376 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f69b0156450 0x7f69b015fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:46.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.433+0000 7f69ade00640 1 -- 172.21.15.63:0/2507496376 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f69b0156070 msgr2=0x7f69b01f8f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:46.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.433+0000 7f69ade00640 1 --2- 172.21.15.63:0/2507496376 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f69b0156070 0x7f69b01f8f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:46.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.433+0000 7f69ade00640 1 -- 172.21.15.63:0/2507496376 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f69b0156450 msgr2=0x7f69b015fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:46.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.433+0000 7f69ade00640 1 --2- 172.21.15.63:0/2507496376 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f69b0156450 0x7f69b015fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:46.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.433+0000 7f69ade00640 1 -- 172.21.15.63:0/2507496376 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69b0151820 con 0x7f69b006f080 2024-05-21T01:26:46.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.433+0000 7f69ade00640 1 --2- 172.21.15.63:0/2507496376 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f69b006f080 0x7f69b01f5a00 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f69a000c3c0 tx=0x7f69a000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:46.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.433+0000 7f69a6000640 1 -- 172.21.15.63:0/2507496376 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69a00074e0 con 0x7f69b006f080 2024-05-21T01:26:46.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.437+0000 7f69a6000640 1 -- 172.21.15.63:0/2507496376 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69a0007680 con 0x7f69b006f080 2024-05-21T01:26:46.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.437+0000 7f69a6000640 1 -- 172.21.15.63:0/2507496376 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69a0004a30 con 0x7f69b006f080 2024-05-21T01:26:46.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.437+0000 7f69b4c00640 1 -- 172.21.15.63:0/2507496376 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69b0151b00 con 0x7f69b006f080 2024-05-21T01:26:46.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.437+0000 7f69b4c00640 1 -- 172.21.15.63:0/2507496376 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69b01f8740 con 0x7f69b006f080 2024-05-21T01:26:46.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.437+0000 7f69b4c00640 1 -- 172.21.15.63:0/2507496376 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69b00507f0 con 0x7f69b006f080 2024-05-21T01:26:46.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.437+0000 7f69a6000640 1 -- 172.21.15.63:0/2507496376 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7f69a001a020 con 0x7f69b006f080 2024-05-21T01:26:46.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.437+0000 7f69a6000640 1 --2- 172.21.15.63:0/2507496376 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f699006f430 0x7f69900718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:46.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.437+0000 7f69a6000640 1 -- 172.21.15.63:0/2507496376 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f69a008ed50 con 0x7f69b006f080 2024-05-21T01:26:46.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.437+0000 7f69ad400640 1 --2- 172.21.15.63:0/2507496376 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f699006f430 0x7f69900718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:46.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.441+0000 7f69ad400640 1 --2- 172.21.15.63:0/2507496376 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f699006f430 0x7f69900718f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f699c0ad000 tx=0x7f699c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:46.448 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.441+0000 7f69a6000640 1 -- 172.21.15.63:0/2507496376 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f69a0001090 con 0x7f69b006f080 2024-05-21T01:26:46.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.609+0000 7f69b4c00640 1 -- 172.21.15.63:0/2507496376 --> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f69b0071f60 con 0x7f699006f430 2024-05-21T01:26:46.613 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.609+0000 7f69a6000640 1 -- 172.21.15.63:0/2507496376 <== mgr.4103 v2:172.21.15.131:6832/921953667 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f69b0071f60 con 0x7f699006f430 2024-05-21T01:26:46.613 INFO:teuthology.orchestra.run.smithi063.stderr:instructed osd(s) 6 to deep-scrub 2024-05-21T01:26:46.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.609+0000 7f69b4c00640 1 -- 172.21.15.63:0/2507496376 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f699006f430 msgr2=0x7f69900718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:46.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.609+0000 7f69b4c00640 1 --2- 172.21.15.63:0/2507496376 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f699006f430 0x7f69900718f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f699c0ad000 tx=0x7f699c008040 comp rx=0 tx=0).stop 2024-05-21T01:26:46.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.609+0000 7f69b4c00640 1 -- 172.21.15.63:0/2507496376 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f69b006f080 msgr2=0x7f69b01f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:46.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.609+0000 7f69b4c00640 1 --2- 172.21.15.63:0/2507496376 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f69b006f080 0x7f69b01f5a00 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f69a000c3c0 tx=0x7f69a000c880 comp rx=0 tx=0).stop 2024-05-21T01:26:46.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.609+0000 7f69b4c00640 1 -- 172.21.15.63:0/2507496376 shutdown_connections 2024-05-21T01:26:46.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.609+0000 7f69b4c00640 1 --2- 172.21.15.63:0/2507496376 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f699006f430 0x7f69900718f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:46.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.609+0000 7f69b4c00640 1 --2- 172.21.15.63:0/2507496376 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f69b0156450 0x7f69b015fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:46.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.609+0000 7f69b4c00640 1 --2- 172.21.15.63:0/2507496376 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f69b0156070 0x7f69b01f8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:46.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.609+0000 7f69b4c00640 1 --2- 172.21.15.63:0/2507496376 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f69b006f080 0x7f69b01f5a00 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:46.616 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.609+0000 7f69b4c00640 1 -- 172.21.15.63:0/2507496376 >> 172.21.15.63:0/2507496376 conn(0x7f69b00735f0 msgr2=0x7f69b0159f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:26:46.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.609+0000 7f69b4c00640 1 -- 172.21.15.63:0/2507496376 shutdown_connections 2024-05-21T01:26:46.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.609+0000 7f69b4c00640 1 -- 172.21.15.63:0/2507496376 wait complete. 2024-05-21T01:26:46.636 INFO:tasks.ceph:Scrubbing osd.7 2024-05-21T01:26:46.636 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-05-21T01:26:46.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.781+0000 7ff1d3200640 1 Processor -- start 2024-05-21T01:26:46.786 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.781+0000 7ff1d3200640 1 -- start start 2024-05-21T01:26:46.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.781+0000 7ff1d3200640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff1d415a6f0 0x7ff1d40cb880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:46.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.781+0000 7ff1d3200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff1d4072160 0x7ff1d40725a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:46.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.781+0000 7ff1d3200640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1d415abe0 con 0x7ff1d40c7c00 2024-05-21T01:26:46.787 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.781+0000 7ff1d3200640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7ff1d406c6c0 con 0x7ff1d415a6f0 2024-05-21T01:26:46.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.781+0000 7ff1d3200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7ff1d406dd30 con 0x7ff1d4072160 2024-05-21T01:26:46.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.781+0000 7ff1d1e00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7ff1d40c7c00 0x7ff1d40c7fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37592/0 (socket says 172.21.15.63:37592) 2024-05-21T01:26:46.788 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.781+0000 7ff1d1e00640 1 -- 172.21.15.63:0/688328364 learned_addr learned my addr 172.21.15.63:0/688328364 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-05-21T01:26:46.789 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.781+0000 7ff1d1400640 1 --2- 172.21.15.63:0/688328364 >> v2:172.21.15.131:3300/0 conn(0x7ff1d415a6f0 0x7ff1d40cb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:46.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.785+0000 7ff1d2800640 1 --2- 172.21.15.63:0/688328364 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff1d4072160 0x7ff1d40725a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:46.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.785+0000 7ff1d0a00640 1 -- 172.21.15.63:0/688328364 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1828790899 0 0) 0x7ff1d415abe0 con 0x7ff1d40c7c00 2024-05-21T01:26:46.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.785+0000 7ff1d0a00640 1 -- 172.21.15.63:0/688328364 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff1b8003530 con 0x7ff1d40c7c00 2024-05-21T01:26:46.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.785+0000 7ff1d0a00640 1 -- 172.21.15.63:0/688328364 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1364080041 0 0) 0x7ff1b8003530 con 0x7ff1d40c7c00 2024-05-21T01:26:46.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.785+0000 7ff1d0a00640 1 -- 172.21.15.63:0/688328364 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff1d4072160 msgr2=0x7ff1d40725a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:26:46.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.785+0000 7ff1d0a00640 1 --2- 172.21.15.63:0/688328364 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff1d4072160 0x7ff1d40725a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:46.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.785+0000 7ff1d0a00640 1 -- 172.21.15.63:0/688328364 >> v2:172.21.15.131:3300/0 conn(0x7ff1d415a6f0 msgr2=0x7ff1d40cb880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:26:46.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.785+0000 7ff1d0a00640 1 --2- 172.21.15.63:0/688328364 >> v2:172.21.15.131:3300/0 conn(0x7ff1d415a6f0 0x7ff1d40cb880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:46.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.785+0000 7ff1d0a00640 1 -- 172.21.15.63:0/688328364 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1d406dfd0 con 0x7ff1d40c7c00 2024-05-21T01:26:46.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.785+0000 7ff1d0a00640 1 -- 172.21.15.63:0/688328364 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 466403955 0 0) 0x7ff1c4001700 con 0x7ff1d40c7c00 2024-05-21T01:26:46.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.785+0000 7ff1d0a00640 1 -- 172.21.15.63:0/688328364 >> v1:172.21.15.63:6789/0 conn(0x7ff1d40c7c00 legacy=0x7ff1d40c7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:46.790 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.785+0000 7ff1d0a00640 1 --2- 172.21.15.63:0/688328364 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1b8003a80 0x7ff1b8003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:46.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.785+0000 7ff1d0a00640 1 --2- 172.21.15.63:0/688328364 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff1d4072160 0x7ff1b8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:46.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.785+0000 7ff1d0a00640 1 --2- 172.21.15.63:0/688328364 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff1b8004d50 0x7ff1b80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:46.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.785+0000 7ff1d0a00640 1 -- 172.21.15.63:0/688328364 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff1d406c6c0 con 0x7ff1b8003a80 2024-05-21T01:26:46.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.785+0000 7ff1d0a00640 1 -- 172.21.15.63:0/688328364 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7ff1d406dd30 con 0x7ff1b8004d50 2024-05-21T01:26:46.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.785+0000 7ff1d0a00640 1 -- 172.21.15.63:0/688328364 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7ff1b800bb60 con 0x7ff1d4072160 2024-05-21T01:26:46.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.785+0000 7ff1d1e00640 1 --2- 172.21.15.63:0/688328364 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1b8003a80 0x7ff1b8003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:46.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.785+0000 7ff1d2800640 1 --2- 172.21.15.63:0/688328364 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff1b8004d50 0x7ff1b80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:46.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.785+0000 7ff1d1400640 1 --2- 172.21.15.63:0/688328364 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff1d4072160 0x7ff1b8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:46.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.785+0000 7ff1d1e00640 1 -- 172.21.15.63:0/688328364 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff1d4072160 msgr2=0x7ff1b8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:26:46.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.785+0000 7ff1d1e00640 1 --2- 172.21.15.63:0/688328364 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff1d4072160 0x7ff1b8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:46.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.785+0000 7ff1d1e00640 1 -- 172.21.15.63:0/688328364 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff1b8004d50 msgr2=0x7ff1b80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:26:46.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.785+0000 7ff1d1e00640 1 --2- 172.21.15.63:0/688328364 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff1b8004d50 0x7ff1b80051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:46.791 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.785+0000 7ff1d1e00640 1 -- 172.21.15.63:0/688328364 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1b8003530 con 0x7ff1b8003a80 2024-05-21T01:26:46.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.785+0000 7ff1d1400640 1 --2- 172.21.15.63:0/688328364 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff1d4072160 0x7ff1b8004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T01:26:46.792 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.785+0000 7ff1d2800640 1 --2- 172.21.15.63:0/688328364 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff1b8004d50 0x7ff1b80051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T01:26:46.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.789+0000 7ff1d1e00640 1 --2- 172.21.15.63:0/688328364 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1b8003a80 0x7ff1b8003ea0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ff1c400c240 tx=0x7ff1c401cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f914b11596affc6 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:46.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.789+0000 7ff1d0a00640 1 -- 172.21.15.63:0/688328364 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c4007d60 con 0x7ff1b8003a80 2024-05-21T01:26:46.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.789+0000 7ff1d0a00640 1 -- 172.21.15.63:0/688328364 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1c40a9070 con 0x7ff1b8003a80 2024-05-21T01:26:46.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.789+0000 7ff1d0a00640 1 -- 172.21.15.63:0/688328364 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c4005d20 con 0x7ff1b8003a80 2024-05-21T01:26:46.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.789+0000 7ff1d3200640 1 -- 172.21.15.63:0/688328364 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1b8003a80 msgr2=0x7ff1b8003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:46.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.789+0000 7ff1d3200640 1 --2- 172.21.15.63:0/688328364 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1b8003a80 0x7ff1b8003ea0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ff1c400c240 tx=0x7ff1c401cc20 comp rx=0 tx=0).stop 2024-05-21T01:26:46.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.789+0000 7ff1d2800640 1 -- 172.21.15.63:0/688328364 reap_dead start 2024-05-21T01:26:46.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.789+0000 7ff1d3200640 1 -- 172.21.15.63:0/688328364 shutdown_connections 2024-05-21T01:26:46.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.789+0000 7ff1d3200640 1 -- 172.21.15.63:0/688328364 >> 172.21.15.63:0/688328364 conn(0x7ff1d40cad90 msgr2=0x7ff1d40cb170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:26:46.793 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.789+0000 7ff1d3200640 1 -- 172.21.15.63:0/688328364 shutdown_connections 2024-05-21T01:26:46.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.789+0000 7ff1d3200640 1 -- 172.21.15.63:0/688328364 wait complete. 2024-05-21T01:26:46.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.789+0000 7ff1d3200640 1 Processor -- start 2024-05-21T01:26:46.794 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.789+0000 7ff1d3200640 1 -- start start 2024-05-21T01:26:46.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.789+0000 7ff1d3200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff1b8003a80 0x7ff1d414e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:46.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.789+0000 7ff1d3200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1d40c51e0 0x7ff1d414f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:46.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.789+0000 7ff1d3200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff1d41f6180 0x7ff1d4147030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:46.796 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.789+0000 7ff1d3200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7ff1d4072950 con 0x7ff1d40c51e0 2024-05-21T01:26:46.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.789+0000 7ff1d3200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7ff1d40c86f0 con 0x7ff1b8003a80 2024-05-21T01:26:46.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.789+0000 7ff1d3200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7ff1d4164510 con 0x7ff1d41f6180 2024-05-21T01:26:46.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.789+0000 7ff1d1400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1d40c51e0 0x7ff1d414f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:46.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.789+0000 7ff1d1400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1d40c51e0 0x7ff1d414f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48262/0 (socket says 172.21.15.63:48262) 2024-05-21T01:26:46.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.789+0000 7ff1d1400640 1 -- 172.21.15.63:0/3747336353 learned_addr learned my addr 172.21.15.63:0/3747336353 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:26:46.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.789+0000 7ff1d1e00640 1 --2- 172.21.15.63:0/3747336353 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff1b8003a80 0x7ff1d414e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:46.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.793+0000 7ff1d2800640 1 --2- 172.21.15.63:0/3747336353 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff1d41f6180 0x7ff1d4147030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:46.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.793+0000 7ff1d1400640 1 -- 172.21.15.63:0/3747336353 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff1d41f6180 msgr2=0x7ff1d4147030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:46.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.793+0000 7ff1d1400640 1 --2- 172.21.15.63:0/3747336353 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff1d41f6180 0x7ff1d4147030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:46.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.793+0000 7ff1d1400640 1 -- 172.21.15.63:0/3747336353 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff1b8003a80 msgr2=0x7ff1d414e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:46.797 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.793+0000 7ff1d1400640 1 --2- 172.21.15.63:0/3747336353 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff1b8003a80 0x7ff1d414e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:46.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.793+0000 7ff1d1400640 1 -- 172.21.15.63:0/3747336353 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1d4154710 con 0x7ff1d40c51e0 2024-05-21T01:26:46.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.793+0000 7ff1d1400640 1 --2- 172.21.15.63:0/3747336353 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1d40c51e0 0x7ff1d414f280 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7ff1c00116d0 tx=0x7ff1c0011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:46.798 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.793+0000 7ff1ca000640 1 -- 172.21.15.63:0/3747336353 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c0004220 con 0x7ff1d40c51e0 2024-05-21T01:26:46.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.793+0000 7ff1ca000640 1 -- 172.21.15.63:0/3747336353 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1c00043c0 con 0x7ff1d40c51e0 2024-05-21T01:26:46.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.793+0000 7ff1ca000640 1 -- 172.21.15.63:0/3747336353 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c000f9c0 con 0x7ff1d40c51e0 2024-05-21T01:26:46.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.793+0000 7ff1d3200640 1 -- 172.21.15.63:0/3747336353 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1d41549f0 con 0x7ff1d40c51e0 2024-05-21T01:26:46.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.793+0000 7ff1d3200640 1 -- 172.21.15.63:0/3747336353 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1d41e9860 con 0x7ff1d40c51e0 2024-05-21T01:26:46.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.793+0000 7ff1d3200640 1 -- 172.21.15.63:0/3747336353 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff1d414ee50 con 0x7ff1d40c51e0 2024-05-21T01:26:46.799 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.793+0000 7ff1ca000640 1 -- 172.21.15.63:0/3747336353 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7ff1c000fb60 con 0x7ff1d40c51e0 2024-05-21T01:26:46.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.793+0000 7ff1ca000640 1 --2- 172.21.15.63:0/3747336353 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7ff1b406f400 0x7ff1b40718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:46.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.793+0000 7ff1ca000640 1 -- 172.21.15.63:0/3747336353 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7ff1c008fc00 con 0x7ff1d40c51e0 2024-05-21T01:26:46.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.797+0000 7ff1ca000640 1 --2- 172.21.15.63:0/3747336353 >> [v2:172.21.15.131:6824/4219797450,v1:172.21.15.131:6825/4219797450] conn(0x7ff1b4078bb0 0x7ff1b407b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:46.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.797+0000 7ff1ca000640 1 -- 172.21.15.63:0/3747336353 --> [v2:172.21.15.131:6824/4219797450,v1:172.21.15.131:6825/4219797450] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff1b407b700 con 0x7ff1b4078bb0 2024-05-21T01:26:46.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.797+0000 7ff1ca000640 1 -- 172.21.15.63:0/3747336353 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff1c0092300 con 0x7ff1d40c51e0 2024-05-21T01:26:46.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.797+0000 7ff1d1e00640 1 --2- 172.21.15.63:0/3747336353 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7ff1b406f400 0x7ff1b40718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:46.800 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.797+0000 7ff1d2800640 1 --2- 172.21.15.63:0/3747336353 >> [v2:172.21.15.131:6824/4219797450,v1:172.21.15.131:6825/4219797450] conn(0x7ff1b4078bb0 0x7ff1b407b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:46.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.797+0000 7ff1d1e00640 1 --2- 172.21.15.63:0/3747336353 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7ff1b406f400 0x7ff1b40718c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff1c40ab000 tx=0x7ff1c40b1040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:46.801 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.797+0000 7ff1d2800640 1 --2- 172.21.15.63:0/3747336353 >> [v2:172.21.15.131:6824/4219797450,v1:172.21.15.131:6825/4219797450] conn(0x7ff1b4078bb0 0x7ff1b407b030 crc :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:46.802 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.797+0000 7ff1ca000640 1 -- 172.21.15.63:0/3747336353 <== osd.7 v2:172.21.15.131:6824/4219797450 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff1b407b700 con 0x7ff1b4078bb0 2024-05-21T01:26:46.816 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.813+0000 7ff1d3200640 1 -- 172.21.15.63:0/3747336353 --> [v2:172.21.15.131:6824/4219797450,v1:172.21.15.131:6825/4219797450] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff1d406c0c0 con 0x7ff1b4078bb0 2024-05-21T01:26:46.817 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.813+0000 7ff1ca000640 1 -- 172.21.15.63:0/3747336353 <== osd.7 v2:172.21.15.131:6824/4219797450 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ff1d406c0c0 con 0x7ff1b4078bb0 2024-05-21T01:26:46.817 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2024-05-21T01:26:46.817 INFO:teuthology.orchestra.run.smithi063.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-21T01:26:46.818 INFO:teuthology.orchestra.run.smithi063.stdout:} 2024-05-21T01:26:46.818 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.813+0000 7ff1d3200640 1 -- 172.21.15.63:0/3747336353 >> [v2:172.21.15.131:6824/4219797450,v1:172.21.15.131:6825/4219797450] conn(0x7ff1b4078bb0 msgr2=0x7ff1b407b030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:46.818 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.813+0000 7ff1d3200640 1 --2- 172.21.15.63:0/3747336353 >> [v2:172.21.15.131:6824/4219797450,v1:172.21.15.131:6825/4219797450] conn(0x7ff1b4078bb0 0x7ff1b407b030 crc :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:46.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.813+0000 7ff1d3200640 1 -- 172.21.15.63:0/3747336353 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7ff1b406f400 msgr2=0x7ff1b40718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:46.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.813+0000 7ff1d3200640 1 --2- 172.21.15.63:0/3747336353 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7ff1b406f400 0x7ff1b40718c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff1c40ab000 tx=0x7ff1c40b1040 comp rx=0 tx=0).stop 2024-05-21T01:26:46.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.813+0000 7ff1d3200640 1 -- 172.21.15.63:0/3747336353 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1d40c51e0 msgr2=0x7ff1d414f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:46.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.813+0000 7ff1d3200640 1 --2- 172.21.15.63:0/3747336353 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff1d40c51e0 0x7ff1d414f280 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7ff1c00116d0 tx=0x7ff1c0011b90 comp rx=0 tx=0).stop 2024-05-21T01:26:46.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.813+0000 7ff1d2800640 1 -- 172.21.15.63:0/3747336353 reap_dead start 2024-05-21T01:26:46.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.813+0000 7ff1d3200640 1 -- 172.21.15.63:0/3747336353 shutdown_connections 2024-05-21T01:26:46.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.813+0000 7ff1d3200640 1 -- 172.21.15.63:0/3747336353 >> 172.21.15.63:0/3747336353 conn(0x7ff1d40cad90 msgr2=0x7ff1d40cc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:26:46.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.813+0000 7ff1d3200640 1 -- 172.21.15.63:0/3747336353 shutdown_connections 2024-05-21T01:26:46.819 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.813+0000 7ff1d3200640 1 -- 172.21.15.63:0/3747336353 wait complete. 2024-05-21T01:26:46.836 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-05-21T01:26:46.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.973+0000 7fb1b4200640 1 Processor -- start 2024-05-21T01:26:46.979 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.973+0000 7fb1b4200640 1 -- start start 2024-05-21T01:26:46.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.977+0000 7fb1b4200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb1ac06f9b0 0x7fb1ac072660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:46.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.977+0000 7fb1b4200640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1ac0cdcc0 con 0x7fb1ac06f5d0 2024-05-21T01:26:46.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.977+0000 7fb1b4200640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1ac0cdfa0 con 0x7fb1ac163950 2024-05-21T01:26:46.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.977+0000 7fb1b4200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fb1ac0cad70 con 0x7fb1ac06f9b0 2024-05-21T01:26:46.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.977+0000 7fb1b1800640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fb1ac06f5d0 0x7fb1ac0cd280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37604/0 (socket says 172.21.15.63:37604) 2024-05-21T01:26:46.980 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.977+0000 7fb1b1800640 1 -- 172.21.15.63:0/1812266819 learned_addr learned my addr 172.21.15.63:0/1812266819 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-05-21T01:26:46.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.977+0000 7fb1b0e00640 1 --2- 172.21.15.63:0/1812266819 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb1ac06f9b0 0x7fb1ac072660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:46.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.977+0000 7fb1abe00640 1 -- 172.21.15.63:0/1812266819 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1902225536 0 0) 0x7fb1ac0cdcc0 con 0x7fb1ac06f5d0 2024-05-21T01:26:46.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.977+0000 7fb1abe00640 1 -- 172.21.15.63:0/1812266819 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb194003530 con 0x7fb1ac06f5d0 2024-05-21T01:26:46.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.977+0000 7fb1abe00640 1 -- 172.21.15.63:0/1812266819 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2896210533 0 0) 0x7fb1ac0cdfa0 con 0x7fb1ac163950 2024-05-21T01:26:46.982 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.977+0000 7fb1abe00640 1 -- 172.21.15.63:0/1812266819 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb1ac0cdcc0 con 0x7fb1ac163950 2024-05-21T01:26:46.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.977+0000 7fb1abe00640 1 -- 172.21.15.63:0/1812266819 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 543108568 0 0) 0x7fb194003530 con 0x7fb1ac06f5d0 2024-05-21T01:26:46.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.977+0000 7fb1abe00640 1 -- 172.21.15.63:0/1812266819 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb1ac06f9b0 msgr2=0x7fb1ac072660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:26:46.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.977+0000 7fb1abe00640 1 --2- 172.21.15.63:0/1812266819 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb1ac06f9b0 0x7fb1ac072660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:46.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.977+0000 7fb1abe00640 1 -- 172.21.15.63:0/1812266819 >> v1:172.21.15.131:6789/0 conn(0x7fb1ac163950 legacy=0x7fb1ac159ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:46.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.977+0000 7fb1abe00640 1 -- 172.21.15.63:0/1812266819 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1ac071b80 con 0x7fb1ac06f5d0 2024-05-21T01:26:46.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.977+0000 7fb1abe00640 1 -- 172.21.15.63:0/1812266819 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 466403955 0 0) 0x7fb1a0001700 con 0x7fb1ac06f5d0 2024-05-21T01:26:46.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.977+0000 7fb1abe00640 1 -- 172.21.15.63:0/1812266819 >> v1:172.21.15.63:6789/0 conn(0x7fb1ac06f5d0 legacy=0x7fb1ac0cd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:46.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.977+0000 7fb1abe00640 1 --2- 172.21.15.63:0/1812266819 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb194003c20 0x7fb194004020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:46.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.977+0000 7fb1abe00640 1 --2- 172.21.15.63:0/1812266819 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb1ac06f9b0 0x7fb194004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:46.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.977+0000 7fb1abe00640 1 --2- 172.21.15.63:0/1812266819 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb194004d50 0x7fb1940051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:46.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.977+0000 7fb1abe00640 1 -- 172.21.15.63:0/1812266819 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fb1ac0cad70 con 0x7fb194003c20 2024-05-21T01:26:46.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.977+0000 7fb1abe00640 1 -- 172.21.15.63:0/1812266819 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fb19400bb60 con 0x7fb194004d50 2024-05-21T01:26:46.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.977+0000 7fb1abe00640 1 -- 172.21.15.63:0/1812266819 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fb19400bd30 con 0x7fb1ac06f9b0 2024-05-21T01:26:46.983 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.977+0000 7fb1b1800640 1 --2- 172.21.15.63:0/1812266819 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb194003c20 0x7fb194004020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:46.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.977+0000 7fb1b0e00640 1 --2- 172.21.15.63:0/1812266819 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb1ac06f9b0 0x7fb194004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:46.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.977+0000 7fb1b2200640 1 --2- 172.21.15.63:0/1812266819 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb194004d50 0x7fb1940051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:46.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.977+0000 7fb1b1800640 1 -- 172.21.15.63:0/1812266819 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb1ac06f9b0 msgr2=0x7fb194004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:26:46.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.977+0000 7fb1b1800640 1 --2- 172.21.15.63:0/1812266819 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb1ac06f9b0 0x7fb194004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:46.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.977+0000 7fb1b1800640 1 -- 172.21.15.63:0/1812266819 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb194004d50 msgr2=0x7fb1940051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:26:46.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.977+0000 7fb1b1800640 1 --2- 172.21.15.63:0/1812266819 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb194004d50 0x7fb1940051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:46.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.977+0000 7fb1b1800640 1 -- 172.21.15.63:0/1812266819 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb194003530 con 0x7fb194003c20 2024-05-21T01:26:46.984 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.977+0000 7fb1b0e00640 1 --2- 172.21.15.63:0/1812266819 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb1ac06f9b0 0x7fb194004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T01:26:46.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.981+0000 7fb1b1800640 1 --2- 172.21.15.63:0/1812266819 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb194003c20 0x7fb194004020 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fb1a000c1f0 tx=0x7fb1a001cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bc3860cd41e275c server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:46.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.981+0000 7fb1abe00640 1 -- 172.21.15.63:0/1812266819 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1a0007cf0 con 0x7fb194003c20 2024-05-21T01:26:46.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.981+0000 7fb1abe00640 1 -- 172.21.15.63:0/1812266819 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1a00a9070 con 0x7fb194003c20 2024-05-21T01:26:46.985 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.981+0000 7fb1abe00640 1 -- 172.21.15.63:0/1812266819 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1a0005d40 con 0x7fb194003c20 2024-05-21T01:26:46.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.981+0000 7fb1b4200640 1 -- 172.21.15.63:0/1812266819 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb194003c20 msgr2=0x7fb194004020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:46.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.981+0000 7fb1b4200640 1 --2- 172.21.15.63:0/1812266819 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb194003c20 0x7fb194004020 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fb1a000c1f0 tx=0x7fb1a001cb80 comp rx=0 tx=0).stop 2024-05-21T01:26:46.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.981+0000 7fb1b2200640 1 -- 172.21.15.63:0/1812266819 reap_dead start 2024-05-21T01:26:46.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.981+0000 7fb1b4200640 1 -- 172.21.15.63:0/1812266819 shutdown_connections 2024-05-21T01:26:46.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.981+0000 7fb1b4200640 1 -- 172.21.15.63:0/1812266819 >> 172.21.15.63:0/1812266819 conn(0x7fb1ac068460 msgr2=0x7fb1ac068870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:26:46.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.981+0000 7fb1b4200640 1 -- 172.21.15.63:0/1812266819 shutdown_connections 2024-05-21T01:26:46.986 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.981+0000 7fb1b4200640 1 -- 172.21.15.63:0/1812266819 wait complete. 2024-05-21T01:26:46.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.981+0000 7fb1b4200640 1 Processor -- start 2024-05-21T01:26:46.987 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.981+0000 7fb1b4200640 1 -- start start 2024-05-21T01:26:46.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.985+0000 7fb1b4200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb194003c20 0x7fb1ac0c4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:46.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.985+0000 7fb1b4200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb1ac0c4340 0x7fb1ac15a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:46.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.985+0000 7fb1b4200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb1ac15f340 0x7fb1ac15f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:46.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.985+0000 7fb1b4200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fb1ac072660 con 0x7fb194003c20 2024-05-21T01:26:46.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.985+0000 7fb1b4200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fb1ac0cd990 con 0x7fb1ac15f340 2024-05-21T01:26:46.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.985+0000 7fb1b4200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fb1ac0727e0 con 0x7fb1ac0c4340 2024-05-21T01:26:46.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.985+0000 7fb1b1800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb194003c20 0x7fb1ac0c4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:46.989 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.985+0000 7fb1b1800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb194003c20 0x7fb1ac0c4e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48270/0 (socket says 172.21.15.63:48270) 2024-05-21T01:26:46.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.985+0000 7fb1b1800640 1 -- 172.21.15.63:0/825977426 learned_addr learned my addr 172.21.15.63:0/825977426 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:26:46.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.985+0000 7fb1b0e00640 1 --2- 172.21.15.63:0/825977426 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb1ac0c4340 0x7fb1ac15a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:46.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.985+0000 7fb1b2200640 1 --2- 172.21.15.63:0/825977426 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb1ac15f340 0x7fb1ac15f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:46.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.985+0000 7fb1b1800640 1 -- 172.21.15.63:0/825977426 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb1ac0c4340 msgr2=0x7fb1ac15a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:46.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.985+0000 7fb1b1800640 1 --2- 172.21.15.63:0/825977426 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb1ac0c4340 0x7fb1ac15a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:46.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.985+0000 7fb1b1800640 1 -- 172.21.15.63:0/825977426 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb1ac15f340 msgr2=0x7fb1ac15f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:46.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.985+0000 7fb1b1800640 1 --2- 172.21.15.63:0/825977426 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb1ac15f340 0x7fb1ac15f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:46.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.985+0000 7fb1b1800640 1 -- 172.21.15.63:0/825977426 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1ac15fd00 con 0x7fb194003c20 2024-05-21T01:26:46.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.985+0000 7fb1b0e00640 1 --2- 172.21.15.63:0/825977426 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb1ac0c4340 0x7fb1ac15a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T01:26:46.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.985+0000 7fb1b2200640 1 --2- 172.21.15.63:0/825977426 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb1ac15f340 0x7fb1ac15f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T01:26:46.990 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.985+0000 7fb1b1800640 1 --2- 172.21.15.63:0/825977426 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb194003c20 0x7fb1ac0c4e60 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fb1a001c640 tx=0x7fb194005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:46.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.985+0000 7fb1a9600640 1 -- 172.21.15.63:0/825977426 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1a00a6ce0 con 0x7fb194003c20 2024-05-21T01:26:46.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.985+0000 7fb1a9600640 1 -- 172.21.15.63:0/825977426 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1a00047f0 con 0x7fb194003c20 2024-05-21T01:26:46.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.985+0000 7fb1a9600640 1 -- 172.21.15.63:0/825977426 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1a0004bc0 con 0x7fb194003c20 2024-05-21T01:26:46.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.985+0000 7fb1b4200640 1 -- 172.21.15.63:0/825977426 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1ac1f60f0 con 0x7fb194003c20 2024-05-21T01:26:46.991 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.985+0000 7fb1b4200640 1 -- 172.21.15.63:0/825977426 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1ac15e860 con 0x7fb194003c20 2024-05-21T01:26:46.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.985+0000 7fb1b4200640 1 -- 172.21.15.63:0/825977426 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1ac0507f0 con 0x7fb194003c20 2024-05-21T01:26:46.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.985+0000 7fb1a9600640 1 -- 172.21.15.63:0/825977426 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7fb1a00070d0 con 0x7fb194003c20 2024-05-21T01:26:46.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.989+0000 7fb1a9600640 1 --2- 172.21.15.63:0/825977426 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fb18c06f400 0x7fb18c0718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:46.992 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.989+0000 7fb1a9600640 1 -- 172.21.15.63:0/825977426 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7fb1a01291e0 con 0x7fb194003c20 2024-05-21T01:26:46.993 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.989+0000 7fb1b0e00640 1 --2- 172.21.15.63:0/825977426 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fb18c06f400 0x7fb18c0718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:46.994 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.989+0000 7fb1b0e00640 1 --2- 172.21.15.63:0/825977426 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fb18c06f400 0x7fb18c0718c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac1612c0 tx=0x7fb198008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:46.996 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:46.993+0000 7fb1a9600640 1 -- 172.21.15.63:0/825977426 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fb1ac15fd00 con 0x7fb194003c20 2024-05-21T01:26:47.164 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:47.161+0000 7fb1b4200640 1 -- 172.21.15.63:0/825977426 --> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7fb1ac0c8c40 con 0x7fb18c06f400 2024-05-21T01:26:47.165 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:47.161+0000 7fb1a9600640 1 -- 172.21.15.63:0/825977426 <== mgr.4103 v2:172.21.15.131:6832/921953667 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fb1ac0c8c40 con 0x7fb18c06f400 2024-05-21T01:26:47.165 INFO:teuthology.orchestra.run.smithi063.stderr:instructed osd(s) 7 to deep-scrub 2024-05-21T01:26:47.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:47.161+0000 7fb1b4200640 1 -- 172.21.15.63:0/825977426 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fb18c06f400 msgr2=0x7fb18c0718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:47.167 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:47.161+0000 7fb1b4200640 1 --2- 172.21.15.63:0/825977426 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fb18c06f400 0x7fb18c0718c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac1612c0 tx=0x7fb198008040 comp rx=0 tx=0).stop 2024-05-21T01:26:47.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:47.161+0000 7fb1b4200640 1 -- 172.21.15.63:0/825977426 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb194003c20 msgr2=0x7fb1ac0c4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:47.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:47.161+0000 7fb1b4200640 1 --2- 172.21.15.63:0/825977426 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb194003c20 0x7fb1ac0c4e60 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fb1a001c640 tx=0x7fb194005840 comp rx=0 tx=0).stop 2024-05-21T01:26:47.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:47.161+0000 7fb1b4200640 1 -- 172.21.15.63:0/825977426 shutdown_connections 2024-05-21T01:26:47.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:47.161+0000 7fb1b4200640 1 --2- 172.21.15.63:0/825977426 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fb18c06f400 0x7fb18c0718c0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:47.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:47.161+0000 7fb1b4200640 1 --2- 172.21.15.63:0/825977426 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb1ac15f340 0x7fb1ac15f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:47.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:47.161+0000 7fb1b4200640 1 --2- 172.21.15.63:0/825977426 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb1ac0c4340 0x7fb1ac15a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:47.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:47.161+0000 7fb1b4200640 1 --2- 172.21.15.63:0/825977426 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb194003c20 0x7fb1ac0c4e60 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:47.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:47.161+0000 7fb1b4200640 1 -- 172.21.15.63:0/825977426 >> 172.21.15.63:0/825977426 conn(0x7fb1ac068460 msgr2=0x7fb1ac0cd160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:26:47.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:47.161+0000 7fb1b4200640 1 -- 172.21.15.63:0/825977426 shutdown_connections 2024-05-21T01:26:47.168 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:47.161+0000 7fb1b4200640 1 -- 172.21.15.63:0/825977426 wait complete. 2024-05-21T01:26:47.188 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-21T01:26:47.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:47.325+0000 7feb94a00640 1 Processor -- start 2024-05-21T01:26:47.330 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:47.325+0000 7feb94a00640 1 -- start start 2024-05-21T01:26:47.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:47.325+0000 7feb94a00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7feb90156150 0x7feb9015bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:47.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:47.325+0000 7feb94a00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7feb90073480 0x7feb90071190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:47.331 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:47.325+0000 7feb94a00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb9006f510 con 0x7feb900716d0 2024-05-21T01:26:47.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:47.325+0000 7feb94a00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7feb90070a20 con 0x7feb90073480 2024-05-21T01:26:47.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:47.325+0000 7feb94a00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7feb90073ac0 con 0x7feb90156150 2024-05-21T01:26:47.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:47.325+0000 7feb8d400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7feb90073480 0x7feb90071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:47.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:47.325+0000 7feb8d400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7feb90073480 0x7feb90071190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48286/0 (socket says 172.21.15.63:48286) 2024-05-21T01:26:47.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:47.325+0000 7feb8d400640 1 -- 172.21.15.63:0/1183571325 learned_addr learned my addr 172.21.15.63:0/1183571325 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:26:47.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:47.325+0000 7feb8e800640 1 --1- 172.21.15.63:0/1183571325 >> v1:172.21.15.63:6789/0 conn(0x7feb900716d0 0x7feb9006d5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37606/0 (socket says 172.21.15.63:37606) 2024-05-21T01:26:47.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:47.325+0000 7feb8de00640 1 --2- 172.21.15.63:0/1183571325 >> v2:172.21.15.131:3300/0 conn(0x7feb90156150 0x7feb9015bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:47.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:47.329+0000 7feb8d400640 1 -- 172.21.15.63:0/1183571325 >> v2:172.21.15.131:3300/0 conn(0x7feb90156150 msgr2=0x7feb9015bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:26:47.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:47.329+0000 7feb8d400640 1 --2- 172.21.15.63:0/1183571325 >> v2:172.21.15.131:3300/0 conn(0x7feb90156150 0x7feb9015bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:47.332 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:47.329+0000 7feb8d400640 1 -- 172.21.15.63:0/1183571325 >> v1:172.21.15.63:6789/0 conn(0x7feb900716d0 legacy=0x7feb9006d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:47.333 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:47.329+0000 7feb8d400640 1 -- 172.21.15.63:0/1183571325 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb90073da0 con 0x7feb90073480 2024-05-21T01:26:47.334 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:47.329+0000 7feb8d400640 1 --2- 172.21.15.63:0/1183571325 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feb90073480 0x7feb90071190 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7feb90072da0 tx=0x7feb7c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc1bdf08a333e857 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:47.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:47.329+0000 7feb8ca00640 1 -- 172.21.15.63:0/1183571325 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb7c0b0070 con 0x7feb90073480 2024-05-21T01:26:47.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:47.329+0000 7feb8ca00640 1 -- 172.21.15.63:0/1183571325 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb7c0ab600 con 0x7feb90073480 2024-05-21T01:26:47.335 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:47.329+0000 7feb8ca00640 1 -- 172.21.15.63:0/1183571325 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb7c0ab9d0 con 0x7feb90073480 2024-05-21T01:26:47.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:47.329+0000 7feb94a00640 1 -- 172.21.15.63:0/1183571325 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feb90073480 msgr2=0x7feb90071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:47.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:47.329+0000 7feb94a00640 1 --2- 172.21.15.63:0/1183571325 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feb90073480 0x7feb90071190 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7feb90072da0 tx=0x7feb7c01c490 comp rx=0 tx=0).stop 2024-05-21T01:26:47.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:47.329+0000 7feb94a00640 1 -- 172.21.15.63:0/1183571325 shutdown_connections 2024-05-21T01:26:47.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:47.329+0000 7feb94a00640 1 --2- 172.21.15.63:0/1183571325 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feb90073480 0x7feb90071190 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:47.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:47.329+0000 7feb94a00640 1 --2- 172.21.15.63:0/1183571325 >> v2:172.21.15.131:3300/0 conn(0x7feb90156150 0x7feb9015bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:47.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:47.329+0000 7feb94a00640 1 -- 172.21.15.63:0/1183571325 >> 172.21.15.63:0/1183571325 conn(0x7feb900cbf10 msgr2=0x7feb900cc320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:26:47.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:47.329+0000 7feb94a00640 1 -- 172.21.15.63:0/1183571325 shutdown_connections 2024-05-21T01:26:47.336 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:47.329+0000 7feb94a00640 1 -- 172.21.15.63:0/1183571325 wait complete. 2024-05-21T01:26:47.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:47.333+0000 7feb94a00640 1 Processor -- start 2024-05-21T01:26:47.337 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:47.333+0000 7feb94a00640 1 -- start start 2024-05-21T01:26:47.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:47.333+0000 7feb94a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb900716d0 0x7feb900c8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:47.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:47.333+0000 7feb94a00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feb90073480 0x7feb9015f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:47.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:47.333+0000 7feb94a00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feb90156150 0x7feb900c8f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:47.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:47.333+0000 7feb94a00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7feb9006de40 con 0x7feb90073480 2024-05-21T01:26:47.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:47.333+0000 7feb94a00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7feb9006dcc0 con 0x7feb900716d0 2024-05-21T01:26:47.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:47.333+0000 7feb94a00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7feb90168ed0 con 0x7feb90156150 2024-05-21T01:26:47.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:47.333+0000 7feb8d400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feb90073480 0x7feb9015f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:47.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:47.333+0000 7feb8d400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feb90073480 0x7feb9015f8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:48296/0 (socket says 172.21.15.63:48296) 2024-05-21T01:26:47.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:47.333+0000 7feb8d400640 1 -- 172.21.15.63:0/3986195099 learned_addr learned my addr 172.21.15.63:0/3986195099 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:26:47.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:47.333+0000 7feb8de00640 1 --2- 172.21.15.63:0/3986195099 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb900716d0 0x7feb900c8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:47.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:47.333+0000 7feb8e800640 1 --2- 172.21.15.63:0/3986195099 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feb90156150 0x7feb900c8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:47.340 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:47.333+0000 7feb8d400640 1 -- 172.21.15.63:0/3986195099 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feb90156150 msgr2=0x7feb900c8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:47.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:47.333+0000 7feb8d400640 1 --2- 172.21.15.63:0/3986195099 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feb90156150 0x7feb900c8f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:47.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:47.333+0000 7feb8d400640 1 -- 172.21.15.63:0/3986195099 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb900716d0 msgr2=0x7feb900c8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:47.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:47.333+0000 7feb8d400640 1 --2- 172.21.15.63:0/3986195099 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb900716d0 0x7feb900c8530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:47.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:47.333+0000 7feb8d400640 1 -- 172.21.15.63:0/3986195099 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb9015fe20 con 0x7feb90073480 2024-05-21T01:26:47.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:47.333+0000 7feb8d400640 1 --2- 172.21.15.63:0/3986195099 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feb90073480 0x7feb9015f8e0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7feb7c0190a0 tx=0x7feb7c019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:47.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:47.333+0000 7feb86000640 1 -- 172.21.15.63:0/3986195099 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb7c0b0040 con 0x7feb90073480 2024-05-21T01:26:47.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:47.333+0000 7feb86000640 1 -- 172.21.15.63:0/3986195099 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb7c0b4620 con 0x7feb90073480 2024-05-21T01:26:47.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:47.333+0000 7feb86000640 1 -- 172.21.15.63:0/3986195099 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb7c0b4a10 con 0x7feb90073480 2024-05-21T01:26:47.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:47.333+0000 7feb94a00640 1 -- 172.21.15.63:0/3986195099 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb9015e5a0 con 0x7feb90073480 2024-05-21T01:26:47.341 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:47.337+0000 7feb94a00640 1 -- 172.21.15.63:0/3986195099 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb9015e840 con 0x7feb90073480 2024-05-21T01:26:47.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:47.337+0000 7feb94a00640 1 -- 172.21.15.63:0/3986195099 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb900507f0 con 0x7feb90073480 2024-05-21T01:26:47.342 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:47.337+0000 7feb86000640 1 -- 172.21.15.63:0/3986195099 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7feb7c0ab4c0 con 0x7feb90073480 2024-05-21T01:26:47.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:47.337+0000 7feb86000640 1 --2- 172.21.15.63:0/3986195099 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7feb7006f400 0x7feb700718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:26:47.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:47.337+0000 7feb86000640 1 -- 172.21.15.63:0/3986195099 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7feb7c129190 con 0x7feb90073480 2024-05-21T01:26:47.343 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:47.337+0000 7feb8de00640 1 --2- 172.21.15.63:0/3986195099 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7feb7006f400 0x7feb700718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:26:47.344 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:47.341+0000 7feb8de00640 1 --2- 172.21.15.63:0/3986195099 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7feb7006f400 0x7feb700718c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7feb800079c0 tx=0x7feb80008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:26:47.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:47.341+0000 7feb86000640 1 -- 172.21.15.63:0/3986195099 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7feb7c016110 con 0x7feb90073480 2024-05-21T01:26:47.507 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:47.501+0000 7feb94a00640 1 -- 172.21.15.63:0/3986195099 --> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7feb900746b0 con 0x7feb7006f400 2024-05-21T01:26:47.530 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:47.525+0000 7feb86000640 1 -- 172.21.15.63:0/3986195099 <== mgr.4103 v2:172.21.15.131:6832/921953667 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332278 (secure 0 0 0) 0x7feb900746b0 con 0x7feb7006f400 2024-05-21T01:26:47.531 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-05-21T01:26:47.536 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-05-21T01:26:47.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:47.529+0000 7feb94a00640 1 -- 172.21.15.63:0/3986195099 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7feb7006f400 msgr2=0x7feb700718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:47.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:47.529+0000 7feb94a00640 1 --2- 172.21.15.63:0/3986195099 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7feb7006f400 0x7feb700718c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7feb800079c0 tx=0x7feb80008040 comp rx=0 tx=0).stop 2024-05-21T01:26:47.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:47.529+0000 7feb94a00640 1 -- 172.21.15.63:0/3986195099 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feb90073480 msgr2=0x7feb9015f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:26:47.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:47.529+0000 7feb94a00640 1 --2- 172.21.15.63:0/3986195099 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feb90073480 0x7feb9015f8e0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7feb7c0190a0 tx=0x7feb7c019230 comp rx=0 tx=0).stop 2024-05-21T01:26:47.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:47.529+0000 7feb94a00640 1 -- 172.21.15.63:0/3986195099 shutdown_connections 2024-05-21T01:26:47.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:47.529+0000 7feb94a00640 1 --2- 172.21.15.63:0/3986195099 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7feb7006f400 0x7feb700718c0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:47.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:47.529+0000 7feb94a00640 1 --2- 172.21.15.63:0/3986195099 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7feb90156150 0x7feb900c8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:47.537 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:47.529+0000 7feb94a00640 1 --2- 172.21.15.63:0/3986195099 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feb90073480 0x7feb9015f8e0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:47.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:47.529+0000 7feb94a00640 1 --2- 172.21.15.63:0/3986195099 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb900716d0 0x7feb900c8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:26:47.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:47.529+0000 7feb94a00640 1 -- 172.21.15.63:0/3986195099 >> 172.21.15.63:0/3986195099 conn(0x7feb900cbf10 msgr2=0x7feb9006d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:26:47.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:47.529+0000 7feb94a00640 1 -- 172.21.15.63:0/3986195099 shutdown_connections 2024-05-21T01:26:47.538 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:26:47.529+0000 7feb94a00640 1 -- 172.21.15.63:0/3986195099 wait complete. 2024-05-21T01:26:47.555 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":230,"stamp":"2024-05-21T01:26:46.612154+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3437165,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":5199,"num_read_kb":21004348,"num_write":10912,"num_write_kb":25170463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11861,"ondisk_log_size":11861,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":383792,"kb_used_data":8048,"kb_used_omap":12,"kb_used_meta":375667,"kb_avail":754590928,"statfs":{"total":773094113280,"available":772701110272,"internally_reserved":0,"allocated":8241152,"data_stored":7806050,"data_compressed":66932,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12750,"internal_metadata":384683570},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":84,"apply_latency_ms":84,"commit_latency_ns":84000000,"apply_latency_ns":84000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-10737401657,"num_objects":-2560,"num_object_clones":0,"num_object_copies":-10240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2560,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":2585,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004899"},"pg_stats":[{"pgid":"2.1f","version":"25'9","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:07.489107+0000","last_change":"2024-05-21T01:19:53.545236+0000","last_active":"2024-05-21T01:24:07.489107+0000","last_peered":"2024-05-21T01:24:07.489107+0000","last_clean":"2024-05-21T01:24:07.489107+0000","last_became_active":"2024-05-21T01:19:53.544469+0000","last_became_peered":"2024-05-21T01:19:53.544469+0000","last_unstale":"2024-05-21T01:24:07.489107+0000","last_undegraded":"2024-05-21T01:24:07.489107+0000","last_fullsized":"2024-05-21T01:24:07.489107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:33:09.421287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"27'5","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:39.912966+0000","last_change":"2024-05-21T01:19:54.568235+0000","last_active":"2024-05-21T01:26:39.912966+0000","last_peered":"2024-05-21T01:26:39.912966+0000","last_clean":"2024-05-21T01:26:39.912966+0000","last_became_active":"2024-05-21T01:19:54.567245+0000","last_became_peered":"2024-05-21T01:19:54.567245+0000","last_unstale":"2024-05-21T01:26:39.912966+0000","last_undegraded":"2024-05-21T01:26:39.912966+0000","last_fullsized":"2024-05-21T01:26:39.912966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:39:51.222819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"27'327","reported_seq":523,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:37.844079+0000","last_change":"2024-05-21T01:19:58.618772+0000","last_active":"2024-05-21T01:26:37.844079+0000","last_peered":"2024-05-21T01:26:37.844079+0000","last_clean":"2024-05-21T01:26:37.844079+0000","last_became_active":"2024-05-21T01:19:58.617757+0000","last_became_peered":"2024-05-21T01:19:58.617757+0000","last_unstale":"2024-05-21T01:26:37.844079+0000","last_undegraded":"2024-05-21T01:26:37.844079+0000","last_fullsized":"2024-05-21T01:26:37.844079+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T13:07:31.666521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":176,"num_read_kb":720896,"num_write":306,"num_write_kb":835584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"25'2","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:23:53.495690+0000","last_change":"2024-05-21T01:19:53.551775+0000","last_active":"2024-05-21T01:23:53.495690+0000","last_peered":"2024-05-21T01:23:53.495690+0000","last_clean":"2024-05-21T01:23:53.495690+0000","last_became_active":"2024-05-21T01:19:53.551049+0000","last_became_peered":"2024-05-21T01:19:53.551049+0000","last_unstale":"2024-05-21T01:23:53.495690+0000","last_undegraded":"2024-05-21T01:23:53.495690+0000","last_fullsized":"2024-05-21T01:23:53.495690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:49:02.289202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"27'6","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:39.925423+0000","last_change":"2024-05-21T01:19:54.573420+0000","last_active":"2024-05-21T01:26:39.925423+0000","last_peered":"2024-05-21T01:26:39.925423+0000","last_clean":"2024-05-21T01:26:39.925423+0000","last_became_active":"2024-05-21T01:19:54.569573+0000","last_became_peered":"2024-05-21T01:19:54.569573+0000","last_unstale":"2024-05-21T01:26:39.925423+0000","last_undegraded":"2024-05-21T01:26:39.925423+0000","last_fullsized":"2024-05-21T01:26:39.925423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:00:12.257816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"27'351","reported_seq":568,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:38.419709+0000","last_change":"2024-05-21T01:19:58.604490+0000","last_active":"2024-05-21T01:26:38.419709+0000","last_peered":"2024-05-21T01:26:38.419709+0000","last_clean":"2024-05-21T01:26:38.419709+0000","last_became_active":"2024-05-21T01:19:58.604108+0000","last_became_peered":"2024-05-21T01:19:58.604108+0000","last_unstale":"2024-05-21T01:26:38.419709+0000","last_undegraded":"2024-05-21T01:26:38.419709+0000","last_fullsized":"2024-05-21T01:26:38.419709+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":196,"num_read_kb":802816,"num_write":339,"num_write_kb":925696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"27'5","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:54.543241+0000","last_change":"2024-05-21T01:19:53.525403+0000","last_active":"2024-05-21T01:24:54.543241+0000","last_peered":"2024-05-21T01:24:54.543241+0000","last_clean":"2024-05-21T01:24:54.543241+0000","last_became_active":"2024-05-21T01:19:53.521265+0000","last_became_peered":"2024-05-21T01:19:53.521265+0000","last_unstale":"2024-05-21T01:24:54.543241+0000","last_undegraded":"2024-05-21T01:24:54.543241+0000","last_fullsized":"2024-05-21T01:24:54.543241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"27'9","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:39.884601+0000","last_change":"2024-05-21T01:19:54.536436+0000","last_active":"2024-05-21T01:26:39.884601+0000","last_peered":"2024-05-21T01:26:39.884601+0000","last_clean":"2024-05-21T01:26:39.884601+0000","last_became_active":"2024-05-21T01:19:54.536061+0000","last_became_peered":"2024-05-21T01:19:54.536061+0000","last_unstale":"2024-05-21T01:26:39.884601+0000","last_undegraded":"2024-05-21T01:26:39.884601+0000","last_fullsized":"2024-05-21T01:26:39.884601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"27'291","reported_seq":461,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:38.395362+0000","last_change":"2024-05-21T01:19:58.623087+0000","last_active":"2024-05-21T01:26:38.395362+0000","last_peered":"2024-05-21T01:26:38.395362+0000","last_clean":"2024-05-21T01:26:38.395362+0000","last_became_active":"2024-05-21T01:19:58.622672+0000","last_became_peered":"2024-05-21T01:19:58.622672+0000","last_unstale":"2024-05-21T01:26:38.395362+0000","last_undegraded":"2024-05-21T01:26:38.395362+0000","last_fullsized":"2024-05-21T01:26:38.395362+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":149,"num_read_kb":610304,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:54.543216+0000","last_change":"2024-05-21T01:19:53.522497+0000","last_active":"2024-05-21T01:24:54.543216+0000","last_peered":"2024-05-21T01:24:54.543216+0000","last_clean":"2024-05-21T01:24:54.543216+0000","last_became_active":"2024-05-21T01:19:53.521684+0000","last_became_peered":"2024-05-21T01:19:53.521684+0000","last_unstale":"2024-05-21T01:24:54.543216+0000","last_undegraded":"2024-05-21T01:24:54.543216+0000","last_fullsized":"2024-05-21T01:24:54.543216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"27'15","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:39.907741+0000","last_change":"2024-05-21T01:19:54.549512+0000","last_active":"2024-05-21T01:26:39.907741+0000","last_peered":"2024-05-21T01:26:39.907741+0000","last_clean":"2024-05-21T01:26:39.907741+0000","last_became_active":"2024-05-21T01:19:54.549291+0000","last_became_peered":"2024-05-21T01:19:54.549291+0000","last_unstale":"2024-05-21T01:26:39.907741+0000","last_undegraded":"2024-05-21T01:26:39.907741+0000","last_fullsized":"2024-05-21T01:26:39.907741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:48:34.571236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"27'271","reported_seq":434,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:38.323101+0000","last_change":"2024-05-21T01:19:58.614748+0000","last_active":"2024-05-21T01:26:38.323101+0000","last_peered":"2024-05-21T01:26:38.323101+0000","last_clean":"2024-05-21T01:26:38.323101+0000","last_became_active":"2024-05-21T01:19:58.614313+0000","last_became_peered":"2024-05-21T01:19:58.614313+0000","last_unstale":"2024-05-21T01:26:38.323101+0000","last_undegraded":"2024-05-21T01:26:38.323101+0000","last_fullsized":"2024-05-21T01:26:38.323101+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":581632,"num_write":252,"num_write_kb":688128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"27'5","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:39.907885+0000","last_change":"2024-05-21T01:19:54.545467+0000","last_active":"2024-05-21T01:26:39.907885+0000","last_peered":"2024-05-21T01:26:39.907885+0000","last_clean":"2024-05-21T01:26:39.907885+0000","last_became_active":"2024-05-21T01:19:54.545181+0000","last_became_peered":"2024-05-21T01:19:54.545181+0000","last_unstale":"2024-05-21T01:26:39.907885+0000","last_undegraded":"2024-05-21T01:26:39.907885+0000","last_fullsized":"2024-05-21T01:26:39.907885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:43:15.387067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"27'5","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:24.595463+0000","last_change":"2024-05-21T01:19:53.536139+0000","last_active":"2024-05-21T01:24:24.595463+0000","last_peered":"2024-05-21T01:24:24.595463+0000","last_clean":"2024-05-21T01:24:24.595463+0000","last_became_active":"2024-05-21T01:19:53.535899+0000","last_became_peered":"2024-05-21T01:19:53.535899+0000","last_unstale":"2024-05-21T01:24:24.595463+0000","last_undegraded":"2024-05-21T01:24:24.595463+0000","last_fullsized":"2024-05-21T01:24:24.595463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:40:12.033744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"27'326","reported_seq":528,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:38.388137+0000","last_change":"2024-05-21T01:19:58.621487+0000","last_active":"2024-05-21T01:26:38.388137+0000","last_peered":"2024-05-21T01:26:38.388137+0000","last_clean":"2024-05-21T01:26:38.388137+0000","last_became_active":"2024-05-21T01:19:58.621083+0000","last_became_peered":"2024-05-21T01:19:58.621083+0000","last_unstale":"2024-05-21T01:26:38.388137+0000","last_undegraded":"2024-05-21T01:26:38.388137+0000","last_fullsized":"2024-05-21T01:26:38.388137+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:18:44.587274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":181,"num_read_kb":741376,"num_write":309,"num_write_kb":843776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"27'8","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:39.931806+0000","last_change":"2024-05-21T01:19:54.572420+0000","last_active":"2024-05-21T01:26:39.931806+0000","last_peered":"2024-05-21T01:26:39.931806+0000","last_clean":"2024-05-21T01:26:39.931806+0000","last_became_active":"2024-05-21T01:19:54.571863+0000","last_became_peered":"2024-05-21T01:19:54.571863+0000","last_unstale":"2024-05-21T01:26:39.931806+0000","last_undegraded":"2024-05-21T01:26:39.931806+0000","last_fullsized":"2024-05-21T01:26:39.931806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:13:52.491903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"27'3","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:13.507766+0000","last_change":"2024-05-21T01:19:53.553351+0000","last_active":"2024-05-21T01:24:13.507766+0000","last_peered":"2024-05-21T01:24:13.507766+0000","last_clean":"2024-05-21T01:24:13.507766+0000","last_became_active":"2024-05-21T01:19:53.552694+0000","last_became_peered":"2024-05-21T01:19:53.552694+0000","last_unstale":"2024-05-21T01:24:13.507766+0000","last_undegraded":"2024-05-21T01:24:13.507766+0000","last_fullsized":"2024-05-21T01:24:13.507766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:46:55.273278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"27'300","reported_seq":490,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:43.353619+0000","last_change":"2024-05-21T01:19:58.594904+0000","last_active":"2024-05-21T01:26:43.353619+0000","last_peered":"2024-05-21T01:26:43.353619+0000","last_clean":"2024-05-21T01:26:43.353619+0000","last_became_active":"2024-05-21T01:19:58.594450+0000","last_became_peered":"2024-05-21T01:19:58.594450+0000","last_unstale":"2024-05-21T01:26:43.353619+0000","last_undegraded":"2024-05-21T01:26:43.353619+0000","last_fullsized":"2024-05-21T01:26:43.353619+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":300,"log_dups_size":0,"ondisk_log_size":300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":688128,"num_write":291,"num_write_kb":794624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"27'9","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:39.933004+0000","last_change":"2024-05-21T01:19:54.554750+0000","last_active":"2024-05-21T01:26:39.933004+0000","last_peered":"2024-05-21T01:26:39.933004+0000","last_clean":"2024-05-21T01:26:39.933004+0000","last_became_active":"2024-05-21T01:19:54.551583+0000","last_became_peered":"2024-05-21T01:19:54.551583+0000","last_unstale":"2024-05-21T01:26:39.933004+0000","last_undegraded":"2024-05-21T01:26:39.933004+0000","last_fullsized":"2024-05-21T01:26:39.933004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:37:19.564099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"25'3","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:17.490604+0000","last_change":"2024-05-21T01:19:53.523277+0000","last_active":"2024-05-21T01:24:17.490604+0000","last_peered":"2024-05-21T01:24:17.490604+0000","last_clean":"2024-05-21T01:24:17.490604+0000","last_became_active":"2024-05-21T01:19:53.522525+0000","last_became_peered":"2024-05-21T01:19:53.522525+0000","last_unstale":"2024-05-21T01:24:17.490604+0000","last_undegraded":"2024-05-21T01:24:17.490604+0000","last_fullsized":"2024-05-21T01:24:17.490604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:23:59.949781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"27'286","reported_seq":464,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:37.867028+0000","last_change":"2024-05-21T01:19:58.615575+0000","last_active":"2024-05-21T01:26:37.867028+0000","last_peered":"2024-05-21T01:26:37.867028+0000","last_clean":"2024-05-21T01:26:37.867028+0000","last_became_active":"2024-05-21T01:19:58.614401+0000","last_became_peered":"2024-05-21T01:19:58.614401+0000","last_unstale":"2024-05-21T01:26:37.867028+0000","last_undegraded":"2024-05-21T01:26:37.867028+0000","last_fullsized":"2024-05-21T01:26:37.867028+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:51:09.839503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":158,"num_read_kb":647168,"num_write":267,"num_write_kb":729088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"27'2","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:39.930384+0000","last_change":"2024-05-21T01:19:54.555489+0000","last_active":"2024-05-21T01:26:39.930384+0000","last_peered":"2024-05-21T01:26:39.930384+0000","last_clean":"2024-05-21T01:26:39.930384+0000","last_became_active":"2024-05-21T01:19:54.555227+0000","last_became_peered":"2024-05-21T01:19:54.555227+0000","last_unstale":"2024-05-21T01:26:39.930384+0000","last_undegraded":"2024-05-21T01:26:39.930384+0000","last_fullsized":"2024-05-21T01:26:39.930384+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:00:22.873520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"25'2","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:24.551948+0000","last_change":"2024-05-21T01:19:53.520840+0000","last_active":"2024-05-21T01:26:24.551948+0000","last_peered":"2024-05-21T01:26:24.551948+0000","last_clean":"2024-05-21T01:26:24.551948+0000","last_became_active":"2024-05-21T01:19:53.520540+0000","last_became_peered":"2024-05-21T01:19:53.520540+0000","last_unstale":"2024-05-21T01:26:24.551948+0000","last_undegraded":"2024-05-21T01:26:24.551948+0000","last_fullsized":"2024-05-21T01:26:24.551948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"27'300","reported_seq":492,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:44.438167+0000","last_change":"2024-05-21T01:19:58.604357+0000","last_active":"2024-05-21T01:26:44.438167+0000","last_peered":"2024-05-21T01:26:44.438167+0000","last_clean":"2024-05-21T01:26:44.438167+0000","last_became_active":"2024-05-21T01:19:58.603922+0000","last_became_peered":"2024-05-21T01:19:58.603922+0000","last_unstale":"2024-05-21T01:26:44.438167+0000","last_undegraded":"2024-05-21T01:26:44.438167+0000","last_fullsized":"2024-05-21T01:26:44.438167+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":300,"log_dups_size":0,"ondisk_log_size":300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":170,"num_read_kb":696320,"num_write":288,"num_write_kb":786432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"27'7","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:39.932851+0000","last_change":"2024-05-21T01:19:54.569315+0000","last_active":"2024-05-21T01:26:39.932851+0000","last_peered":"2024-05-21T01:26:39.932851+0000","last_clean":"2024-05-21T01:26:39.932851+0000","last_became_active":"2024-05-21T01:19:54.568232+0000","last_became_peered":"2024-05-21T01:19:54.568232+0000","last_unstale":"2024-05-21T01:26:39.932851+0000","last_undegraded":"2024-05-21T01:26:39.932851+0000","last_fullsized":"2024-05-21T01:26:39.932851+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:19:01.819418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"27'5","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:24.626669+0000","last_change":"2024-05-21T01:19:53.525301+0000","last_active":"2024-05-21T01:26:24.626669+0000","last_peered":"2024-05-21T01:26:24.626669+0000","last_clean":"2024-05-21T01:26:24.626669+0000","last_became_active":"2024-05-21T01:19:53.525010+0000","last_became_peered":"2024-05-21T01:19:53.525010+0000","last_unstale":"2024-05-21T01:26:24.626669+0000","last_undegraded":"2024-05-21T01:26:24.626669+0000","last_fullsized":"2024-05-21T01:26:24.626669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:53:11.316975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"27'273","reported_seq":423,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:38.427390+0000","last_change":"2024-05-21T01:19:58.590354+0000","last_active":"2024-05-21T01:26:38.427390+0000","last_peered":"2024-05-21T01:26:38.427390+0000","last_clean":"2024-05-21T01:26:38.427390+0000","last_became_active":"2024-05-21T01:19:58.589985+0000","last_became_peered":"2024-05-21T01:19:58.589985+0000","last_unstale":"2024-05-21T01:26:38.427390+0000","last_undegraded":"2024-05-21T01:26:38.427390+0000","last_fullsized":"2024-05-21T01:26:38.427390+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":524288,"num_write":249,"num_write_kb":679936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"27'5","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:39.930538+0000","last_change":"2024-05-21T01:19:54.555318+0000","last_active":"2024-05-21T01:26:39.930538+0000","last_peered":"2024-05-21T01:26:39.930538+0000","last_clean":"2024-05-21T01:26:39.930538+0000","last_became_active":"2024-05-21T01:19:54.552947+0000","last_became_peered":"2024-05-21T01:19:54.552947+0000","last_unstale":"2024-05-21T01:26:39.930538+0000","last_undegraded":"2024-05-21T01:26:39.930538+0000","last_fullsized":"2024-05-21T01:26:39.930538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:29:24.153986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"27'33","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:39.741595+0000","last_change":"2024-05-21T01:19:53.525004+0000","last_active":"2024-05-21T01:26:39.741595+0000","last_peered":"2024-05-21T01:26:39.741595+0000","last_clean":"2024-05-21T01:26:39.741595+0000","last_became_active":"2024-05-21T01:19:53.521014+0000","last_became_peered":"2024-05-21T01:19:53.521014+0000","last_unstale":"2024-05-21T01:26:39.741595+0000","last_undegraded":"2024-05-21T01:26:39.741595+0000","last_fullsized":"2024-05-21T01:26:39.741595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:02:46.668320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"27'277","reported_seq":436,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:38.363312+0000","last_change":"2024-05-21T01:19:58.599880+0000","last_active":"2024-05-21T01:26:38.363312+0000","last_peered":"2024-05-21T01:26:38.363312+0000","last_clean":"2024-05-21T01:26:38.363312+0000","last_became_active":"2024-05-21T01:19:58.598712+0000","last_became_peered":"2024-05-21T01:19:58.598712+0000","last_unstale":"2024-05-21T01:26:38.363312+0000","last_undegraded":"2024-05-21T01:26:38.363312+0000","last_fullsized":"2024-05-21T01:26:38.363312+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:43:05.995986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":565248,"num_write":264,"num_write_kb":720896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"27'9","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:39.921996+0000","last_change":"2024-05-21T01:19:54.576044+0000","last_active":"2024-05-21T01:26:39.921996+0000","last_peered":"2024-05-21T01:26:39.921996+0000","last_clean":"2024-05-21T01:26:39.921996+0000","last_became_active":"2024-05-21T01:19:54.575543+0000","last_became_peered":"2024-05-21T01:19:54.575543+0000","last_unstale":"2024-05-21T01:26:39.921996+0000","last_undegraded":"2024-05-21T01:26:39.921996+0000","last_fullsized":"2024-05-21T01:26:39.921996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T09:33:07.188470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"25'1","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:04.555386+0000","last_change":"2024-05-21T01:19:53.543705+0000","last_active":"2024-05-21T01:24:04.555386+0000","last_peered":"2024-05-21T01:24:04.555386+0000","last_clean":"2024-05-21T01:24:04.555386+0000","last_became_active":"2024-05-21T01:19:53.543450+0000","last_became_peered":"2024-05-21T01:19:53.543450+0000","last_unstale":"2024-05-21T01:24:04.555386+0000","last_undegraded":"2024-05-21T01:24:04.555386+0000","last_fullsized":"2024-05-21T01:24:04.555386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:05:49.465156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"27'267","reported_seq":424,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:38.308781+0000","last_change":"2024-05-21T01:19:58.612049+0000","last_active":"2024-05-21T01:26:38.308781+0000","last_peered":"2024-05-21T01:26:38.308781+0000","last_clean":"2024-05-21T01:26:38.308781+0000","last_became_active":"2024-05-21T01:19:58.610837+0000","last_became_peered":"2024-05-21T01:19:58.610837+0000","last_unstale":"2024-05-21T01:26:38.308781+0000","last_undegraded":"2024-05-21T01:26:38.308781+0000","last_fullsized":"2024-05-21T01:26:38.308781+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":267,"log_dups_size":0,"ondisk_log_size":267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:24:14.332056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":557056,"num_write":249,"num_write_kb":679936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"27'5","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:39.917973+0000","last_change":"2024-05-21T01:19:54.553083+0000","last_active":"2024-05-21T01:26:39.917973+0000","last_peered":"2024-05-21T01:26:39.917973+0000","last_clean":"2024-05-21T01:26:39.917973+0000","last_became_active":"2024-05-21T01:19:54.552812+0000","last_became_peered":"2024-05-21T01:19:54.552812+0000","last_unstale":"2024-05-21T01:26:39.917973+0000","last_undegraded":"2024-05-21T01:26:39.917973+0000","last_fullsized":"2024-05-21T01:26:39.917973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:03.497940+0000","last_change":"2024-05-21T01:19:53.551697+0000","last_active":"2024-05-21T01:24:03.497940+0000","last_peered":"2024-05-21T01:24:03.497940+0000","last_clean":"2024-05-21T01:24:03.497940+0000","last_became_active":"2024-05-21T01:19:53.550921+0000","last_became_peered":"2024-05-21T01:19:53.550921+0000","last_unstale":"2024-05-21T01:24:03.497940+0000","last_undegraded":"2024-05-21T01:24:03.497940+0000","last_fullsized":"2024-05-21T01:24:03.497940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T09:31:31.996638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"27'289","reported_seq":468,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:38.366664+0000","last_change":"2024-05-21T01:19:58.626472+0000","last_active":"2024-05-21T01:26:38.366664+0000","last_peered":"2024-05-21T01:26:38.366664+0000","last_clean":"2024-05-21T01:26:38.366664+0000","last_became_active":"2024-05-21T01:19:58.625720+0000","last_became_peered":"2024-05-21T01:19:58.625720+0000","last_unstale":"2024-05-21T01:26:38.366664+0000","last_undegraded":"2024-05-21T01:26:38.366664+0000","last_fullsized":"2024-05-21T01:26:38.366664+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":289,"log_dups_size":0,"ondisk_log_size":289,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:16:03.911585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":158,"num_read_kb":647168,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"27'7","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:39.912789+0000","last_change":"2024-05-21T01:19:54.547947+0000","last_active":"2024-05-21T01:26:39.912789+0000","last_peered":"2024-05-21T01:26:39.912789+0000","last_clean":"2024-05-21T01:26:39.912789+0000","last_became_active":"2024-05-21T01:19:54.547689+0000","last_became_peered":"2024-05-21T01:19:54.547689+0000","last_unstale":"2024-05-21T01:26:39.912789+0000","last_undegraded":"2024-05-21T01:26:39.912789+0000","last_fullsized":"2024-05-21T01:26:39.912789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"25'1","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:04.555333+0000","last_change":"2024-05-21T01:19:53.540973+0000","last_active":"2024-05-21T01:24:04.555333+0000","last_peered":"2024-05-21T01:24:04.555333+0000","last_clean":"2024-05-21T01:24:04.555333+0000","last_became_active":"2024-05-21T01:19:53.540670+0000","last_became_peered":"2024-05-21T01:19:53.540670+0000","last_unstale":"2024-05-21T01:24:04.555333+0000","last_undegraded":"2024-05-21T01:24:04.555333+0000","last_fullsized":"2024-05-21T01:24:04.555333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:08:21.802284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"27'277","reported_seq":446,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:38.380089+0000","last_change":"2024-05-21T01:19:58.611280+0000","last_active":"2024-05-21T01:26:38.380089+0000","last_peered":"2024-05-21T01:26:38.380089+0000","last_clean":"2024-05-21T01:26:38.380089+0000","last_became_active":"2024-05-21T01:19:58.610511+0000","last_became_peered":"2024-05-21T01:19:58.610511+0000","last_unstale":"2024-05-21T01:26:38.380089+0000","last_undegraded":"2024-05-21T01:26:38.380089+0000","last_fullsized":"2024-05-21T01:26:38.380089+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:49:19.660422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":606208,"num_write":264,"num_write_kb":720896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"27'8","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:39.927130+0000","last_change":"2024-05-21T01:19:54.572546+0000","last_active":"2024-05-21T01:26:39.927130+0000","last_peered":"2024-05-21T01:26:39.927130+0000","last_clean":"2024-05-21T01:26:39.927130+0000","last_became_active":"2024-05-21T01:19:54.572022+0000","last_became_peered":"2024-05-21T01:19:54.572022+0000","last_unstale":"2024-05-21T01:26:39.927130+0000","last_undegraded":"2024-05-21T01:26:39.927130+0000","last_fullsized":"2024-05-21T01:26:39.927130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:50:08.351383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"27'10","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:40.062540+0000","last_change":"2024-05-21T01:19:53.556786+0000","last_active":"2024-05-21T01:26:40.062540+0000","last_peered":"2024-05-21T01:26:40.062540+0000","last_clean":"2024-05-21T01:26:40.062540+0000","last_became_active":"2024-05-21T01:19:53.556143+0000","last_became_peered":"2024-05-21T01:19:53.556143+0000","last_unstale":"2024-05-21T01:26:40.062540+0000","last_undegraded":"2024-05-21T01:26:40.062540+0000","last_fullsized":"2024-05-21T01:26:40.062540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:02:17.391701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":619,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"27'289","reported_seq":452,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:38.385695+0000","last_change":"2024-05-21T01:19:58.599203+0000","last_active":"2024-05-21T01:26:38.385695+0000","last_peered":"2024-05-21T01:26:38.385695+0000","last_clean":"2024-05-21T01:26:38.385695+0000","last_became_active":"2024-05-21T01:19:58.598175+0000","last_became_peered":"2024-05-21T01:19:58.598175+0000","last_unstale":"2024-05-21T01:26:38.385695+0000","last_undegraded":"2024-05-21T01:26:38.385695+0000","last_fullsized":"2024-05-21T01:26:38.385695+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":289,"log_dups_size":0,"ondisk_log_size":289,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:45:17.138090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":581632,"num_write":270,"num_write_kb":737280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"27'5","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:39.917607+0000","last_change":"2024-05-21T01:19:54.551092+0000","last_active":"2024-05-21T01:26:39.917607+0000","last_peered":"2024-05-21T01:26:39.917607+0000","last_clean":"2024-05-21T01:26:39.917607+0000","last_became_active":"2024-05-21T01:19:54.550338+0000","last_became_peered":"2024-05-21T01:19:54.550338+0000","last_unstale":"2024-05-21T01:26:39.917607+0000","last_undegraded":"2024-05-21T01:26:39.917607+0000","last_fullsized":"2024-05-21T01:26:39.917607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:29:13.540719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"25'3","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:23:54.554210+0000","last_change":"2024-05-21T01:19:53.554835+0000","last_active":"2024-05-21T01:23:54.554210+0000","last_peered":"2024-05-21T01:23:54.554210+0000","last_clean":"2024-05-21T01:23:54.554210+0000","last_became_active":"2024-05-21T01:19:53.554598+0000","last_became_peered":"2024-05-21T01:19:53.554598+0000","last_unstale":"2024-05-21T01:23:54.554210+0000","last_undegraded":"2024-05-21T01:23:54.554210+0000","last_fullsized":"2024-05-21T01:23:54.554210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:28:43.940978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"27'351","reported_seq":558,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:38.359893+0000","last_change":"2024-05-21T01:19:58.629747+0000","last_active":"2024-05-21T01:26:38.359893+0000","last_peered":"2024-05-21T01:26:38.359893+0000","last_clean":"2024-05-21T01:26:38.359893+0000","last_became_active":"2024-05-21T01:19:58.622106+0000","last_became_peered":"2024-05-21T01:19:58.622106+0000","last_unstale":"2024-05-21T01:26:38.359893+0000","last_undegraded":"2024-05-21T01:26:38.359893+0000","last_fullsized":"2024-05-21T01:26:38.359893+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:22:07.047914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":761856,"num_write":339,"num_write_kb":925696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"27'8","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:39.927850+0000","last_change":"2024-05-21T01:19:54.554303+0000","last_active":"2024-05-21T01:26:39.927850+0000","last_peered":"2024-05-21T01:26:39.927850+0000","last_clean":"2024-05-21T01:26:39.927850+0000","last_became_active":"2024-05-21T01:19:54.552126+0000","last_became_peered":"2024-05-21T01:19:54.552126+0000","last_unstale":"2024-05-21T01:26:39.927850+0000","last_undegraded":"2024-05-21T01:26:39.927850+0000","last_fullsized":"2024-05-21T01:26:39.927850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:59:46.383359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"25'3","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:04.555354+0000","last_change":"2024-05-21T01:19:53.536580+0000","last_active":"2024-05-21T01:24:04.555354+0000","last_peered":"2024-05-21T01:24:04.555354+0000","last_clean":"2024-05-21T01:24:04.555354+0000","last_became_active":"2024-05-21T01:19:53.535105+0000","last_became_peered":"2024-05-21T01:19:53.535105+0000","last_unstale":"2024-05-21T01:24:04.555354+0000","last_undegraded":"2024-05-21T01:24:04.555354+0000","last_fullsized":"2024-05-21T01:24:04.555354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:58:05.019025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":126,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:25:49.533168+0000","last_change":"2024-05-21T01:19:49.490062+0000","last_active":"2024-05-21T01:25:49.533168+0000","last_peered":"2024-05-21T01:25:49.533168+0000","last_clean":"2024-05-21T01:25:49.533168+0000","last_became_active":"2024-05-21T01:19:49.488796+0000","last_became_peered":"2024-05-21T01:19:49.488796+0000","last_unstale":"2024-05-21T01:25:49.533168+0000","last_undegraded":"2024-05-21T01:25:49.533168+0000","last_fullsized":"2024-05-21T01:25:49.533168+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:47.457865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:47.457865+0000","last_clean_scrub_stamp":"2024-05-21T01:19:47.457865+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"27'292","reported_seq":468,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:38.382121+0000","last_change":"2024-05-21T01:19:58.590851+0000","last_active":"2024-05-21T01:26:38.382121+0000","last_peered":"2024-05-21T01:26:38.382121+0000","last_clean":"2024-05-21T01:26:38.382121+0000","last_became_active":"2024-05-21T01:19:58.589288+0000","last_became_peered":"2024-05-21T01:19:58.589288+0000","last_unstale":"2024-05-21T01:26:38.382121+0000","last_undegraded":"2024-05-21T01:26:38.382121+0000","last_fullsized":"2024-05-21T01:26:38.382121+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":292,"log_dups_size":0,"ondisk_log_size":292,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:36:46.992834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":155,"num_read_kb":634880,"num_write":276,"num_write_kb":753664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"27'7","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:39.902599+0000","last_change":"2024-05-21T01:19:54.543894+0000","last_active":"2024-05-21T01:26:39.902599+0000","last_peered":"2024-05-21T01:26:39.902599+0000","last_clean":"2024-05-21T01:26:39.902599+0000","last_became_active":"2024-05-21T01:19:54.543586+0000","last_became_peered":"2024-05-21T01:19:54.543586+0000","last_unstale":"2024-05-21T01:26:39.902599+0000","last_undegraded":"2024-05-21T01:26:39.902599+0000","last_fullsized":"2024-05-21T01:26:39.902599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:33:02.756634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"25'3","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:23.509317+0000","last_change":"2024-05-21T01:19:53.532115+0000","last_active":"2024-05-21T01:24:23.509317+0000","last_peered":"2024-05-21T01:24:23.509317+0000","last_clean":"2024-05-21T01:24:23.509317+0000","last_became_active":"2024-05-21T01:19:53.529879+0000","last_became_peered":"2024-05-21T01:19:53.529879+0000","last_unstale":"2024-05-21T01:24:23.509317+0000","last_undegraded":"2024-05-21T01:24:23.509317+0000","last_fullsized":"2024-05-21T01:24:23.509317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:42:07.436243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"27'301","reported_seq":483,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:38.413030+0000","last_change":"2024-05-21T01:19:58.604417+0000","last_active":"2024-05-21T01:26:38.413030+0000","last_peered":"2024-05-21T01:26:38.413030+0000","last_clean":"2024-05-21T01:26:38.413030+0000","last_became_active":"2024-05-21T01:19:58.603929+0000","last_became_peered":"2024-05-21T01:19:58.603929+0000","last_unstale":"2024-05-21T01:26:38.413030+0000","last_undegraded":"2024-05-21T01:26:38.413030+0000","last_fullsized":"2024-05-21T01:26:38.413030+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":301,"log_dups_size":0,"ondisk_log_size":301,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":655360,"num_write":279,"num_write_kb":761856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"27'6","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:39.916718+0000","last_change":"2024-05-21T01:19:54.542096+0000","last_active":"2024-05-21T01:26:39.916718+0000","last_peered":"2024-05-21T01:26:39.916718+0000","last_clean":"2024-05-21T01:26:39.916718+0000","last_became_active":"2024-05-21T01:19:54.541837+0000","last_became_peered":"2024-05-21T01:19:54.541837+0000","last_unstale":"2024-05-21T01:26:39.916718+0000","last_undegraded":"2024-05-21T01:26:39.916718+0000","last_fullsized":"2024-05-21T01:26:39.916718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:23.503932+0000","last_change":"2024-05-21T01:19:53.551697+0000","last_active":"2024-05-21T01:24:23.503932+0000","last_peered":"2024-05-21T01:24:23.503932+0000","last_clean":"2024-05-21T01:24:23.503932+0000","last_became_active":"2024-05-21T01:19:53.550893+0000","last_became_peered":"2024-05-21T01:19:53.550893+0000","last_unstale":"2024-05-21T01:24:23.503932+0000","last_undegraded":"2024-05-21T01:24:23.503932+0000","last_fullsized":"2024-05-21T01:24:23.503932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:42:20.295229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"27'271","reported_seq":434,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:38.410135+0000","last_change":"2024-05-21T01:19:58.628526+0000","last_active":"2024-05-21T01:26:38.410135+0000","last_peered":"2024-05-21T01:26:38.410135+0000","last_clean":"2024-05-21T01:26:38.410135+0000","last_became_active":"2024-05-21T01:19:58.620667+0000","last_became_peered":"2024-05-21T01:19:58.620667+0000","last_unstale":"2024-05-21T01:26:38.410135+0000","last_undegraded":"2024-05-21T01:26:38.410135+0000","last_fullsized":"2024-05-21T01:26:38.410135+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:46:22.396063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":581632,"num_write":261,"num_write_kb":712704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"27'9","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:39.914405+0000","last_change":"2024-05-21T01:19:54.532551+0000","last_active":"2024-05-21T01:26:39.914405+0000","last_peered":"2024-05-21T01:26:39.914405+0000","last_clean":"2024-05-21T01:26:39.914405+0000","last_became_active":"2024-05-21T01:19:54.532251+0000","last_became_peered":"2024-05-21T01:19:54.532251+0000","last_unstale":"2024-05-21T01:26:39.914405+0000","last_undegraded":"2024-05-21T01:26:39.914405+0000","last_fullsized":"2024-05-21T01:26:39.914405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:27.492487+0000","last_change":"2024-05-21T01:19:53.554659+0000","last_active":"2024-05-21T01:24:27.492487+0000","last_peered":"2024-05-21T01:24:27.492487+0000","last_clean":"2024-05-21T01:24:27.492487+0000","last_became_active":"2024-05-21T01:19:53.553953+0000","last_became_peered":"2024-05-21T01:19:53.553953+0000","last_unstale":"2024-05-21T01:24:27.492487+0000","last_undegraded":"2024-05-21T01:24:27.492487+0000","last_fullsized":"2024-05-21T01:24:27.492487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:31:13.091061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"27'333","reported_seq":524,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:38.339710+0000","last_change":"2024-05-21T01:19:58.593243+0000","last_active":"2024-05-21T01:26:38.339710+0000","last_peered":"2024-05-21T01:26:38.339710+0000","last_clean":"2024-05-21T01:26:38.339710+0000","last_became_active":"2024-05-21T01:19:58.592758+0000","last_became_peered":"2024-05-21T01:19:58.592758+0000","last_unstale":"2024-05-21T01:26:38.339710+0000","last_undegraded":"2024-05-21T01:26:38.339710+0000","last_fullsized":"2024-05-21T01:26:38.339710+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":333,"log_dups_size":0,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:46:17.877736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":170,"num_read_kb":696320,"num_write":318,"num_write_kb":868352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"27'5","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:39.884954+0000","last_change":"2024-05-21T01:19:54.538391+0000","last_active":"2024-05-21T01:26:39.884954+0000","last_peered":"2024-05-21T01:26:39.884954+0000","last_clean":"2024-05-21T01:26:39.884954+0000","last_became_active":"2024-05-21T01:19:54.538106+0000","last_became_peered":"2024-05-21T01:19:54.538106+0000","last_unstale":"2024-05-21T01:26:39.884954+0000","last_undegraded":"2024-05-21T01:26:39.884954+0000","last_fullsized":"2024-05-21T01:26:39.884954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"25'2","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:39.553455+0000","last_change":"2024-05-21T01:19:53.551917+0000","last_active":"2024-05-21T01:26:39.553455+0000","last_peered":"2024-05-21T01:26:39.553455+0000","last_clean":"2024-05-21T01:26:39.553455+0000","last_became_active":"2024-05-21T01:19:53.551608+0000","last_became_peered":"2024-05-21T01:19:53.551608+0000","last_unstale":"2024-05-21T01:26:39.553455+0000","last_undegraded":"2024-05-21T01:26:39.553455+0000","last_fullsized":"2024-05-21T01:26:39.553455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"27'274","reported_seq":431,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:38.353194+0000","last_change":"2024-05-21T01:19:58.613367+0000","last_active":"2024-05-21T01:26:38.353194+0000","last_peered":"2024-05-21T01:26:38.353194+0000","last_clean":"2024-05-21T01:26:38.353194+0000","last_became_active":"2024-05-21T01:19:58.612950+0000","last_became_peered":"2024-05-21T01:19:58.612950+0000","last_unstale":"2024-05-21T01:26:38.353194+0000","last_undegraded":"2024-05-21T01:26:38.353194+0000","last_fullsized":"2024-05-21T01:26:38.353194+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":135,"num_read_kb":552960,"num_write":258,"num_write_kb":704512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"27'6","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:39.901503+0000","last_change":"2024-05-21T01:19:54.548979+0000","last_active":"2024-05-21T01:26:39.901503+0000","last_peered":"2024-05-21T01:26:39.901503+0000","last_clean":"2024-05-21T01:26:39.901503+0000","last_became_active":"2024-05-21T01:19:54.548704+0000","last_became_peered":"2024-05-21T01:19:54.548704+0000","last_unstale":"2024-05-21T01:26:39.901503+0000","last_undegraded":"2024-05-21T01:26:39.901503+0000","last_fullsized":"2024-05-21T01:26:39.901503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:57:09.076705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"27'16","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:37.495262+0000","last_change":"2024-05-21T01:19:53.542425+0000","last_active":"2024-05-21T01:24:37.495262+0000","last_peered":"2024-05-21T01:24:37.495262+0000","last_clean":"2024-05-21T01:24:37.495262+0000","last_became_active":"2024-05-21T01:19:53.541577+0000","last_became_peered":"2024-05-21T01:19:53.541577+0000","last_unstale":"2024-05-21T01:24:37.495262+0000","last_undegraded":"2024-05-21T01:24:37.495262+0000","last_fullsized":"2024-05-21T01:24:37.495262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:47:54.892789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"27'384","reported_seq":612,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:38.426942+0000","last_change":"2024-05-21T01:20:43.554019+0000","last_active":"2024-05-21T01:26:38.426942+0000","last_peered":"2024-05-21T01:26:38.426942+0000","last_clean":"2024-05-21T01:26:38.426942+0000","last_became_active":"2024-05-21T01:20:43.553035+0000","last_became_peered":"2024-05-21T01:20:43.553035+0000","last_unstale":"2024-05-21T01:26:38.426942+0000","last_undegraded":"2024-05-21T01:26:38.426942+0000","last_fullsized":"2024-05-21T01:26:38.426942+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:00:23.785030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":201,"num_read_kb":823296,"num_write":360,"num_write_kb":983040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1,6],"acting":[5,0,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"27'6","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:39.916609+0000","last_change":"2024-05-21T01:19:54.575541+0000","last_active":"2024-05-21T01:26:39.916609+0000","last_peered":"2024-05-21T01:26:39.916609+0000","last_clean":"2024-05-21T01:26:39.916609+0000","last_became_active":"2024-05-21T01:19:54.575314+0000","last_became_peered":"2024-05-21T01:19:54.575314+0000","last_unstale":"2024-05-21T01:26:39.916609+0000","last_undegraded":"2024-05-21T01:26:39.916609+0000","last_fullsized":"2024-05-21T01:26:39.916609+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"25'3","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:34.538015+0000","last_change":"2024-05-21T01:19:53.523758+0000","last_active":"2024-05-21T01:24:34.538015+0000","last_peered":"2024-05-21T01:24:34.538015+0000","last_clean":"2024-05-21T01:24:34.538015+0000","last_became_active":"2024-05-21T01:19:53.523273+0000","last_became_peered":"2024-05-21T01:19:53.523273+0000","last_unstale":"2024-05-21T01:24:34.538015+0000","last_undegraded":"2024-05-21T01:24:34.538015+0000","last_fullsized":"2024-05-21T01:24:34.538015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"27'288","reported_seq":455,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:38.413187+0000","last_change":"2024-05-21T01:19:58.621996+0000","last_active":"2024-05-21T01:26:38.413187+0000","last_peered":"2024-05-21T01:26:38.413187+0000","last_clean":"2024-05-21T01:26:38.413187+0000","last_became_active":"2024-05-21T01:19:58.620552+0000","last_became_peered":"2024-05-21T01:19:58.620552+0000","last_unstale":"2024-05-21T01:26:38.413187+0000","last_undegraded":"2024-05-21T01:26:38.413187+0000","last_fullsized":"2024-05-21T01:26:38.413187+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:58:32.635003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":602112,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"27'15","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:39.913201+0000","last_change":"2024-05-21T01:19:54.557379+0000","last_active":"2024-05-21T01:26:39.913201+0000","last_peered":"2024-05-21T01:26:39.913201+0000","last_clean":"2024-05-21T01:26:39.913201+0000","last_became_active":"2024-05-21T01:19:54.550335+0000","last_became_peered":"2024-05-21T01:19:54.550335+0000","last_unstale":"2024-05-21T01:26:39.913201+0000","last_undegraded":"2024-05-21T01:26:39.913201+0000","last_fullsized":"2024-05-21T01:26:39.913201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:24:52.297888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"25'3","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:14.476584+0000","last_change":"2024-05-21T01:19:53.534431+0000","last_active":"2024-05-21T01:22:14.476584+0000","last_peered":"2024-05-21T01:22:14.476584+0000","last_clean":"2024-05-21T01:22:14.476584+0000","last_became_active":"2024-05-21T01:19:53.534174+0000","last_became_peered":"2024-05-21T01:19:53.534174+0000","last_unstale":"2024-05-21T01:22:14.476584+0000","last_undegraded":"2024-05-21T01:22:14.476584+0000","last_fullsized":"2024-05-21T01:22:14.476584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:42:04.743914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"27'287","reported_seq":453,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:37.857440+0000","last_change":"2024-05-21T01:19:58.609289+0000","last_active":"2024-05-21T01:26:37.857440+0000","last_peered":"2024-05-21T01:26:37.857440+0000","last_clean":"2024-05-21T01:26:37.857440+0000","last_became_active":"2024-05-21T01:19:58.608371+0000","last_became_peered":"2024-05-21T01:19:58.608371+0000","last_unstale":"2024-05-21T01:26:37.857440+0000","last_undegraded":"2024-05-21T01:26:37.857440+0000","last_fullsized":"2024-05-21T01:26:37.857440+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":287,"log_dups_size":0,"ondisk_log_size":287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:27:36.997803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":598016,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"27'10","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:39.923940+0000","last_change":"2024-05-21T01:19:54.551617+0000","last_active":"2024-05-21T01:26:39.923940+0000","last_peered":"2024-05-21T01:26:39.923940+0000","last_clean":"2024-05-21T01:26:39.923940+0000","last_became_active":"2024-05-21T01:19:54.550865+0000","last_became_peered":"2024-05-21T01:19:54.550865+0000","last_unstale":"2024-05-21T01:26:39.923940+0000","last_undegraded":"2024-05-21T01:26:39.923940+0000","last_fullsized":"2024-05-21T01:26:39.923940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:32:44.168265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"25'6","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:17.471297+0000","last_change":"2024-05-21T01:19:53.535936+0000","last_active":"2024-05-21T01:22:17.471297+0000","last_peered":"2024-05-21T01:22:17.471297+0000","last_clean":"2024-05-21T01:22:17.471297+0000","last_became_active":"2024-05-21T01:19:53.535143+0000","last_became_peered":"2024-05-21T01:19:53.535143+0000","last_unstale":"2024-05-21T01:22:17.471297+0000","last_undegraded":"2024-05-21T01:22:17.471297+0000","last_fullsized":"2024-05-21T01:22:17.471297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:50:51.433726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"27'338","reported_seq":542,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:37.816577+0000","last_change":"2024-05-21T01:19:58.622615+0000","last_active":"2024-05-21T01:26:37.816577+0000","last_peered":"2024-05-21T01:26:37.816577+0000","last_clean":"2024-05-21T01:26:37.816577+0000","last_became_active":"2024-05-21T01:19:58.622250+0000","last_became_peered":"2024-05-21T01:19:58.622250+0000","last_unstale":"2024-05-21T01:26:37.816577+0000","last_undegraded":"2024-05-21T01:26:37.816577+0000","last_fullsized":"2024-05-21T01:26:37.816577+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:05:22.913945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":184,"num_read_kb":753664,"num_write":327,"num_write_kb":892928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"27'6","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:39.926182+0000","last_change":"2024-05-21T01:19:54.558348+0000","last_active":"2024-05-21T01:26:39.926182+0000","last_peered":"2024-05-21T01:26:39.926182+0000","last_clean":"2024-05-21T01:26:39.926182+0000","last_became_active":"2024-05-21T01:19:54.558095+0000","last_became_peered":"2024-05-21T01:19:54.558095+0000","last_unstale":"2024-05-21T01:26:39.926182+0000","last_undegraded":"2024-05-21T01:26:39.926182+0000","last_fullsized":"2024-05-21T01:26:39.926182+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'1403","reported_seq":1432,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:40.465724+0000","last_change":"2024-05-21T01:19:53.534947+0000","last_active":"2024-05-21T01:26:40.465724+0000","last_peered":"2024-05-21T01:26:40.465724+0000","last_clean":"2024-05-21T01:26:40.465724+0000","last_became_active":"2024-05-21T01:19:53.534616+0000","last_became_peered":"2024-05-21T01:19:53.534616+0000","last_unstale":"2024-05-21T01:26:40.465724+0000","last_undegraded":"2024-05-21T01:26:40.465724+0000","last_fullsized":"2024-05-21T01:26:40.465724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":1403,"log_dups_size":0,"ondisk_log_size":1403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2842259,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1403,"num_write_kb":2944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"27'304","reported_seq":484,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:38.377887+0000","last_change":"2024-05-21T01:19:58.617970+0000","last_active":"2024-05-21T01:26:38.377887+0000","last_peered":"2024-05-21T01:26:38.377887+0000","last_clean":"2024-05-21T01:26:38.377887+0000","last_became_active":"2024-05-21T01:19:58.617061+0000","last_became_peered":"2024-05-21T01:19:58.617061+0000","last_unstale":"2024-05-21T01:26:38.377887+0000","last_undegraded":"2024-05-21T01:26:38.377887+0000","last_fullsized":"2024-05-21T01:26:38.377887+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:48:50.703577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":655360,"num_write":288,"num_write_kb":786432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"27'11","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:39.903404+0000","last_change":"2024-05-21T01:19:54.557175+0000","last_active":"2024-05-21T01:26:39.903404+0000","last_peered":"2024-05-21T01:26:39.903404+0000","last_clean":"2024-05-21T01:26:39.903404+0000","last_became_active":"2024-05-21T01:19:54.556933+0000","last_became_peered":"2024-05-21T01:19:54.556933+0000","last_unstale":"2024-05-21T01:26:39.903404+0000","last_undegraded":"2024-05-21T01:26:39.903404+0000","last_fullsized":"2024-05-21T01:26:39.903404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:15:44.089544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"27'9","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:39.154812+0000","last_change":"2024-05-21T01:19:53.536780+0000","last_active":"2024-05-21T01:26:39.154812+0000","last_peered":"2024-05-21T01:26:39.154812+0000","last_clean":"2024-05-21T01:26:39.154812+0000","last_became_active":"2024-05-21T01:19:53.535768+0000","last_became_peered":"2024-05-21T01:19:53.535768+0000","last_unstale":"2024-05-21T01:26:39.154812+0000","last_undegraded":"2024-05-21T01:26:39.154812+0000","last_fullsized":"2024-05-21T01:26:39.154812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:04:14.732801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"27'320","reported_seq":515,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:38.385952+0000","last_change":"2024-05-21T01:19:58.606532+0000","last_active":"2024-05-21T01:26:38.385952+0000","last_peered":"2024-05-21T01:26:38.385952+0000","last_clean":"2024-05-21T01:26:38.385952+0000","last_became_active":"2024-05-21T01:19:58.606180+0000","last_became_peered":"2024-05-21T01:19:58.606180+0000","last_unstale":"2024-05-21T01:26:38.385952+0000","last_undegraded":"2024-05-21T01:26:38.385952+0000","last_fullsized":"2024-05-21T01:26:38.385952+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":174,"num_read_kb":712704,"num_write":297,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"27'9","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:39.923347+0000","last_change":"2024-05-21T01:19:54.571280+0000","last_active":"2024-05-21T01:26:39.923347+0000","last_peered":"2024-05-21T01:26:39.923347+0000","last_clean":"2024-05-21T01:26:39.923347+0000","last_became_active":"2024-05-21T01:19:54.568778+0000","last_became_peered":"2024-05-21T01:19:54.568778+0000","last_unstale":"2024-05-21T01:26:39.923347+0000","last_undegraded":"2024-05-21T01:26:39.923347+0000","last_fullsized":"2024-05-21T01:26:39.923347+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:43:16.583632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"25'2","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:44.542314+0000","last_change":"2024-05-21T01:19:53.530770+0000","last_active":"2024-05-21T01:24:44.542314+0000","last_peered":"2024-05-21T01:24:44.542314+0000","last_clean":"2024-05-21T01:24:44.542314+0000","last_became_active":"2024-05-21T01:19:53.526431+0000","last_became_peered":"2024-05-21T01:19:53.526431+0000","last_unstale":"2024-05-21T01:24:44.542314+0000","last_undegraded":"2024-05-21T01:24:44.542314+0000","last_fullsized":"2024-05-21T01:24:44.542314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"27'316","reported_seq":490,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:38.258677+0000","last_change":"2024-05-21T01:19:58.611576+0000","last_active":"2024-05-21T01:26:38.258677+0000","last_peered":"2024-05-21T01:26:38.258677+0000","last_clean":"2024-05-21T01:26:38.258677+0000","last_became_active":"2024-05-21T01:19:58.610838+0000","last_became_peered":"2024-05-21T01:19:58.610838+0000","last_unstale":"2024-05-21T01:26:38.258677+0000","last_undegraded":"2024-05-21T01:26:38.258677+0000","last_fullsized":"2024-05-21T01:26:38.258677+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":316,"log_dups_size":0,"ondisk_log_size":316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:07:31.736640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":630784,"num_write":297,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"27'10","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:39.903227+0000","last_change":"2024-05-21T01:19:54.552709+0000","last_active":"2024-05-21T01:26:39.903227+0000","last_peered":"2024-05-21T01:26:39.903227+0000","last_clean":"2024-05-21T01:26:39.903227+0000","last_became_active":"2024-05-21T01:19:54.547898+0000","last_became_peered":"2024-05-21T01:19:54.547898+0000","last_unstale":"2024-05-21T01:26:39.903227+0000","last_undegraded":"2024-05-21T01:26:39.903227+0000","last_fullsized":"2024-05-21T01:26:39.903227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"27'5","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:39.854233+0000","last_change":"2024-05-21T01:19:53.534507+0000","last_active":"2024-05-21T01:26:39.854233+0000","last_peered":"2024-05-21T01:26:39.854233+0000","last_clean":"2024-05-21T01:26:39.854233+0000","last_became_active":"2024-05-21T01:19:53.534036+0000","last_became_peered":"2024-05-21T01:19:53.534036+0000","last_unstale":"2024-05-21T01:26:39.854233+0000","last_undegraded":"2024-05-21T01:26:39.854233+0000","last_fullsized":"2024-05-21T01:26:39.854233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"27'342","reported_seq":536,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:38.391651+0000","last_change":"2024-05-21T01:19:58.608135+0000","last_active":"2024-05-21T01:26:38.391651+0000","last_peered":"2024-05-21T01:26:38.391651+0000","last_clean":"2024-05-21T01:26:38.391651+0000","last_became_active":"2024-05-21T01:19:58.607242+0000","last_became_peered":"2024-05-21T01:19:58.607242+0000","last_unstale":"2024-05-21T01:26:38.391651+0000","last_undegraded":"2024-05-21T01:26:38.391651+0000","last_fullsized":"2024-05-21T01:26:38.391651+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:05:26.197876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":174,"num_read_kb":712704,"num_write":327,"num_write_kb":892928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"27'287","reported_seq":464,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:38.371583+0000","last_change":"2024-05-21T01:19:58.624883+0000","last_active":"2024-05-21T01:26:38.371583+0000","last_peered":"2024-05-21T01:26:38.371583+0000","last_clean":"2024-05-21T01:26:38.371583+0000","last_became_active":"2024-05-21T01:19:58.623991+0000","last_became_peered":"2024-05-21T01:19:58.623991+0000","last_unstale":"2024-05-21T01:26:38.371583+0000","last_undegraded":"2024-05-21T01:26:38.371583+0000","last_fullsized":"2024-05-21T01:26:38.371583+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":287,"log_dups_size":0,"ondisk_log_size":287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:29:26.251376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":156,"num_read_kb":638976,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"27'11","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:39.935323+0000","last_change":"2024-05-21T01:19:54.549215+0000","last_active":"2024-05-21T01:26:39.935323+0000","last_peered":"2024-05-21T01:26:39.935323+0000","last_clean":"2024-05-21T01:26:39.935323+0000","last_became_active":"2024-05-21T01:19:54.548426+0000","last_became_peered":"2024-05-21T01:19:54.548426+0000","last_unstale":"2024-05-21T01:26:39.935323+0000","last_undegraded":"2024-05-21T01:26:39.935323+0000","last_fullsized":"2024-05-21T01:26:39.935323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:10:10.800391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"25'1","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:19.477048+0000","last_change":"2024-05-21T01:19:53.526106+0000","last_active":"2024-05-21T01:22:19.477048+0000","last_peered":"2024-05-21T01:22:19.477048+0000","last_clean":"2024-05-21T01:22:19.477048+0000","last_became_active":"2024-05-21T01:19:53.525786+0000","last_became_peered":"2024-05-21T01:19:53.525786+0000","last_unstale":"2024-05-21T01:22:19.477048+0000","last_undegraded":"2024-05-21T01:22:19.477048+0000","last_fullsized":"2024-05-21T01:22:19.477048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:01:05.180803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"27'277","reported_seq":450,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:38.397676+0000","last_change":"2024-05-21T01:19:58.615481+0000","last_active":"2024-05-21T01:26:38.397676+0000","last_peered":"2024-05-21T01:26:38.397676+0000","last_clean":"2024-05-21T01:26:38.397676+0000","last_became_active":"2024-05-21T01:19:58.614879+0000","last_became_peered":"2024-05-21T01:19:58.614879+0000","last_unstale":"2024-05-21T01:26:38.397676+0000","last_undegraded":"2024-05-21T01:26:38.397676+0000","last_fullsized":"2024-05-21T01:26:38.397676+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:45:57.208342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":622592,"num_write":267,"num_write_kb":729088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"27'8","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:39.929137+0000","last_change":"2024-05-21T01:19:54.570650+0000","last_active":"2024-05-21T01:26:39.929137+0000","last_peered":"2024-05-21T01:26:39.929137+0000","last_clean":"2024-05-21T01:26:39.929137+0000","last_became_active":"2024-05-21T01:19:54.570034+0000","last_became_peered":"2024-05-21T01:19:54.570034+0000","last_unstale":"2024-05-21T01:26:39.929137+0000","last_undegraded":"2024-05-21T01:26:39.929137+0000","last_fullsized":"2024-05-21T01:26:39.929137+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:01:05.887729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"25'2","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:18.478669+0000","last_change":"2024-05-21T01:19:53.532017+0000","last_active":"2024-05-21T01:22:18.478669+0000","last_peered":"2024-05-21T01:22:18.478669+0000","last_clean":"2024-05-21T01:22:18.478669+0000","last_became_active":"2024-05-21T01:19:53.529457+0000","last_became_peered":"2024-05-21T01:19:53.529457+0000","last_unstale":"2024-05-21T01:22:18.478669+0000","last_undegraded":"2024-05-21T01:22:18.478669+0000","last_fullsized":"2024-05-21T01:22:18.478669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:58:03.979929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"25'3","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:22:24.486665+0000","last_change":"2024-05-21T01:19:53.525620+0000","last_active":"2024-05-21T01:22:24.486665+0000","last_peered":"2024-05-21T01:22:24.486665+0000","last_clean":"2024-05-21T01:22:24.486665+0000","last_became_active":"2024-05-21T01:19:53.525315+0000","last_became_peered":"2024-05-21T01:19:53.525315+0000","last_unstale":"2024-05-21T01:22:24.486665+0000","last_undegraded":"2024-05-21T01:22:24.486665+0000","last_fullsized":"2024-05-21T01:22:24.486665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:30:38.075463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"27'8","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:39.935133+0000","last_change":"2024-05-21T01:19:54.555344+0000","last_active":"2024-05-21T01:26:39.935133+0000","last_peered":"2024-05-21T01:26:39.935133+0000","last_clean":"2024-05-21T01:26:39.935133+0000","last_became_active":"2024-05-21T01:19:54.552817+0000","last_became_peered":"2024-05-21T01:19:54.552817+0000","last_unstale":"2024-05-21T01:26:39.935133+0000","last_undegraded":"2024-05-21T01:26:39.935133+0000","last_fullsized":"2024-05-21T01:26:39.935133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:10:03.810064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"27'316","reported_seq":506,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:37.831256+0000","last_change":"2024-05-21T01:19:58.619520+0000","last_active":"2024-05-21T01:26:37.831256+0000","last_peered":"2024-05-21T01:26:37.831256+0000","last_clean":"2024-05-21T01:26:37.831256+0000","last_became_active":"2024-05-21T01:19:58.617165+0000","last_became_peered":"2024-05-21T01:19:58.617165+0000","last_unstale":"2024-05-21T01:26:37.831256+0000","last_undegraded":"2024-05-21T01:26:37.831256+0000","last_fullsized":"2024-05-21T01:26:37.831256+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":316,"log_dups_size":0,"ondisk_log_size":316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T13:07:51.530746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":170,"num_read_kb":696320,"num_write":297,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"27'7","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:24:53.507680+0000","last_change":"2024-05-21T01:19:53.551547+0000","last_active":"2024-05-21T01:24:53.507680+0000","last_peered":"2024-05-21T01:24:53.507680+0000","last_clean":"2024-05-21T01:24:53.507680+0000","last_became_active":"2024-05-21T01:19:53.550931+0000","last_became_peered":"2024-05-21T01:19:53.550931+0000","last_unstale":"2024-05-21T01:24:53.507680+0000","last_undegraded":"2024-05-21T01:24:53.507680+0000","last_fullsized":"2024-05-21T01:24:53.507680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:52.490266+0000","last_clean_scrub_stamp":"2024-05-21T01:19:52.490266+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:13:47.329230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1021,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"27'7","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:39.917516+0000","last_change":"2024-05-21T01:19:54.574552+0000","last_active":"2024-05-21T01:26:39.917516+0000","last_peered":"2024-05-21T01:26:39.917516+0000","last_clean":"2024-05-21T01:26:39.917516+0000","last_became_active":"2024-05-21T01:19:54.574246+0000","last_became_peered":"2024-05-21T01:19:54.574246+0000","last_unstale":"2024-05-21T01:26:39.917516+0000","last_undegraded":"2024-05-21T01:26:39.917516+0000","last_fullsized":"2024-05-21T01:26:39.917516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"27'326","reported_seq":518,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:38.301130+0000","last_change":"2024-05-21T01:19:58.624400+0000","last_active":"2024-05-21T01:26:38.301130+0000","last_peered":"2024-05-21T01:26:38.301130+0000","last_clean":"2024-05-21T01:26:38.301130+0000","last_became_active":"2024-05-21T01:19:58.623388+0000","last_became_peered":"2024-05-21T01:19:58.623388+0000","last_unstale":"2024-05-21T01:26:38.301130+0000","last_undegraded":"2024-05-21T01:26:38.301130+0000","last_fullsized":"2024-05-21T01:26:38.301130+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:59:30.019393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":704512,"num_write":312,"num_write_kb":851968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"27'9","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:39.922001+0000","last_change":"2024-05-21T01:19:54.553262+0000","last_active":"2024-05-21T01:26:39.922001+0000","last_peered":"2024-05-21T01:26:39.922001+0000","last_clean":"2024-05-21T01:26:39.922001+0000","last_became_active":"2024-05-21T01:19:54.553060+0000","last_became_peered":"2024-05-21T01:19:54.553060+0000","last_unstale":"2024-05-21T01:26:39.922001+0000","last_undegraded":"2024-05-21T01:26:39.922001+0000","last_fullsized":"2024-05-21T01:26:39.922001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"27'12","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:39.925791+0000","last_change":"2024-05-21T01:19:54.566851+0000","last_active":"2024-05-21T01:26:39.925791+0000","last_peered":"2024-05-21T01:26:39.925791+0000","last_clean":"2024-05-21T01:26:39.925791+0000","last_became_active":"2024-05-21T01:19:54.565573+0000","last_became_peered":"2024-05-21T01:19:54.565573+0000","last_unstale":"2024-05-21T01:26:39.925791+0000","last_undegraded":"2024-05-21T01:26:39.925791+0000","last_fullsized":"2024-05-21T01:26:39.925791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:51:30.883954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"27'8","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:39.921071+0000","last_change":"2024-05-21T01:19:54.566934+0000","last_active":"2024-05-21T01:26:39.921071+0000","last_peered":"2024-05-21T01:26:39.921071+0000","last_clean":"2024-05-21T01:26:39.921071+0000","last_became_active":"2024-05-21T01:19:54.566503+0000","last_became_peered":"2024-05-21T01:19:54.566503+0000","last_unstale":"2024-05-21T01:26:39.921071+0000","last_undegraded":"2024-05-21T01:26:39.921071+0000","last_fullsized":"2024-05-21T01:26:39.921071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:14:54.262165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"27'7","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:39.912874+0000","last_change":"2024-05-21T01:19:54.573091+0000","last_active":"2024-05-21T01:26:39.912874+0000","last_peered":"2024-05-21T01:26:39.912874+0000","last_clean":"2024-05-21T01:26:39.912874+0000","last_became_active":"2024-05-21T01:19:54.572366+0000","last_became_peered":"2024-05-21T01:19:54.572366+0000","last_unstale":"2024-05-21T01:26:39.912874+0000","last_undegraded":"2024-05-21T01:26:39.912874+0000","last_fullsized":"2024-05-21T01:26:39.912874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:10:09.353807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"27'4","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:39.922514+0000","last_change":"2024-05-21T01:19:54.563339+0000","last_active":"2024-05-21T01:26:39.922514+0000","last_peered":"2024-05-21T01:26:39.922514+0000","last_clean":"2024-05-21T01:26:39.922514+0000","last_became_active":"2024-05-21T01:19:54.557934+0000","last_became_peered":"2024-05-21T01:19:54.557934+0000","last_unstale":"2024-05-21T01:26:39.922514+0000","last_undegraded":"2024-05-21T01:26:39.922514+0000","last_fullsized":"2024-05-21T01:26:39.922514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:46:21.598689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"27'6","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:39.919131+0000","last_change":"2024-05-21T01:19:54.553551+0000","last_active":"2024-05-21T01:26:39.919131+0000","last_peered":"2024-05-21T01:26:39.919131+0000","last_clean":"2024-05-21T01:26:39.919131+0000","last_became_active":"2024-05-21T01:19:54.552812+0000","last_became_peered":"2024-05-21T01:19:54.552812+0000","last_unstale":"2024-05-21T01:26:39.919131+0000","last_undegraded":"2024-05-21T01:26:39.919131+0000","last_fullsized":"2024-05-21T01:26:39.919131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:27:41.166606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"27'15","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:39.902984+0000","last_change":"2024-05-21T01:19:54.548604+0000","last_active":"2024-05-21T01:26:39.902984+0000","last_peered":"2024-05-21T01:26:39.902984+0000","last_clean":"2024-05-21T01:26:39.902984+0000","last_became_active":"2024-05-21T01:19:54.548263+0000","last_became_peered":"2024-05-21T01:19:54.548263+0000","last_unstale":"2024-05-21T01:26:39.902984+0000","last_undegraded":"2024-05-21T01:26:39.902984+0000","last_fullsized":"2024-05-21T01:26:39.902984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"27'2","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:39.919529+0000","last_change":"2024-05-21T01:19:54.573995+0000","last_active":"2024-05-21T01:26:39.919529+0000","last_peered":"2024-05-21T01:26:39.919529+0000","last_clean":"2024-05-21T01:26:39.919529+0000","last_became_active":"2024-05-21T01:19:54.570373+0000","last_became_peered":"2024-05-21T01:19:54.570373+0000","last_unstale":"2024-05-21T01:26:39.919529+0000","last_undegraded":"2024-05-21T01:26:39.919529+0000","last_fullsized":"2024-05-21T01:26:39.919529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:44:23.194713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"27'6","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:39.922497+0000","last_change":"2024-05-21T01:19:54.575196+0000","last_active":"2024-05-21T01:26:39.922497+0000","last_peered":"2024-05-21T01:26:39.922497+0000","last_clean":"2024-05-21T01:26:39.922497+0000","last_became_active":"2024-05-21T01:19:54.574945+0000","last_became_peered":"2024-05-21T01:19:54.574945+0000","last_unstale":"2024-05-21T01:26:39.922497+0000","last_undegraded":"2024-05-21T01:26:39.922497+0000","last_fullsized":"2024-05-21T01:26:39.922497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:52:56.244771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"27'8","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:39.919664+0000","last_change":"2024-05-21T01:19:54.566719+0000","last_active":"2024-05-21T01:26:39.919664+0000","last_peered":"2024-05-21T01:26:39.919664+0000","last_clean":"2024-05-21T01:26:39.919664+0000","last_became_active":"2024-05-21T01:19:54.565922+0000","last_became_peered":"2024-05-21T01:19:54.565922+0000","last_unstale":"2024-05-21T01:26:39.919664+0000","last_undegraded":"2024-05-21T01:26:39.919664+0000","last_fullsized":"2024-05-21T01:26:39.919664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:39:19.454688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"27'10","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:40.430189+0000","last_change":"2024-05-21T01:19:54.536815+0000","last_active":"2024-05-21T01:26:40.430189+0000","last_peered":"2024-05-21T01:26:40.430189+0000","last_clean":"2024-05-21T01:26:40.430189+0000","last_became_active":"2024-05-21T01:19:54.535957+0000","last_became_peered":"2024-05-21T01:19:54.535957+0000","last_unstale":"2024-05-21T01:26:40.430189+0000","last_undegraded":"2024-05-21T01:26:40.430189+0000","last_fullsized":"2024-05-21T01:26:40.430189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"27'11","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:39.933253+0000","last_change":"2024-05-21T01:19:54.552466+0000","last_active":"2024-05-21T01:26:39.933253+0000","last_peered":"2024-05-21T01:26:39.933253+0000","last_clean":"2024-05-21T01:26:39.933253+0000","last_became_active":"2024-05-21T01:19:54.551790+0000","last_became_peered":"2024-05-21T01:19:54.551790+0000","last_unstale":"2024-05-21T01:26:39.933253+0000","last_undegraded":"2024-05-21T01:26:39.933253+0000","last_fullsized":"2024-05-21T01:26:39.933253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:24:34.737707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"27'8","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:44.195055+0000","last_change":"2024-05-21T01:26:44.195074+0000","last_active":"2024-05-21T01:26:44.195055+0000","last_peered":"2024-05-21T01:26:44.195055+0000","last_clean":"2024-05-21T01:26:44.195055+0000","last_became_active":"2024-05-21T01:19:54.534793+0000","last_became_peered":"2024-05-21T01:19:54.534793+0000","last_unstale":"2024-05-21T01:26:44.195055+0000","last_undegraded":"2024-05-21T01:26:44.195055+0000","last_fullsized":"2024-05-21T01:26:44.195055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-21T01:26:44.194989+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-21T01:26:44.194989+0000","last_clean_scrub_stamp":"2024-05-21T01:26:44.194989+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:25:26.245486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"27'7","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:39.928841+0000","last_change":"2024-05-21T01:19:54.556323+0000","last_active":"2024-05-21T01:26:39.928841+0000","last_peered":"2024-05-21T01:26:39.928841+0000","last_clean":"2024-05-21T01:26:39.928841+0000","last_became_active":"2024-05-21T01:19:54.556043+0000","last_became_peered":"2024-05-21T01:19:54.556043+0000","last_unstale":"2024-05-21T01:26:39.928841+0000","last_undegraded":"2024-05-21T01:26:39.928841+0000","last_fullsized":"2024-05-21T01:26:39.928841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:34:02.068527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"27'10","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:39.922567+0000","last_change":"2024-05-21T01:19:54.567457+0000","last_active":"2024-05-21T01:26:39.922567+0000","last_peered":"2024-05-21T01:26:39.922567+0000","last_clean":"2024-05-21T01:26:39.922567+0000","last_became_active":"2024-05-21T01:19:54.565326+0000","last_became_peered":"2024-05-21T01:19:54.565326+0000","last_unstale":"2024-05-21T01:26:39.922567+0000","last_undegraded":"2024-05-21T01:26:39.922567+0000","last_fullsized":"2024-05-21T01:26:39.922567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:11:05.775389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"27'8","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:39.907268+0000","last_change":"2024-05-21T01:19:54.562078+0000","last_active":"2024-05-21T01:26:39.907268+0000","last_peered":"2024-05-21T01:26:39.907268+0000","last_clean":"2024-05-21T01:26:39.907268+0000","last_became_active":"2024-05-21T01:19:54.558286+0000","last_became_peered":"2024-05-21T01:19:54.558286+0000","last_unstale":"2024-05-21T01:26:39.907268+0000","last_undegraded":"2024-05-21T01:26:39.907268+0000","last_fullsized":"2024-05-21T01:26:39.907268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T09:09:58.360014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"27'9","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:39.899956+0000","last_change":"2024-05-21T01:19:54.548274+0000","last_active":"2024-05-21T01:26:39.899956+0000","last_peered":"2024-05-21T01:26:39.899956+0000","last_clean":"2024-05-21T01:26:39.899956+0000","last_became_active":"2024-05-21T01:19:54.548079+0000","last_became_peered":"2024-05-21T01:19:54.548079+0000","last_unstale":"2024-05-21T01:26:39.899956+0000","last_undegraded":"2024-05-21T01:26:39.899956+0000","last_fullsized":"2024-05-21T01:26:39.899956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:49:03.296571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"27'7","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:39.917923+0000","last_change":"2024-05-21T01:19:54.568211+0000","last_active":"2024-05-21T01:26:39.917923+0000","last_peered":"2024-05-21T01:26:39.917923+0000","last_clean":"2024-05-21T01:26:39.917923+0000","last_became_active":"2024-05-21T01:19:54.567512+0000","last_became_peered":"2024-05-21T01:19:54.567512+0000","last_unstale":"2024-05-21T01:26:39.917923+0000","last_undegraded":"2024-05-21T01:26:39.917923+0000","last_fullsized":"2024-05-21T01:26:39.917923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:32:18.004763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"27'8","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:39.924077+0000","last_change":"2024-05-21T01:19:54.556683+0000","last_active":"2024-05-21T01:26:39.924077+0000","last_peered":"2024-05-21T01:26:39.924077+0000","last_clean":"2024-05-21T01:26:39.924077+0000","last_became_active":"2024-05-21T01:19:54.555947+0000","last_became_peered":"2024-05-21T01:19:54.555947+0000","last_unstale":"2024-05-21T01:26:39.924077+0000","last_undegraded":"2024-05-21T01:26:39.924077+0000","last_fullsized":"2024-05-21T01:26:39.924077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:59:04.593946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"27'10","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:39.925744+0000","last_change":"2024-05-21T01:19:54.560218+0000","last_active":"2024-05-21T01:26:39.925744+0000","last_peered":"2024-05-21T01:26:39.925744+0000","last_clean":"2024-05-21T01:26:39.925744+0000","last_became_active":"2024-05-21T01:19:54.557787+0000","last_became_peered":"2024-05-21T01:19:54.557787+0000","last_unstale":"2024-05-21T01:26:39.925744+0000","last_undegraded":"2024-05-21T01:26:39.925744+0000","last_fullsized":"2024-05-21T01:26:39.925744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:05:48.282563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"27'7","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:39.914623+0000","last_change":"2024-05-21T01:19:54.535096+0000","last_active":"2024-05-21T01:26:39.914623+0000","last_peered":"2024-05-21T01:26:39.914623+0000","last_clean":"2024-05-21T01:26:39.914623+0000","last_became_active":"2024-05-21T01:19:54.534472+0000","last_became_peered":"2024-05-21T01:19:54.534472+0000","last_unstale":"2024-05-21T01:26:39.914623+0000","last_undegraded":"2024-05-21T01:26:39.914623+0000","last_fullsized":"2024-05-21T01:26:39.914623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"27'6","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:39.914301+0000","last_change":"2024-05-21T01:19:54.546352+0000","last_active":"2024-05-21T01:26:39.914301+0000","last_peered":"2024-05-21T01:26:39.914301+0000","last_clean":"2024-05-21T01:26:39.914301+0000","last_became_active":"2024-05-21T01:19:54.546055+0000","last_became_peered":"2024-05-21T01:19:54.546055+0000","last_unstale":"2024-05-21T01:26:39.914301+0000","last_undegraded":"2024-05-21T01:26:39.914301+0000","last_fullsized":"2024-05-21T01:26:39.914301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"27'16","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:39.923626+0000","last_change":"2024-05-21T01:20:43.551219+0000","last_active":"2024-05-21T01:26:39.923626+0000","last_peered":"2024-05-21T01:26:39.923626+0000","last_clean":"2024-05-21T01:26:39.923626+0000","last_became_active":"2024-05-21T01:20:43.550179+0000","last_became_peered":"2024-05-21T01:20:43.550179+0000","last_unstale":"2024-05-21T01:26:39.923626+0000","last_undegraded":"2024-05-21T01:26:39.923626+0000","last_fullsized":"2024-05-21T01:26:39.923626+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:00:31.919441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.37","version":"27'11","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:39.902046+0000","last_change":"2024-05-21T01:19:54.548954+0000","last_active":"2024-05-21T01:26:39.902046+0000","last_peered":"2024-05-21T01:26:39.902046+0000","last_clean":"2024-05-21T01:26:39.902046+0000","last_became_active":"2024-05-21T01:19:54.547528+0000","last_became_peered":"2024-05-21T01:19:54.547528+0000","last_unstale":"2024-05-21T01:26:39.902046+0000","last_undegraded":"2024-05-21T01:26:39.902046+0000","last_fullsized":"2024-05-21T01:26:39.902046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"27'9","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:39.929502+0000","last_change":"2024-05-21T01:19:54.575256+0000","last_active":"2024-05-21T01:26:39.929502+0000","last_peered":"2024-05-21T01:26:39.929502+0000","last_clean":"2024-05-21T01:26:39.929502+0000","last_became_active":"2024-05-21T01:19:54.570119+0000","last_became_peered":"2024-05-21T01:19:54.570119+0000","last_unstale":"2024-05-21T01:26:39.929502+0000","last_undegraded":"2024-05-21T01:26:39.929502+0000","last_fullsized":"2024-05-21T01:26:39.929502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:10:02.800110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"27'5","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:39.933936+0000","last_change":"2024-05-21T01:19:54.550134+0000","last_active":"2024-05-21T01:26:39.933936+0000","last_peered":"2024-05-21T01:26:39.933936+0000","last_clean":"2024-05-21T01:26:39.933936+0000","last_became_active":"2024-05-21T01:19:54.549617+0000","last_became_peered":"2024-05-21T01:19:54.549617+0000","last_unstale":"2024-05-21T01:26:39.933936+0000","last_undegraded":"2024-05-21T01:26:39.933936+0000","last_fullsized":"2024-05-21T01:26:39.933936+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"27'6","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:39.934161+0000","last_change":"2024-05-21T01:19:54.555653+0000","last_active":"2024-05-21T01:26:39.934161+0000","last_peered":"2024-05-21T01:26:39.934161+0000","last_clean":"2024-05-21T01:26:39.934161+0000","last_became_active":"2024-05-21T01:19:54.555274+0000","last_became_peered":"2024-05-21T01:19:54.555274+0000","last_unstale":"2024-05-21T01:26:39.934161+0000","last_undegraded":"2024-05-21T01:26:39.934161+0000","last_fullsized":"2024-05-21T01:26:39.934161+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"27'4","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:39.924033+0000","last_change":"2024-05-21T01:19:54.568866+0000","last_active":"2024-05-21T01:26:39.924033+0000","last_peered":"2024-05-21T01:26:39.924033+0000","last_clean":"2024-05-21T01:26:39.924033+0000","last_became_active":"2024-05-21T01:19:54.568605+0000","last_became_peered":"2024-05-21T01:19:54.568605+0000","last_unstale":"2024-05-21T01:26:39.924033+0000","last_undegraded":"2024-05-21T01:26:39.924033+0000","last_fullsized":"2024-05-21T01:26:39.924033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"27'8","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:39.934348+0000","last_change":"2024-05-21T01:19:54.557468+0000","last_active":"2024-05-21T01:26:39.934348+0000","last_peered":"2024-05-21T01:26:39.934348+0000","last_clean":"2024-05-21T01:26:39.934348+0000","last_became_active":"2024-05-21T01:19:54.554976+0000","last_became_peered":"2024-05-21T01:19:54.554976+0000","last_unstale":"2024-05-21T01:26:39.934348+0000","last_undegraded":"2024-05-21T01:26:39.934348+0000","last_fullsized":"2024-05-21T01:26:39.934348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"27'7","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:39.933992+0000","last_change":"2024-05-21T01:19:54.566991+0000","last_active":"2024-05-21T01:26:39.933992+0000","last_peered":"2024-05-21T01:26:39.933992+0000","last_clean":"2024-05-21T01:26:39.933992+0000","last_became_active":"2024-05-21T01:19:54.566349+0000","last_became_peered":"2024-05-21T01:19:54.566349+0000","last_unstale":"2024-05-21T01:26:39.933992+0000","last_undegraded":"2024-05-21T01:26:39.933992+0000","last_fullsized":"2024-05-21T01:26:39.933992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:25:43.468081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"27'4","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:39.924434+0000","last_change":"2024-05-21T01:19:54.576100+0000","last_active":"2024-05-21T01:26:39.924434+0000","last_peered":"2024-05-21T01:26:39.924434+0000","last_clean":"2024-05-21T01:26:39.924434+0000","last_became_active":"2024-05-21T01:19:54.574914+0000","last_became_peered":"2024-05-21T01:19:54.574914+0000","last_unstale":"2024-05-21T01:26:39.924434+0000","last_undegraded":"2024-05-21T01:26:39.924434+0000","last_fullsized":"2024-05-21T01:26:39.924434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:29:30.730283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"27'8","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:39.914482+0000","last_change":"2024-05-21T01:19:54.546570+0000","last_active":"2024-05-21T01:26:39.914482+0000","last_peered":"2024-05-21T01:26:39.914482+0000","last_clean":"2024-05-21T01:26:39.914482+0000","last_became_active":"2024-05-21T01:19:54.546284+0000","last_became_peered":"2024-05-21T01:19:54.546284+0000","last_unstale":"2024-05-21T01:26:39.914482+0000","last_undegraded":"2024-05-21T01:26:39.914482+0000","last_fullsized":"2024-05-21T01:26:39.914482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5128,"num_read_kb":21004288,"num_write":9216,"num_write_kb":25165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9731,"ondisk_log_size":9731,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":503,"ondisk_log_size":503,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2846797,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":1595,"num_write_kb":3011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":5849088,"data_stored":5693594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1555,"ondisk_log_size":1555,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66932,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509528,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49516,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94322324,"statfs":{"total":96636764160,"available":96586059776,"internally_reserved":0,"allocated":299008,"data_stored":117691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":50395592},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509528,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48128,"kb_used_data":3064,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94323712,"statfs":{"total":96636764160,"available":96587481088,"internally_reserved":0,"allocated":3137536,"data_stored":2958758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509526,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53732,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94318108,"statfs":{"total":96636764160,"available":96581742592,"internally_reserved":0,"allocated":356352,"data_stored":706993,"data_compressed":33466,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509526,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35632,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336208,"statfs":{"total":96636764160,"available":96600276992,"internally_reserved":0,"allocated":303104,"data_stored":117781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542231,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49512,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94322328,"statfs":{"total":96636764160,"available":96586063872,"internally_reserved":0,"allocated":294912,"data_stored":118068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542231,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45428,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326412,"statfs":{"total":96636764160,"available":96590245888,"internally_reserved":0,"allocated":372736,"data_stored":708565,"data_compressed":33466,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574934,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49528,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94322312,"statfs":{"total":96636764160,"available":96586047488,"internally_reserved":0,"allocated":311296,"data_stored":117902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574934,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52316,"kb_used_data":3092,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319524,"statfs":{"total":96636764160,"available":96583192576,"internally_reserved":0,"allocated":3166208,"data_stored":2960292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33466,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33466,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2854912,"data_stored":2842293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":2883584,"data_stored":2843827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-21T01:26:47.563 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2024-05-21T01:19:52.490266+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=52, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.563 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-05-21T01:19:53.497636+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=53, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.563 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-05-21T01:19:57.549460+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=57, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.563 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-05-21T01:19:52.490266+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=52, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.563 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-05-21T01:19:53.497636+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=53, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.563 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-05-21T01:19:57.549460+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=57, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.564 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-05-21T01:19:52.490266+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=52, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.564 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-05-21T01:19:53.497636+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=53, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.564 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-05-21T01:19:57.549460+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=57, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.564 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-05-21T01:19:52.490266+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=52, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.564 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-05-21T01:19:53.497636+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=53, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.564 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-05-21T01:19:57.549460+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=57, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.564 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-05-21T01:19:53.497636+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=53, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.564 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-05-21T01:19:52.490266+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=52, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.564 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-05-21T01:19:57.549460+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=57, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.564 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-05-21T01:19:53.497636+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=53, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.565 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-05-21T01:19:52.490266+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=52, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.565 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-05-21T01:19:57.549460+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=57, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.565 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-05-21T01:19:53.497636+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=53, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.565 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-05-21T01:19:52.490266+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=52, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.565 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-05-21T01:19:57.549460+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=57, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.565 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-05-21T01:19:53.497636+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=53, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.565 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-05-21T01:19:52.490266+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=52, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.565 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-05-21T01:19:57.549460+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=57, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.565 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-05-21T01:19:53.497636+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=53, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.566 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-05-21T01:19:52.490266+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=52, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.566 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-05-21T01:19:57.549460+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=57, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.566 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-05-21T01:19:53.497636+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=53, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.566 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-05-21T01:19:52.490266+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=52, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.566 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-05-21T01:19:57.549460+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=57, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.566 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-05-21T01:19:53.497636+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=53, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.566 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-05-21T01:19:52.490266+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=52, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.566 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-05-21T01:19:57.549460+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=57, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.566 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-05-21T01:19:53.497636+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=53, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.567 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-05-21T01:19:52.490266+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=52, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.567 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-05-21T01:19:57.549460+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=57, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.567 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-05-21T01:19:53.497636+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=53, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.567 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-05-21T01:19:52.490266+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=52, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.567 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-05-21T01:19:57.549460+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=57, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.567 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-05-21T01:19:53.497636+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=53, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.567 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-05-21T01:19:52.490266+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=52, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.567 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-05-21T01:19:57.549460+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=57, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.567 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-05-21T01:19:53.497636+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=53, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.568 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-05-21T01:19:52.490266+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=52, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.568 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-05-21T01:19:57.549460+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=57, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.568 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-05-21T01:19:53.497636+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=53, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.568 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-05-21T01:19:52.490266+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=52, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.568 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-05-21T01:19:47.457865+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=47, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.568 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-05-21T01:19:57.549460+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=57, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.568 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-05-21T01:19:53.497636+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=53, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.568 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-05-21T01:19:52.490266+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=52, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.568 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-05-21T01:19:57.549460+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=57, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.569 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-05-21T01:19:53.497636+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=53, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.569 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-05-21T01:19:52.490266+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=52, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.569 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-05-21T01:19:57.549460+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=57, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.569 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-05-21T01:19:53.497636+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=53, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.569 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-05-21T01:19:52.490266+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=52, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.569 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-05-21T01:19:57.549460+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=57, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.569 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-05-21T01:19:53.497636+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=53, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.569 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-05-21T01:19:52.490266+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=52, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.569 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-05-21T01:19:57.549460+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=57, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.569 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-05-21T01:19:53.497636+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=53, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.570 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-05-21T01:19:52.490266+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=52, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.570 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-05-21T01:19:57.549460+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=57, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.570 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-05-21T01:19:53.497636+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=53, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.570 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-05-21T01:19:52.490266+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=52, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.570 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-05-21T01:19:57.549460+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=57, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.570 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-05-21T01:19:53.497636+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=53, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.570 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-05-21T01:19:52.490266+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=52, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.570 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-05-21T01:19:57.549460+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=57, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.570 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-05-21T01:19:53.497636+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=53, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.571 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2024-05-21T01:19:52.490266+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=52, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.571 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-05-21T01:19:57.549460+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=57, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.571 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-05-21T01:19:53.497636+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=53, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.571 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-05-21T01:19:52.490266+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=52, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.571 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-05-21T01:19:57.549460+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=57, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.571 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-05-21T01:19:53.497636+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=53, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.571 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-05-21T01:19:52.490266+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=52, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.571 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-05-21T01:19:57.549460+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=57, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.571 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-05-21T01:19:53.497636+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=53, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.572 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-05-21T01:19:52.490266+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=52, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.572 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-05-21T01:19:57.549460+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=57, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.572 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-05-21T01:19:53.497636+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=53, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.572 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-05-21T01:19:52.490266+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=52, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.572 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-05-21T01:19:57.549460+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=57, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.572 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-05-21T01:19:57.549460+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=57, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.572 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-05-21T01:19:53.497636+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=53, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.572 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-05-21T01:19:52.490266+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=52, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.572 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-05-21T01:19:57.549460+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=57, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.573 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-05-21T01:19:53.497636+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=53, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.573 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-05-21T01:19:52.490266+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=52, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.573 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-05-21T01:19:52.490266+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=52, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.573 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-05-21T01:19:53.497636+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=53, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.573 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-05-21T01:19:57.549460+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=57, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.573 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-05-21T01:19:52.490266+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=52, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.573 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-05-21T01:19:53.497636+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=53, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.573 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-05-21T01:19:57.549460+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=57, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.573 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-05-21T01:19:53.497636+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=53, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.574 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-05-21T01:19:53.497636+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=53, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.574 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-05-21T01:19:53.497636+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=53, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.574 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-05-21T01:19:53.497636+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=53, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.574 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-05-21T01:19:53.497636+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=53, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.574 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-05-21T01:19:53.497636+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=53, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.574 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-05-21T01:19:53.497636+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=53, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.574 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-05-21T01:19:53.497636+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=53, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.574 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-05-21T01:19:53.497636+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=53, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.574 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-05-21T01:19:53.497636+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=53, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.575 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-05-21T01:19:53.497636+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=53, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.575 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-05-21T01:19:53.497636+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=53, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.575 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-05-21T01:19:53.497636+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=53, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.575 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-05-21T01:19:53.497636+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=53, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.575 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-05-21T01:19:53.497636+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=53, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.575 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-05-21T01:19:53.497636+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=53, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.575 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-05-21T01:19:53.497636+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=53, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.575 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-05-21T01:19:53.497636+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=53, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.575 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-05-21T01:19:53.497636+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=53, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.575 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-05-21T01:19:53.497636+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=53, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.576 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-05-21T01:19:53.497636+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=53, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.576 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-05-21T01:19:53.497636+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=53, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.576 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-05-21T01:19:53.497636+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=53, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.576 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-05-21T01:19:53.497636+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=53, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.576 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-05-21T01:19:53.497636+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=53, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.576 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-05-21T01:19:53.497636+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=53, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.576 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-05-21T01:19:53.497636+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=53, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.576 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-05-21T01:19:53.497636+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=53, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.576 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-05-21T01:19:53.497636+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=53, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.577 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-05-21T01:19:53.497636+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=53, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.577 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-05-21T01:19:53.497636+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=53, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:26:47.577 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-21T01:26:57.722 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-21T01:26:57.736 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-21T01:27:07.578 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-21T01:27:07.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:07.725+0000 7f2ca6200640 1 Processor -- start 2024-05-21T01:27:07.731 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:07.725+0000 7f2ca6200640 1 -- start start 2024-05-21T01:27:07.732 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:07.729+0000 7f2ca6200640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2ca00cd4e0 0x7f2ca00717e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:27:07.732 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:07.729+0000 7f2ca6200640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ca0158930 con 0x7f2ca0158480 2024-05-21T01:27:07.732 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:07.729+0000 7f2ca6200640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ca0158c10 con 0x7f2ca00cd8c0 2024-05-21T01:27:07.733 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:07.729+0000 7f2ca6200640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f2ca0158ef0 con 0x7f2ca00cd4e0 2024-05-21T01:27:07.733 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:07.729+0000 7f2c9f400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2ca00cd4e0 0x7f2ca00717e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:27:07.733 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:07.729+0000 7f2c9f400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2ca00cd4e0 0x7f2ca00717e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:32874/0 (socket says 172.21.15.63:32874) 2024-05-21T01:27:07.733 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:07.729+0000 7f2c9f400640 1 -- 172.21.15.63:0/814756425 learned_addr learned my addr 172.21.15.63:0/814756425 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:27:07.733 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:07.729+0000 7f2c9ea00640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f2ca0158480 0x7f2ca0072810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:44828/0 (socket says 172.21.15.63:44828) 2024-05-21T01:27:07.733 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:07.729+0000 7f2c9f400640 1 -- 172.21.15.63:0/814756425 >> v1:172.21.15.131:6789/0 conn(0x7f2ca00cd8c0 legacy=0x7f2ca0152210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:27:07.733 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:07.729+0000 7f2c9f400640 1 -- 172.21.15.63:0/814756425 >> v1:172.21.15.63:6789/0 conn(0x7f2ca0158480 legacy=0x7f2ca0072810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:27:07.733 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:07.729+0000 7f2c9f400640 1 -- 172.21.15.63:0/814756425 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ca01591d0 con 0x7f2ca00cd4e0 2024-05-21T01:27:07.734 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:07.729+0000 7f2c9e000640 1 -- 172.21.15.63:0/814756425 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1779877857 0 0) 0x7f2ca0158930 con 0x7f2ca0158480 2024-05-21T01:27:07.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:07.729+0000 7f2c9f400640 1 --2- 172.21.15.63:0/814756425 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2ca00cd4e0 0x7f2ca00717e0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f2c90009870 tx=0x7f2c9001ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c3fe1405abb7cc6 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:27:07.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:07.733+0000 7f2c9e000640 1 -- 172.21.15.63:0/814756425 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c900b5070 con 0x7f2ca00cd4e0 2024-05-21T01:27:07.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:07.733+0000 7f2c9e000640 1 -- 172.21.15.63:0/814756425 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c900a8a50 con 0x7f2ca00cd4e0 2024-05-21T01:27:07.736 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:07.733+0000 7f2c9e000640 1 -- 172.21.15.63:0/814756425 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c900a8e20 con 0x7f2ca00cd4e0 2024-05-21T01:27:07.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:07.733+0000 7f2ca6200640 1 -- 172.21.15.63:0/814756425 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2ca00cd4e0 msgr2=0x7f2ca00717e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:27:07.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:07.733+0000 7f2ca6200640 1 --2- 172.21.15.63:0/814756425 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2ca00cd4e0 0x7f2ca00717e0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f2c90009870 tx=0x7f2c9001ed50 comp rx=0 tx=0).stop 2024-05-21T01:27:07.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:07.733+0000 7f2ca6200640 1 -- 172.21.15.63:0/814756425 shutdown_connections 2024-05-21T01:27:07.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:07.733+0000 7f2ca6200640 1 --2- 172.21.15.63:0/814756425 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2ca00cd4e0 0x7f2ca00717e0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:07.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:07.733+0000 7f2ca6200640 1 -- 172.21.15.63:0/814756425 >> 172.21.15.63:0/814756425 conn(0x7f2ca0068460 msgr2=0x7f2ca0068870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:27:07.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:07.733+0000 7f2ca6200640 1 -- 172.21.15.63:0/814756425 shutdown_connections 2024-05-21T01:27:07.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:07.733+0000 7f2ca6200640 1 -- 172.21.15.63:0/814756425 wait complete. 2024-05-21T01:27:07.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:07.733+0000 7f2ca6200640 1 Processor -- start 2024-05-21T01:27:07.738 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:07.733+0000 7f2ca6200640 1 -- start start 2024-05-21T01:27:07.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:07.733+0000 7f2ca6200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2ca00cd4e0 0x7f2ca00c6d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:27:07.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:07.733+0000 7f2ca6200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2ca00cd8c0 0x7f2ca01f5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:27:07.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:07.733+0000 7f2ca6200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2ca0158480 0x7f2ca01f1c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:27:07.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:07.733+0000 7f2ca6200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f2ca00c9180 con 0x7f2ca0158480 2024-05-21T01:27:07.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:07.733+0000 7f2ca6200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f2ca00c9000 con 0x7f2ca00cd4e0 2024-05-21T01:27:07.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:07.733+0000 7f2ca6200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f2ca0072f20 con 0x7f2ca00cd8c0 2024-05-21T01:27:07.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:07.733+0000 7f2c9fe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2ca0158480 0x7f2ca01f1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:27:07.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:07.733+0000 7f2c9fe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2ca0158480 0x7f2ca01f1c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:32880/0 (socket says 172.21.15.63:32880) 2024-05-21T01:27:07.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:07.733+0000 7f2c9fe00640 1 -- 172.21.15.63:0/2689345146 learned_addr learned my addr 172.21.15.63:0/2689345146 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:27:07.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:07.733+0000 7f2c9f400640 1 --2- 172.21.15.63:0/2689345146 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2ca00cd4e0 0x7f2ca00c6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:27:07.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:07.733+0000 7f2c9ea00640 1 --2- 172.21.15.63:0/2689345146 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2ca00cd8c0 0x7f2ca01f5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:27:07.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:07.737+0000 7f2c9fe00640 1 -- 172.21.15.63:0/2689345146 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2ca00cd8c0 msgr2=0x7f2ca01f5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:27:07.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:07.737+0000 7f2c9fe00640 1 --2- 172.21.15.63:0/2689345146 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2ca00cd8c0 0x7f2ca01f5410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:07.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:07.737+0000 7f2c9fe00640 1 -- 172.21.15.63:0/2689345146 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2ca00cd4e0 msgr2=0x7f2ca00c6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:27:07.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:07.737+0000 7f2c9fe00640 1 --2- 172.21.15.63:0/2689345146 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2ca00cd4e0 0x7f2ca00c6d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:07.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:07.737+0000 7f2c9fe00640 1 -- 172.21.15.63:0/2689345146 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ca0154a30 con 0x7f2ca0158480 2024-05-21T01:27:07.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:07.737+0000 7f2c9fe00640 1 --2- 172.21.15.63:0/2689345146 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2ca0158480 0x7f2ca01f1c10 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f2c9800c7c0 tx=0x7f2c9800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:27:07.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:07.737+0000 7f2c97400640 1 -- 172.21.15.63:0/2689345146 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c98003b80 con 0x7f2ca0158480 2024-05-21T01:27:07.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:07.737+0000 7f2c97400640 1 -- 172.21.15.63:0/2689345146 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c98003d20 con 0x7f2ca0158480 2024-05-21T01:27:07.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:07.737+0000 7f2ca6200640 1 -- 172.21.15.63:0/2689345146 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ca00c7580 con 0x7f2ca0158480 2024-05-21T01:27:07.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:07.737+0000 7f2c97400640 1 -- 172.21.15.63:0/2689345146 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c9800aa90 con 0x7f2ca0158480 2024-05-21T01:27:07.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:07.737+0000 7f2ca6200640 1 -- 172.21.15.63:0/2689345146 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ca00c6660 con 0x7f2ca0158480 2024-05-21T01:27:07.742 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:07.737+0000 7f2ca6200640 1 -- 172.21.15.63:0/2689345146 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ca00507f0 con 0x7f2ca0158480 2024-05-21T01:27:07.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:07.737+0000 7f2c97400640 1 -- 172.21.15.63:0/2689345146 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7f2c9800ac30 con 0x7f2ca0158480 2024-05-21T01:27:07.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:07.737+0000 7f2c97400640 1 --2- 172.21.15.63:0/2689345146 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f2c8006f400 0x7f2c800718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:27:07.746 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:07.741+0000 7f2c97400640 1 -- 172.21.15.63:0/2689345146 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f2c9808f4c0 con 0x7f2ca0158480 2024-05-21T01:27:07.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:07.741+0000 7f2c9f400640 1 --2- 172.21.15.63:0/2689345146 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f2c8006f400 0x7f2c800718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:27:07.747 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:07.741+0000 7f2c9f400640 1 --2- 172.21.15.63:0/2689345146 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f2c8006f400 0x7f2c800718c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f2c900b2000 tx=0x7f2c90008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:27:07.748 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:07.745+0000 7f2c97400640 1 -- 172.21.15.63:0/2689345146 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f2ca0154a30 con 0x7f2ca0158480 2024-05-21T01:27:07.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:07.905+0000 7f2ca6200640 1 -- 172.21.15.63:0/2689345146 --> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2ca014fa40 con 0x7f2c8006f400 2024-05-21T01:27:07.938 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-05-21T01:27:07.941 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-05-21T01:27:07.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:07.933+0000 7f2c97400640 1 -- 172.21.15.63:0/2689345146 <== mgr.4103 v2:172.21.15.131:6832/921953667 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+333657 (secure 0 0 0) 0x7f2ca014fa40 con 0x7f2c8006f400 2024-05-21T01:27:07.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:07.933+0000 7f2ca6200640 1 -- 172.21.15.63:0/2689345146 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f2c8006f400 msgr2=0x7f2c800718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:27:07.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:07.933+0000 7f2ca6200640 1 --2- 172.21.15.63:0/2689345146 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f2c8006f400 0x7f2c800718c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f2c900b2000 tx=0x7f2c90008040 comp rx=0 tx=0).stop 2024-05-21T01:27:07.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:07.933+0000 7f2ca6200640 1 -- 172.21.15.63:0/2689345146 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2ca0158480 msgr2=0x7f2ca01f1c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:27:07.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:07.933+0000 7f2ca6200640 1 --2- 172.21.15.63:0/2689345146 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2ca0158480 0x7f2ca01f1c10 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f2c9800c7c0 tx=0x7f2c9800cc80 comp rx=0 tx=0).stop 2024-05-21T01:27:07.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:07.933+0000 7f2ca6200640 1 -- 172.21.15.63:0/2689345146 shutdown_connections 2024-05-21T01:27:07.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:07.933+0000 7f2ca6200640 1 --2- 172.21.15.63:0/2689345146 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f2c8006f400 0x7f2c800718c0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:07.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:07.933+0000 7f2ca6200640 1 --2- 172.21.15.63:0/2689345146 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2ca0158480 0x7f2ca01f1c10 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:07.954 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:07.933+0000 7f2ca6200640 1 --2- 172.21.15.63:0/2689345146 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2ca00cd8c0 0x7f2ca01f5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:07.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:07.933+0000 7f2ca6200640 1 --2- 172.21.15.63:0/2689345146 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2ca00cd4e0 0x7f2ca00c6d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:07.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:07.933+0000 7f2ca6200640 1 -- 172.21.15.63:0/2689345146 >> 172.21.15.63:0/2689345146 conn(0x7f2ca0068460 msgr2=0x7f2ca00cbba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:27:07.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:07.933+0000 7f2ca6200640 1 -- 172.21.15.63:0/2689345146 shutdown_connections 2024-05-21T01:27:07.955 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:07.933+0000 7f2ca6200640 1 -- 172.21.15.63:0/2689345146 wait complete. 2024-05-21T01:27:07.974 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":240,"stamp":"2024-05-21T01:27:06.620722+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3437165,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":5199,"num_read_kb":21004348,"num_write":10912,"num_write_kb":25170463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15000,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11917,"ondisk_log_size":11917,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":383792,"kb_used_data":8048,"kb_used_omap":12,"kb_used_meta":375667,"kb_avail":754590928,"statfs":{"total":773094113280,"available":772701110272,"internally_reserved":0,"allocated":8241152,"data_stored":7806050,"data_compressed":66932,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12750,"internal_metadata":384683570},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005122"},"pg_stats":[{"pgid":"2.1f","version":"27'13","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:49.745951+0000","last_change":"2024-05-21T01:26:49.746028+0000","last_active":"2024-05-21T01:26:49.745951+0000","last_peered":"2024-05-21T01:26:49.745951+0000","last_clean":"2024-05-21T01:26:49.745951+0000","last_became_active":"2024-05-21T01:19:53.544469+0000","last_became_peered":"2024-05-21T01:19:53.544469+0000","last_unstale":"2024-05-21T01:26:49.745951+0000","last_undegraded":"2024-05-21T01:26:49.745951+0000","last_fullsized":"2024-05-21T01:26:49.745951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'13","last_scrub_stamp":"2024-05-21T01:26:49.745791+0000","last_deep_scrub":"27'13","last_deep_scrub_stamp":"2024-05-21T01:26:49.745791+0000","last_clean_scrub_stamp":"2024-05-21T01:26:49.745791+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:22:35.348983+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"27'5","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:46.707546+0000","last_change":"2024-05-21T01:26:46.707664+0000","last_active":"2024-05-21T01:26:46.707546+0000","last_peered":"2024-05-21T01:26:46.707546+0000","last_clean":"2024-05-21T01:26:46.707546+0000","last_became_active":"2024-05-21T01:19:54.567245+0000","last_became_peered":"2024-05-21T01:19:54.567245+0000","last_unstale":"2024-05-21T01:26:46.707546+0000","last_undegraded":"2024-05-21T01:26:46.707546+0000","last_fullsized":"2024-05-21T01:26:46.707546+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-05-21T01:26:46.707326+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-05-21T01:26:46.707326+0000","last_clean_scrub_stamp":"2024-05-21T01:26:46.707326+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T13:03:37.114380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"27'327","reported_seq":532,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:55.802642+0000","last_change":"2024-05-21T01:26:55.802708+0000","last_active":"2024-05-21T01:26:55.802642+0000","last_peered":"2024-05-21T01:26:55.802642+0000","last_clean":"2024-05-21T01:26:55.802642+0000","last_became_active":"2024-05-21T01:19:58.617757+0000","last_became_peered":"2024-05-21T01:19:58.617757+0000","last_unstale":"2024-05-21T01:26:55.802642+0000","last_undegraded":"2024-05-21T01:26:55.802642+0000","last_fullsized":"2024-05-21T01:26:55.802642+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'327","last_scrub_stamp":"2024-05-21T01:26:55.802452+0000","last_deep_scrub":"27'327","last_deep_scrub_stamp":"2024-05-21T01:26:55.802452+0000","last_clean_scrub_stamp":"2024-05-21T01:26:55.802452+0000","objects_scrubbed":0,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:12:25.366877+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":176,"num_read_kb":720896,"num_write":306,"num_write_kb":835584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"25'2","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:53.656687+0000","last_change":"2024-05-21T01:26:53.656748+0000","last_active":"2024-05-21T01:26:53.656687+0000","last_peered":"2024-05-21T01:26:53.656687+0000","last_clean":"2024-05-21T01:26:53.656687+0000","last_became_active":"2024-05-21T01:19:53.551049+0000","last_became_peered":"2024-05-21T01:19:53.551049+0000","last_unstale":"2024-05-21T01:26:53.656687+0000","last_undegraded":"2024-05-21T01:26:53.656687+0000","last_fullsized":"2024-05-21T01:26:53.656687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2024-05-21T01:26:53.656481+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2024-05-21T01:26:53.656481+0000","last_clean_scrub_stamp":"2024-05-21T01:26:53.656481+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:47:17.945190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"27'6","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:58.669474+0000","last_change":"2024-05-21T01:26:58.669532+0000","last_active":"2024-05-21T01:26:58.669474+0000","last_peered":"2024-05-21T01:26:58.669474+0000","last_clean":"2024-05-21T01:26:58.669474+0000","last_became_active":"2024-05-21T01:19:54.569573+0000","last_became_peered":"2024-05-21T01:19:54.569573+0000","last_unstale":"2024-05-21T01:26:58.669474+0000","last_undegraded":"2024-05-21T01:26:58.669474+0000","last_fullsized":"2024-05-21T01:26:58.669474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-21T01:26:58.669299+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-21T01:26:58.669299+0000","last_clean_scrub_stamp":"2024-05-21T01:26:58.669299+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:38:05.675515+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"27'351","reported_seq":576,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:56.174343+0000","last_change":"2024-05-21T01:26:56.174369+0000","last_active":"2024-05-21T01:26:56.174343+0000","last_peered":"2024-05-21T01:26:56.174343+0000","last_clean":"2024-05-21T01:26:56.174343+0000","last_became_active":"2024-05-21T01:19:58.604108+0000","last_became_peered":"2024-05-21T01:19:58.604108+0000","last_unstale":"2024-05-21T01:26:56.174343+0000","last_undegraded":"2024-05-21T01:26:56.174343+0000","last_fullsized":"2024-05-21T01:26:56.174343+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'351","last_scrub_stamp":"2024-05-21T01:26:56.174261+0000","last_deep_scrub":"27'351","last_deep_scrub_stamp":"2024-05-21T01:26:56.174261+0000","last_clean_scrub_stamp":"2024-05-21T01:26:56.174261+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:45:59.495938+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":196,"num_read_kb":802816,"num_write":339,"num_write_kb":925696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"27'7","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:48.313689+0000","last_change":"2024-05-21T01:26:48.313716+0000","last_active":"2024-05-21T01:26:48.313689+0000","last_peered":"2024-05-21T01:26:48.313689+0000","last_clean":"2024-05-21T01:26:48.313689+0000","last_became_active":"2024-05-21T01:19:53.521265+0000","last_became_peered":"2024-05-21T01:19:53.521265+0000","last_unstale":"2024-05-21T01:26:48.313689+0000","last_undegraded":"2024-05-21T01:26:48.313689+0000","last_fullsized":"2024-05-21T01:26:48.313689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-05-21T01:26:48.313621+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-05-21T01:26:48.313621+0000","last_clean_scrub_stamp":"2024-05-21T01:26:48.313621+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:31:27.415046+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"27'9","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:46.815302+0000","last_change":"2024-05-21T01:26:46.815323+0000","last_active":"2024-05-21T01:26:46.815302+0000","last_peered":"2024-05-21T01:26:46.815302+0000","last_clean":"2024-05-21T01:26:46.815302+0000","last_became_active":"2024-05-21T01:19:54.536061+0000","last_became_peered":"2024-05-21T01:19:54.536061+0000","last_unstale":"2024-05-21T01:26:46.815302+0000","last_undegraded":"2024-05-21T01:26:46.815302+0000","last_fullsized":"2024-05-21T01:26:46.815302+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-05-21T01:26:46.815236+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-05-21T01:26:46.815236+0000","last_clean_scrub_stamp":"2024-05-21T01:26:46.815236+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:39:00.246159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"27'291","reported_seq":469,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:59.162018+0000","last_change":"2024-05-21T01:26:59.162047+0000","last_active":"2024-05-21T01:26:59.162018+0000","last_peered":"2024-05-21T01:26:59.162018+0000","last_clean":"2024-05-21T01:26:59.162018+0000","last_became_active":"2024-05-21T01:19:58.622672+0000","last_became_peered":"2024-05-21T01:19:58.622672+0000","last_unstale":"2024-05-21T01:26:59.162018+0000","last_undegraded":"2024-05-21T01:26:59.162018+0000","last_fullsized":"2024-05-21T01:26:59.162018+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'291","last_scrub_stamp":"2024-05-21T01:26:59.161939+0000","last_deep_scrub":"27'291","last_deep_scrub_stamp":"2024-05-21T01:26:59.161939+0000","last_clean_scrub_stamp":"2024-05-21T01:26:59.161939+0000","objects_scrubbed":0,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:59:43.678378+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":149,"num_read_kb":610304,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"27'3","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:46.250637+0000","last_change":"2024-05-21T01:26:46.250663+0000","last_active":"2024-05-21T01:26:46.250637+0000","last_peered":"2024-05-21T01:26:46.250637+0000","last_clean":"2024-05-21T01:26:46.250637+0000","last_became_active":"2024-05-21T01:19:53.521684+0000","last_became_peered":"2024-05-21T01:19:53.521684+0000","last_unstale":"2024-05-21T01:26:46.250637+0000","last_undegraded":"2024-05-21T01:26:46.250637+0000","last_fullsized":"2024-05-21T01:26:46.250637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-05-21T01:26:46.250574+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-05-21T01:26:46.250574+0000","last_clean_scrub_stamp":"2024-05-21T01:26:46.250574+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:47:44.164598+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"27'15","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:45.206984+0000","last_change":"2024-05-21T01:26:45.207004+0000","last_active":"2024-05-21T01:26:45.206984+0000","last_peered":"2024-05-21T01:26:45.206984+0000","last_clean":"2024-05-21T01:26:45.206984+0000","last_became_active":"2024-05-21T01:19:54.549291+0000","last_became_peered":"2024-05-21T01:19:54.549291+0000","last_unstale":"2024-05-21T01:26:45.206984+0000","last_undegraded":"2024-05-21T01:26:45.206984+0000","last_fullsized":"2024-05-21T01:26:45.206984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2024-05-21T01:26:45.206916+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2024-05-21T01:26:45.206916+0000","last_clean_scrub_stamp":"2024-05-21T01:26:45.206916+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:35:33.283072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"27'271","reported_seq":442,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:58.180680+0000","last_change":"2024-05-21T01:26:58.180706+0000","last_active":"2024-05-21T01:26:58.180680+0000","last_peered":"2024-05-21T01:26:58.180680+0000","last_clean":"2024-05-21T01:26:58.180680+0000","last_became_active":"2024-05-21T01:19:58.614313+0000","last_became_peered":"2024-05-21T01:19:58.614313+0000","last_unstale":"2024-05-21T01:26:58.180680+0000","last_undegraded":"2024-05-21T01:26:58.180680+0000","last_fullsized":"2024-05-21T01:26:58.180680+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'271","last_scrub_stamp":"2024-05-21T01:26:58.180599+0000","last_deep_scrub":"27'271","last_deep_scrub_stamp":"2024-05-21T01:26:58.180599+0000","last_clean_scrub_stamp":"2024-05-21T01:26:58.180599+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:11:09.915590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":581632,"num_write":252,"num_write_kb":688128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"27'5","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:50.139600+0000","last_change":"2024-05-21T01:26:50.139623+0000","last_active":"2024-05-21T01:26:50.139600+0000","last_peered":"2024-05-21T01:26:50.139600+0000","last_clean":"2024-05-21T01:26:50.139600+0000","last_became_active":"2024-05-21T01:19:54.545181+0000","last_became_peered":"2024-05-21T01:19:54.545181+0000","last_unstale":"2024-05-21T01:26:50.139600+0000","last_undegraded":"2024-05-21T01:26:50.139600+0000","last_fullsized":"2024-05-21T01:26:50.139600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-05-21T01:26:50.139518+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-05-21T01:26:50.139518+0000","last_clean_scrub_stamp":"2024-05-21T01:26:50.139518+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:24:40.691568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"27'7","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:59.093941+0000","last_change":"2024-05-21T01:26:59.093990+0000","last_active":"2024-05-21T01:26:59.093941+0000","last_peered":"2024-05-21T01:26:59.093941+0000","last_clean":"2024-05-21T01:26:59.093941+0000","last_became_active":"2024-05-21T01:19:53.535899+0000","last_became_peered":"2024-05-21T01:19:53.535899+0000","last_unstale":"2024-05-21T01:26:59.093941+0000","last_undegraded":"2024-05-21T01:26:59.093941+0000","last_fullsized":"2024-05-21T01:26:59.093941+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-05-21T01:26:59.093859+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-05-21T01:26:59.093859+0000","last_clean_scrub_stamp":"2024-05-21T01:26:59.093859+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:40:20.551343+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"27'326","reported_seq":529,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:44.628728+0000","last_change":"2024-05-21T01:19:58.621487+0000","last_active":"2024-05-21T01:26:44.628728+0000","last_peered":"2024-05-21T01:26:44.628728+0000","last_clean":"2024-05-21T01:26:44.628728+0000","last_became_active":"2024-05-21T01:19:58.621083+0000","last_became_peered":"2024-05-21T01:19:58.621083+0000","last_unstale":"2024-05-21T01:26:44.628728+0000","last_undegraded":"2024-05-21T01:26:44.628728+0000","last_fullsized":"2024-05-21T01:26:44.628728+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":181,"num_read_kb":741376,"num_write":309,"num_write_kb":843776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"27'8","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:52.797832+0000","last_change":"2024-05-21T01:26:52.797890+0000","last_active":"2024-05-21T01:26:52.797832+0000","last_peered":"2024-05-21T01:26:52.797832+0000","last_clean":"2024-05-21T01:26:52.797832+0000","last_became_active":"2024-05-21T01:19:54.571863+0000","last_became_peered":"2024-05-21T01:19:54.571863+0000","last_unstale":"2024-05-21T01:26:52.797832+0000","last_undegraded":"2024-05-21T01:26:52.797832+0000","last_fullsized":"2024-05-21T01:26:52.797832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-21T01:26:52.797652+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-21T01:26:52.797652+0000","last_clean_scrub_stamp":"2024-05-21T01:26:52.797652+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:14:16.510168+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"27'4","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:48.965511+0000","last_change":"2024-05-21T01:26:48.965626+0000","last_active":"2024-05-21T01:26:48.965511+0000","last_peered":"2024-05-21T01:26:48.965511+0000","last_clean":"2024-05-21T01:26:48.965511+0000","last_became_active":"2024-05-21T01:19:53.552694+0000","last_became_peered":"2024-05-21T01:19:53.552694+0000","last_unstale":"2024-05-21T01:26:48.965511+0000","last_undegraded":"2024-05-21T01:26:48.965511+0000","last_fullsized":"2024-05-21T01:26:48.965511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-21T01:26:48.965227+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-21T01:26:48.965227+0000","last_clean_scrub_stamp":"2024-05-21T01:26:48.965227+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T09:13:35.044857+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"27'300","reported_seq":498,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:27:00.260423+0000","last_change":"2024-05-21T01:27:00.260444+0000","last_active":"2024-05-21T01:27:00.260423+0000","last_peered":"2024-05-21T01:27:00.260423+0000","last_clean":"2024-05-21T01:27:00.260423+0000","last_became_active":"2024-05-21T01:19:58.594450+0000","last_became_peered":"2024-05-21T01:19:58.594450+0000","last_unstale":"2024-05-21T01:27:00.260423+0000","last_undegraded":"2024-05-21T01:27:00.260423+0000","last_fullsized":"2024-05-21T01:27:00.260423+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'300","last_scrub_stamp":"2024-05-21T01:27:00.260356+0000","last_deep_scrub":"27'300","last_deep_scrub_stamp":"2024-05-21T01:27:00.260356+0000","last_clean_scrub_stamp":"2024-05-21T01:27:00.260356+0000","objects_scrubbed":0,"log_size":300,"log_dups_size":0,"ondisk_log_size":300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:02:22.841987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":688128,"num_write":291,"num_write_kb":794624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"27'9","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:45.857714+0000","last_change":"2024-05-21T01:26:45.857771+0000","last_active":"2024-05-21T01:26:45.857714+0000","last_peered":"2024-05-21T01:26:45.857714+0000","last_clean":"2024-05-21T01:26:45.857714+0000","last_became_active":"2024-05-21T01:19:54.551583+0000","last_became_peered":"2024-05-21T01:19:54.551583+0000","last_unstale":"2024-05-21T01:26:45.857714+0000","last_undegraded":"2024-05-21T01:26:45.857714+0000","last_fullsized":"2024-05-21T01:26:45.857714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-05-21T01:26:45.857549+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-05-21T01:26:45.857549+0000","last_clean_scrub_stamp":"2024-05-21T01:26:45.857549+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:04:37.304112+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"27'5","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:46.861813+0000","last_change":"2024-05-21T01:26:46.861879+0000","last_active":"2024-05-21T01:26:46.861813+0000","last_peered":"2024-05-21T01:26:46.861813+0000","last_clean":"2024-05-21T01:26:46.861813+0000","last_became_active":"2024-05-21T01:19:53.522525+0000","last_became_peered":"2024-05-21T01:19:53.522525+0000","last_unstale":"2024-05-21T01:26:46.861813+0000","last_undegraded":"2024-05-21T01:26:46.861813+0000","last_fullsized":"2024-05-21T01:26:46.861813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-05-21T01:26:46.861655+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-05-21T01:26:46.861655+0000","last_clean_scrub_stamp":"2024-05-21T01:26:46.861655+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T13:06:56.920915+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"27'286","reported_seq":474,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:54.779707+0000","last_change":"2024-05-21T01:26:54.779824+0000","last_active":"2024-05-21T01:26:54.779707+0000","last_peered":"2024-05-21T01:26:54.779707+0000","last_clean":"2024-05-21T01:26:54.779707+0000","last_became_active":"2024-05-21T01:19:58.614401+0000","last_became_peered":"2024-05-21T01:19:58.614401+0000","last_unstale":"2024-05-21T01:26:54.779707+0000","last_undegraded":"2024-05-21T01:26:54.779707+0000","last_fullsized":"2024-05-21T01:26:54.779707+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'286","last_scrub_stamp":"2024-05-21T01:26:54.779430+0000","last_deep_scrub":"27'286","last_deep_scrub_stamp":"2024-05-21T01:26:54.779430+0000","last_clean_scrub_stamp":"2024-05-21T01:26:54.779430+0000","objects_scrubbed":0,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T09:20:35.692517+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":158,"num_read_kb":647168,"num_write":267,"num_write_kb":729088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"27'2","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:47.170331+0000","last_change":"2024-05-21T01:26:47.170354+0000","last_active":"2024-05-21T01:26:47.170331+0000","last_peered":"2024-05-21T01:26:47.170331+0000","last_clean":"2024-05-21T01:26:47.170331+0000","last_became_active":"2024-05-21T01:19:54.555227+0000","last_became_peered":"2024-05-21T01:19:54.555227+0000","last_unstale":"2024-05-21T01:26:47.170331+0000","last_undegraded":"2024-05-21T01:26:47.170331+0000","last_fullsized":"2024-05-21T01:26:47.170331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-21T01:26:47.170260+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-21T01:26:47.170260+0000","last_clean_scrub_stamp":"2024-05-21T01:26:47.170260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:49:45.419640+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"27'3","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:45.213973+0000","last_change":"2024-05-21T01:26:45.214017+0000","last_active":"2024-05-21T01:26:45.213973+0000","last_peered":"2024-05-21T01:26:45.213973+0000","last_clean":"2024-05-21T01:26:45.213973+0000","last_became_active":"2024-05-21T01:19:53.520540+0000","last_became_peered":"2024-05-21T01:19:53.520540+0000","last_unstale":"2024-05-21T01:26:45.213973+0000","last_undegraded":"2024-05-21T01:26:45.213973+0000","last_fullsized":"2024-05-21T01:26:45.213973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-05-21T01:26:45.213896+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-05-21T01:26:45.213896+0000","last_clean_scrub_stamp":"2024-05-21T01:26:45.213896+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:46:39.810336+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"27'300","reported_seq":500,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:54.121352+0000","last_change":"2024-05-21T01:26:54.121379+0000","last_active":"2024-05-21T01:26:54.121352+0000","last_peered":"2024-05-21T01:26:54.121352+0000","last_clean":"2024-05-21T01:26:54.121352+0000","last_became_active":"2024-05-21T01:19:58.603922+0000","last_became_peered":"2024-05-21T01:19:58.603922+0000","last_unstale":"2024-05-21T01:26:54.121352+0000","last_undegraded":"2024-05-21T01:26:54.121352+0000","last_fullsized":"2024-05-21T01:26:54.121352+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'300","last_scrub_stamp":"2024-05-21T01:26:54.121268+0000","last_deep_scrub":"27'300","last_deep_scrub_stamp":"2024-05-21T01:26:54.121268+0000","last_clean_scrub_stamp":"2024-05-21T01:26:54.121268+0000","objects_scrubbed":0,"log_size":300,"log_dups_size":0,"ondisk_log_size":300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:27:33.346161+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":170,"num_read_kb":696320,"num_write":288,"num_write_kb":786432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"27'7","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:56.748814+0000","last_change":"2024-05-21T01:26:56.748923+0000","last_active":"2024-05-21T01:26:56.748814+0000","last_peered":"2024-05-21T01:26:56.748814+0000","last_clean":"2024-05-21T01:26:56.748814+0000","last_became_active":"2024-05-21T01:19:54.568232+0000","last_became_peered":"2024-05-21T01:19:54.568232+0000","last_unstale":"2024-05-21T01:26:56.748814+0000","last_undegraded":"2024-05-21T01:26:56.748814+0000","last_fullsized":"2024-05-21T01:26:56.748814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-05-21T01:26:56.748591+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-05-21T01:26:56.748591+0000","last_clean_scrub_stamp":"2024-05-21T01:26:56.748591+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T09:25:00.912111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"27'7","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:55.131151+0000","last_change":"2024-05-21T01:26:55.131180+0000","last_active":"2024-05-21T01:26:55.131151+0000","last_peered":"2024-05-21T01:26:55.131151+0000","last_clean":"2024-05-21T01:26:55.131151+0000","last_became_active":"2024-05-21T01:19:53.525010+0000","last_became_peered":"2024-05-21T01:19:53.525010+0000","last_unstale":"2024-05-21T01:26:55.131151+0000","last_undegraded":"2024-05-21T01:26:55.131151+0000","last_fullsized":"2024-05-21T01:26:55.131151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-05-21T01:26:55.131069+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-05-21T01:26:55.131069+0000","last_clean_scrub_stamp":"2024-05-21T01:26:55.131069+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:45:10.945442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"27'273","reported_seq":431,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:53.158963+0000","last_change":"2024-05-21T01:26:53.158994+0000","last_active":"2024-05-21T01:26:53.158963+0000","last_peered":"2024-05-21T01:26:53.158963+0000","last_clean":"2024-05-21T01:26:53.158963+0000","last_became_active":"2024-05-21T01:19:58.589985+0000","last_became_peered":"2024-05-21T01:19:58.589985+0000","last_unstale":"2024-05-21T01:26:53.158963+0000","last_undegraded":"2024-05-21T01:26:53.158963+0000","last_fullsized":"2024-05-21T01:26:53.158963+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'273","last_scrub_stamp":"2024-05-21T01:26:53.158864+0000","last_deep_scrub":"27'273","last_deep_scrub_stamp":"2024-05-21T01:26:53.158864+0000","last_clean_scrub_stamp":"2024-05-21T01:26:53.158864+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:23:52.920362+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":524288,"num_write":249,"num_write_kb":679936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"27'5","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:54.752495+0000","last_change":"2024-05-21T01:26:54.752558+0000","last_active":"2024-05-21T01:26:54.752495+0000","last_peered":"2024-05-21T01:26:54.752495+0000","last_clean":"2024-05-21T01:26:54.752495+0000","last_became_active":"2024-05-21T01:19:54.552947+0000","last_became_peered":"2024-05-21T01:19:54.552947+0000","last_unstale":"2024-05-21T01:26:54.752495+0000","last_undegraded":"2024-05-21T01:26:54.752495+0000","last_fullsized":"2024-05-21T01:26:54.752495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-05-21T01:26:54.752316+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-05-21T01:26:54.752316+0000","last_clean_scrub_stamp":"2024-05-21T01:26:54.752316+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:41:41.002637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"27'34","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:47.813823+0000","last_change":"2024-05-21T01:26:47.813889+0000","last_active":"2024-05-21T01:26:47.813823+0000","last_peered":"2024-05-21T01:26:47.813823+0000","last_clean":"2024-05-21T01:26:47.813823+0000","last_became_active":"2024-05-21T01:19:53.521014+0000","last_became_peered":"2024-05-21T01:19:53.521014+0000","last_unstale":"2024-05-21T01:26:47.813823+0000","last_undegraded":"2024-05-21T01:26:47.813823+0000","last_fullsized":"2024-05-21T01:26:47.813823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'34","last_scrub_stamp":"2024-05-21T01:26:47.813640+0000","last_deep_scrub":"27'34","last_deep_scrub_stamp":"2024-05-21T01:26:47.813640+0000","last_clean_scrub_stamp":"2024-05-21T01:26:47.813640+0000","objects_scrubbed":2,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:39:44.370849+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"27'277","reported_seq":445,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:57.759337+0000","last_change":"2024-05-21T01:26:57.759372+0000","last_active":"2024-05-21T01:26:57.759337+0000","last_peered":"2024-05-21T01:26:57.759337+0000","last_clean":"2024-05-21T01:26:57.759337+0000","last_became_active":"2024-05-21T01:19:58.598712+0000","last_became_peered":"2024-05-21T01:19:58.598712+0000","last_unstale":"2024-05-21T01:26:57.759337+0000","last_undegraded":"2024-05-21T01:26:57.759337+0000","last_fullsized":"2024-05-21T01:26:57.759337+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'277","last_scrub_stamp":"2024-05-21T01:26:57.759225+0000","last_deep_scrub":"27'277","last_deep_scrub_stamp":"2024-05-21T01:26:57.759225+0000","last_clean_scrub_stamp":"2024-05-21T01:26:57.759225+0000","objects_scrubbed":0,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:52:53.947204+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":565248,"num_write":264,"num_write_kb":720896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"27'9","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:56.076810+0000","last_change":"2024-05-21T01:26:56.076877+0000","last_active":"2024-05-21T01:26:56.076810+0000","last_peered":"2024-05-21T01:26:56.076810+0000","last_clean":"2024-05-21T01:26:56.076810+0000","last_became_active":"2024-05-21T01:19:54.575543+0000","last_became_peered":"2024-05-21T01:19:54.575543+0000","last_unstale":"2024-05-21T01:26:56.076810+0000","last_undegraded":"2024-05-21T01:26:56.076810+0000","last_fullsized":"2024-05-21T01:26:56.076810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-05-21T01:26:56.076587+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-05-21T01:26:56.076587+0000","last_clean_scrub_stamp":"2024-05-21T01:26:56.076587+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:16:45.513170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"27'2","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:27:02.124208+0000","last_change":"2024-05-21T01:27:02.124240+0000","last_active":"2024-05-21T01:27:02.124208+0000","last_peered":"2024-05-21T01:27:02.124208+0000","last_clean":"2024-05-21T01:27:02.124208+0000","last_became_active":"2024-05-21T01:19:53.543450+0000","last_became_peered":"2024-05-21T01:19:53.543450+0000","last_unstale":"2024-05-21T01:27:02.124208+0000","last_undegraded":"2024-05-21T01:27:02.124208+0000","last_fullsized":"2024-05-21T01:27:02.124208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-21T01:27:02.124115+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-21T01:27:02.124115+0000","last_clean_scrub_stamp":"2024-05-21T01:27:02.124115+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:11:09.546221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"27'267","reported_seq":433,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:27:00.079645+0000","last_change":"2024-05-21T01:27:00.079720+0000","last_active":"2024-05-21T01:27:00.079645+0000","last_peered":"2024-05-21T01:27:00.079645+0000","last_clean":"2024-05-21T01:27:00.079645+0000","last_became_active":"2024-05-21T01:19:58.610837+0000","last_became_peered":"2024-05-21T01:19:58.610837+0000","last_unstale":"2024-05-21T01:27:00.079645+0000","last_undegraded":"2024-05-21T01:27:00.079645+0000","last_fullsized":"2024-05-21T01:27:00.079645+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'267","last_scrub_stamp":"2024-05-21T01:27:00.079454+0000","last_deep_scrub":"27'267","last_deep_scrub_stamp":"2024-05-21T01:27:00.079454+0000","last_clean_scrub_stamp":"2024-05-21T01:27:00.079454+0000","objects_scrubbed":0,"log_size":267,"log_dups_size":0,"ondisk_log_size":267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:46:36.795995+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":557056,"num_write":249,"num_write_kb":679936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"27'5","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:48.100447+0000","last_change":"2024-05-21T01:26:48.100469+0000","last_active":"2024-05-21T01:26:48.100447+0000","last_peered":"2024-05-21T01:26:48.100447+0000","last_clean":"2024-05-21T01:26:48.100447+0000","last_became_active":"2024-05-21T01:19:54.552812+0000","last_became_peered":"2024-05-21T01:19:54.552812+0000","last_unstale":"2024-05-21T01:26:48.100447+0000","last_undegraded":"2024-05-21T01:26:48.100447+0000","last_fullsized":"2024-05-21T01:26:48.100447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-05-21T01:26:48.100372+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-05-21T01:26:48.100372+0000","last_clean_scrub_stamp":"2024-05-21T01:26:48.100372+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:37:56.476991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:51.640833+0000","last_change":"2024-05-21T01:26:51.640883+0000","last_active":"2024-05-21T01:26:51.640833+0000","last_peered":"2024-05-21T01:26:51.640833+0000","last_clean":"2024-05-21T01:26:51.640833+0000","last_became_active":"2024-05-21T01:19:53.550921+0000","last_became_peered":"2024-05-21T01:19:53.550921+0000","last_unstale":"2024-05-21T01:26:51.640833+0000","last_undegraded":"2024-05-21T01:26:51.640833+0000","last_fullsized":"2024-05-21T01:26:51.640833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:26:51.640660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:26:51.640660+0000","last_clean_scrub_stamp":"2024-05-21T01:26:51.640660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:37:27.351577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"27'289","reported_seq":477,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:27:01.077703+0000","last_change":"2024-05-21T01:27:01.077766+0000","last_active":"2024-05-21T01:27:01.077703+0000","last_peered":"2024-05-21T01:27:01.077703+0000","last_clean":"2024-05-21T01:27:01.077703+0000","last_became_active":"2024-05-21T01:19:58.625720+0000","last_became_peered":"2024-05-21T01:19:58.625720+0000","last_unstale":"2024-05-21T01:27:01.077703+0000","last_undegraded":"2024-05-21T01:27:01.077703+0000","last_fullsized":"2024-05-21T01:27:01.077703+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'289","last_scrub_stamp":"2024-05-21T01:27:01.077521+0000","last_deep_scrub":"27'289","last_deep_scrub_stamp":"2024-05-21T01:27:01.077521+0000","last_clean_scrub_stamp":"2024-05-21T01:27:01.077521+0000","objects_scrubbed":0,"log_size":289,"log_dups_size":0,"ondisk_log_size":289,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:27:29.488982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":158,"num_read_kb":647168,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"27'7","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:56.271875+0000","last_change":"2024-05-21T01:26:56.271898+0000","last_active":"2024-05-21T01:26:56.271875+0000","last_peered":"2024-05-21T01:26:56.271875+0000","last_clean":"2024-05-21T01:26:56.271875+0000","last_became_active":"2024-05-21T01:19:54.547689+0000","last_became_peered":"2024-05-21T01:19:54.547689+0000","last_unstale":"2024-05-21T01:26:56.271875+0000","last_undegraded":"2024-05-21T01:26:56.271875+0000","last_fullsized":"2024-05-21T01:26:56.271875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-05-21T01:26:56.271795+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-05-21T01:26:56.271795+0000","last_clean_scrub_stamp":"2024-05-21T01:26:56.271795+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:15:00.986476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"25'1","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:27:01.119690+0000","last_change":"2024-05-21T01:27:01.119715+0000","last_active":"2024-05-21T01:27:01.119690+0000","last_peered":"2024-05-21T01:27:01.119690+0000","last_clean":"2024-05-21T01:27:01.119690+0000","last_became_active":"2024-05-21T01:19:53.540670+0000","last_became_peered":"2024-05-21T01:19:53.540670+0000","last_unstale":"2024-05-21T01:27:01.119690+0000","last_undegraded":"2024-05-21T01:27:01.119690+0000","last_fullsized":"2024-05-21T01:27:01.119690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1","last_scrub_stamp":"2024-05-21T01:27:01.119609+0000","last_deep_scrub":"25'1","last_deep_scrub_stamp":"2024-05-21T01:27:01.119609+0000","last_clean_scrub_stamp":"2024-05-21T01:27:01.119609+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:03:35.826287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"27'277","reported_seq":455,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:59.102482+0000","last_change":"2024-05-21T01:26:59.102617+0000","last_active":"2024-05-21T01:26:59.102482+0000","last_peered":"2024-05-21T01:26:59.102482+0000","last_clean":"2024-05-21T01:26:59.102482+0000","last_became_active":"2024-05-21T01:19:58.610511+0000","last_became_peered":"2024-05-21T01:19:58.610511+0000","last_unstale":"2024-05-21T01:26:59.102482+0000","last_undegraded":"2024-05-21T01:26:59.102482+0000","last_fullsized":"2024-05-21T01:26:59.102482+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'277","last_scrub_stamp":"2024-05-21T01:26:59.102256+0000","last_deep_scrub":"27'277","last_deep_scrub_stamp":"2024-05-21T01:26:59.102256+0000","last_clean_scrub_stamp":"2024-05-21T01:26:59.102256+0000","objects_scrubbed":0,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:09:51.121776+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":606208,"num_write":264,"num_write_kb":720896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"27'8","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:47.671126+0000","last_change":"2024-05-21T01:26:47.671185+0000","last_active":"2024-05-21T01:26:47.671126+0000","last_peered":"2024-05-21T01:26:47.671126+0000","last_clean":"2024-05-21T01:26:47.671126+0000","last_became_active":"2024-05-21T01:19:54.572022+0000","last_became_peered":"2024-05-21T01:19:54.572022+0000","last_unstale":"2024-05-21T01:26:47.671126+0000","last_undegraded":"2024-05-21T01:26:47.671126+0000","last_fullsized":"2024-05-21T01:26:47.671126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-21T01:26:47.670942+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-21T01:26:47.670942+0000","last_clean_scrub_stamp":"2024-05-21T01:26:47.670942+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T09:38:35.597083+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"27'12","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:49.865125+0000","last_change":"2024-05-21T01:26:49.865192+0000","last_active":"2024-05-21T01:26:49.865125+0000","last_peered":"2024-05-21T01:26:49.865125+0000","last_clean":"2024-05-21T01:26:49.865125+0000","last_became_active":"2024-05-21T01:19:53.556143+0000","last_became_peered":"2024-05-21T01:19:53.556143+0000","last_unstale":"2024-05-21T01:26:49.865125+0000","last_undegraded":"2024-05-21T01:26:49.865125+0000","last_fullsized":"2024-05-21T01:26:49.865125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'12","last_scrub_stamp":"2024-05-21T01:26:49.864953+0000","last_deep_scrub":"27'12","last_deep_scrub_stamp":"2024-05-21T01:26:49.864953+0000","last_clean_scrub_stamp":"2024-05-21T01:26:49.864953+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:36:12.668688+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":619,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"27'289","reported_seq":461,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:57.042800+0000","last_change":"2024-05-21T01:26:57.042866+0000","last_active":"2024-05-21T01:26:57.042800+0000","last_peered":"2024-05-21T01:26:57.042800+0000","last_clean":"2024-05-21T01:26:57.042800+0000","last_became_active":"2024-05-21T01:19:58.598175+0000","last_became_peered":"2024-05-21T01:19:58.598175+0000","last_unstale":"2024-05-21T01:26:57.042800+0000","last_undegraded":"2024-05-21T01:26:57.042800+0000","last_fullsized":"2024-05-21T01:26:57.042800+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'289","last_scrub_stamp":"2024-05-21T01:26:57.042609+0000","last_deep_scrub":"27'289","last_deep_scrub_stamp":"2024-05-21T01:26:57.042609+0000","last_clean_scrub_stamp":"2024-05-21T01:26:57.042609+0000","objects_scrubbed":0,"log_size":289,"log_dups_size":0,"ondisk_log_size":289,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:04:19.610256+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":581632,"num_write":270,"num_write_kb":737280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"27'5","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:49.993480+0000","last_change":"2024-05-21T01:26:49.993540+0000","last_active":"2024-05-21T01:26:49.993480+0000","last_peered":"2024-05-21T01:26:49.993480+0000","last_clean":"2024-05-21T01:26:49.993480+0000","last_became_active":"2024-05-21T01:19:54.550338+0000","last_became_peered":"2024-05-21T01:19:54.550338+0000","last_unstale":"2024-05-21T01:26:49.993480+0000","last_undegraded":"2024-05-21T01:26:49.993480+0000","last_fullsized":"2024-05-21T01:26:49.993480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-05-21T01:26:49.993305+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-05-21T01:26:49.993305+0000","last_clean_scrub_stamp":"2024-05-21T01:26:49.993305+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:49:15.700901+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"27'4","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:54.177892+0000","last_change":"2024-05-21T01:26:54.177922+0000","last_active":"2024-05-21T01:26:54.177892+0000","last_peered":"2024-05-21T01:26:54.177892+0000","last_clean":"2024-05-21T01:26:54.177892+0000","last_became_active":"2024-05-21T01:19:53.554598+0000","last_became_peered":"2024-05-21T01:19:53.554598+0000","last_unstale":"2024-05-21T01:26:54.177892+0000","last_undegraded":"2024-05-21T01:26:54.177892+0000","last_fullsized":"2024-05-21T01:26:54.177892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-21T01:26:54.177806+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-21T01:26:54.177806+0000","last_clean_scrub_stamp":"2024-05-21T01:26:54.177806+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T09:38:36.457589+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"27'351","reported_seq":559,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:38.371693+0000","last_change":"2024-05-21T01:19:58.629747+0000","last_active":"2024-05-21T01:26:38.371693+0000","last_peered":"2024-05-21T01:26:38.371693+0000","last_clean":"2024-05-21T01:26:38.371693+0000","last_became_active":"2024-05-21T01:19:58.622106+0000","last_became_peered":"2024-05-21T01:19:58.622106+0000","last_unstale":"2024-05-21T01:26:38.371693+0000","last_undegraded":"2024-05-21T01:26:38.371693+0000","last_fullsized":"2024-05-21T01:26:38.371693+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":761856,"num_write":339,"num_write_kb":925696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"27'8","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:53.718804+0000","last_change":"2024-05-21T01:26:53.718863+0000","last_active":"2024-05-21T01:26:53.718804+0000","last_peered":"2024-05-21T01:26:53.718804+0000","last_clean":"2024-05-21T01:26:53.718804+0000","last_became_active":"2024-05-21T01:19:54.552126+0000","last_became_peered":"2024-05-21T01:19:54.552126+0000","last_unstale":"2024-05-21T01:26:53.718804+0000","last_undegraded":"2024-05-21T01:26:53.718804+0000","last_fullsized":"2024-05-21T01:26:53.718804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-21T01:26:53.718634+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-21T01:26:53.718634+0000","last_clean_scrub_stamp":"2024-05-21T01:26:53.718634+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:14:06.384055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"27'6","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:27:00.074049+0000","last_change":"2024-05-21T01:27:00.074073+0000","last_active":"2024-05-21T01:27:00.074049+0000","last_peered":"2024-05-21T01:27:00.074049+0000","last_clean":"2024-05-21T01:27:00.074049+0000","last_became_active":"2024-05-21T01:19:53.535105+0000","last_became_peered":"2024-05-21T01:19:53.535105+0000","last_unstale":"2024-05-21T01:27:00.074049+0000","last_undegraded":"2024-05-21T01:27:00.074049+0000","last_fullsized":"2024-05-21T01:27:00.074049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-21T01:27:00.073984+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-21T01:27:00.073984+0000","last_clean_scrub_stamp":"2024-05-21T01:27:00.073984+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:57:39.293726+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"27'74","reported_seq":136,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:44.796614+0000","last_change":"2024-05-21T01:26:44.796644+0000","last_active":"2024-05-21T01:26:44.796614+0000","last_peered":"2024-05-21T01:26:44.796614+0000","last_clean":"2024-05-21T01:26:44.796614+0000","last_became_active":"2024-05-21T01:19:49.488796+0000","last_became_peered":"2024-05-21T01:19:49.488796+0000","last_unstale":"2024-05-21T01:26:44.796614+0000","last_undegraded":"2024-05-21T01:26:44.796614+0000","last_fullsized":"2024-05-21T01:26:44.796614+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'74","last_scrub_stamp":"2024-05-21T01:26:44.796558+0000","last_deep_scrub":"27'74","last_deep_scrub_stamp":"2024-05-21T01:26:44.796558+0000","last_clean_scrub_stamp":"2024-05-21T01:26:44.796558+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:49:48.754501+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"27'292","reported_seq":469,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:38.411397+0000","last_change":"2024-05-21T01:19:58.590851+0000","last_active":"2024-05-21T01:26:38.411397+0000","last_peered":"2024-05-21T01:26:38.411397+0000","last_clean":"2024-05-21T01:26:38.411397+0000","last_became_active":"2024-05-21T01:19:58.589288+0000","last_became_peered":"2024-05-21T01:19:58.589288+0000","last_unstale":"2024-05-21T01:26:38.411397+0000","last_undegraded":"2024-05-21T01:26:38.411397+0000","last_fullsized":"2024-05-21T01:26:38.411397+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":292,"log_dups_size":0,"ondisk_log_size":292,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":155,"num_read_kb":634880,"num_write":276,"num_write_kb":753664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"27'7","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:52.149763+0000","last_change":"2024-05-21T01:26:52.149787+0000","last_active":"2024-05-21T01:26:52.149763+0000","last_peered":"2024-05-21T01:26:52.149763+0000","last_clean":"2024-05-21T01:26:52.149763+0000","last_became_active":"2024-05-21T01:19:54.543586+0000","last_became_peered":"2024-05-21T01:19:54.543586+0000","last_unstale":"2024-05-21T01:26:52.149763+0000","last_undegraded":"2024-05-21T01:26:52.149763+0000","last_fullsized":"2024-05-21T01:26:52.149763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-05-21T01:26:52.149680+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-05-21T01:26:52.149680+0000","last_clean_scrub_stamp":"2024-05-21T01:26:52.149680+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:12:27.624595+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"27'5","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:47.975792+0000","last_change":"2024-05-21T01:26:47.975914+0000","last_active":"2024-05-21T01:26:47.975792+0000","last_peered":"2024-05-21T01:26:47.975792+0000","last_clean":"2024-05-21T01:26:47.975792+0000","last_became_active":"2024-05-21T01:19:53.529879+0000","last_became_peered":"2024-05-21T01:19:53.529879+0000","last_unstale":"2024-05-21T01:26:47.975792+0000","last_undegraded":"2024-05-21T01:26:47.975792+0000","last_fullsized":"2024-05-21T01:26:47.975792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-05-21T01:26:47.975523+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-05-21T01:26:47.975523+0000","last_clean_scrub_stamp":"2024-05-21T01:26:47.975523+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:43:22.816436+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"27'301","reported_seq":491,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:55.169346+0000","last_change":"2024-05-21T01:26:55.169394+0000","last_active":"2024-05-21T01:26:55.169346+0000","last_peered":"2024-05-21T01:26:55.169346+0000","last_clean":"2024-05-21T01:26:55.169346+0000","last_became_active":"2024-05-21T01:19:58.603929+0000","last_became_peered":"2024-05-21T01:19:58.603929+0000","last_unstale":"2024-05-21T01:26:55.169346+0000","last_undegraded":"2024-05-21T01:26:55.169346+0000","last_fullsized":"2024-05-21T01:26:55.169346+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'301","last_scrub_stamp":"2024-05-21T01:26:55.169259+0000","last_deep_scrub":"27'301","last_deep_scrub_stamp":"2024-05-21T01:26:55.169259+0000","last_clean_scrub_stamp":"2024-05-21T01:26:55.169259+0000","objects_scrubbed":0,"log_size":301,"log_dups_size":0,"ondisk_log_size":301,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:42:08.929644+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":655360,"num_write":279,"num_write_kb":761856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"27'6","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:53.323996+0000","last_change":"2024-05-21T01:26:53.324022+0000","last_active":"2024-05-21T01:26:53.323996+0000","last_peered":"2024-05-21T01:26:53.323996+0000","last_clean":"2024-05-21T01:26:53.323996+0000","last_became_active":"2024-05-21T01:19:54.541837+0000","last_became_peered":"2024-05-21T01:19:54.541837+0000","last_unstale":"2024-05-21T01:26:53.323996+0000","last_undegraded":"2024-05-21T01:26:53.323996+0000","last_fullsized":"2024-05-21T01:26:53.323996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-21T01:26:53.323914+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-21T01:26:53.323914+0000","last_clean_scrub_stamp":"2024-05-21T01:26:53.323914+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:01:05.767815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"27'2","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:52.662451+0000","last_change":"2024-05-21T01:26:52.662518+0000","last_active":"2024-05-21T01:26:52.662451+0000","last_peered":"2024-05-21T01:26:52.662451+0000","last_clean":"2024-05-21T01:26:52.662451+0000","last_became_active":"2024-05-21T01:19:53.550893+0000","last_became_peered":"2024-05-21T01:19:53.550893+0000","last_unstale":"2024-05-21T01:26:52.662451+0000","last_undegraded":"2024-05-21T01:26:52.662451+0000","last_fullsized":"2024-05-21T01:26:52.662451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-21T01:26:52.662284+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-21T01:26:52.662284+0000","last_clean_scrub_stamp":"2024-05-21T01:26:52.662284+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:31:44.375845+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"27'271","reported_seq":435,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:43.531183+0000","last_change":"2024-05-21T01:19:58.628526+0000","last_active":"2024-05-21T01:26:43.531183+0000","last_peered":"2024-05-21T01:26:43.531183+0000","last_clean":"2024-05-21T01:26:43.531183+0000","last_became_active":"2024-05-21T01:19:58.620667+0000","last_became_peered":"2024-05-21T01:19:58.620667+0000","last_unstale":"2024-05-21T01:26:43.531183+0000","last_undegraded":"2024-05-21T01:26:43.531183+0000","last_fullsized":"2024-05-21T01:26:43.531183+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":581632,"num_write":261,"num_write_kb":712704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"27'9","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:51.309162+0000","last_change":"2024-05-21T01:26:51.309201+0000","last_active":"2024-05-21T01:26:51.309162+0000","last_peered":"2024-05-21T01:26:51.309162+0000","last_clean":"2024-05-21T01:26:51.309162+0000","last_became_active":"2024-05-21T01:19:54.532251+0000","last_became_peered":"2024-05-21T01:19:54.532251+0000","last_unstale":"2024-05-21T01:26:51.309162+0000","last_undegraded":"2024-05-21T01:26:51.309162+0000","last_fullsized":"2024-05-21T01:26:51.309162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-05-21T01:26:51.309083+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-05-21T01:26:51.309083+0000","last_clean_scrub_stamp":"2024-05-21T01:26:51.309083+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:27:22.553011+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"27'3","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:50.734352+0000","last_change":"2024-05-21T01:26:50.734416+0000","last_active":"2024-05-21T01:26:50.734352+0000","last_peered":"2024-05-21T01:26:50.734352+0000","last_clean":"2024-05-21T01:26:50.734352+0000","last_became_active":"2024-05-21T01:19:53.553953+0000","last_became_peered":"2024-05-21T01:19:53.553953+0000","last_unstale":"2024-05-21T01:26:50.734352+0000","last_undegraded":"2024-05-21T01:26:50.734352+0000","last_fullsized":"2024-05-21T01:26:50.734352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-05-21T01:26:50.734180+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-05-21T01:26:50.734180+0000","last_clean_scrub_stamp":"2024-05-21T01:26:50.734180+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:58:44.907145+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"27'333","reported_seq":525,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:38.398391+0000","last_change":"2024-05-21T01:19:58.593243+0000","last_active":"2024-05-21T01:26:38.398391+0000","last_peered":"2024-05-21T01:26:38.398391+0000","last_clean":"2024-05-21T01:26:38.398391+0000","last_became_active":"2024-05-21T01:19:58.592758+0000","last_became_peered":"2024-05-21T01:19:58.592758+0000","last_unstale":"2024-05-21T01:26:38.398391+0000","last_undegraded":"2024-05-21T01:26:38.398391+0000","last_fullsized":"2024-05-21T01:26:38.398391+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":333,"log_dups_size":0,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":170,"num_read_kb":696320,"num_write":318,"num_write_kb":868352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"27'5","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:46.077555+0000","last_change":"2024-05-21T01:26:46.077615+0000","last_active":"2024-05-21T01:26:46.077555+0000","last_peered":"2024-05-21T01:26:46.077555+0000","last_clean":"2024-05-21T01:26:46.077555+0000","last_became_active":"2024-05-21T01:19:54.538106+0000","last_became_peered":"2024-05-21T01:19:54.538106+0000","last_unstale":"2024-05-21T01:26:46.077555+0000","last_undegraded":"2024-05-21T01:26:46.077555+0000","last_fullsized":"2024-05-21T01:26:46.077555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-05-21T01:26:46.077462+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-05-21T01:26:46.077462+0000","last_clean_scrub_stamp":"2024-05-21T01:26:46.077462+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:00:40.231333+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"27'4","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:50.323699+0000","last_change":"2024-05-21T01:26:50.323732+0000","last_active":"2024-05-21T01:26:50.323699+0000","last_peered":"2024-05-21T01:26:50.323699+0000","last_clean":"2024-05-21T01:26:50.323699+0000","last_became_active":"2024-05-21T01:19:53.551608+0000","last_became_peered":"2024-05-21T01:19:53.551608+0000","last_unstale":"2024-05-21T01:26:50.323699+0000","last_undegraded":"2024-05-21T01:26:50.323699+0000","last_fullsized":"2024-05-21T01:26:50.323699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-21T01:26:50.323620+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-21T01:26:50.323620+0000","last_clean_scrub_stamp":"2024-05-21T01:26:50.323620+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:38:57.957402+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"27'274","reported_seq":439,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:51.898093+0000","last_change":"2024-05-21T01:26:51.898120+0000","last_active":"2024-05-21T01:26:51.898093+0000","last_peered":"2024-05-21T01:26:51.898093+0000","last_clean":"2024-05-21T01:26:51.898093+0000","last_became_active":"2024-05-21T01:19:58.612950+0000","last_became_peered":"2024-05-21T01:19:58.612950+0000","last_unstale":"2024-05-21T01:26:51.898093+0000","last_undegraded":"2024-05-21T01:26:51.898093+0000","last_fullsized":"2024-05-21T01:26:51.898093+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'274","last_scrub_stamp":"2024-05-21T01:26:51.897999+0000","last_deep_scrub":"27'274","last_deep_scrub_stamp":"2024-05-21T01:26:51.897999+0000","last_clean_scrub_stamp":"2024-05-21T01:26:51.897999+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:29:26.293479+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":135,"num_read_kb":552960,"num_write":258,"num_write_kb":704512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"27'6","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:46.178595+0000","last_change":"2024-05-21T01:26:46.178595+0000","last_active":"2024-05-21T01:26:46.178595+0000","last_peered":"2024-05-21T01:26:46.178595+0000","last_clean":"2024-05-21T01:26:46.178595+0000","last_became_active":"2024-05-21T01:19:54.548704+0000","last_became_peered":"2024-05-21T01:19:54.548704+0000","last_unstale":"2024-05-21T01:26:46.178595+0000","last_undegraded":"2024-05-21T01:26:46.178595+0000","last_fullsized":"2024-05-21T01:26:46.178595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-21T01:26:46.178499+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-21T01:26:46.178499+0000","last_clean_scrub_stamp":"2024-05-21T01:26:46.178499+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:00:45.652703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"27'24","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:48.796750+0000","last_change":"2024-05-21T01:26:48.796750+0000","last_active":"2024-05-21T01:26:48.796750+0000","last_peered":"2024-05-21T01:26:48.796750+0000","last_clean":"2024-05-21T01:26:48.796750+0000","last_became_active":"2024-05-21T01:19:53.541577+0000","last_became_peered":"2024-05-21T01:19:53.541577+0000","last_unstale":"2024-05-21T01:26:48.796750+0000","last_undegraded":"2024-05-21T01:26:48.796750+0000","last_fullsized":"2024-05-21T01:26:48.796750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'24","last_scrub_stamp":"2024-05-21T01:26:48.796408+0000","last_deep_scrub":"27'24","last_deep_scrub_stamp":"2024-05-21T01:26:48.796408+0000","last_clean_scrub_stamp":"2024-05-21T01:26:48.796408+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:08:47.580902+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"27'384","reported_seq":613,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:38.429215+0000","last_change":"2024-05-21T01:20:43.554019+0000","last_active":"2024-05-21T01:26:38.429215+0000","last_peered":"2024-05-21T01:26:38.429215+0000","last_clean":"2024-05-21T01:26:38.429215+0000","last_became_active":"2024-05-21T01:20:43.553035+0000","last_became_peered":"2024-05-21T01:20:43.553035+0000","last_unstale":"2024-05-21T01:26:38.429215+0000","last_undegraded":"2024-05-21T01:26:38.429215+0000","last_fullsized":"2024-05-21T01:26:38.429215+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":201,"num_read_kb":823296,"num_write":360,"num_write_kb":983040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1,6],"acting":[5,0,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"27'6","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:50.898610+0000","last_change":"2024-05-21T01:26:50.898610+0000","last_active":"2024-05-21T01:26:50.898610+0000","last_peered":"2024-05-21T01:26:50.898610+0000","last_clean":"2024-05-21T01:26:50.898610+0000","last_became_active":"2024-05-21T01:19:54.575314+0000","last_became_peered":"2024-05-21T01:19:54.575314+0000","last_unstale":"2024-05-21T01:26:50.898610+0000","last_undegraded":"2024-05-21T01:26:50.898610+0000","last_fullsized":"2024-05-21T01:26:50.898610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-21T01:26:50.898503+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-21T01:26:50.898503+0000","last_clean_scrub_stamp":"2024-05-21T01:26:50.898503+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T09:59:23.106731+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"27'5","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:47.267532+0000","last_change":"2024-05-21T01:26:47.267532+0000","last_active":"2024-05-21T01:26:47.267532+0000","last_peered":"2024-05-21T01:26:47.267532+0000","last_clean":"2024-05-21T01:26:47.267532+0000","last_became_active":"2024-05-21T01:19:53.523273+0000","last_became_peered":"2024-05-21T01:19:53.523273+0000","last_unstale":"2024-05-21T01:26:47.267532+0000","last_undegraded":"2024-05-21T01:26:47.267532+0000","last_fullsized":"2024-05-21T01:26:47.267532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-05-21T01:26:47.267430+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-05-21T01:26:47.267430+0000","last_clean_scrub_stamp":"2024-05-21T01:26:47.267430+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:25:53.047123+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"27'288","reported_seq":464,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:27:02.628932+0000","last_change":"2024-05-21T01:27:02.628994+0000","last_active":"2024-05-21T01:27:02.628932+0000","last_peered":"2024-05-21T01:27:02.628932+0000","last_clean":"2024-05-21T01:27:02.628932+0000","last_became_active":"2024-05-21T01:19:58.620552+0000","last_became_peered":"2024-05-21T01:19:58.620552+0000","last_unstale":"2024-05-21T01:27:02.628932+0000","last_undegraded":"2024-05-21T01:27:02.628932+0000","last_fullsized":"2024-05-21T01:27:02.628932+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'288","last_scrub_stamp":"2024-05-21T01:27:02.628723+0000","last_deep_scrub":"27'288","last_deep_scrub_stamp":"2024-05-21T01:27:02.628723+0000","last_clean_scrub_stamp":"2024-05-21T01:27:02.628723+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:20:36.174348+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":602112,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"27'15","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:53.169233+0000","last_change":"2024-05-21T01:26:53.169233+0000","last_active":"2024-05-21T01:26:53.169233+0000","last_peered":"2024-05-21T01:26:53.169233+0000","last_clean":"2024-05-21T01:26:53.169233+0000","last_became_active":"2024-05-21T01:19:54.550335+0000","last_became_peered":"2024-05-21T01:19:54.550335+0000","last_unstale":"2024-05-21T01:26:53.169233+0000","last_undegraded":"2024-05-21T01:26:53.169233+0000","last_fullsized":"2024-05-21T01:26:53.169233+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2024-05-21T01:26:53.169135+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2024-05-21T01:26:53.169135+0000","last_clean_scrub_stamp":"2024-05-21T01:26:53.169135+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:31:53.581830+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"27'4","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:58.140249+0000","last_change":"2024-05-21T01:26:58.140276+0000","last_active":"2024-05-21T01:26:58.140249+0000","last_peered":"2024-05-21T01:26:58.140249+0000","last_clean":"2024-05-21T01:26:58.140249+0000","last_became_active":"2024-05-21T01:19:53.534174+0000","last_became_peered":"2024-05-21T01:19:53.534174+0000","last_unstale":"2024-05-21T01:26:58.140249+0000","last_undegraded":"2024-05-21T01:26:58.140249+0000","last_fullsized":"2024-05-21T01:26:58.140249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-21T01:26:58.140170+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-21T01:26:58.140170+0000","last_clean_scrub_stamp":"2024-05-21T01:26:58.140170+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:29:16.639637+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"27'287","reported_seq":463,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:58.082502+0000","last_change":"2024-05-21T01:26:58.082502+0000","last_active":"2024-05-21T01:26:58.082502+0000","last_peered":"2024-05-21T01:26:58.082502+0000","last_clean":"2024-05-21T01:26:58.082502+0000","last_became_active":"2024-05-21T01:19:58.608371+0000","last_became_peered":"2024-05-21T01:19:58.608371+0000","last_unstale":"2024-05-21T01:26:58.082502+0000","last_undegraded":"2024-05-21T01:26:58.082502+0000","last_fullsized":"2024-05-21T01:26:58.082502+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'287","last_scrub_stamp":"2024-05-21T01:26:58.082269+0000","last_deep_scrub":"27'287","last_deep_scrub_stamp":"2024-05-21T01:26:58.082269+0000","last_clean_scrub_stamp":"2024-05-21T01:26:58.082269+0000","objects_scrubbed":0,"log_size":287,"log_dups_size":0,"ondisk_log_size":287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:28:59.156049+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":598016,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"27'10","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:51.036284+0000","last_change":"2024-05-21T01:26:51.036284+0000","last_active":"2024-05-21T01:26:51.036284+0000","last_peered":"2024-05-21T01:26:51.036284+0000","last_clean":"2024-05-21T01:26:51.036284+0000","last_became_active":"2024-05-21T01:19:54.550865+0000","last_became_peered":"2024-05-21T01:19:54.550865+0000","last_unstale":"2024-05-21T01:26:51.036284+0000","last_undegraded":"2024-05-21T01:26:51.036284+0000","last_fullsized":"2024-05-21T01:26:51.036284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-05-21T01:26:51.036056+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-05-21T01:26:51.036056+0000","last_clean_scrub_stamp":"2024-05-21T01:26:51.036056+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T13:09:58.969165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"27'10","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:47.807209+0000","last_change":"2024-05-21T01:26:47.807209+0000","last_active":"2024-05-21T01:26:47.807209+0000","last_peered":"2024-05-21T01:26:47.807209+0000","last_clean":"2024-05-21T01:26:47.807209+0000","last_became_active":"2024-05-21T01:19:53.535143+0000","last_became_peered":"2024-05-21T01:19:53.535143+0000","last_unstale":"2024-05-21T01:26:47.807209+0000","last_undegraded":"2024-05-21T01:26:47.807209+0000","last_fullsized":"2024-05-21T01:26:47.807209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-05-21T01:26:47.806870+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-05-21T01:26:47.806870+0000","last_clean_scrub_stamp":"2024-05-21T01:26:47.806870+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:57:05.622671+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"27'338","reported_seq":543,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:38.344966+0000","last_change":"2024-05-21T01:19:58.622615+0000","last_active":"2024-05-21T01:26:38.344966+0000","last_peered":"2024-05-21T01:26:38.344966+0000","last_clean":"2024-05-21T01:26:38.344966+0000","last_became_active":"2024-05-21T01:19:58.622250+0000","last_became_peered":"2024-05-21T01:19:58.622250+0000","last_unstale":"2024-05-21T01:26:38.344966+0000","last_undegraded":"2024-05-21T01:26:38.344966+0000","last_fullsized":"2024-05-21T01:26:38.344966+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":184,"num_read_kb":753664,"num_write":327,"num_write_kb":892928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"27'6","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:58.293255+0000","last_change":"2024-05-21T01:26:58.293280+0000","last_active":"2024-05-21T01:26:58.293255+0000","last_peered":"2024-05-21T01:26:58.293255+0000","last_clean":"2024-05-21T01:26:58.293255+0000","last_became_active":"2024-05-21T01:19:54.558095+0000","last_became_peered":"2024-05-21T01:19:54.558095+0000","last_unstale":"2024-05-21T01:26:58.293255+0000","last_undegraded":"2024-05-21T01:26:58.293255+0000","last_fullsized":"2024-05-21T01:26:58.293255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-21T01:26:58.293178+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-21T01:26:58.293178+0000","last_clean_scrub_stamp":"2024-05-21T01:26:58.293178+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:13:58.311888+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'1406","reported_seq":1444,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:45.094295+0000","last_change":"2024-05-21T01:26:45.094295+0000","last_active":"2024-05-21T01:26:45.094295+0000","last_peered":"2024-05-21T01:26:45.094295+0000","last_clean":"2024-05-21T01:26:45.094295+0000","last_became_active":"2024-05-21T01:19:53.534616+0000","last_became_peered":"2024-05-21T01:19:53.534616+0000","last_unstale":"2024-05-21T01:26:45.094295+0000","last_undegraded":"2024-05-21T01:26:45.094295+0000","last_fullsized":"2024-05-21T01:26:45.094295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1406","last_scrub_stamp":"2024-05-21T01:26:45.094198+0000","last_deep_scrub":"27'1406","last_deep_scrub_stamp":"2024-05-21T01:26:45.094198+0000","last_clean_scrub_stamp":"2024-05-21T01:26:45.094198+0000","objects_scrubbed":5,"log_size":1406,"log_dups_size":0,"ondisk_log_size":1406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T09:39:30.902222+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2842259,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1403,"num_write_kb":2944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"27'304","reported_seq":494,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:59.723147+0000","last_change":"2024-05-21T01:26:59.723147+0000","last_active":"2024-05-21T01:26:59.723147+0000","last_peered":"2024-05-21T01:26:59.723147+0000","last_clean":"2024-05-21T01:26:59.723147+0000","last_became_active":"2024-05-21T01:19:58.617061+0000","last_became_peered":"2024-05-21T01:19:58.617061+0000","last_unstale":"2024-05-21T01:26:59.723147+0000","last_undegraded":"2024-05-21T01:26:59.723147+0000","last_fullsized":"2024-05-21T01:26:59.723147+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'304","last_scrub_stamp":"2024-05-21T01:26:59.722898+0000","last_deep_scrub":"27'304","last_deep_scrub_stamp":"2024-05-21T01:26:59.722898+0000","last_clean_scrub_stamp":"2024-05-21T01:26:59.722898+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:48:35.778604+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":655360,"num_write":288,"num_write_kb":786432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"27'11","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:51.167457+0000","last_change":"2024-05-21T01:26:51.167457+0000","last_active":"2024-05-21T01:26:51.167457+0000","last_peered":"2024-05-21T01:26:51.167457+0000","last_clean":"2024-05-21T01:26:51.167457+0000","last_became_active":"2024-05-21T01:19:54.556933+0000","last_became_peered":"2024-05-21T01:19:54.556933+0000","last_unstale":"2024-05-21T01:26:51.167457+0000","last_undegraded":"2024-05-21T01:26:51.167457+0000","last_fullsized":"2024-05-21T01:26:51.167457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'11","last_scrub_stamp":"2024-05-21T01:26:51.167295+0000","last_deep_scrub":"27'11","last_deep_scrub_stamp":"2024-05-21T01:26:51.167295+0000","last_clean_scrub_stamp":"2024-05-21T01:26:51.167295+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T13:06:16.111290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"27'11","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:48.846835+0000","last_change":"2024-05-21T01:26:48.846907+0000","last_active":"2024-05-21T01:26:48.846835+0000","last_peered":"2024-05-21T01:26:48.846835+0000","last_clean":"2024-05-21T01:26:48.846835+0000","last_became_active":"2024-05-21T01:19:53.535768+0000","last_became_peered":"2024-05-21T01:19:53.535768+0000","last_unstale":"2024-05-21T01:26:48.846835+0000","last_undegraded":"2024-05-21T01:26:48.846835+0000","last_fullsized":"2024-05-21T01:26:48.846835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'11","last_scrub_stamp":"2024-05-21T01:26:48.846672+0000","last_deep_scrub":"27'11","last_deep_scrub_stamp":"2024-05-21T01:26:48.846672+0000","last_clean_scrub_stamp":"2024-05-21T01:26:48.846672+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:53:56.087430+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"27'320","reported_seq":524,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:57.145709+0000","last_change":"2024-05-21T01:26:57.145709+0000","last_active":"2024-05-21T01:26:57.145709+0000","last_peered":"2024-05-21T01:26:57.145709+0000","last_clean":"2024-05-21T01:26:57.145709+0000","last_became_active":"2024-05-21T01:19:58.606180+0000","last_became_peered":"2024-05-21T01:19:58.606180+0000","last_unstale":"2024-05-21T01:26:57.145709+0000","last_undegraded":"2024-05-21T01:26:57.145709+0000","last_fullsized":"2024-05-21T01:26:57.145709+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'320","last_scrub_stamp":"2024-05-21T01:26:57.145599+0000","last_deep_scrub":"27'320","last_deep_scrub_stamp":"2024-05-21T01:26:57.145599+0000","last_clean_scrub_stamp":"2024-05-21T01:26:57.145599+0000","objects_scrubbed":0,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:30:22.101240+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":174,"num_read_kb":712704,"num_write":297,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"27'9","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:49.600228+0000","last_change":"2024-05-21T01:26:49.600285+0000","last_active":"2024-05-21T01:26:49.600228+0000","last_peered":"2024-05-21T01:26:49.600228+0000","last_clean":"2024-05-21T01:26:49.600228+0000","last_became_active":"2024-05-21T01:19:54.568778+0000","last_became_peered":"2024-05-21T01:19:54.568778+0000","last_unstale":"2024-05-21T01:26:49.600228+0000","last_undegraded":"2024-05-21T01:26:49.600228+0000","last_fullsized":"2024-05-21T01:26:49.600228+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-05-21T01:26:49.600047+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-05-21T01:26:49.600047+0000","last_clean_scrub_stamp":"2024-05-21T01:26:49.600047+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:46:31.103087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"27'3","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:49.277940+0000","last_change":"2024-05-21T01:26:49.277970+0000","last_active":"2024-05-21T01:26:49.277940+0000","last_peered":"2024-05-21T01:26:49.277940+0000","last_clean":"2024-05-21T01:26:49.277940+0000","last_became_active":"2024-05-21T01:19:53.526431+0000","last_became_peered":"2024-05-21T01:19:53.526431+0000","last_unstale":"2024-05-21T01:26:49.277940+0000","last_undegraded":"2024-05-21T01:26:49.277940+0000","last_fullsized":"2024-05-21T01:26:49.277940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-05-21T01:26:49.277863+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-05-21T01:26:49.277863+0000","last_clean_scrub_stamp":"2024-05-21T01:26:49.277863+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:59:08.625024+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"27'316","reported_seq":500,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:53.785202+0000","last_change":"2024-05-21T01:26:53.785202+0000","last_active":"2024-05-21T01:26:53.785202+0000","last_peered":"2024-05-21T01:26:53.785202+0000","last_clean":"2024-05-21T01:26:53.785202+0000","last_became_active":"2024-05-21T01:19:58.610838+0000","last_became_peered":"2024-05-21T01:19:58.610838+0000","last_unstale":"2024-05-21T01:26:53.785202+0000","last_undegraded":"2024-05-21T01:26:53.785202+0000","last_fullsized":"2024-05-21T01:26:53.785202+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'316","last_scrub_stamp":"2024-05-21T01:26:53.784948+0000","last_deep_scrub":"27'316","last_deep_scrub_stamp":"2024-05-21T01:26:53.784948+0000","last_clean_scrub_stamp":"2024-05-21T01:26:53.784948+0000","objects_scrubbed":0,"log_size":316,"log_dups_size":0,"ondisk_log_size":316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:20:50.020880+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":630784,"num_write":297,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"27'10","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:50.106632+0000","last_change":"2024-05-21T01:26:50.106656+0000","last_active":"2024-05-21T01:26:50.106632+0000","last_peered":"2024-05-21T01:26:50.106632+0000","last_clean":"2024-05-21T01:26:50.106632+0000","last_became_active":"2024-05-21T01:19:54.547898+0000","last_became_peered":"2024-05-21T01:19:54.547898+0000","last_unstale":"2024-05-21T01:26:50.106632+0000","last_undegraded":"2024-05-21T01:26:50.106632+0000","last_fullsized":"2024-05-21T01:26:50.106632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-05-21T01:26:50.106550+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-05-21T01:26:50.106550+0000","last_clean_scrub_stamp":"2024-05-21T01:26:50.106550+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:54:03.172902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"27'6","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:45.792971+0000","last_change":"2024-05-21T01:26:45.792997+0000","last_active":"2024-05-21T01:26:45.792971+0000","last_peered":"2024-05-21T01:26:45.792971+0000","last_clean":"2024-05-21T01:26:45.792971+0000","last_became_active":"2024-05-21T01:19:53.534036+0000","last_became_peered":"2024-05-21T01:19:53.534036+0000","last_unstale":"2024-05-21T01:26:45.792971+0000","last_undegraded":"2024-05-21T01:26:45.792971+0000","last_fullsized":"2024-05-21T01:26:45.792971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-21T01:26:45.792908+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-21T01:26:45.792908+0000","last_clean_scrub_stamp":"2024-05-21T01:26:45.792908+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:50:29.526470+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"27'342","reported_seq":546,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:58.758513+0000","last_change":"2024-05-21T01:26:58.758513+0000","last_active":"2024-05-21T01:26:58.758513+0000","last_peered":"2024-05-21T01:26:58.758513+0000","last_clean":"2024-05-21T01:26:58.758513+0000","last_became_active":"2024-05-21T01:19:58.607242+0000","last_became_peered":"2024-05-21T01:19:58.607242+0000","last_unstale":"2024-05-21T01:26:58.758513+0000","last_undegraded":"2024-05-21T01:26:58.758513+0000","last_fullsized":"2024-05-21T01:26:58.758513+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'342","last_scrub_stamp":"2024-05-21T01:26:58.758144+0000","last_deep_scrub":"27'342","last_deep_scrub_stamp":"2024-05-21T01:26:58.758144+0000","last_clean_scrub_stamp":"2024-05-21T01:26:58.758144+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:22:23.250356+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":174,"num_read_kb":712704,"num_write":327,"num_write_kb":892928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"27'287","reported_seq":473,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:27:01.684382+0000","last_change":"2024-05-21T01:27:01.684515+0000","last_active":"2024-05-21T01:27:01.684382+0000","last_peered":"2024-05-21T01:27:01.684382+0000","last_clean":"2024-05-21T01:27:01.684382+0000","last_became_active":"2024-05-21T01:19:58.623991+0000","last_became_peered":"2024-05-21T01:19:58.623991+0000","last_unstale":"2024-05-21T01:27:01.684382+0000","last_undegraded":"2024-05-21T01:27:01.684382+0000","last_fullsized":"2024-05-21T01:27:01.684382+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'287","last_scrub_stamp":"2024-05-21T01:27:01.684139+0000","last_deep_scrub":"27'287","last_deep_scrub_stamp":"2024-05-21T01:27:01.684139+0000","last_clean_scrub_stamp":"2024-05-21T01:27:01.684139+0000","objects_scrubbed":0,"log_size":287,"log_dups_size":0,"ondisk_log_size":287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:36:27.654144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":156,"num_read_kb":638976,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"27'11","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:51.720596+0000","last_change":"2024-05-21T01:26:51.720671+0000","last_active":"2024-05-21T01:26:51.720596+0000","last_peered":"2024-05-21T01:26:51.720596+0000","last_clean":"2024-05-21T01:26:51.720596+0000","last_became_active":"2024-05-21T01:19:54.548426+0000","last_became_peered":"2024-05-21T01:19:54.548426+0000","last_unstale":"2024-05-21T01:26:51.720596+0000","last_undegraded":"2024-05-21T01:26:51.720596+0000","last_fullsized":"2024-05-21T01:26:51.720596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'11","last_scrub_stamp":"2024-05-21T01:26:51.720404+0000","last_deep_scrub":"27'11","last_deep_scrub_stamp":"2024-05-21T01:26:51.720404+0000","last_clean_scrub_stamp":"2024-05-21T01:26:51.720404+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:03:41.545353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"25'1","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:57.149511+0000","last_change":"2024-05-21T01:26:57.149559+0000","last_active":"2024-05-21T01:26:57.149511+0000","last_peered":"2024-05-21T01:26:57.149511+0000","last_clean":"2024-05-21T01:26:57.149511+0000","last_became_active":"2024-05-21T01:19:53.525786+0000","last_became_peered":"2024-05-21T01:19:53.525786+0000","last_unstale":"2024-05-21T01:26:57.149511+0000","last_undegraded":"2024-05-21T01:26:57.149511+0000","last_fullsized":"2024-05-21T01:26:57.149511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1","last_scrub_stamp":"2024-05-21T01:26:57.149423+0000","last_deep_scrub":"25'1","last_deep_scrub_stamp":"2024-05-21T01:26:57.149423+0000","last_clean_scrub_stamp":"2024-05-21T01:26:57.149423+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:33:00.429829+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"27'277","reported_seq":451,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:38.416295+0000","last_change":"2024-05-21T01:19:58.615481+0000","last_active":"2024-05-21T01:26:38.416295+0000","last_peered":"2024-05-21T01:26:38.416295+0000","last_clean":"2024-05-21T01:26:38.416295+0000","last_became_active":"2024-05-21T01:19:58.614879+0000","last_became_peered":"2024-05-21T01:19:58.614879+0000","last_unstale":"2024-05-21T01:26:38.416295+0000","last_undegraded":"2024-05-21T01:26:38.416295+0000","last_fullsized":"2024-05-21T01:26:38.416295+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:57.549460+0000","last_clean_scrub_stamp":"2024-05-21T01:19:57.549460+0000","objects_scrubbed":0,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":622592,"num_write":267,"num_write_kb":729088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"27'8","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:57.641351+0000","last_change":"2024-05-21T01:26:57.641459+0000","last_active":"2024-05-21T01:26:57.641351+0000","last_peered":"2024-05-21T01:26:57.641351+0000","last_clean":"2024-05-21T01:26:57.641351+0000","last_became_active":"2024-05-21T01:19:54.570034+0000","last_became_peered":"2024-05-21T01:19:54.570034+0000","last_unstale":"2024-05-21T01:26:57.641351+0000","last_undegraded":"2024-05-21T01:26:57.641351+0000","last_fullsized":"2024-05-21T01:26:57.641351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-21T01:26:57.641143+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-21T01:26:57.641143+0000","last_clean_scrub_stamp":"2024-05-21T01:26:57.641143+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:42:59.746002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"27'3","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:46.950492+0000","last_change":"2024-05-21T01:26:46.950561+0000","last_active":"2024-05-21T01:26:46.950492+0000","last_peered":"2024-05-21T01:26:46.950492+0000","last_clean":"2024-05-21T01:26:46.950492+0000","last_became_active":"2024-05-21T01:19:53.529457+0000","last_became_peered":"2024-05-21T01:19:53.529457+0000","last_unstale":"2024-05-21T01:26:46.950492+0000","last_undegraded":"2024-05-21T01:26:46.950492+0000","last_fullsized":"2024-05-21T01:26:46.950492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-05-21T01:26:46.950315+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-05-21T01:26:46.950315+0000","last_clean_scrub_stamp":"2024-05-21T01:26:46.950315+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:38:49.774838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"27'4","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:56.115895+0000","last_change":"2024-05-21T01:26:56.115946+0000","last_active":"2024-05-21T01:26:56.115895+0000","last_peered":"2024-05-21T01:26:56.115895+0000","last_clean":"2024-05-21T01:26:56.115895+0000","last_became_active":"2024-05-21T01:19:53.525315+0000","last_became_peered":"2024-05-21T01:19:53.525315+0000","last_unstale":"2024-05-21T01:26:56.115895+0000","last_undegraded":"2024-05-21T01:26:56.115895+0000","last_fullsized":"2024-05-21T01:26:56.115895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-21T01:26:56.115813+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-21T01:26:56.115813+0000","last_clean_scrub_stamp":"2024-05-21T01:26:56.115813+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:25:23.684582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"27'8","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:55.703346+0000","last_change":"2024-05-21T01:26:55.703404+0000","last_active":"2024-05-21T01:26:55.703346+0000","last_peered":"2024-05-21T01:26:55.703346+0000","last_clean":"2024-05-21T01:26:55.703346+0000","last_became_active":"2024-05-21T01:19:54.552817+0000","last_became_peered":"2024-05-21T01:19:54.552817+0000","last_unstale":"2024-05-21T01:26:55.703346+0000","last_undegraded":"2024-05-21T01:26:55.703346+0000","last_fullsized":"2024-05-21T01:26:55.703346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-21T01:26:55.703178+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-21T01:26:55.703178+0000","last_clean_scrub_stamp":"2024-05-21T01:26:55.703178+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:30:14.511638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"27'316","reported_seq":515,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:27:00.707594+0000","last_change":"2024-05-21T01:27:00.707661+0000","last_active":"2024-05-21T01:27:00.707594+0000","last_peered":"2024-05-21T01:27:00.707594+0000","last_clean":"2024-05-21T01:27:00.707594+0000","last_became_active":"2024-05-21T01:19:58.617165+0000","last_became_peered":"2024-05-21T01:19:58.617165+0000","last_unstale":"2024-05-21T01:27:00.707594+0000","last_undegraded":"2024-05-21T01:27:00.707594+0000","last_fullsized":"2024-05-21T01:27:00.707594+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'316","last_scrub_stamp":"2024-05-21T01:27:00.707401+0000","last_deep_scrub":"27'316","last_deep_scrub_stamp":"2024-05-21T01:27:00.707401+0000","last_clean_scrub_stamp":"2024-05-21T01:27:00.707401+0000","objects_scrubbed":0,"log_size":316,"log_dups_size":0,"ondisk_log_size":316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:46:29.130647+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":170,"num_read_kb":696320,"num_write":297,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"27'8","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:50.648665+0000","last_change":"2024-05-21T01:26:50.648784+0000","last_active":"2024-05-21T01:26:50.648665+0000","last_peered":"2024-05-21T01:26:50.648665+0000","last_clean":"2024-05-21T01:26:50.648665+0000","last_became_active":"2024-05-21T01:19:53.550931+0000","last_became_peered":"2024-05-21T01:19:53.550931+0000","last_unstale":"2024-05-21T01:26:50.648665+0000","last_undegraded":"2024-05-21T01:26:50.648665+0000","last_fullsized":"2024-05-21T01:26:50.648665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-21T01:26:50.648439+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-21T01:26:50.648439+0000","last_clean_scrub_stamp":"2024-05-21T01:26:50.648439+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:37:42.476807+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1021,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"27'7","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:49.878602+0000","last_change":"2024-05-21T01:26:49.878628+0000","last_active":"2024-05-21T01:26:49.878602+0000","last_peered":"2024-05-21T01:26:49.878602+0000","last_clean":"2024-05-21T01:26:49.878602+0000","last_became_active":"2024-05-21T01:19:54.574246+0000","last_became_peered":"2024-05-21T01:19:54.574246+0000","last_unstale":"2024-05-21T01:26:49.878602+0000","last_undegraded":"2024-05-21T01:26:49.878602+0000","last_fullsized":"2024-05-21T01:26:49.878602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-05-21T01:26:49.878514+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-05-21T01:26:49.878514+0000","last_clean_scrub_stamp":"2024-05-21T01:26:49.878514+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:51:40.472391+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"27'326","reported_seq":527,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:56.788749+0000","last_change":"2024-05-21T01:26:56.788819+0000","last_active":"2024-05-21T01:26:56.788749+0000","last_peered":"2024-05-21T01:26:56.788749+0000","last_clean":"2024-05-21T01:26:56.788749+0000","last_became_active":"2024-05-21T01:19:58.623388+0000","last_became_peered":"2024-05-21T01:19:58.623388+0000","last_unstale":"2024-05-21T01:26:56.788749+0000","last_undegraded":"2024-05-21T01:26:56.788749+0000","last_fullsized":"2024-05-21T01:26:56.788749+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'326","last_scrub_stamp":"2024-05-21T01:26:56.788525+0000","last_deep_scrub":"27'326","last_deep_scrub_stamp":"2024-05-21T01:26:56.788525+0000","last_clean_scrub_stamp":"2024-05-21T01:26:56.788525+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:40:16.665568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":704512,"num_write":312,"num_write_kb":851968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"27'9","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:49.073599+0000","last_change":"2024-05-21T01:26:49.073625+0000","last_active":"2024-05-21T01:26:49.073599+0000","last_peered":"2024-05-21T01:26:49.073599+0000","last_clean":"2024-05-21T01:26:49.073599+0000","last_became_active":"2024-05-21T01:19:54.553060+0000","last_became_peered":"2024-05-21T01:19:54.553060+0000","last_unstale":"2024-05-21T01:26:49.073599+0000","last_undegraded":"2024-05-21T01:26:49.073599+0000","last_fullsized":"2024-05-21T01:26:49.073599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-05-21T01:26:49.073514+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-05-21T01:26:49.073514+0000","last_clean_scrub_stamp":"2024-05-21T01:26:49.073514+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:35:50.226987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"27'12","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:50.852458+0000","last_change":"2024-05-21T01:26:50.852517+0000","last_active":"2024-05-21T01:26:50.852458+0000","last_peered":"2024-05-21T01:26:50.852458+0000","last_clean":"2024-05-21T01:26:50.852458+0000","last_became_active":"2024-05-21T01:19:54.565573+0000","last_became_peered":"2024-05-21T01:19:54.565573+0000","last_unstale":"2024-05-21T01:26:50.852458+0000","last_undegraded":"2024-05-21T01:26:50.852458+0000","last_fullsized":"2024-05-21T01:26:50.852458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'12","last_scrub_stamp":"2024-05-21T01:26:50.852273+0000","last_deep_scrub":"27'12","last_deep_scrub_stamp":"2024-05-21T01:26:50.852273+0000","last_clean_scrub_stamp":"2024-05-21T01:26:50.852273+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:18:24.504637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"27'8","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:27:04.128708+0000","last_change":"2024-05-21T01:27:04.128734+0000","last_active":"2024-05-21T01:27:04.128708+0000","last_peered":"2024-05-21T01:27:04.128708+0000","last_clean":"2024-05-21T01:27:04.128708+0000","last_became_active":"2024-05-21T01:19:54.566503+0000","last_became_peered":"2024-05-21T01:19:54.566503+0000","last_unstale":"2024-05-21T01:27:04.128708+0000","last_undegraded":"2024-05-21T01:27:04.128708+0000","last_fullsized":"2024-05-21T01:27:04.128708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-21T01:27:04.128624+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-21T01:27:04.128624+0000","last_clean_scrub_stamp":"2024-05-21T01:27:04.128624+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:11:38.532259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"27'7","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:48.620951+0000","last_change":"2024-05-21T01:26:48.621008+0000","last_active":"2024-05-21T01:26:48.620951+0000","last_peered":"2024-05-21T01:26:48.620951+0000","last_clean":"2024-05-21T01:26:48.620951+0000","last_became_active":"2024-05-21T01:19:54.572366+0000","last_became_peered":"2024-05-21T01:19:54.572366+0000","last_unstale":"2024-05-21T01:26:48.620951+0000","last_undegraded":"2024-05-21T01:26:48.620951+0000","last_fullsized":"2024-05-21T01:26:48.620951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-05-21T01:26:48.620762+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-05-21T01:26:48.620762+0000","last_clean_scrub_stamp":"2024-05-21T01:26:48.620762+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:06:40.734926+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"27'4","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:55.028095+0000","last_change":"2024-05-21T01:26:55.028153+0000","last_active":"2024-05-21T01:26:55.028095+0000","last_peered":"2024-05-21T01:26:55.028095+0000","last_clean":"2024-05-21T01:26:55.028095+0000","last_became_active":"2024-05-21T01:19:54.557934+0000","last_became_peered":"2024-05-21T01:19:54.557934+0000","last_unstale":"2024-05-21T01:26:55.028095+0000","last_undegraded":"2024-05-21T01:26:55.028095+0000","last_fullsized":"2024-05-21T01:26:55.028095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-21T01:26:55.027904+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-21T01:26:55.027904+0000","last_clean_scrub_stamp":"2024-05-21T01:26:55.027904+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:27:42.261888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"27'6","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:51.997264+0000","last_change":"2024-05-21T01:26:51.997389+0000","last_active":"2024-05-21T01:26:51.997264+0000","last_peered":"2024-05-21T01:26:51.997264+0000","last_clean":"2024-05-21T01:26:51.997264+0000","last_became_active":"2024-05-21T01:19:54.552812+0000","last_became_peered":"2024-05-21T01:19:54.552812+0000","last_unstale":"2024-05-21T01:26:51.997264+0000","last_undegraded":"2024-05-21T01:26:51.997264+0000","last_fullsized":"2024-05-21T01:26:51.997264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-21T01:26:51.997028+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-21T01:26:51.997028+0000","last_clean_scrub_stamp":"2024-05-21T01:26:51.997028+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:04:40.370306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"27'15","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:47.073598+0000","last_change":"2024-05-21T01:26:47.073619+0000","last_active":"2024-05-21T01:26:47.073598+0000","last_peered":"2024-05-21T01:26:47.073598+0000","last_clean":"2024-05-21T01:26:47.073598+0000","last_became_active":"2024-05-21T01:19:54.548263+0000","last_became_peered":"2024-05-21T01:19:54.548263+0000","last_unstale":"2024-05-21T01:26:47.073598+0000","last_undegraded":"2024-05-21T01:26:47.073598+0000","last_fullsized":"2024-05-21T01:26:47.073598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2024-05-21T01:26:47.073535+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2024-05-21T01:26:47.073535+0000","last_clean_scrub_stamp":"2024-05-21T01:26:47.073535+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T13:05:21.179383+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"27'2","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:59.653649+0000","last_change":"2024-05-21T01:26:59.653706+0000","last_active":"2024-05-21T01:26:59.653649+0000","last_peered":"2024-05-21T01:26:59.653649+0000","last_clean":"2024-05-21T01:26:59.653649+0000","last_became_active":"2024-05-21T01:19:54.570373+0000","last_became_peered":"2024-05-21T01:19:54.570373+0000","last_unstale":"2024-05-21T01:26:59.653649+0000","last_undegraded":"2024-05-21T01:26:59.653649+0000","last_fullsized":"2024-05-21T01:26:59.653649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-21T01:26:59.653482+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-21T01:26:59.653482+0000","last_clean_scrub_stamp":"2024-05-21T01:26:59.653482+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:47:11.215573+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"27'6","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:39.924020+0000","last_change":"2024-05-21T01:19:54.575196+0000","last_active":"2024-05-21T01:26:39.924020+0000","last_peered":"2024-05-21T01:26:39.924020+0000","last_clean":"2024-05-21T01:26:39.924020+0000","last_became_active":"2024-05-21T01:19:54.574945+0000","last_became_peered":"2024-05-21T01:19:54.574945+0000","last_unstale":"2024-05-21T01:26:39.924020+0000","last_undegraded":"2024-05-21T01:26:39.924020+0000","last_fullsized":"2024-05-21T01:26:39.924020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:19:53.497636+0000","last_clean_scrub_stamp":"2024-05-21T01:19:53.497636+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"27'8","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:54.630621+0000","last_change":"2024-05-21T01:26:54.630746+0000","last_active":"2024-05-21T01:26:54.630621+0000","last_peered":"2024-05-21T01:26:54.630621+0000","last_clean":"2024-05-21T01:26:54.630621+0000","last_became_active":"2024-05-21T01:19:54.565922+0000","last_became_peered":"2024-05-21T01:19:54.565922+0000","last_unstale":"2024-05-21T01:26:54.630621+0000","last_undegraded":"2024-05-21T01:26:54.630621+0000","last_fullsized":"2024-05-21T01:26:54.630621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-21T01:26:54.630337+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-21T01:26:54.630337+0000","last_clean_scrub_stamp":"2024-05-21T01:26:54.630337+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:12:55.698213+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"27'10","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:47.823174+0000","last_change":"2024-05-21T01:26:47.823194+0000","last_active":"2024-05-21T01:26:47.823174+0000","last_peered":"2024-05-21T01:26:47.823174+0000","last_clean":"2024-05-21T01:26:47.823174+0000","last_became_active":"2024-05-21T01:19:54.535957+0000","last_became_peered":"2024-05-21T01:19:54.535957+0000","last_unstale":"2024-05-21T01:26:47.823174+0000","last_undegraded":"2024-05-21T01:26:47.823174+0000","last_fullsized":"2024-05-21T01:26:47.823174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-05-21T01:26:47.823109+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-05-21T01:26:47.823109+0000","last_clean_scrub_stamp":"2024-05-21T01:26:47.823109+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:27:06.305010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"27'11","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:52.683376+0000","last_change":"2024-05-21T01:26:52.683439+0000","last_active":"2024-05-21T01:26:52.683376+0000","last_peered":"2024-05-21T01:26:52.683376+0000","last_clean":"2024-05-21T01:26:52.683376+0000","last_became_active":"2024-05-21T01:19:54.551790+0000","last_became_peered":"2024-05-21T01:19:54.551790+0000","last_unstale":"2024-05-21T01:26:52.683376+0000","last_undegraded":"2024-05-21T01:26:52.683376+0000","last_fullsized":"2024-05-21T01:26:52.683376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'11","last_scrub_stamp":"2024-05-21T01:26:52.683205+0000","last_deep_scrub":"27'11","last_deep_scrub_stamp":"2024-05-21T01:26:52.683205+0000","last_clean_scrub_stamp":"2024-05-21T01:26:52.683205+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:42:37.768211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"27'8","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:44.195055+0000","last_change":"2024-05-21T01:26:44.195074+0000","last_active":"2024-05-21T01:26:44.195055+0000","last_peered":"2024-05-21T01:26:44.195055+0000","last_clean":"2024-05-21T01:26:44.195055+0000","last_became_active":"2024-05-21T01:19:54.534793+0000","last_became_peered":"2024-05-21T01:19:54.534793+0000","last_unstale":"2024-05-21T01:26:44.195055+0000","last_undegraded":"2024-05-21T01:26:44.195055+0000","last_fullsized":"2024-05-21T01:26:44.195055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-21T01:26:44.194989+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-21T01:26:44.194989+0000","last_clean_scrub_stamp":"2024-05-21T01:26:44.194989+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:25:26.245486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"27'7","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:49.100476+0000","last_change":"2024-05-21T01:26:49.100499+0000","last_active":"2024-05-21T01:26:49.100476+0000","last_peered":"2024-05-21T01:26:49.100476+0000","last_clean":"2024-05-21T01:26:49.100476+0000","last_became_active":"2024-05-21T01:19:54.556043+0000","last_became_peered":"2024-05-21T01:19:54.556043+0000","last_unstale":"2024-05-21T01:26:49.100476+0000","last_undegraded":"2024-05-21T01:26:49.100476+0000","last_fullsized":"2024-05-21T01:26:49.100476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-05-21T01:26:49.100392+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-05-21T01:26:49.100392+0000","last_clean_scrub_stamp":"2024-05-21T01:26:49.100392+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:13:35.689703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"27'10","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:51.838759+0000","last_change":"2024-05-21T01:26:51.838759+0000","last_active":"2024-05-21T01:26:51.838759+0000","last_peered":"2024-05-21T01:26:51.838759+0000","last_clean":"2024-05-21T01:26:51.838759+0000","last_became_active":"2024-05-21T01:19:54.565326+0000","last_became_peered":"2024-05-21T01:19:54.565326+0000","last_unstale":"2024-05-21T01:26:51.838759+0000","last_undegraded":"2024-05-21T01:26:51.838759+0000","last_fullsized":"2024-05-21T01:26:51.838759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-05-21T01:26:51.838514+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-05-21T01:26:51.838514+0000","last_clean_scrub_stamp":"2024-05-21T01:26:51.838514+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:18:30.869056+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"27'8","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:27:03.117802+0000","last_change":"2024-05-21T01:27:03.117828+0000","last_active":"2024-05-21T01:27:03.117802+0000","last_peered":"2024-05-21T01:27:03.117802+0000","last_clean":"2024-05-21T01:27:03.117802+0000","last_became_active":"2024-05-21T01:19:54.558286+0000","last_became_peered":"2024-05-21T01:19:54.558286+0000","last_unstale":"2024-05-21T01:27:03.117802+0000","last_undegraded":"2024-05-21T01:27:03.117802+0000","last_fullsized":"2024-05-21T01:27:03.117802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-21T01:27:03.117709+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-21T01:27:03.117709+0000","last_clean_scrub_stamp":"2024-05-21T01:27:03.117709+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:22:41.823621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"27'9","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:48.131202+0000","last_change":"2024-05-21T01:26:48.131202+0000","last_active":"2024-05-21T01:26:48.131202+0000","last_peered":"2024-05-21T01:26:48.131202+0000","last_clean":"2024-05-21T01:26:48.131202+0000","last_became_active":"2024-05-21T01:19:54.548079+0000","last_became_peered":"2024-05-21T01:19:54.548079+0000","last_unstale":"2024-05-21T01:26:48.131202+0000","last_undegraded":"2024-05-21T01:26:48.131202+0000","last_fullsized":"2024-05-21T01:26:48.131202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-05-21T01:26:48.131107+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-05-21T01:26:48.131107+0000","last_clean_scrub_stamp":"2024-05-21T01:26:48.131107+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:11:41.499264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"27'7","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:56.638131+0000","last_change":"2024-05-21T01:26:56.638131+0000","last_active":"2024-05-21T01:26:56.638131+0000","last_peered":"2024-05-21T01:26:56.638131+0000","last_clean":"2024-05-21T01:26:56.638131+0000","last_became_active":"2024-05-21T01:19:54.567512+0000","last_became_peered":"2024-05-21T01:19:54.567512+0000","last_unstale":"2024-05-21T01:26:56.638131+0000","last_undegraded":"2024-05-21T01:26:56.638131+0000","last_fullsized":"2024-05-21T01:26:56.638131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-05-21T01:26:56.637893+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-05-21T01:26:56.637893+0000","last_clean_scrub_stamp":"2024-05-21T01:26:56.637893+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:16:16.449745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"27'8","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:53.003654+0000","last_change":"2024-05-21T01:26:53.003654+0000","last_active":"2024-05-21T01:26:53.003654+0000","last_peered":"2024-05-21T01:26:53.003654+0000","last_clean":"2024-05-21T01:26:53.003654+0000","last_became_active":"2024-05-21T01:19:54.555947+0000","last_became_peered":"2024-05-21T01:19:54.555947+0000","last_unstale":"2024-05-21T01:26:53.003654+0000","last_undegraded":"2024-05-21T01:26:53.003654+0000","last_fullsized":"2024-05-21T01:26:53.003654+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-21T01:26:53.003418+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-21T01:26:53.003418+0000","last_clean_scrub_stamp":"2024-05-21T01:26:53.003418+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:34:27.465308+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"27'10","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:54.005887+0000","last_change":"2024-05-21T01:26:54.005944+0000","last_active":"2024-05-21T01:26:54.005887+0000","last_peered":"2024-05-21T01:26:54.005887+0000","last_clean":"2024-05-21T01:26:54.005887+0000","last_became_active":"2024-05-21T01:19:54.557787+0000","last_became_peered":"2024-05-21T01:19:54.557787+0000","last_unstale":"2024-05-21T01:26:54.005887+0000","last_undegraded":"2024-05-21T01:26:54.005887+0000","last_fullsized":"2024-05-21T01:26:54.005887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-05-21T01:26:54.005706+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-05-21T01:26:54.005706+0000","last_clean_scrub_stamp":"2024-05-21T01:26:54.005706+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T13:25:17.913268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"27'7","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:52.346619+0000","last_change":"2024-05-21T01:26:52.346643+0000","last_active":"2024-05-21T01:26:52.346619+0000","last_peered":"2024-05-21T01:26:52.346619+0000","last_clean":"2024-05-21T01:26:52.346619+0000","last_became_active":"2024-05-21T01:19:54.534472+0000","last_became_peered":"2024-05-21T01:19:54.534472+0000","last_unstale":"2024-05-21T01:26:52.346619+0000","last_undegraded":"2024-05-21T01:26:52.346619+0000","last_fullsized":"2024-05-21T01:26:52.346619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-05-21T01:26:52.346535+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-05-21T01:26:52.346535+0000","last_clean_scrub_stamp":"2024-05-21T01:26:52.346535+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:45:13.941585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"27'6","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:54.326882+0000","last_change":"2024-05-21T01:26:54.326906+0000","last_active":"2024-05-21T01:26:54.326882+0000","last_peered":"2024-05-21T01:26:54.326882+0000","last_clean":"2024-05-21T01:26:54.326882+0000","last_became_active":"2024-05-21T01:19:54.546055+0000","last_became_peered":"2024-05-21T01:19:54.546055+0000","last_unstale":"2024-05-21T01:26:54.326882+0000","last_undegraded":"2024-05-21T01:26:54.326882+0000","last_fullsized":"2024-05-21T01:26:54.326882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-21T01:26:54.326803+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-21T01:26:54.326803+0000","last_clean_scrub_stamp":"2024-05-21T01:26:54.326803+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:37:54.153133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"27'16","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:57.837280+0000","last_change":"2024-05-21T01:26:57.837339+0000","last_active":"2024-05-21T01:26:57.837280+0000","last_peered":"2024-05-21T01:26:57.837280+0000","last_clean":"2024-05-21T01:26:57.837280+0000","last_became_active":"2024-05-21T01:20:43.550179+0000","last_became_peered":"2024-05-21T01:20:43.550179+0000","last_unstale":"2024-05-21T01:26:57.837280+0000","last_undegraded":"2024-05-21T01:26:57.837280+0000","last_fullsized":"2024-05-21T01:26:57.837280+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'16","last_scrub_stamp":"2024-05-21T01:26:57.837110+0000","last_deep_scrub":"27'16","last_deep_scrub_stamp":"2024-05-21T01:26:57.837110+0000","last_clean_scrub_stamp":"2024-05-21T01:26:57.837110+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:28:17.786528+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.37","version":"27'11","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:48.846792+0000","last_change":"2024-05-21T01:26:48.846819+0000","last_active":"2024-05-21T01:26:48.846792+0000","last_peered":"2024-05-21T01:26:48.846792+0000","last_clean":"2024-05-21T01:26:48.846792+0000","last_became_active":"2024-05-21T01:19:54.547528+0000","last_became_peered":"2024-05-21T01:19:54.547528+0000","last_unstale":"2024-05-21T01:26:48.846792+0000","last_undegraded":"2024-05-21T01:26:48.846792+0000","last_fullsized":"2024-05-21T01:26:48.846792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'11","last_scrub_stamp":"2024-05-21T01:26:48.846694+0000","last_deep_scrub":"27'11","last_deep_scrub_stamp":"2024-05-21T01:26:48.846694+0000","last_clean_scrub_stamp":"2024-05-21T01:26:48.846694+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:30:24.322290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"27'9","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:27:00.610071+0000","last_change":"2024-05-21T01:27:00.610134+0000","last_active":"2024-05-21T01:27:00.610071+0000","last_peered":"2024-05-21T01:27:00.610071+0000","last_clean":"2024-05-21T01:27:00.610071+0000","last_became_active":"2024-05-21T01:19:54.570119+0000","last_became_peered":"2024-05-21T01:19:54.570119+0000","last_unstale":"2024-05-21T01:27:00.610071+0000","last_undegraded":"2024-05-21T01:27:00.610071+0000","last_fullsized":"2024-05-21T01:27:00.610071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-05-21T01:27:00.609852+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-05-21T01:27:00.609852+0000","last_clean_scrub_stamp":"2024-05-21T01:27:00.609852+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:33:03.269744+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"27'5","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:57.274530+0000","last_change":"2024-05-21T01:26:57.274575+0000","last_active":"2024-05-21T01:26:57.274530+0000","last_peered":"2024-05-21T01:26:57.274530+0000","last_clean":"2024-05-21T01:26:57.274530+0000","last_became_active":"2024-05-21T01:19:54.549617+0000","last_became_peered":"2024-05-21T01:19:54.549617+0000","last_unstale":"2024-05-21T01:26:57.274530+0000","last_undegraded":"2024-05-21T01:26:57.274530+0000","last_fullsized":"2024-05-21T01:26:57.274530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-05-21T01:26:57.274420+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-05-21T01:26:57.274420+0000","last_clean_scrub_stamp":"2024-05-21T01:26:57.274420+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:24:13.974538+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"27'6","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:51.154137+0000","last_change":"2024-05-21T01:26:51.154162+0000","last_active":"2024-05-21T01:26:51.154137+0000","last_peered":"2024-05-21T01:26:51.154137+0000","last_clean":"2024-05-21T01:26:51.154137+0000","last_became_active":"2024-05-21T01:19:54.555274+0000","last_became_peered":"2024-05-21T01:19:54.555274+0000","last_unstale":"2024-05-21T01:26:51.154137+0000","last_undegraded":"2024-05-21T01:26:51.154137+0000","last_fullsized":"2024-05-21T01:26:51.154137+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-21T01:26:51.154055+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-21T01:26:51.154055+0000","last_clean_scrub_stamp":"2024-05-21T01:26:51.154055+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:06:06.170386+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"27'4","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:59.249831+0000","last_change":"2024-05-21T01:26:59.249853+0000","last_active":"2024-05-21T01:26:59.249831+0000","last_peered":"2024-05-21T01:26:59.249831+0000","last_clean":"2024-05-21T01:26:59.249831+0000","last_became_active":"2024-05-21T01:19:54.568605+0000","last_became_peered":"2024-05-21T01:19:54.568605+0000","last_unstale":"2024-05-21T01:26:59.249831+0000","last_undegraded":"2024-05-21T01:26:59.249831+0000","last_fullsized":"2024-05-21T01:26:59.249831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-21T01:26:59.249751+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-21T01:26:59.249751+0000","last_clean_scrub_stamp":"2024-05-21T01:26:59.249751+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:44:22.003577+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"27'8","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:52.157649+0000","last_change":"2024-05-21T01:26:52.157675+0000","last_active":"2024-05-21T01:26:52.157649+0000","last_peered":"2024-05-21T01:26:52.157649+0000","last_clean":"2024-05-21T01:26:52.157649+0000","last_became_active":"2024-05-21T01:19:54.554976+0000","last_became_peered":"2024-05-21T01:19:54.554976+0000","last_unstale":"2024-05-21T01:26:52.157649+0000","last_undegraded":"2024-05-21T01:26:52.157649+0000","last_fullsized":"2024-05-21T01:26:52.157649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-21T01:26:52.157573+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-21T01:26:52.157573+0000","last_clean_scrub_stamp":"2024-05-21T01:26:52.157573+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:43:36.386460+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"27'7","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:55.669148+0000","last_change":"2024-05-21T01:26:55.669206+0000","last_active":"2024-05-21T01:26:55.669148+0000","last_peered":"2024-05-21T01:26:55.669148+0000","last_clean":"2024-05-21T01:26:55.669148+0000","last_became_active":"2024-05-21T01:19:54.566349+0000","last_became_peered":"2024-05-21T01:19:54.566349+0000","last_unstale":"2024-05-21T01:26:55.669148+0000","last_undegraded":"2024-05-21T01:26:55.669148+0000","last_fullsized":"2024-05-21T01:26:55.669148+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-05-21T01:26:55.668969+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-05-21T01:26:55.668969+0000","last_clean_scrub_stamp":"2024-05-21T01:26:55.668969+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:19:28.963729+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"27'4","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:27:01.627252+0000","last_change":"2024-05-21T01:27:01.627308+0000","last_active":"2024-05-21T01:27:01.627252+0000","last_peered":"2024-05-21T01:27:01.627252+0000","last_clean":"2024-05-21T01:27:01.627252+0000","last_became_active":"2024-05-21T01:19:54.574914+0000","last_became_peered":"2024-05-21T01:19:54.574914+0000","last_unstale":"2024-05-21T01:27:01.627252+0000","last_undegraded":"2024-05-21T01:27:01.627252+0000","last_fullsized":"2024-05-21T01:27:01.627252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-21T01:27:01.627083+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-21T01:27:01.627083+0000","last_clean_scrub_stamp":"2024-05-21T01:27:01.627083+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:27:30.495221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"27'8","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:55.293866+0000","last_change":"2024-05-21T01:26:55.293891+0000","last_active":"2024-05-21T01:26:55.293866+0000","last_peered":"2024-05-21T01:26:55.293866+0000","last_clean":"2024-05-21T01:26:55.293866+0000","last_became_active":"2024-05-21T01:19:54.546284+0000","last_became_peered":"2024-05-21T01:19:54.546284+0000","last_unstale":"2024-05-21T01:26:55.293866+0000","last_undegraded":"2024-05-21T01:26:55.293866+0000","last_fullsized":"2024-05-21T01:26:55.293866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-21T01:26:55.293779+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-21T01:26:55.293779+0000","last_clean_scrub_stamp":"2024-05-21T01:26:55.293779+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:45:55.855610+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5128,"num_read_kb":21004288,"num_write":9216,"num_write_kb":25165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9731,"ondisk_log_size":9731,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":503,"ondisk_log_size":503,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2846797,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":1595,"num_write_kb":3011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15000,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":5849088,"data_stored":5693594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1609,"ondisk_log_size":1609,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66932,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509532,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49516,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94322324,"statfs":{"total":96636764160,"available":96586059776,"internally_reserved":0,"allocated":299008,"data_stored":117691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":50395592},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509532,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48128,"kb_used_data":3064,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94323712,"statfs":{"total":96636764160,"available":96587481088,"internally_reserved":0,"allocated":3137536,"data_stored":2958758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509530,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53732,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94318108,"statfs":{"total":96636764160,"available":96581742592,"internally_reserved":0,"allocated":356352,"data_stored":706993,"data_compressed":33466,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509530,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35632,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336208,"statfs":{"total":96636764160,"available":96600276992,"internally_reserved":0,"allocated":303104,"data_stored":117781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542235,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49512,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94322328,"statfs":{"total":96636764160,"available":96586063872,"internally_reserved":0,"allocated":294912,"data_stored":118068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542235,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45428,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326412,"statfs":{"total":96636764160,"available":96590245888,"internally_reserved":0,"allocated":372736,"data_stored":708565,"data_compressed":33466,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574938,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49528,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94322312,"statfs":{"total":96636764160,"available":96586047488,"internally_reserved":0,"allocated":311296,"data_stored":117902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574938,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52316,"kb_used_data":3092,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319524,"statfs":{"total":96636764160,"available":96583192576,"internally_reserved":0,"allocated":3166208,"data_stored":2960292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33466,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33466,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2854912,"data_stored":2842293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":2883584,"data_stored":2843827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-21T01:27:07.981 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-05-21T01:19:57.549460+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=57, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:27:07.981 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-05-21T01:19:57.549460+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=57, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:27:07.982 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-05-21T01:19:57.549460+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=57, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:27:07.982 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-05-21T01:19:57.549460+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=57, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:27:07.982 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-05-21T01:19:57.549460+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=57, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:27:07.982 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-05-21T01:19:57.549460+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=57, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:27:07.982 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-05-21T01:19:57.549460+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=57, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:27:07.983 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-05-21T01:19:57.549460+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=57, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:27:07.983 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-05-21T01:19:53.497636+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=19, tm_sec=53, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=1, tm_min=26, tm_sec=41, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T01:27:07.983 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-21T01:27:27.801 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-21T01:27:27.806 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-21T01:27:27.984 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-21T01:27:28.137 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.133+0000 7f1ad3200640 1 Processor -- start 2024-05-21T01:27:28.138 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.133+0000 7f1ad3200640 1 -- start start 2024-05-21T01:27:28.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.133+0000 7f1ad3200640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f1acc156350 0x7f1acc0c9960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:27:28.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.133+0000 7f1ad3200640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1acc0ca0c0 con 0x7f1acc15f880 2024-05-21T01:27:28.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.133+0000 7f1ad3200640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1acc0bfbd0 con 0x7f1acc0c9280 2024-05-21T01:27:28.139 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.133+0000 7f1ad3200640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f1acc0c9ea0 con 0x7f1acc156350 2024-05-21T01:27:28.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.133+0000 7f1ad1200640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f1acc15f880 0x7f1acc15fd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:47818/0 (socket says 172.21.15.63:47818) 2024-05-21T01:27:28.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.133+0000 7f1ad1200640 1 -- 172.21.15.63:0/2583151451 learned_addr learned my addr 172.21.15.63:0/2583151451 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-05-21T01:27:28.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.133+0000 7f1acbe00640 1 --2- 172.21.15.63:0/2583151451 >> v2:172.21.15.131:3300/0 conn(0x7f1acc156350 0x7f1acc0c9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:27:28.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.133+0000 7f1acb400640 1 -- 172.21.15.63:0/2583151451 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3585900787 0 0) 0x7f1acc0ca0c0 con 0x7f1acc15f880 2024-05-21T01:27:28.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.133+0000 7f1acb400640 1 -- 172.21.15.63:0/2583151451 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1ab0003530 con 0x7f1acc15f880 2024-05-21T01:27:28.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.137+0000 7f1acb400640 1 -- 172.21.15.63:0/2583151451 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1667700481 0 0) 0x7f1ab0003530 con 0x7f1acc15f880 2024-05-21T01:27:28.140 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.137+0000 7f1acbe00640 1 -- 172.21.15.63:0/2583151451 >> v1:172.21.15.131:6789/0 conn(0x7f1acc0c9280 legacy=0x7f1acc0c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:27:28.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.137+0000 7f1acbe00640 1 -- 172.21.15.63:0/2583151451 >> v1:172.21.15.63:6789/0 conn(0x7f1acc15f880 legacy=0x7f1acc15fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:27:28.141 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.137+0000 7f1acbe00640 1 -- 172.21.15.63:0/2583151451 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1acc0bfeb0 con 0x7f1acc156350 2024-05-21T01:27:28.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.137+0000 7f1acbe00640 1 --2- 172.21.15.63:0/2583151451 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1acc156350 0x7f1acc0c9960 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1abc009d90 tx=0x7f1abc01f080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6fe084793ab1f0fa server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:27:28.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.137+0000 7f1acb400640 1 -- 172.21.15.63:0/2583151451 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1abc0b5070 con 0x7f1acc156350 2024-05-21T01:27:28.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.137+0000 7f1acb400640 1 -- 172.21.15.63:0/2583151451 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1abc0a8c10 con 0x7f1acc156350 2024-05-21T01:27:28.143 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.137+0000 7f1acb400640 1 -- 172.21.15.63:0/2583151451 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ac4001700 con 0x7f1acc156350 2024-05-21T01:27:28.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.141+0000 7f1ad3200640 1 -- 172.21.15.63:0/2583151451 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1acc156350 msgr2=0x7f1acc0c9960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:27:28.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.141+0000 7f1ad3200640 1 --2- 172.21.15.63:0/2583151451 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1acc156350 0x7f1acc0c9960 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1abc009d90 tx=0x7f1abc01f080 comp rx=0 tx=0).stop 2024-05-21T01:27:28.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.141+0000 7f1ad3200640 1 -- 172.21.15.63:0/2583151451 shutdown_connections 2024-05-21T01:27:28.144 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.141+0000 7f1ad3200640 1 --2- 172.21.15.63:0/2583151451 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1acc156350 0x7f1acc0c9960 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:28.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.141+0000 7f1ad3200640 1 -- 172.21.15.63:0/2583151451 >> 172.21.15.63:0/2583151451 conn(0x7f1acc0cde10 msgr2=0x7f1acc0ce220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:27:28.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.141+0000 7f1ad3200640 1 -- 172.21.15.63:0/2583151451 shutdown_connections 2024-05-21T01:27:28.145 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.141+0000 7f1ad3200640 1 -- 172.21.15.63:0/2583151451 wait complete. 2024-05-21T01:27:28.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.141+0000 7f1ad3200640 1 Processor -- start 2024-05-21T01:27:28.146 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.141+0000 7f1ad3200640 1 -- start start 2024-05-21T01:27:28.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.141+0000 7f1ad3200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1acc0c9280 0x7f1acc1f51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:27:28.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.141+0000 7f1ad3200640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1acc156350 0x7f1acc1e5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:27:28.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.141+0000 7f1ad3200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1acc15f880 0x7f1acc06f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:27:28.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.141+0000 7f1ad3200640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f1acc074870 con 0x7f1acc15f880 2024-05-21T01:27:28.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.141+0000 7f1ad3200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f1acc0c0470 con 0x7f1acc0c9280 2024-05-21T01:27:28.148 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.141+0000 7f1ad3200640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f1acc0749f0 con 0x7f1acc156350 2024-05-21T01:27:28.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.141+0000 7f1ad1200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1acc15f880 0x7f1acc06f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:27:28.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.141+0000 7f1ad1200640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1acc15f880 0x7f1acc06f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39912/0 (socket says 172.21.15.63:39912) 2024-05-21T01:27:28.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.141+0000 7f1ad1200640 1 -- 172.21.15.63:0/310540356 learned_addr learned my addr 172.21.15.63:0/310540356 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:27:28.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.141+0000 7f1acbe00640 1 --2- 172.21.15.63:0/310540356 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1acc0c9280 0x7f1acc1f51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:27:28.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.141+0000 7f1ac3400640 1 --2- 172.21.15.63:0/310540356 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1acc156350 0x7f1acc1e5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:27:28.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.141+0000 7f1ad1200640 1 -- 172.21.15.63:0/310540356 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1acc156350 msgr2=0x7f1acc1e5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:27:28.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.141+0000 7f1ad1200640 1 --2- 172.21.15.63:0/310540356 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1acc156350 0x7f1acc1e5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:28.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.141+0000 7f1ad1200640 1 -- 172.21.15.63:0/310540356 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1acc0c9280 msgr2=0x7f1acc1f51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:27:28.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.141+0000 7f1ad1200640 1 --2- 172.21.15.63:0/310540356 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1acc0c9280 0x7f1acc1f51c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:28.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.141+0000 7f1ad1200640 1 -- 172.21.15.63:0/310540356 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1acc068470 con 0x7f1acc15f880 2024-05-21T01:27:28.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.145+0000 7f1ad1200640 1 --2- 172.21.15.63:0/310540356 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1acc15f880 0x7f1acc06f760 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f1ac4001870 tx=0x7f1ac400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:27:28.149 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.145+0000 7f1ac8c00640 1 -- 172.21.15.63:0/310540356 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ac4017070 con 0x7f1acc15f880 2024-05-21T01:27:28.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.145+0000 7f1ac8c00640 1 -- 172.21.15.63:0/310540356 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ac4005cf0 con 0x7f1acc15f880 2024-05-21T01:27:28.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.145+0000 7f1ac8c00640 1 -- 172.21.15.63:0/310540356 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ac40072d0 con 0x7f1acc15f880 2024-05-21T01:27:28.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.145+0000 7f1ad3200640 1 -- 172.21.15.63:0/310540356 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1acc1f5700 con 0x7f1acc15f880 2024-05-21T01:27:28.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.145+0000 7f1ad3200640 1 -- 172.21.15.63:0/310540356 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1acc15f090 con 0x7f1acc15f880 2024-05-21T01:27:28.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.145+0000 7f1ad3200640 1 -- 172.21.15.63:0/310540356 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1acc0507f0 con 0x7f1acc15f880 2024-05-21T01:27:28.150 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.145+0000 7f1ac8c00640 1 -- 172.21.15.63:0/310540356 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7f1ac401a070 con 0x7f1acc15f880 2024-05-21T01:27:28.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.145+0000 7f1ac8c00640 1 --2- 172.21.15.63:0/310540356 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f1aa806f430 0x7f1aa80718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:27:28.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.145+0000 7f1ac8c00640 1 -- 172.21.15.63:0/310540356 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f1ac408e8e0 con 0x7f1acc15f880 2024-05-21T01:27:28.151 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.145+0000 7f1acbe00640 1 --2- 172.21.15.63:0/310540356 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f1aa806f430 0x7f1aa80718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:27:28.152 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.149+0000 7f1acbe00640 1 --2- 172.21.15.63:0/310540356 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f1aa806f430 0x7f1aa80718f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1abc0b2000 tx=0x7f1abc0aa070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:27:28.155 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.153+0000 7f1ac8c00640 1 -- 172.21.15.63:0/310540356 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f1ac405ae90 con 0x7f1acc15f880 2024-05-21T01:27:28.316 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.313+0000 7f1ad3200640 1 -- 172.21.15.63:0/310540356 --> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1acc0c8da0 con 0x7f1aa806f430 2024-05-21T01:27:28.339 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.333+0000 7f1ac8c00640 1 -- 172.21.15.63:0/310540356 <== mgr.4103 v2:172.21.15.131:6832/921953667 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+334036 (secure 0 0 0) 0x7f1acc0c8da0 con 0x7f1aa806f430 2024-05-21T01:27:28.343 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-05-21T01:27:28.345 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2024-05-21T01:27:28.346 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.337+0000 7f1ad3200640 1 -- 172.21.15.63:0/310540356 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f1aa806f430 msgr2=0x7f1aa80718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:27:28.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.337+0000 7f1ad3200640 1 --2- 172.21.15.63:0/310540356 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f1aa806f430 0x7f1aa80718f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1abc0b2000 tx=0x7f1abc0aa070 comp rx=0 tx=0).stop 2024-05-21T01:27:28.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.337+0000 7f1ad3200640 1 -- 172.21.15.63:0/310540356 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1acc15f880 msgr2=0x7f1acc06f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:27:28.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.337+0000 7f1ad3200640 1 --2- 172.21.15.63:0/310540356 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1acc15f880 0x7f1acc06f760 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f1ac4001870 tx=0x7f1ac400c960 comp rx=0 tx=0).stop 2024-05-21T01:27:28.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.337+0000 7f1ad3200640 1 -- 172.21.15.63:0/310540356 shutdown_connections 2024-05-21T01:27:28.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.337+0000 7f1ad3200640 1 --2- 172.21.15.63:0/310540356 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f1aa806f430 0x7f1aa80718f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:28.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.337+0000 7f1ad3200640 1 --2- 172.21.15.63:0/310540356 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1acc15f880 0x7f1acc06f760 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:28.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.337+0000 7f1ad3200640 1 --2- 172.21.15.63:0/310540356 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1acc156350 0x7f1acc1e5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:28.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.337+0000 7f1ad3200640 1 --2- 172.21.15.63:0/310540356 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1acc0c9280 0x7f1acc1f51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:28.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.337+0000 7f1ad3200640 1 -- 172.21.15.63:0/310540356 >> 172.21.15.63:0/310540356 conn(0x7f1acc0cde10 msgr2=0x7f1acc0cc1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:27:28.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.337+0000 7f1ad3200640 1 -- 172.21.15.63:0/310540356 shutdown_connections 2024-05-21T01:27:28.347 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.337+0000 7f1ad3200640 1 -- 172.21.15.63:0/310540356 wait complete. 2024-05-21T01:27:28.364 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":250,"stamp":"2024-05-21T01:27:26.629673+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3437165,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":5199,"num_read_kb":21004348,"num_write":10912,"num_write_kb":25170463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15000,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11917,"ondisk_log_size":11917,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":383792,"kb_used_data":8048,"kb_used_omap":12,"kb_used_meta":375667,"kb_avail":754590928,"statfs":{"total":773094113280,"available":772701110272,"internally_reserved":0,"allocated":8241152,"data_stored":7806050,"data_compressed":66932,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12750,"internal_metadata":384683570},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005541"},"pg_stats":[{"pgid":"2.1f","version":"27'13","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:49.745951+0000","last_change":"2024-05-21T01:26:49.746028+0000","last_active":"2024-05-21T01:26:49.745951+0000","last_peered":"2024-05-21T01:26:49.745951+0000","last_clean":"2024-05-21T01:26:49.745951+0000","last_became_active":"2024-05-21T01:19:53.544469+0000","last_became_peered":"2024-05-21T01:19:53.544469+0000","last_unstale":"2024-05-21T01:26:49.745951+0000","last_undegraded":"2024-05-21T01:26:49.745951+0000","last_fullsized":"2024-05-21T01:26:49.745951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'13","last_scrub_stamp":"2024-05-21T01:26:49.745791+0000","last_deep_scrub":"27'13","last_deep_scrub_stamp":"2024-05-21T01:26:49.745791+0000","last_clean_scrub_stamp":"2024-05-21T01:26:49.745791+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:22:35.348983+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"27'5","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:46.707546+0000","last_change":"2024-05-21T01:26:46.707664+0000","last_active":"2024-05-21T01:26:46.707546+0000","last_peered":"2024-05-21T01:26:46.707546+0000","last_clean":"2024-05-21T01:26:46.707546+0000","last_became_active":"2024-05-21T01:19:54.567245+0000","last_became_peered":"2024-05-21T01:19:54.567245+0000","last_unstale":"2024-05-21T01:26:46.707546+0000","last_undegraded":"2024-05-21T01:26:46.707546+0000","last_fullsized":"2024-05-21T01:26:46.707546+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-05-21T01:26:46.707326+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-05-21T01:26:46.707326+0000","last_clean_scrub_stamp":"2024-05-21T01:26:46.707326+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T13:03:37.114380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"27'327","reported_seq":533,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:55.802708+0000","last_change":"2024-05-21T01:26:55.802708+0000","last_active":"2024-05-21T01:26:55.802708+0000","last_peered":"2024-05-21T01:26:55.802708+0000","last_clean":"2024-05-21T01:26:55.802708+0000","last_became_active":"2024-05-21T01:19:58.617757+0000","last_became_peered":"2024-05-21T01:19:58.617757+0000","last_unstale":"2024-05-21T01:26:55.802708+0000","last_undegraded":"2024-05-21T01:26:55.802708+0000","last_fullsized":"2024-05-21T01:26:55.802708+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'327","last_scrub_stamp":"2024-05-21T01:26:55.802452+0000","last_deep_scrub":"27'327","last_deep_scrub_stamp":"2024-05-21T01:26:55.802452+0000","last_clean_scrub_stamp":"2024-05-21T01:26:55.802452+0000","objects_scrubbed":0,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:12:25.366877+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":176,"num_read_kb":720896,"num_write":306,"num_write_kb":835584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"25'2","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:53.656687+0000","last_change":"2024-05-21T01:26:53.656748+0000","last_active":"2024-05-21T01:26:53.656687+0000","last_peered":"2024-05-21T01:26:53.656687+0000","last_clean":"2024-05-21T01:26:53.656687+0000","last_became_active":"2024-05-21T01:19:53.551049+0000","last_became_peered":"2024-05-21T01:19:53.551049+0000","last_unstale":"2024-05-21T01:26:53.656687+0000","last_undegraded":"2024-05-21T01:26:53.656687+0000","last_fullsized":"2024-05-21T01:26:53.656687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2024-05-21T01:26:53.656481+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2024-05-21T01:26:53.656481+0000","last_clean_scrub_stamp":"2024-05-21T01:26:53.656481+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:47:17.945190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"27'6","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:58.669474+0000","last_change":"2024-05-21T01:26:58.669532+0000","last_active":"2024-05-21T01:26:58.669474+0000","last_peered":"2024-05-21T01:26:58.669474+0000","last_clean":"2024-05-21T01:26:58.669474+0000","last_became_active":"2024-05-21T01:19:54.569573+0000","last_became_peered":"2024-05-21T01:19:54.569573+0000","last_unstale":"2024-05-21T01:26:58.669474+0000","last_undegraded":"2024-05-21T01:26:58.669474+0000","last_fullsized":"2024-05-21T01:26:58.669474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-21T01:26:58.669299+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-21T01:26:58.669299+0000","last_clean_scrub_stamp":"2024-05-21T01:26:58.669299+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:38:05.675515+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"27'351","reported_seq":577,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:56.174369+0000","last_change":"2024-05-21T01:26:56.174369+0000","last_active":"2024-05-21T01:26:56.174369+0000","last_peered":"2024-05-21T01:26:56.174369+0000","last_clean":"2024-05-21T01:26:56.174369+0000","last_became_active":"2024-05-21T01:19:58.604108+0000","last_became_peered":"2024-05-21T01:19:58.604108+0000","last_unstale":"2024-05-21T01:26:56.174369+0000","last_undegraded":"2024-05-21T01:26:56.174369+0000","last_fullsized":"2024-05-21T01:26:56.174369+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'351","last_scrub_stamp":"2024-05-21T01:26:56.174261+0000","last_deep_scrub":"27'351","last_deep_scrub_stamp":"2024-05-21T01:26:56.174261+0000","last_clean_scrub_stamp":"2024-05-21T01:26:56.174261+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:45:59.495938+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":196,"num_read_kb":802816,"num_write":339,"num_write_kb":925696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"27'7","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:48.313716+0000","last_change":"2024-05-21T01:26:48.313716+0000","last_active":"2024-05-21T01:26:48.313716+0000","last_peered":"2024-05-21T01:26:48.313716+0000","last_clean":"2024-05-21T01:26:48.313716+0000","last_became_active":"2024-05-21T01:19:53.521265+0000","last_became_peered":"2024-05-21T01:19:53.521265+0000","last_unstale":"2024-05-21T01:26:48.313716+0000","last_undegraded":"2024-05-21T01:26:48.313716+0000","last_fullsized":"2024-05-21T01:26:48.313716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-05-21T01:26:48.313621+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-05-21T01:26:48.313621+0000","last_clean_scrub_stamp":"2024-05-21T01:26:48.313621+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:31:27.415046+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"27'9","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:46.815323+0000","last_change":"2024-05-21T01:26:46.815323+0000","last_active":"2024-05-21T01:26:46.815323+0000","last_peered":"2024-05-21T01:26:46.815323+0000","last_clean":"2024-05-21T01:26:46.815323+0000","last_became_active":"2024-05-21T01:19:54.536061+0000","last_became_peered":"2024-05-21T01:19:54.536061+0000","last_unstale":"2024-05-21T01:26:46.815323+0000","last_undegraded":"2024-05-21T01:26:46.815323+0000","last_fullsized":"2024-05-21T01:26:46.815323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-05-21T01:26:46.815236+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-05-21T01:26:46.815236+0000","last_clean_scrub_stamp":"2024-05-21T01:26:46.815236+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:39:00.246159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"27'291","reported_seq":469,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:59.162018+0000","last_change":"2024-05-21T01:26:59.162047+0000","last_active":"2024-05-21T01:26:59.162018+0000","last_peered":"2024-05-21T01:26:59.162018+0000","last_clean":"2024-05-21T01:26:59.162018+0000","last_became_active":"2024-05-21T01:19:58.622672+0000","last_became_peered":"2024-05-21T01:19:58.622672+0000","last_unstale":"2024-05-21T01:26:59.162018+0000","last_undegraded":"2024-05-21T01:26:59.162018+0000","last_fullsized":"2024-05-21T01:26:59.162018+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'291","last_scrub_stamp":"2024-05-21T01:26:59.161939+0000","last_deep_scrub":"27'291","last_deep_scrub_stamp":"2024-05-21T01:26:59.161939+0000","last_clean_scrub_stamp":"2024-05-21T01:26:59.161939+0000","objects_scrubbed":0,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:59:43.678378+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":149,"num_read_kb":610304,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"27'3","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:46.250663+0000","last_change":"2024-05-21T01:26:46.250663+0000","last_active":"2024-05-21T01:26:46.250663+0000","last_peered":"2024-05-21T01:26:46.250663+0000","last_clean":"2024-05-21T01:26:46.250663+0000","last_became_active":"2024-05-21T01:19:53.521684+0000","last_became_peered":"2024-05-21T01:19:53.521684+0000","last_unstale":"2024-05-21T01:26:46.250663+0000","last_undegraded":"2024-05-21T01:26:46.250663+0000","last_fullsized":"2024-05-21T01:26:46.250663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-05-21T01:26:46.250574+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-05-21T01:26:46.250574+0000","last_clean_scrub_stamp":"2024-05-21T01:26:46.250574+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:47:44.164598+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"27'15","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:45.207004+0000","last_change":"2024-05-21T01:26:45.207004+0000","last_active":"2024-05-21T01:26:45.207004+0000","last_peered":"2024-05-21T01:26:45.207004+0000","last_clean":"2024-05-21T01:26:45.207004+0000","last_became_active":"2024-05-21T01:19:54.549291+0000","last_became_peered":"2024-05-21T01:19:54.549291+0000","last_unstale":"2024-05-21T01:26:45.207004+0000","last_undegraded":"2024-05-21T01:26:45.207004+0000","last_fullsized":"2024-05-21T01:26:45.207004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2024-05-21T01:26:45.206916+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2024-05-21T01:26:45.206916+0000","last_clean_scrub_stamp":"2024-05-21T01:26:45.206916+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:35:33.283072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"27'271","reported_seq":442,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:58.180680+0000","last_change":"2024-05-21T01:26:58.180706+0000","last_active":"2024-05-21T01:26:58.180680+0000","last_peered":"2024-05-21T01:26:58.180680+0000","last_clean":"2024-05-21T01:26:58.180680+0000","last_became_active":"2024-05-21T01:19:58.614313+0000","last_became_peered":"2024-05-21T01:19:58.614313+0000","last_unstale":"2024-05-21T01:26:58.180680+0000","last_undegraded":"2024-05-21T01:26:58.180680+0000","last_fullsized":"2024-05-21T01:26:58.180680+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'271","last_scrub_stamp":"2024-05-21T01:26:58.180599+0000","last_deep_scrub":"27'271","last_deep_scrub_stamp":"2024-05-21T01:26:58.180599+0000","last_clean_scrub_stamp":"2024-05-21T01:26:58.180599+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:11:09.915590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":581632,"num_write":252,"num_write_kb":688128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"27'5","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:50.139600+0000","last_change":"2024-05-21T01:26:50.139623+0000","last_active":"2024-05-21T01:26:50.139600+0000","last_peered":"2024-05-21T01:26:50.139600+0000","last_clean":"2024-05-21T01:26:50.139600+0000","last_became_active":"2024-05-21T01:19:54.545181+0000","last_became_peered":"2024-05-21T01:19:54.545181+0000","last_unstale":"2024-05-21T01:26:50.139600+0000","last_undegraded":"2024-05-21T01:26:50.139600+0000","last_fullsized":"2024-05-21T01:26:50.139600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-05-21T01:26:50.139518+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-05-21T01:26:50.139518+0000","last_clean_scrub_stamp":"2024-05-21T01:26:50.139518+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:24:40.691568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"27'7","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:59.093941+0000","last_change":"2024-05-21T01:26:59.093990+0000","last_active":"2024-05-21T01:26:59.093941+0000","last_peered":"2024-05-21T01:26:59.093941+0000","last_clean":"2024-05-21T01:26:59.093941+0000","last_became_active":"2024-05-21T01:19:53.535899+0000","last_became_peered":"2024-05-21T01:19:53.535899+0000","last_unstale":"2024-05-21T01:26:59.093941+0000","last_undegraded":"2024-05-21T01:26:59.093941+0000","last_fullsized":"2024-05-21T01:26:59.093941+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-05-21T01:26:59.093859+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-05-21T01:26:59.093859+0000","last_clean_scrub_stamp":"2024-05-21T01:26:59.093859+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:40:20.551343+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"27'326","reported_seq":537,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:27:09.121912+0000","last_change":"2024-05-21T01:27:09.121941+0000","last_active":"2024-05-21T01:27:09.121912+0000","last_peered":"2024-05-21T01:27:09.121912+0000","last_clean":"2024-05-21T01:27:09.121912+0000","last_became_active":"2024-05-21T01:19:58.621083+0000","last_became_peered":"2024-05-21T01:19:58.621083+0000","last_unstale":"2024-05-21T01:27:09.121912+0000","last_undegraded":"2024-05-21T01:27:09.121912+0000","last_fullsized":"2024-05-21T01:27:09.121912+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'326","last_scrub_stamp":"2024-05-21T01:27:09.121820+0000","last_deep_scrub":"27'326","last_deep_scrub_stamp":"2024-05-21T01:27:09.121820+0000","last_clean_scrub_stamp":"2024-05-21T01:27:09.121820+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:03:01.199523+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":181,"num_read_kb":741376,"num_write":309,"num_write_kb":843776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"27'8","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:52.797832+0000","last_change":"2024-05-21T01:26:52.797890+0000","last_active":"2024-05-21T01:26:52.797832+0000","last_peered":"2024-05-21T01:26:52.797832+0000","last_clean":"2024-05-21T01:26:52.797832+0000","last_became_active":"2024-05-21T01:19:54.571863+0000","last_became_peered":"2024-05-21T01:19:54.571863+0000","last_unstale":"2024-05-21T01:26:52.797832+0000","last_undegraded":"2024-05-21T01:26:52.797832+0000","last_fullsized":"2024-05-21T01:26:52.797832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-21T01:26:52.797652+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-21T01:26:52.797652+0000","last_clean_scrub_stamp":"2024-05-21T01:26:52.797652+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:14:16.510168+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"27'4","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:48.965511+0000","last_change":"2024-05-21T01:26:48.965626+0000","last_active":"2024-05-21T01:26:48.965511+0000","last_peered":"2024-05-21T01:26:48.965511+0000","last_clean":"2024-05-21T01:26:48.965511+0000","last_became_active":"2024-05-21T01:19:53.552694+0000","last_became_peered":"2024-05-21T01:19:53.552694+0000","last_unstale":"2024-05-21T01:26:48.965511+0000","last_undegraded":"2024-05-21T01:26:48.965511+0000","last_fullsized":"2024-05-21T01:26:48.965511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-21T01:26:48.965227+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-21T01:26:48.965227+0000","last_clean_scrub_stamp":"2024-05-21T01:26:48.965227+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T09:13:35.044857+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"27'300","reported_seq":498,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:27:00.260423+0000","last_change":"2024-05-21T01:27:00.260444+0000","last_active":"2024-05-21T01:27:00.260423+0000","last_peered":"2024-05-21T01:27:00.260423+0000","last_clean":"2024-05-21T01:27:00.260423+0000","last_became_active":"2024-05-21T01:19:58.594450+0000","last_became_peered":"2024-05-21T01:19:58.594450+0000","last_unstale":"2024-05-21T01:27:00.260423+0000","last_undegraded":"2024-05-21T01:27:00.260423+0000","last_fullsized":"2024-05-21T01:27:00.260423+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'300","last_scrub_stamp":"2024-05-21T01:27:00.260356+0000","last_deep_scrub":"27'300","last_deep_scrub_stamp":"2024-05-21T01:27:00.260356+0000","last_clean_scrub_stamp":"2024-05-21T01:27:00.260356+0000","objects_scrubbed":0,"log_size":300,"log_dups_size":0,"ondisk_log_size":300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:02:22.841987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":688128,"num_write":291,"num_write_kb":794624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"27'9","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:45.857714+0000","last_change":"2024-05-21T01:26:45.857771+0000","last_active":"2024-05-21T01:26:45.857714+0000","last_peered":"2024-05-21T01:26:45.857714+0000","last_clean":"2024-05-21T01:26:45.857714+0000","last_became_active":"2024-05-21T01:19:54.551583+0000","last_became_peered":"2024-05-21T01:19:54.551583+0000","last_unstale":"2024-05-21T01:26:45.857714+0000","last_undegraded":"2024-05-21T01:26:45.857714+0000","last_fullsized":"2024-05-21T01:26:45.857714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-05-21T01:26:45.857549+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-05-21T01:26:45.857549+0000","last_clean_scrub_stamp":"2024-05-21T01:26:45.857549+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:04:37.304112+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"27'5","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:46.861813+0000","last_change":"2024-05-21T01:26:46.861879+0000","last_active":"2024-05-21T01:26:46.861813+0000","last_peered":"2024-05-21T01:26:46.861813+0000","last_clean":"2024-05-21T01:26:46.861813+0000","last_became_active":"2024-05-21T01:19:53.522525+0000","last_became_peered":"2024-05-21T01:19:53.522525+0000","last_unstale":"2024-05-21T01:26:46.861813+0000","last_undegraded":"2024-05-21T01:26:46.861813+0000","last_fullsized":"2024-05-21T01:26:46.861813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-05-21T01:26:46.861655+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-05-21T01:26:46.861655+0000","last_clean_scrub_stamp":"2024-05-21T01:26:46.861655+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T13:06:56.920915+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"27'286","reported_seq":474,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:54.779707+0000","last_change":"2024-05-21T01:26:54.779824+0000","last_active":"2024-05-21T01:26:54.779707+0000","last_peered":"2024-05-21T01:26:54.779707+0000","last_clean":"2024-05-21T01:26:54.779707+0000","last_became_active":"2024-05-21T01:19:58.614401+0000","last_became_peered":"2024-05-21T01:19:58.614401+0000","last_unstale":"2024-05-21T01:26:54.779707+0000","last_undegraded":"2024-05-21T01:26:54.779707+0000","last_fullsized":"2024-05-21T01:26:54.779707+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'286","last_scrub_stamp":"2024-05-21T01:26:54.779430+0000","last_deep_scrub":"27'286","last_deep_scrub_stamp":"2024-05-21T01:26:54.779430+0000","last_clean_scrub_stamp":"2024-05-21T01:26:54.779430+0000","objects_scrubbed":0,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T09:20:35.692517+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":158,"num_read_kb":647168,"num_write":267,"num_write_kb":729088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"27'2","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:47.170331+0000","last_change":"2024-05-21T01:26:47.170354+0000","last_active":"2024-05-21T01:26:47.170331+0000","last_peered":"2024-05-21T01:26:47.170331+0000","last_clean":"2024-05-21T01:26:47.170331+0000","last_became_active":"2024-05-21T01:19:54.555227+0000","last_became_peered":"2024-05-21T01:19:54.555227+0000","last_unstale":"2024-05-21T01:26:47.170331+0000","last_undegraded":"2024-05-21T01:26:47.170331+0000","last_fullsized":"2024-05-21T01:26:47.170331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-21T01:26:47.170260+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-21T01:26:47.170260+0000","last_clean_scrub_stamp":"2024-05-21T01:26:47.170260+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:49:45.419640+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"27'3","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:45.213973+0000","last_change":"2024-05-21T01:26:45.214017+0000","last_active":"2024-05-21T01:26:45.213973+0000","last_peered":"2024-05-21T01:26:45.213973+0000","last_clean":"2024-05-21T01:26:45.213973+0000","last_became_active":"2024-05-21T01:19:53.520540+0000","last_became_peered":"2024-05-21T01:19:53.520540+0000","last_unstale":"2024-05-21T01:26:45.213973+0000","last_undegraded":"2024-05-21T01:26:45.213973+0000","last_fullsized":"2024-05-21T01:26:45.213973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-05-21T01:26:45.213896+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-05-21T01:26:45.213896+0000","last_clean_scrub_stamp":"2024-05-21T01:26:45.213896+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:46:39.810336+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"27'300","reported_seq":500,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:54.121352+0000","last_change":"2024-05-21T01:26:54.121379+0000","last_active":"2024-05-21T01:26:54.121352+0000","last_peered":"2024-05-21T01:26:54.121352+0000","last_clean":"2024-05-21T01:26:54.121352+0000","last_became_active":"2024-05-21T01:19:58.603922+0000","last_became_peered":"2024-05-21T01:19:58.603922+0000","last_unstale":"2024-05-21T01:26:54.121352+0000","last_undegraded":"2024-05-21T01:26:54.121352+0000","last_fullsized":"2024-05-21T01:26:54.121352+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'300","last_scrub_stamp":"2024-05-21T01:26:54.121268+0000","last_deep_scrub":"27'300","last_deep_scrub_stamp":"2024-05-21T01:26:54.121268+0000","last_clean_scrub_stamp":"2024-05-21T01:26:54.121268+0000","objects_scrubbed":0,"log_size":300,"log_dups_size":0,"ondisk_log_size":300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:27:33.346161+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":170,"num_read_kb":696320,"num_write":288,"num_write_kb":786432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"27'7","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:56.748814+0000","last_change":"2024-05-21T01:26:56.748923+0000","last_active":"2024-05-21T01:26:56.748814+0000","last_peered":"2024-05-21T01:26:56.748814+0000","last_clean":"2024-05-21T01:26:56.748814+0000","last_became_active":"2024-05-21T01:19:54.568232+0000","last_became_peered":"2024-05-21T01:19:54.568232+0000","last_unstale":"2024-05-21T01:26:56.748814+0000","last_undegraded":"2024-05-21T01:26:56.748814+0000","last_fullsized":"2024-05-21T01:26:56.748814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-05-21T01:26:56.748591+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-05-21T01:26:56.748591+0000","last_clean_scrub_stamp":"2024-05-21T01:26:56.748591+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T09:25:00.912111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"27'7","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:55.131151+0000","last_change":"2024-05-21T01:26:55.131180+0000","last_active":"2024-05-21T01:26:55.131151+0000","last_peered":"2024-05-21T01:26:55.131151+0000","last_clean":"2024-05-21T01:26:55.131151+0000","last_became_active":"2024-05-21T01:19:53.525010+0000","last_became_peered":"2024-05-21T01:19:53.525010+0000","last_unstale":"2024-05-21T01:26:55.131151+0000","last_undegraded":"2024-05-21T01:26:55.131151+0000","last_fullsized":"2024-05-21T01:26:55.131151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-05-21T01:26:55.131069+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-05-21T01:26:55.131069+0000","last_clean_scrub_stamp":"2024-05-21T01:26:55.131069+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:45:10.945442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"27'273","reported_seq":431,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:53.158963+0000","last_change":"2024-05-21T01:26:53.158994+0000","last_active":"2024-05-21T01:26:53.158963+0000","last_peered":"2024-05-21T01:26:53.158963+0000","last_clean":"2024-05-21T01:26:53.158963+0000","last_became_active":"2024-05-21T01:19:58.589985+0000","last_became_peered":"2024-05-21T01:19:58.589985+0000","last_unstale":"2024-05-21T01:26:53.158963+0000","last_undegraded":"2024-05-21T01:26:53.158963+0000","last_fullsized":"2024-05-21T01:26:53.158963+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'273","last_scrub_stamp":"2024-05-21T01:26:53.158864+0000","last_deep_scrub":"27'273","last_deep_scrub_stamp":"2024-05-21T01:26:53.158864+0000","last_clean_scrub_stamp":"2024-05-21T01:26:53.158864+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:23:52.920362+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":524288,"num_write":249,"num_write_kb":679936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"27'5","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:54.752495+0000","last_change":"2024-05-21T01:26:54.752558+0000","last_active":"2024-05-21T01:26:54.752495+0000","last_peered":"2024-05-21T01:26:54.752495+0000","last_clean":"2024-05-21T01:26:54.752495+0000","last_became_active":"2024-05-21T01:19:54.552947+0000","last_became_peered":"2024-05-21T01:19:54.552947+0000","last_unstale":"2024-05-21T01:26:54.752495+0000","last_undegraded":"2024-05-21T01:26:54.752495+0000","last_fullsized":"2024-05-21T01:26:54.752495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-05-21T01:26:54.752316+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-05-21T01:26:54.752316+0000","last_clean_scrub_stamp":"2024-05-21T01:26:54.752316+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:41:41.002637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"27'34","reported_seq":72,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:47.813823+0000","last_change":"2024-05-21T01:26:47.813889+0000","last_active":"2024-05-21T01:26:47.813823+0000","last_peered":"2024-05-21T01:26:47.813823+0000","last_clean":"2024-05-21T01:26:47.813823+0000","last_became_active":"2024-05-21T01:19:53.521014+0000","last_became_peered":"2024-05-21T01:19:53.521014+0000","last_unstale":"2024-05-21T01:26:47.813823+0000","last_undegraded":"2024-05-21T01:26:47.813823+0000","last_fullsized":"2024-05-21T01:26:47.813823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'34","last_scrub_stamp":"2024-05-21T01:26:47.813640+0000","last_deep_scrub":"27'34","last_deep_scrub_stamp":"2024-05-21T01:26:47.813640+0000","last_clean_scrub_stamp":"2024-05-21T01:26:47.813640+0000","objects_scrubbed":2,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:39:44.370849+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":63,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"27'277","reported_seq":445,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:57.759337+0000","last_change":"2024-05-21T01:26:57.759372+0000","last_active":"2024-05-21T01:26:57.759337+0000","last_peered":"2024-05-21T01:26:57.759337+0000","last_clean":"2024-05-21T01:26:57.759337+0000","last_became_active":"2024-05-21T01:19:58.598712+0000","last_became_peered":"2024-05-21T01:19:58.598712+0000","last_unstale":"2024-05-21T01:26:57.759337+0000","last_undegraded":"2024-05-21T01:26:57.759337+0000","last_fullsized":"2024-05-21T01:26:57.759337+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'277","last_scrub_stamp":"2024-05-21T01:26:57.759225+0000","last_deep_scrub":"27'277","last_deep_scrub_stamp":"2024-05-21T01:26:57.759225+0000","last_clean_scrub_stamp":"2024-05-21T01:26:57.759225+0000","objects_scrubbed":0,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:52:53.947204+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":565248,"num_write":264,"num_write_kb":720896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"27'9","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:56.076810+0000","last_change":"2024-05-21T01:26:56.076877+0000","last_active":"2024-05-21T01:26:56.076810+0000","last_peered":"2024-05-21T01:26:56.076810+0000","last_clean":"2024-05-21T01:26:56.076810+0000","last_became_active":"2024-05-21T01:19:54.575543+0000","last_became_peered":"2024-05-21T01:19:54.575543+0000","last_unstale":"2024-05-21T01:26:56.076810+0000","last_undegraded":"2024-05-21T01:26:56.076810+0000","last_fullsized":"2024-05-21T01:26:56.076810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-05-21T01:26:56.076587+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-05-21T01:26:56.076587+0000","last_clean_scrub_stamp":"2024-05-21T01:26:56.076587+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:16:45.513170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"27'2","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:27:02.124208+0000","last_change":"2024-05-21T01:27:02.124240+0000","last_active":"2024-05-21T01:27:02.124208+0000","last_peered":"2024-05-21T01:27:02.124208+0000","last_clean":"2024-05-21T01:27:02.124208+0000","last_became_active":"2024-05-21T01:19:53.543450+0000","last_became_peered":"2024-05-21T01:19:53.543450+0000","last_unstale":"2024-05-21T01:27:02.124208+0000","last_undegraded":"2024-05-21T01:27:02.124208+0000","last_fullsized":"2024-05-21T01:27:02.124208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-21T01:27:02.124115+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-21T01:27:02.124115+0000","last_clean_scrub_stamp":"2024-05-21T01:27:02.124115+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:11:09.546221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"27'267","reported_seq":433,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:27:00.079645+0000","last_change":"2024-05-21T01:27:00.079720+0000","last_active":"2024-05-21T01:27:00.079645+0000","last_peered":"2024-05-21T01:27:00.079645+0000","last_clean":"2024-05-21T01:27:00.079645+0000","last_became_active":"2024-05-21T01:19:58.610837+0000","last_became_peered":"2024-05-21T01:19:58.610837+0000","last_unstale":"2024-05-21T01:27:00.079645+0000","last_undegraded":"2024-05-21T01:27:00.079645+0000","last_fullsized":"2024-05-21T01:27:00.079645+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'267","last_scrub_stamp":"2024-05-21T01:27:00.079454+0000","last_deep_scrub":"27'267","last_deep_scrub_stamp":"2024-05-21T01:27:00.079454+0000","last_clean_scrub_stamp":"2024-05-21T01:27:00.079454+0000","objects_scrubbed":0,"log_size":267,"log_dups_size":0,"ondisk_log_size":267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:46:36.795995+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":557056,"num_write":249,"num_write_kb":679936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"27'5","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:48.100447+0000","last_change":"2024-05-21T01:26:48.100469+0000","last_active":"2024-05-21T01:26:48.100447+0000","last_peered":"2024-05-21T01:26:48.100447+0000","last_clean":"2024-05-21T01:26:48.100447+0000","last_became_active":"2024-05-21T01:19:54.552812+0000","last_became_peered":"2024-05-21T01:19:54.552812+0000","last_unstale":"2024-05-21T01:26:48.100447+0000","last_undegraded":"2024-05-21T01:26:48.100447+0000","last_fullsized":"2024-05-21T01:26:48.100447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-05-21T01:26:48.100372+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-05-21T01:26:48.100372+0000","last_clean_scrub_stamp":"2024-05-21T01:26:48.100372+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:37:56.476991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:51.640833+0000","last_change":"2024-05-21T01:26:51.640883+0000","last_active":"2024-05-21T01:26:51.640833+0000","last_peered":"2024-05-21T01:26:51.640833+0000","last_clean":"2024-05-21T01:26:51.640833+0000","last_became_active":"2024-05-21T01:19:53.550921+0000","last_became_peered":"2024-05-21T01:19:53.550921+0000","last_unstale":"2024-05-21T01:26:51.640833+0000","last_undegraded":"2024-05-21T01:26:51.640833+0000","last_fullsized":"2024-05-21T01:26:51.640833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T01:26:51.640660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T01:26:51.640660+0000","last_clean_scrub_stamp":"2024-05-21T01:26:51.640660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:37:27.351577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"27'289","reported_seq":477,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:27:01.077703+0000","last_change":"2024-05-21T01:27:01.077766+0000","last_active":"2024-05-21T01:27:01.077703+0000","last_peered":"2024-05-21T01:27:01.077703+0000","last_clean":"2024-05-21T01:27:01.077703+0000","last_became_active":"2024-05-21T01:19:58.625720+0000","last_became_peered":"2024-05-21T01:19:58.625720+0000","last_unstale":"2024-05-21T01:27:01.077703+0000","last_undegraded":"2024-05-21T01:27:01.077703+0000","last_fullsized":"2024-05-21T01:27:01.077703+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'289","last_scrub_stamp":"2024-05-21T01:27:01.077521+0000","last_deep_scrub":"27'289","last_deep_scrub_stamp":"2024-05-21T01:27:01.077521+0000","last_clean_scrub_stamp":"2024-05-21T01:27:01.077521+0000","objects_scrubbed":0,"log_size":289,"log_dups_size":0,"ondisk_log_size":289,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:27:29.488982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":158,"num_read_kb":647168,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"27'7","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:56.271875+0000","last_change":"2024-05-21T01:26:56.271898+0000","last_active":"2024-05-21T01:26:56.271875+0000","last_peered":"2024-05-21T01:26:56.271875+0000","last_clean":"2024-05-21T01:26:56.271875+0000","last_became_active":"2024-05-21T01:19:54.547689+0000","last_became_peered":"2024-05-21T01:19:54.547689+0000","last_unstale":"2024-05-21T01:26:56.271875+0000","last_undegraded":"2024-05-21T01:26:56.271875+0000","last_fullsized":"2024-05-21T01:26:56.271875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-05-21T01:26:56.271795+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-05-21T01:26:56.271795+0000","last_clean_scrub_stamp":"2024-05-21T01:26:56.271795+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:15:00.986476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"25'1","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:27:01.119690+0000","last_change":"2024-05-21T01:27:01.119715+0000","last_active":"2024-05-21T01:27:01.119690+0000","last_peered":"2024-05-21T01:27:01.119690+0000","last_clean":"2024-05-21T01:27:01.119690+0000","last_became_active":"2024-05-21T01:19:53.540670+0000","last_became_peered":"2024-05-21T01:19:53.540670+0000","last_unstale":"2024-05-21T01:27:01.119690+0000","last_undegraded":"2024-05-21T01:27:01.119690+0000","last_fullsized":"2024-05-21T01:27:01.119690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1","last_scrub_stamp":"2024-05-21T01:27:01.119609+0000","last_deep_scrub":"25'1","last_deep_scrub_stamp":"2024-05-21T01:27:01.119609+0000","last_clean_scrub_stamp":"2024-05-21T01:27:01.119609+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:03:35.826287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"27'277","reported_seq":455,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:59.102482+0000","last_change":"2024-05-21T01:26:59.102617+0000","last_active":"2024-05-21T01:26:59.102482+0000","last_peered":"2024-05-21T01:26:59.102482+0000","last_clean":"2024-05-21T01:26:59.102482+0000","last_became_active":"2024-05-21T01:19:58.610511+0000","last_became_peered":"2024-05-21T01:19:58.610511+0000","last_unstale":"2024-05-21T01:26:59.102482+0000","last_undegraded":"2024-05-21T01:26:59.102482+0000","last_fullsized":"2024-05-21T01:26:59.102482+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'277","last_scrub_stamp":"2024-05-21T01:26:59.102256+0000","last_deep_scrub":"27'277","last_deep_scrub_stamp":"2024-05-21T01:26:59.102256+0000","last_clean_scrub_stamp":"2024-05-21T01:26:59.102256+0000","objects_scrubbed":0,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:09:51.121776+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":606208,"num_write":264,"num_write_kb":720896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"27'8","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:47.671126+0000","last_change":"2024-05-21T01:26:47.671185+0000","last_active":"2024-05-21T01:26:47.671126+0000","last_peered":"2024-05-21T01:26:47.671126+0000","last_clean":"2024-05-21T01:26:47.671126+0000","last_became_active":"2024-05-21T01:19:54.572022+0000","last_became_peered":"2024-05-21T01:19:54.572022+0000","last_unstale":"2024-05-21T01:26:47.671126+0000","last_undegraded":"2024-05-21T01:26:47.671126+0000","last_fullsized":"2024-05-21T01:26:47.671126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-21T01:26:47.670942+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-21T01:26:47.670942+0000","last_clean_scrub_stamp":"2024-05-21T01:26:47.670942+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T09:38:35.597083+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"27'12","reported_seq":55,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:49.865125+0000","last_change":"2024-05-21T01:26:49.865192+0000","last_active":"2024-05-21T01:26:49.865125+0000","last_peered":"2024-05-21T01:26:49.865125+0000","last_clean":"2024-05-21T01:26:49.865125+0000","last_became_active":"2024-05-21T01:19:53.556143+0000","last_became_peered":"2024-05-21T01:19:53.556143+0000","last_unstale":"2024-05-21T01:26:49.865125+0000","last_undegraded":"2024-05-21T01:26:49.865125+0000","last_fullsized":"2024-05-21T01:26:49.865125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'12","last_scrub_stamp":"2024-05-21T01:26:49.864953+0000","last_deep_scrub":"27'12","last_deep_scrub_stamp":"2024-05-21T01:26:49.864953+0000","last_clean_scrub_stamp":"2024-05-21T01:26:49.864953+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:36:12.668688+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":619,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"27'289","reported_seq":461,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:57.042800+0000","last_change":"2024-05-21T01:26:57.042866+0000","last_active":"2024-05-21T01:26:57.042800+0000","last_peered":"2024-05-21T01:26:57.042800+0000","last_clean":"2024-05-21T01:26:57.042800+0000","last_became_active":"2024-05-21T01:19:58.598175+0000","last_became_peered":"2024-05-21T01:19:58.598175+0000","last_unstale":"2024-05-21T01:26:57.042800+0000","last_undegraded":"2024-05-21T01:26:57.042800+0000","last_fullsized":"2024-05-21T01:26:57.042800+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'289","last_scrub_stamp":"2024-05-21T01:26:57.042609+0000","last_deep_scrub":"27'289","last_deep_scrub_stamp":"2024-05-21T01:26:57.042609+0000","last_clean_scrub_stamp":"2024-05-21T01:26:57.042609+0000","objects_scrubbed":0,"log_size":289,"log_dups_size":0,"ondisk_log_size":289,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:04:19.610256+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":581632,"num_write":270,"num_write_kb":737280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"27'5","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:49.993480+0000","last_change":"2024-05-21T01:26:49.993540+0000","last_active":"2024-05-21T01:26:49.993480+0000","last_peered":"2024-05-21T01:26:49.993480+0000","last_clean":"2024-05-21T01:26:49.993480+0000","last_became_active":"2024-05-21T01:19:54.550338+0000","last_became_peered":"2024-05-21T01:19:54.550338+0000","last_unstale":"2024-05-21T01:26:49.993480+0000","last_undegraded":"2024-05-21T01:26:49.993480+0000","last_fullsized":"2024-05-21T01:26:49.993480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-05-21T01:26:49.993305+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-05-21T01:26:49.993305+0000","last_clean_scrub_stamp":"2024-05-21T01:26:49.993305+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:49:15.700901+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"27'4","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:54.177892+0000","last_change":"2024-05-21T01:26:54.177922+0000","last_active":"2024-05-21T01:26:54.177892+0000","last_peered":"2024-05-21T01:26:54.177892+0000","last_clean":"2024-05-21T01:26:54.177892+0000","last_became_active":"2024-05-21T01:19:53.554598+0000","last_became_peered":"2024-05-21T01:19:53.554598+0000","last_unstale":"2024-05-21T01:26:54.177892+0000","last_undegraded":"2024-05-21T01:26:54.177892+0000","last_fullsized":"2024-05-21T01:26:54.177892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-21T01:26:54.177806+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-21T01:26:54.177806+0000","last_clean_scrub_stamp":"2024-05-21T01:26:54.177806+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T09:38:36.457589+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"27'351","reported_seq":567,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:27:04.579826+0000","last_change":"2024-05-21T01:27:04.579887+0000","last_active":"2024-05-21T01:27:04.579826+0000","last_peered":"2024-05-21T01:27:04.579826+0000","last_clean":"2024-05-21T01:27:04.579826+0000","last_became_active":"2024-05-21T01:19:58.622106+0000","last_became_peered":"2024-05-21T01:19:58.622106+0000","last_unstale":"2024-05-21T01:27:04.579826+0000","last_undegraded":"2024-05-21T01:27:04.579826+0000","last_fullsized":"2024-05-21T01:27:04.579826+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'351","last_scrub_stamp":"2024-05-21T01:27:04.579646+0000","last_deep_scrub":"27'351","last_deep_scrub_stamp":"2024-05-21T01:27:04.579646+0000","last_clean_scrub_stamp":"2024-05-21T01:27:04.579646+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:39:10.272066+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":761856,"num_write":339,"num_write_kb":925696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"27'8","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:53.718804+0000","last_change":"2024-05-21T01:26:53.718863+0000","last_active":"2024-05-21T01:26:53.718804+0000","last_peered":"2024-05-21T01:26:53.718804+0000","last_clean":"2024-05-21T01:26:53.718804+0000","last_became_active":"2024-05-21T01:19:54.552126+0000","last_became_peered":"2024-05-21T01:19:54.552126+0000","last_unstale":"2024-05-21T01:26:53.718804+0000","last_undegraded":"2024-05-21T01:26:53.718804+0000","last_fullsized":"2024-05-21T01:26:53.718804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-21T01:26:53.718634+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-21T01:26:53.718634+0000","last_clean_scrub_stamp":"2024-05-21T01:26:53.718634+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:14:06.384055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"27'6","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:27:00.074049+0000","last_change":"2024-05-21T01:27:00.074073+0000","last_active":"2024-05-21T01:27:00.074049+0000","last_peered":"2024-05-21T01:27:00.074049+0000","last_clean":"2024-05-21T01:27:00.074049+0000","last_became_active":"2024-05-21T01:19:53.535105+0000","last_became_peered":"2024-05-21T01:19:53.535105+0000","last_unstale":"2024-05-21T01:27:00.074049+0000","last_undegraded":"2024-05-21T01:27:00.074049+0000","last_fullsized":"2024-05-21T01:27:00.074049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-21T01:27:00.073984+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-21T01:27:00.073984+0000","last_clean_scrub_stamp":"2024-05-21T01:27:00.073984+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:57:39.293726+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"27'74","reported_seq":136,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:44.796614+0000","last_change":"2024-05-21T01:26:44.796644+0000","last_active":"2024-05-21T01:26:44.796614+0000","last_peered":"2024-05-21T01:26:44.796614+0000","last_clean":"2024-05-21T01:26:44.796614+0000","last_became_active":"2024-05-21T01:19:49.488796+0000","last_became_peered":"2024-05-21T01:19:49.488796+0000","last_unstale":"2024-05-21T01:26:44.796614+0000","last_undegraded":"2024-05-21T01:26:44.796614+0000","last_fullsized":"2024-05-21T01:26:44.796614+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'74","last_scrub_stamp":"2024-05-21T01:26:44.796558+0000","last_deep_scrub":"27'74","last_deep_scrub_stamp":"2024-05-21T01:26:44.796558+0000","last_clean_scrub_stamp":"2024-05-21T01:26:44.796558+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:49:48.754501+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"27'292","reported_seq":477,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:27:06.122787+0000","last_change":"2024-05-21T01:27:06.122816+0000","last_active":"2024-05-21T01:27:06.122787+0000","last_peered":"2024-05-21T01:27:06.122787+0000","last_clean":"2024-05-21T01:27:06.122787+0000","last_became_active":"2024-05-21T01:19:58.589288+0000","last_became_peered":"2024-05-21T01:19:58.589288+0000","last_unstale":"2024-05-21T01:27:06.122787+0000","last_undegraded":"2024-05-21T01:27:06.122787+0000","last_fullsized":"2024-05-21T01:27:06.122787+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'292","last_scrub_stamp":"2024-05-21T01:27:06.122702+0000","last_deep_scrub":"27'292","last_deep_scrub_stamp":"2024-05-21T01:27:06.122702+0000","last_clean_scrub_stamp":"2024-05-21T01:27:06.122702+0000","objects_scrubbed":0,"log_size":292,"log_dups_size":0,"ondisk_log_size":292,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:16:22.575882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":155,"num_read_kb":634880,"num_write":276,"num_write_kb":753664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"27'7","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:52.149763+0000","last_change":"2024-05-21T01:26:52.149787+0000","last_active":"2024-05-21T01:26:52.149763+0000","last_peered":"2024-05-21T01:26:52.149763+0000","last_clean":"2024-05-21T01:26:52.149763+0000","last_became_active":"2024-05-21T01:19:54.543586+0000","last_became_peered":"2024-05-21T01:19:54.543586+0000","last_unstale":"2024-05-21T01:26:52.149763+0000","last_undegraded":"2024-05-21T01:26:52.149763+0000","last_fullsized":"2024-05-21T01:26:52.149763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-05-21T01:26:52.149680+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-05-21T01:26:52.149680+0000","last_clean_scrub_stamp":"2024-05-21T01:26:52.149680+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:12:27.624595+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"27'5","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:47.975792+0000","last_change":"2024-05-21T01:26:47.975914+0000","last_active":"2024-05-21T01:26:47.975792+0000","last_peered":"2024-05-21T01:26:47.975792+0000","last_clean":"2024-05-21T01:26:47.975792+0000","last_became_active":"2024-05-21T01:19:53.529879+0000","last_became_peered":"2024-05-21T01:19:53.529879+0000","last_unstale":"2024-05-21T01:26:47.975792+0000","last_undegraded":"2024-05-21T01:26:47.975792+0000","last_fullsized":"2024-05-21T01:26:47.975792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-05-21T01:26:47.975523+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-05-21T01:26:47.975523+0000","last_clean_scrub_stamp":"2024-05-21T01:26:47.975523+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:43:22.816436+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"27'301","reported_seq":491,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:55.169346+0000","last_change":"2024-05-21T01:26:55.169394+0000","last_active":"2024-05-21T01:26:55.169346+0000","last_peered":"2024-05-21T01:26:55.169346+0000","last_clean":"2024-05-21T01:26:55.169346+0000","last_became_active":"2024-05-21T01:19:58.603929+0000","last_became_peered":"2024-05-21T01:19:58.603929+0000","last_unstale":"2024-05-21T01:26:55.169346+0000","last_undegraded":"2024-05-21T01:26:55.169346+0000","last_fullsized":"2024-05-21T01:26:55.169346+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'301","last_scrub_stamp":"2024-05-21T01:26:55.169259+0000","last_deep_scrub":"27'301","last_deep_scrub_stamp":"2024-05-21T01:26:55.169259+0000","last_clean_scrub_stamp":"2024-05-21T01:26:55.169259+0000","objects_scrubbed":0,"log_size":301,"log_dups_size":0,"ondisk_log_size":301,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:42:08.929644+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":655360,"num_write":279,"num_write_kb":761856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"27'6","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:53.323996+0000","last_change":"2024-05-21T01:26:53.324022+0000","last_active":"2024-05-21T01:26:53.323996+0000","last_peered":"2024-05-21T01:26:53.323996+0000","last_clean":"2024-05-21T01:26:53.323996+0000","last_became_active":"2024-05-21T01:19:54.541837+0000","last_became_peered":"2024-05-21T01:19:54.541837+0000","last_unstale":"2024-05-21T01:26:53.323996+0000","last_undegraded":"2024-05-21T01:26:53.323996+0000","last_fullsized":"2024-05-21T01:26:53.323996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-21T01:26:53.323914+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-21T01:26:53.323914+0000","last_clean_scrub_stamp":"2024-05-21T01:26:53.323914+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:01:05.767815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"27'2","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:52.662451+0000","last_change":"2024-05-21T01:26:52.662518+0000","last_active":"2024-05-21T01:26:52.662451+0000","last_peered":"2024-05-21T01:26:52.662451+0000","last_clean":"2024-05-21T01:26:52.662451+0000","last_became_active":"2024-05-21T01:19:53.550893+0000","last_became_peered":"2024-05-21T01:19:53.550893+0000","last_unstale":"2024-05-21T01:26:52.662451+0000","last_undegraded":"2024-05-21T01:26:52.662451+0000","last_fullsized":"2024-05-21T01:26:52.662451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-21T01:26:52.662284+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-21T01:26:52.662284+0000","last_clean_scrub_stamp":"2024-05-21T01:26:52.662284+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:31:44.375845+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"27'271","reported_seq":443,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:27:03.614955+0000","last_change":"2024-05-21T01:27:03.615018+0000","last_active":"2024-05-21T01:27:03.614955+0000","last_peered":"2024-05-21T01:27:03.614955+0000","last_clean":"2024-05-21T01:27:03.614955+0000","last_became_active":"2024-05-21T01:19:58.620667+0000","last_became_peered":"2024-05-21T01:19:58.620667+0000","last_unstale":"2024-05-21T01:27:03.614955+0000","last_undegraded":"2024-05-21T01:27:03.614955+0000","last_fullsized":"2024-05-21T01:27:03.614955+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'271","last_scrub_stamp":"2024-05-21T01:27:03.614775+0000","last_deep_scrub":"27'271","last_deep_scrub_stamp":"2024-05-21T01:27:03.614775+0000","last_clean_scrub_stamp":"2024-05-21T01:27:03.614775+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:39:31.108046+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":581632,"num_write":261,"num_write_kb":712704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"27'9","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:51.309162+0000","last_change":"2024-05-21T01:26:51.309201+0000","last_active":"2024-05-21T01:26:51.309162+0000","last_peered":"2024-05-21T01:26:51.309162+0000","last_clean":"2024-05-21T01:26:51.309162+0000","last_became_active":"2024-05-21T01:19:54.532251+0000","last_became_peered":"2024-05-21T01:19:54.532251+0000","last_unstale":"2024-05-21T01:26:51.309162+0000","last_undegraded":"2024-05-21T01:26:51.309162+0000","last_fullsized":"2024-05-21T01:26:51.309162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-05-21T01:26:51.309083+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-05-21T01:26:51.309083+0000","last_clean_scrub_stamp":"2024-05-21T01:26:51.309083+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:27:22.553011+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"27'3","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:50.734352+0000","last_change":"2024-05-21T01:26:50.734416+0000","last_active":"2024-05-21T01:26:50.734352+0000","last_peered":"2024-05-21T01:26:50.734352+0000","last_clean":"2024-05-21T01:26:50.734352+0000","last_became_active":"2024-05-21T01:19:53.553953+0000","last_became_peered":"2024-05-21T01:19:53.553953+0000","last_unstale":"2024-05-21T01:26:50.734352+0000","last_undegraded":"2024-05-21T01:26:50.734352+0000","last_fullsized":"2024-05-21T01:26:50.734352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-05-21T01:26:50.734180+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-05-21T01:26:50.734180+0000","last_clean_scrub_stamp":"2024-05-21T01:26:50.734180+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:58:44.907145+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"27'333","reported_seq":533,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:27:07.100351+0000","last_change":"2024-05-21T01:27:07.100375+0000","last_active":"2024-05-21T01:27:07.100351+0000","last_peered":"2024-05-21T01:27:07.100351+0000","last_clean":"2024-05-21T01:27:07.100351+0000","last_became_active":"2024-05-21T01:19:58.592758+0000","last_became_peered":"2024-05-21T01:19:58.592758+0000","last_unstale":"2024-05-21T01:27:07.100351+0000","last_undegraded":"2024-05-21T01:27:07.100351+0000","last_fullsized":"2024-05-21T01:27:07.100351+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'333","last_scrub_stamp":"2024-05-21T01:27:07.100259+0000","last_deep_scrub":"27'333","last_deep_scrub_stamp":"2024-05-21T01:27:07.100259+0000","last_clean_scrub_stamp":"2024-05-21T01:27:07.100259+0000","objects_scrubbed":0,"log_size":333,"log_dups_size":0,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:14:15.831702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":170,"num_read_kb":696320,"num_write":318,"num_write_kb":868352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"27'5","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:46.077555+0000","last_change":"2024-05-21T01:26:46.077615+0000","last_active":"2024-05-21T01:26:46.077555+0000","last_peered":"2024-05-21T01:26:46.077555+0000","last_clean":"2024-05-21T01:26:46.077555+0000","last_became_active":"2024-05-21T01:19:54.538106+0000","last_became_peered":"2024-05-21T01:19:54.538106+0000","last_unstale":"2024-05-21T01:26:46.077555+0000","last_undegraded":"2024-05-21T01:26:46.077555+0000","last_fullsized":"2024-05-21T01:26:46.077555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-05-21T01:26:46.077462+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-05-21T01:26:46.077462+0000","last_clean_scrub_stamp":"2024-05-21T01:26:46.077462+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:00:40.231333+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"27'4","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:50.323699+0000","last_change":"2024-05-21T01:26:50.323732+0000","last_active":"2024-05-21T01:26:50.323699+0000","last_peered":"2024-05-21T01:26:50.323699+0000","last_clean":"2024-05-21T01:26:50.323699+0000","last_became_active":"2024-05-21T01:19:53.551608+0000","last_became_peered":"2024-05-21T01:19:53.551608+0000","last_unstale":"2024-05-21T01:26:50.323699+0000","last_undegraded":"2024-05-21T01:26:50.323699+0000","last_fullsized":"2024-05-21T01:26:50.323699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-21T01:26:50.323620+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-21T01:26:50.323620+0000","last_clean_scrub_stamp":"2024-05-21T01:26:50.323620+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:38:57.957402+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"27'274","reported_seq":439,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:51.898093+0000","last_change":"2024-05-21T01:26:51.898120+0000","last_active":"2024-05-21T01:26:51.898093+0000","last_peered":"2024-05-21T01:26:51.898093+0000","last_clean":"2024-05-21T01:26:51.898093+0000","last_became_active":"2024-05-21T01:19:58.612950+0000","last_became_peered":"2024-05-21T01:19:58.612950+0000","last_unstale":"2024-05-21T01:26:51.898093+0000","last_undegraded":"2024-05-21T01:26:51.898093+0000","last_fullsized":"2024-05-21T01:26:51.898093+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'274","last_scrub_stamp":"2024-05-21T01:26:51.897999+0000","last_deep_scrub":"27'274","last_deep_scrub_stamp":"2024-05-21T01:26:51.897999+0000","last_clean_scrub_stamp":"2024-05-21T01:26:51.897999+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:29:26.293479+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":135,"num_read_kb":552960,"num_write":258,"num_write_kb":704512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"27'6","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:46.178595+0000","last_change":"2024-05-21T01:26:46.178595+0000","last_active":"2024-05-21T01:26:46.178595+0000","last_peered":"2024-05-21T01:26:46.178595+0000","last_clean":"2024-05-21T01:26:46.178595+0000","last_became_active":"2024-05-21T01:19:54.548704+0000","last_became_peered":"2024-05-21T01:19:54.548704+0000","last_unstale":"2024-05-21T01:26:46.178595+0000","last_undegraded":"2024-05-21T01:26:46.178595+0000","last_fullsized":"2024-05-21T01:26:46.178595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-21T01:26:46.178499+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-21T01:26:46.178499+0000","last_clean_scrub_stamp":"2024-05-21T01:26:46.178499+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:00:45.652703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"27'24","reported_seq":62,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:48.796750+0000","last_change":"2024-05-21T01:26:48.796750+0000","last_active":"2024-05-21T01:26:48.796750+0000","last_peered":"2024-05-21T01:26:48.796750+0000","last_clean":"2024-05-21T01:26:48.796750+0000","last_became_active":"2024-05-21T01:19:53.541577+0000","last_became_peered":"2024-05-21T01:19:53.541577+0000","last_unstale":"2024-05-21T01:26:48.796750+0000","last_undegraded":"2024-05-21T01:26:48.796750+0000","last_fullsized":"2024-05-21T01:26:48.796750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'24","last_scrub_stamp":"2024-05-21T01:26:48.796408+0000","last_deep_scrub":"27'24","last_deep_scrub_stamp":"2024-05-21T01:26:48.796408+0000","last_clean_scrub_stamp":"2024-05-21T01:26:48.796408+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:08:47.580902+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"27'384","reported_seq":622,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:27:05.599816+0000","last_change":"2024-05-21T01:27:05.599816+0000","last_active":"2024-05-21T01:27:05.599816+0000","last_peered":"2024-05-21T01:27:05.599816+0000","last_clean":"2024-05-21T01:27:05.599816+0000","last_became_active":"2024-05-21T01:20:43.553035+0000","last_became_peered":"2024-05-21T01:20:43.553035+0000","last_unstale":"2024-05-21T01:27:05.599816+0000","last_undegraded":"2024-05-21T01:27:05.599816+0000","last_fullsized":"2024-05-21T01:27:05.599816+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'384","last_scrub_stamp":"2024-05-21T01:27:05.599572+0000","last_deep_scrub":"27'384","last_deep_scrub_stamp":"2024-05-21T01:27:05.599572+0000","last_clean_scrub_stamp":"2024-05-21T01:27:05.599572+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:19:29.804996+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":201,"num_read_kb":823296,"num_write":360,"num_write_kb":983040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1,6],"acting":[5,0,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"27'6","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:50.898610+0000","last_change":"2024-05-21T01:26:50.898610+0000","last_active":"2024-05-21T01:26:50.898610+0000","last_peered":"2024-05-21T01:26:50.898610+0000","last_clean":"2024-05-21T01:26:50.898610+0000","last_became_active":"2024-05-21T01:19:54.575314+0000","last_became_peered":"2024-05-21T01:19:54.575314+0000","last_unstale":"2024-05-21T01:26:50.898610+0000","last_undegraded":"2024-05-21T01:26:50.898610+0000","last_fullsized":"2024-05-21T01:26:50.898610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-21T01:26:50.898503+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-21T01:26:50.898503+0000","last_clean_scrub_stamp":"2024-05-21T01:26:50.898503+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T09:59:23.106731+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"27'5","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:47.267532+0000","last_change":"2024-05-21T01:26:47.267532+0000","last_active":"2024-05-21T01:26:47.267532+0000","last_peered":"2024-05-21T01:26:47.267532+0000","last_clean":"2024-05-21T01:26:47.267532+0000","last_became_active":"2024-05-21T01:19:53.523273+0000","last_became_peered":"2024-05-21T01:19:53.523273+0000","last_unstale":"2024-05-21T01:26:47.267532+0000","last_undegraded":"2024-05-21T01:26:47.267532+0000","last_fullsized":"2024-05-21T01:26:47.267532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-05-21T01:26:47.267430+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-05-21T01:26:47.267430+0000","last_clean_scrub_stamp":"2024-05-21T01:26:47.267430+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:25:53.047123+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"27'288","reported_seq":465,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:27:02.628994+0000","last_change":"2024-05-21T01:27:02.628994+0000","last_active":"2024-05-21T01:27:02.628994+0000","last_peered":"2024-05-21T01:27:02.628994+0000","last_clean":"2024-05-21T01:27:02.628994+0000","last_became_active":"2024-05-21T01:19:58.620552+0000","last_became_peered":"2024-05-21T01:19:58.620552+0000","last_unstale":"2024-05-21T01:27:02.628994+0000","last_undegraded":"2024-05-21T01:27:02.628994+0000","last_fullsized":"2024-05-21T01:27:02.628994+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'288","last_scrub_stamp":"2024-05-21T01:27:02.628723+0000","last_deep_scrub":"27'288","last_deep_scrub_stamp":"2024-05-21T01:27:02.628723+0000","last_clean_scrub_stamp":"2024-05-21T01:27:02.628723+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:20:36.174348+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":602112,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"27'15","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:53.169233+0000","last_change":"2024-05-21T01:26:53.169233+0000","last_active":"2024-05-21T01:26:53.169233+0000","last_peered":"2024-05-21T01:26:53.169233+0000","last_clean":"2024-05-21T01:26:53.169233+0000","last_became_active":"2024-05-21T01:19:54.550335+0000","last_became_peered":"2024-05-21T01:19:54.550335+0000","last_unstale":"2024-05-21T01:26:53.169233+0000","last_undegraded":"2024-05-21T01:26:53.169233+0000","last_fullsized":"2024-05-21T01:26:53.169233+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2024-05-21T01:26:53.169135+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2024-05-21T01:26:53.169135+0000","last_clean_scrub_stamp":"2024-05-21T01:26:53.169135+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:31:53.581830+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"27'4","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:58.140249+0000","last_change":"2024-05-21T01:26:58.140276+0000","last_active":"2024-05-21T01:26:58.140249+0000","last_peered":"2024-05-21T01:26:58.140249+0000","last_clean":"2024-05-21T01:26:58.140249+0000","last_became_active":"2024-05-21T01:19:53.534174+0000","last_became_peered":"2024-05-21T01:19:53.534174+0000","last_unstale":"2024-05-21T01:26:58.140249+0000","last_undegraded":"2024-05-21T01:26:58.140249+0000","last_fullsized":"2024-05-21T01:26:58.140249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-21T01:26:58.140170+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-21T01:26:58.140170+0000","last_clean_scrub_stamp":"2024-05-21T01:26:58.140170+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:29:16.639637+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"27'287","reported_seq":463,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:58.082502+0000","last_change":"2024-05-21T01:26:58.082502+0000","last_active":"2024-05-21T01:26:58.082502+0000","last_peered":"2024-05-21T01:26:58.082502+0000","last_clean":"2024-05-21T01:26:58.082502+0000","last_became_active":"2024-05-21T01:19:58.608371+0000","last_became_peered":"2024-05-21T01:19:58.608371+0000","last_unstale":"2024-05-21T01:26:58.082502+0000","last_undegraded":"2024-05-21T01:26:58.082502+0000","last_fullsized":"2024-05-21T01:26:58.082502+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'287","last_scrub_stamp":"2024-05-21T01:26:58.082269+0000","last_deep_scrub":"27'287","last_deep_scrub_stamp":"2024-05-21T01:26:58.082269+0000","last_clean_scrub_stamp":"2024-05-21T01:26:58.082269+0000","objects_scrubbed":0,"log_size":287,"log_dups_size":0,"ondisk_log_size":287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:28:59.156049+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":598016,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"27'10","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:51.036284+0000","last_change":"2024-05-21T01:26:51.036284+0000","last_active":"2024-05-21T01:26:51.036284+0000","last_peered":"2024-05-21T01:26:51.036284+0000","last_clean":"2024-05-21T01:26:51.036284+0000","last_became_active":"2024-05-21T01:19:54.550865+0000","last_became_peered":"2024-05-21T01:19:54.550865+0000","last_unstale":"2024-05-21T01:26:51.036284+0000","last_undegraded":"2024-05-21T01:26:51.036284+0000","last_fullsized":"2024-05-21T01:26:51.036284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-05-21T01:26:51.036056+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-05-21T01:26:51.036056+0000","last_clean_scrub_stamp":"2024-05-21T01:26:51.036056+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T13:09:58.969165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"27'10","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:47.807209+0000","last_change":"2024-05-21T01:26:47.807209+0000","last_active":"2024-05-21T01:26:47.807209+0000","last_peered":"2024-05-21T01:26:47.807209+0000","last_clean":"2024-05-21T01:26:47.807209+0000","last_became_active":"2024-05-21T01:19:53.535143+0000","last_became_peered":"2024-05-21T01:19:53.535143+0000","last_unstale":"2024-05-21T01:26:47.807209+0000","last_undegraded":"2024-05-21T01:26:47.807209+0000","last_fullsized":"2024-05-21T01:26:47.807209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-05-21T01:26:47.806870+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-05-21T01:26:47.806870+0000","last_clean_scrub_stamp":"2024-05-21T01:26:47.806870+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:57:05.622671+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"27'338","reported_seq":552,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:27:10.137055+0000","last_change":"2024-05-21T01:27:10.137055+0000","last_active":"2024-05-21T01:27:10.137055+0000","last_peered":"2024-05-21T01:27:10.137055+0000","last_clean":"2024-05-21T01:27:10.137055+0000","last_became_active":"2024-05-21T01:19:58.622250+0000","last_became_peered":"2024-05-21T01:19:58.622250+0000","last_unstale":"2024-05-21T01:27:10.137055+0000","last_undegraded":"2024-05-21T01:27:10.137055+0000","last_fullsized":"2024-05-21T01:27:10.137055+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'338","last_scrub_stamp":"2024-05-21T01:27:10.136955+0000","last_deep_scrub":"27'338","last_deep_scrub_stamp":"2024-05-21T01:27:10.136955+0000","last_clean_scrub_stamp":"2024-05-21T01:27:10.136955+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:45:17.942927+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":184,"num_read_kb":753664,"num_write":327,"num_write_kb":892928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"27'6","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:58.293280+0000","last_change":"2024-05-21T01:26:58.293280+0000","last_active":"2024-05-21T01:26:58.293280+0000","last_peered":"2024-05-21T01:26:58.293280+0000","last_clean":"2024-05-21T01:26:58.293280+0000","last_became_active":"2024-05-21T01:19:54.558095+0000","last_became_peered":"2024-05-21T01:19:54.558095+0000","last_unstale":"2024-05-21T01:26:58.293280+0000","last_undegraded":"2024-05-21T01:26:58.293280+0000","last_fullsized":"2024-05-21T01:26:58.293280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-21T01:26:58.293178+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-21T01:26:58.293178+0000","last_clean_scrub_stamp":"2024-05-21T01:26:58.293178+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:13:58.311888+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'1406","reported_seq":1444,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:45.094295+0000","last_change":"2024-05-21T01:26:45.094295+0000","last_active":"2024-05-21T01:26:45.094295+0000","last_peered":"2024-05-21T01:26:45.094295+0000","last_clean":"2024-05-21T01:26:45.094295+0000","last_became_active":"2024-05-21T01:19:53.534616+0000","last_became_peered":"2024-05-21T01:19:53.534616+0000","last_unstale":"2024-05-21T01:26:45.094295+0000","last_undegraded":"2024-05-21T01:26:45.094295+0000","last_fullsized":"2024-05-21T01:26:45.094295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1406","last_scrub_stamp":"2024-05-21T01:26:45.094198+0000","last_deep_scrub":"27'1406","last_deep_scrub_stamp":"2024-05-21T01:26:45.094198+0000","last_clean_scrub_stamp":"2024-05-21T01:26:45.094198+0000","objects_scrubbed":5,"log_size":1406,"log_dups_size":0,"ondisk_log_size":1406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T09:39:30.902222+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2842259,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1403,"num_write_kb":2944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"27'304","reported_seq":494,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:59.723147+0000","last_change":"2024-05-21T01:26:59.723147+0000","last_active":"2024-05-21T01:26:59.723147+0000","last_peered":"2024-05-21T01:26:59.723147+0000","last_clean":"2024-05-21T01:26:59.723147+0000","last_became_active":"2024-05-21T01:19:58.617061+0000","last_became_peered":"2024-05-21T01:19:58.617061+0000","last_unstale":"2024-05-21T01:26:59.723147+0000","last_undegraded":"2024-05-21T01:26:59.723147+0000","last_fullsized":"2024-05-21T01:26:59.723147+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'304","last_scrub_stamp":"2024-05-21T01:26:59.722898+0000","last_deep_scrub":"27'304","last_deep_scrub_stamp":"2024-05-21T01:26:59.722898+0000","last_clean_scrub_stamp":"2024-05-21T01:26:59.722898+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:48:35.778604+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":655360,"num_write":288,"num_write_kb":786432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"27'11","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:51.167457+0000","last_change":"2024-05-21T01:26:51.167457+0000","last_active":"2024-05-21T01:26:51.167457+0000","last_peered":"2024-05-21T01:26:51.167457+0000","last_clean":"2024-05-21T01:26:51.167457+0000","last_became_active":"2024-05-21T01:19:54.556933+0000","last_became_peered":"2024-05-21T01:19:54.556933+0000","last_unstale":"2024-05-21T01:26:51.167457+0000","last_undegraded":"2024-05-21T01:26:51.167457+0000","last_fullsized":"2024-05-21T01:26:51.167457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'11","last_scrub_stamp":"2024-05-21T01:26:51.167295+0000","last_deep_scrub":"27'11","last_deep_scrub_stamp":"2024-05-21T01:26:51.167295+0000","last_clean_scrub_stamp":"2024-05-21T01:26:51.167295+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T13:06:16.111290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"27'11","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:48.846907+0000","last_change":"2024-05-21T01:26:48.846907+0000","last_active":"2024-05-21T01:26:48.846907+0000","last_peered":"2024-05-21T01:26:48.846907+0000","last_clean":"2024-05-21T01:26:48.846907+0000","last_became_active":"2024-05-21T01:19:53.535768+0000","last_became_peered":"2024-05-21T01:19:53.535768+0000","last_unstale":"2024-05-21T01:26:48.846907+0000","last_undegraded":"2024-05-21T01:26:48.846907+0000","last_fullsized":"2024-05-21T01:26:48.846907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'11","last_scrub_stamp":"2024-05-21T01:26:48.846672+0000","last_deep_scrub":"27'11","last_deep_scrub_stamp":"2024-05-21T01:26:48.846672+0000","last_clean_scrub_stamp":"2024-05-21T01:26:48.846672+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:53:56.087430+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"27'320","reported_seq":524,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:57.145709+0000","last_change":"2024-05-21T01:26:57.145709+0000","last_active":"2024-05-21T01:26:57.145709+0000","last_peered":"2024-05-21T01:26:57.145709+0000","last_clean":"2024-05-21T01:26:57.145709+0000","last_became_active":"2024-05-21T01:19:58.606180+0000","last_became_peered":"2024-05-21T01:19:58.606180+0000","last_unstale":"2024-05-21T01:26:57.145709+0000","last_undegraded":"2024-05-21T01:26:57.145709+0000","last_fullsized":"2024-05-21T01:26:57.145709+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'320","last_scrub_stamp":"2024-05-21T01:26:57.145599+0000","last_deep_scrub":"27'320","last_deep_scrub_stamp":"2024-05-21T01:26:57.145599+0000","last_clean_scrub_stamp":"2024-05-21T01:26:57.145599+0000","objects_scrubbed":0,"log_size":320,"log_dups_size":0,"ondisk_log_size":320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:30:22.101240+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":174,"num_read_kb":712704,"num_write":297,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"27'9","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:49.600285+0000","last_change":"2024-05-21T01:26:49.600285+0000","last_active":"2024-05-21T01:26:49.600285+0000","last_peered":"2024-05-21T01:26:49.600285+0000","last_clean":"2024-05-21T01:26:49.600285+0000","last_became_active":"2024-05-21T01:19:54.568778+0000","last_became_peered":"2024-05-21T01:19:54.568778+0000","last_unstale":"2024-05-21T01:26:49.600285+0000","last_undegraded":"2024-05-21T01:26:49.600285+0000","last_fullsized":"2024-05-21T01:26:49.600285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-05-21T01:26:49.600047+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-05-21T01:26:49.600047+0000","last_clean_scrub_stamp":"2024-05-21T01:26:49.600047+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:46:31.103087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"27'3","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:49.277970+0000","last_change":"2024-05-21T01:26:49.277970+0000","last_active":"2024-05-21T01:26:49.277970+0000","last_peered":"2024-05-21T01:26:49.277970+0000","last_clean":"2024-05-21T01:26:49.277970+0000","last_became_active":"2024-05-21T01:19:53.526431+0000","last_became_peered":"2024-05-21T01:19:53.526431+0000","last_unstale":"2024-05-21T01:26:49.277970+0000","last_undegraded":"2024-05-21T01:26:49.277970+0000","last_fullsized":"2024-05-21T01:26:49.277970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-05-21T01:26:49.277863+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-05-21T01:26:49.277863+0000","last_clean_scrub_stamp":"2024-05-21T01:26:49.277863+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:59:08.625024+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"27'316","reported_seq":500,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:53.785202+0000","last_change":"2024-05-21T01:26:53.785202+0000","last_active":"2024-05-21T01:26:53.785202+0000","last_peered":"2024-05-21T01:26:53.785202+0000","last_clean":"2024-05-21T01:26:53.785202+0000","last_became_active":"2024-05-21T01:19:58.610838+0000","last_became_peered":"2024-05-21T01:19:58.610838+0000","last_unstale":"2024-05-21T01:26:53.785202+0000","last_undegraded":"2024-05-21T01:26:53.785202+0000","last_fullsized":"2024-05-21T01:26:53.785202+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'316","last_scrub_stamp":"2024-05-21T01:26:53.784948+0000","last_deep_scrub":"27'316","last_deep_scrub_stamp":"2024-05-21T01:26:53.784948+0000","last_clean_scrub_stamp":"2024-05-21T01:26:53.784948+0000","objects_scrubbed":0,"log_size":316,"log_dups_size":0,"ondisk_log_size":316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:20:50.020880+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":630784,"num_write":297,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"27'10","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:50.106656+0000","last_change":"2024-05-21T01:26:50.106656+0000","last_active":"2024-05-21T01:26:50.106656+0000","last_peered":"2024-05-21T01:26:50.106656+0000","last_clean":"2024-05-21T01:26:50.106656+0000","last_became_active":"2024-05-21T01:19:54.547898+0000","last_became_peered":"2024-05-21T01:19:54.547898+0000","last_unstale":"2024-05-21T01:26:50.106656+0000","last_undegraded":"2024-05-21T01:26:50.106656+0000","last_fullsized":"2024-05-21T01:26:50.106656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-05-21T01:26:50.106550+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-05-21T01:26:50.106550+0000","last_clean_scrub_stamp":"2024-05-21T01:26:50.106550+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:54:03.172902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"27'6","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:45.792997+0000","last_change":"2024-05-21T01:26:45.792997+0000","last_active":"2024-05-21T01:26:45.792997+0000","last_peered":"2024-05-21T01:26:45.792997+0000","last_clean":"2024-05-21T01:26:45.792997+0000","last_became_active":"2024-05-21T01:19:53.534036+0000","last_became_peered":"2024-05-21T01:19:53.534036+0000","last_unstale":"2024-05-21T01:26:45.792997+0000","last_undegraded":"2024-05-21T01:26:45.792997+0000","last_fullsized":"2024-05-21T01:26:45.792997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-21T01:26:45.792908+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-21T01:26:45.792908+0000","last_clean_scrub_stamp":"2024-05-21T01:26:45.792908+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:50:29.526470+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"27'342","reported_seq":546,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:58.758513+0000","last_change":"2024-05-21T01:26:58.758513+0000","last_active":"2024-05-21T01:26:58.758513+0000","last_peered":"2024-05-21T01:26:58.758513+0000","last_clean":"2024-05-21T01:26:58.758513+0000","last_became_active":"2024-05-21T01:19:58.607242+0000","last_became_peered":"2024-05-21T01:19:58.607242+0000","last_unstale":"2024-05-21T01:26:58.758513+0000","last_undegraded":"2024-05-21T01:26:58.758513+0000","last_fullsized":"2024-05-21T01:26:58.758513+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'342","last_scrub_stamp":"2024-05-21T01:26:58.758144+0000","last_deep_scrub":"27'342","last_deep_scrub_stamp":"2024-05-21T01:26:58.758144+0000","last_clean_scrub_stamp":"2024-05-21T01:26:58.758144+0000","objects_scrubbed":0,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:22:23.250356+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":174,"num_read_kb":712704,"num_write":327,"num_write_kb":892928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"27'287","reported_seq":473,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:27:01.684382+0000","last_change":"2024-05-21T01:27:01.684515+0000","last_active":"2024-05-21T01:27:01.684382+0000","last_peered":"2024-05-21T01:27:01.684382+0000","last_clean":"2024-05-21T01:27:01.684382+0000","last_became_active":"2024-05-21T01:19:58.623991+0000","last_became_peered":"2024-05-21T01:19:58.623991+0000","last_unstale":"2024-05-21T01:27:01.684382+0000","last_undegraded":"2024-05-21T01:27:01.684382+0000","last_fullsized":"2024-05-21T01:27:01.684382+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'287","last_scrub_stamp":"2024-05-21T01:27:01.684139+0000","last_deep_scrub":"27'287","last_deep_scrub_stamp":"2024-05-21T01:27:01.684139+0000","last_clean_scrub_stamp":"2024-05-21T01:27:01.684139+0000","objects_scrubbed":0,"log_size":287,"log_dups_size":0,"ondisk_log_size":287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:36:27.654144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":156,"num_read_kb":638976,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"27'11","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:51.720671+0000","last_change":"2024-05-21T01:26:51.720671+0000","last_active":"2024-05-21T01:26:51.720671+0000","last_peered":"2024-05-21T01:26:51.720671+0000","last_clean":"2024-05-21T01:26:51.720671+0000","last_became_active":"2024-05-21T01:19:54.548426+0000","last_became_peered":"2024-05-21T01:19:54.548426+0000","last_unstale":"2024-05-21T01:26:51.720671+0000","last_undegraded":"2024-05-21T01:26:51.720671+0000","last_fullsized":"2024-05-21T01:26:51.720671+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'11","last_scrub_stamp":"2024-05-21T01:26:51.720404+0000","last_deep_scrub":"27'11","last_deep_scrub_stamp":"2024-05-21T01:26:51.720404+0000","last_clean_scrub_stamp":"2024-05-21T01:26:51.720404+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:03:41.545353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"25'1","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:57.149559+0000","last_change":"2024-05-21T01:26:57.149559+0000","last_active":"2024-05-21T01:26:57.149559+0000","last_peered":"2024-05-21T01:26:57.149559+0000","last_clean":"2024-05-21T01:26:57.149559+0000","last_became_active":"2024-05-21T01:19:53.525786+0000","last_became_peered":"2024-05-21T01:19:53.525786+0000","last_unstale":"2024-05-21T01:26:57.149559+0000","last_undegraded":"2024-05-21T01:26:57.149559+0000","last_fullsized":"2024-05-21T01:26:57.149559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1","last_scrub_stamp":"2024-05-21T01:26:57.149423+0000","last_deep_scrub":"25'1","last_deep_scrub_stamp":"2024-05-21T01:26:57.149423+0000","last_clean_scrub_stamp":"2024-05-21T01:26:57.149423+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:33:00.429829+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"27'277","reported_seq":459,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:27:08.116859+0000","last_change":"2024-05-21T01:27:08.116883+0000","last_active":"2024-05-21T01:27:08.116859+0000","last_peered":"2024-05-21T01:27:08.116859+0000","last_clean":"2024-05-21T01:27:08.116859+0000","last_became_active":"2024-05-21T01:19:58.614879+0000","last_became_peered":"2024-05-21T01:19:58.614879+0000","last_unstale":"2024-05-21T01:27:08.116859+0000","last_undegraded":"2024-05-21T01:27:08.116859+0000","last_fullsized":"2024-05-21T01:27:08.116859+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'277","last_scrub_stamp":"2024-05-21T01:27:08.116789+0000","last_deep_scrub":"27'277","last_deep_scrub_stamp":"2024-05-21T01:27:08.116789+0000","last_clean_scrub_stamp":"2024-05-21T01:27:08.116789+0000","objects_scrubbed":0,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:55:27.732856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":622592,"num_write":267,"num_write_kb":729088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"27'8","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:57.641459+0000","last_change":"2024-05-21T01:26:57.641459+0000","last_active":"2024-05-21T01:26:57.641459+0000","last_peered":"2024-05-21T01:26:57.641459+0000","last_clean":"2024-05-21T01:26:57.641459+0000","last_became_active":"2024-05-21T01:19:54.570034+0000","last_became_peered":"2024-05-21T01:19:54.570034+0000","last_unstale":"2024-05-21T01:26:57.641459+0000","last_undegraded":"2024-05-21T01:26:57.641459+0000","last_fullsized":"2024-05-21T01:26:57.641459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-21T01:26:57.641143+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-21T01:26:57.641143+0000","last_clean_scrub_stamp":"2024-05-21T01:26:57.641143+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:42:59.746002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"27'3","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:46.950561+0000","last_change":"2024-05-21T01:26:46.950561+0000","last_active":"2024-05-21T01:26:46.950561+0000","last_peered":"2024-05-21T01:26:46.950561+0000","last_clean":"2024-05-21T01:26:46.950561+0000","last_became_active":"2024-05-21T01:19:53.529457+0000","last_became_peered":"2024-05-21T01:19:53.529457+0000","last_unstale":"2024-05-21T01:26:46.950561+0000","last_undegraded":"2024-05-21T01:26:46.950561+0000","last_fullsized":"2024-05-21T01:26:46.950561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-05-21T01:26:46.950315+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-05-21T01:26:46.950315+0000","last_clean_scrub_stamp":"2024-05-21T01:26:46.950315+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:38:49.774838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"27'4","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:56.115946+0000","last_change":"2024-05-21T01:26:56.115946+0000","last_active":"2024-05-21T01:26:56.115946+0000","last_peered":"2024-05-21T01:26:56.115946+0000","last_clean":"2024-05-21T01:26:56.115946+0000","last_became_active":"2024-05-21T01:19:53.525315+0000","last_became_peered":"2024-05-21T01:19:53.525315+0000","last_unstale":"2024-05-21T01:26:56.115946+0000","last_undegraded":"2024-05-21T01:26:56.115946+0000","last_fullsized":"2024-05-21T01:26:56.115946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-21T01:26:56.115813+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-21T01:26:56.115813+0000","last_clean_scrub_stamp":"2024-05-21T01:26:56.115813+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:25:23.684582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"27'8","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:55.703346+0000","last_change":"2024-05-21T01:26:55.703404+0000","last_active":"2024-05-21T01:26:55.703346+0000","last_peered":"2024-05-21T01:26:55.703346+0000","last_clean":"2024-05-21T01:26:55.703346+0000","last_became_active":"2024-05-21T01:19:54.552817+0000","last_became_peered":"2024-05-21T01:19:54.552817+0000","last_unstale":"2024-05-21T01:26:55.703346+0000","last_undegraded":"2024-05-21T01:26:55.703346+0000","last_fullsized":"2024-05-21T01:26:55.703346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-21T01:26:55.703178+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-21T01:26:55.703178+0000","last_clean_scrub_stamp":"2024-05-21T01:26:55.703178+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:30:14.511638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"27'316","reported_seq":515,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:27:00.707594+0000","last_change":"2024-05-21T01:27:00.707661+0000","last_active":"2024-05-21T01:27:00.707594+0000","last_peered":"2024-05-21T01:27:00.707594+0000","last_clean":"2024-05-21T01:27:00.707594+0000","last_became_active":"2024-05-21T01:19:58.617165+0000","last_became_peered":"2024-05-21T01:19:58.617165+0000","last_unstale":"2024-05-21T01:27:00.707594+0000","last_undegraded":"2024-05-21T01:27:00.707594+0000","last_fullsized":"2024-05-21T01:27:00.707594+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'316","last_scrub_stamp":"2024-05-21T01:27:00.707401+0000","last_deep_scrub":"27'316","last_deep_scrub_stamp":"2024-05-21T01:27:00.707401+0000","last_clean_scrub_stamp":"2024-05-21T01:27:00.707401+0000","objects_scrubbed":0,"log_size":316,"log_dups_size":0,"ondisk_log_size":316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:46:29.130647+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":170,"num_read_kb":696320,"num_write":297,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"27'8","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:50.648784+0000","last_change":"2024-05-21T01:26:50.648784+0000","last_active":"2024-05-21T01:26:50.648784+0000","last_peered":"2024-05-21T01:26:50.648784+0000","last_clean":"2024-05-21T01:26:50.648784+0000","last_became_active":"2024-05-21T01:19:53.550931+0000","last_became_peered":"2024-05-21T01:19:53.550931+0000","last_unstale":"2024-05-21T01:26:50.648784+0000","last_undegraded":"2024-05-21T01:26:50.648784+0000","last_fullsized":"2024-05-21T01:26:50.648784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-21T01:26:50.648439+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-21T01:26:50.648439+0000","last_clean_scrub_stamp":"2024-05-21T01:26:50.648439+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:37:42.476807+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1021,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"27'7","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:49.878628+0000","last_change":"2024-05-21T01:26:49.878628+0000","last_active":"2024-05-21T01:26:49.878628+0000","last_peered":"2024-05-21T01:26:49.878628+0000","last_clean":"2024-05-21T01:26:49.878628+0000","last_became_active":"2024-05-21T01:19:54.574246+0000","last_became_peered":"2024-05-21T01:19:54.574246+0000","last_unstale":"2024-05-21T01:26:49.878628+0000","last_undegraded":"2024-05-21T01:26:49.878628+0000","last_fullsized":"2024-05-21T01:26:49.878628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-05-21T01:26:49.878514+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-05-21T01:26:49.878514+0000","last_clean_scrub_stamp":"2024-05-21T01:26:49.878514+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:51:40.472391+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"27'326","reported_seq":527,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:56.788749+0000","last_change":"2024-05-21T01:26:56.788819+0000","last_active":"2024-05-21T01:26:56.788749+0000","last_peered":"2024-05-21T01:26:56.788749+0000","last_clean":"2024-05-21T01:26:56.788749+0000","last_became_active":"2024-05-21T01:19:58.623388+0000","last_became_peered":"2024-05-21T01:19:58.623388+0000","last_unstale":"2024-05-21T01:26:56.788749+0000","last_undegraded":"2024-05-21T01:26:56.788749+0000","last_fullsized":"2024-05-21T01:26:56.788749+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'326","last_scrub_stamp":"2024-05-21T01:26:56.788525+0000","last_deep_scrub":"27'326","last_deep_scrub_stamp":"2024-05-21T01:26:56.788525+0000","last_clean_scrub_stamp":"2024-05-21T01:26:56.788525+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:40:16.665568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":704512,"num_write":312,"num_write_kb":851968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"27'9","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:49.073599+0000","last_change":"2024-05-21T01:26:49.073625+0000","last_active":"2024-05-21T01:26:49.073599+0000","last_peered":"2024-05-21T01:26:49.073599+0000","last_clean":"2024-05-21T01:26:49.073599+0000","last_became_active":"2024-05-21T01:19:54.553060+0000","last_became_peered":"2024-05-21T01:19:54.553060+0000","last_unstale":"2024-05-21T01:26:49.073599+0000","last_undegraded":"2024-05-21T01:26:49.073599+0000","last_fullsized":"2024-05-21T01:26:49.073599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-05-21T01:26:49.073514+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-05-21T01:26:49.073514+0000","last_clean_scrub_stamp":"2024-05-21T01:26:49.073514+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:35:50.226987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"27'12","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:50.852458+0000","last_change":"2024-05-21T01:26:50.852517+0000","last_active":"2024-05-21T01:26:50.852458+0000","last_peered":"2024-05-21T01:26:50.852458+0000","last_clean":"2024-05-21T01:26:50.852458+0000","last_became_active":"2024-05-21T01:19:54.565573+0000","last_became_peered":"2024-05-21T01:19:54.565573+0000","last_unstale":"2024-05-21T01:26:50.852458+0000","last_undegraded":"2024-05-21T01:26:50.852458+0000","last_fullsized":"2024-05-21T01:26:50.852458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'12","last_scrub_stamp":"2024-05-21T01:26:50.852273+0000","last_deep_scrub":"27'12","last_deep_scrub_stamp":"2024-05-21T01:26:50.852273+0000","last_clean_scrub_stamp":"2024-05-21T01:26:50.852273+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T07:18:24.504637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"27'8","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:27:04.128708+0000","last_change":"2024-05-21T01:27:04.128734+0000","last_active":"2024-05-21T01:27:04.128708+0000","last_peered":"2024-05-21T01:27:04.128708+0000","last_clean":"2024-05-21T01:27:04.128708+0000","last_became_active":"2024-05-21T01:19:54.566503+0000","last_became_peered":"2024-05-21T01:19:54.566503+0000","last_unstale":"2024-05-21T01:27:04.128708+0000","last_undegraded":"2024-05-21T01:27:04.128708+0000","last_fullsized":"2024-05-21T01:27:04.128708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-21T01:27:04.128624+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-21T01:27:04.128624+0000","last_clean_scrub_stamp":"2024-05-21T01:27:04.128624+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:11:38.532259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"27'7","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:48.620951+0000","last_change":"2024-05-21T01:26:48.621008+0000","last_active":"2024-05-21T01:26:48.620951+0000","last_peered":"2024-05-21T01:26:48.620951+0000","last_clean":"2024-05-21T01:26:48.620951+0000","last_became_active":"2024-05-21T01:19:54.572366+0000","last_became_peered":"2024-05-21T01:19:54.572366+0000","last_unstale":"2024-05-21T01:26:48.620951+0000","last_undegraded":"2024-05-21T01:26:48.620951+0000","last_fullsized":"2024-05-21T01:26:48.620951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-05-21T01:26:48.620762+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-05-21T01:26:48.620762+0000","last_clean_scrub_stamp":"2024-05-21T01:26:48.620762+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:06:40.734926+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"27'4","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:55.028095+0000","last_change":"2024-05-21T01:26:55.028153+0000","last_active":"2024-05-21T01:26:55.028095+0000","last_peered":"2024-05-21T01:26:55.028095+0000","last_clean":"2024-05-21T01:26:55.028095+0000","last_became_active":"2024-05-21T01:19:54.557934+0000","last_became_peered":"2024-05-21T01:19:54.557934+0000","last_unstale":"2024-05-21T01:26:55.028095+0000","last_undegraded":"2024-05-21T01:26:55.028095+0000","last_fullsized":"2024-05-21T01:26:55.028095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-21T01:26:55.027904+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-21T01:26:55.027904+0000","last_clean_scrub_stamp":"2024-05-21T01:26:55.027904+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:27:42.261888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"27'6","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:51.997264+0000","last_change":"2024-05-21T01:26:51.997389+0000","last_active":"2024-05-21T01:26:51.997264+0000","last_peered":"2024-05-21T01:26:51.997264+0000","last_clean":"2024-05-21T01:26:51.997264+0000","last_became_active":"2024-05-21T01:19:54.552812+0000","last_became_peered":"2024-05-21T01:19:54.552812+0000","last_unstale":"2024-05-21T01:26:51.997264+0000","last_undegraded":"2024-05-21T01:26:51.997264+0000","last_fullsized":"2024-05-21T01:26:51.997264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-21T01:26:51.997028+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-21T01:26:51.997028+0000","last_clean_scrub_stamp":"2024-05-21T01:26:51.997028+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:04:40.370306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"27'15","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:47.073598+0000","last_change":"2024-05-21T01:26:47.073619+0000","last_active":"2024-05-21T01:26:47.073598+0000","last_peered":"2024-05-21T01:26:47.073598+0000","last_clean":"2024-05-21T01:26:47.073598+0000","last_became_active":"2024-05-21T01:19:54.548263+0000","last_became_peered":"2024-05-21T01:19:54.548263+0000","last_unstale":"2024-05-21T01:26:47.073598+0000","last_undegraded":"2024-05-21T01:26:47.073598+0000","last_fullsized":"2024-05-21T01:26:47.073598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2024-05-21T01:26:47.073535+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2024-05-21T01:26:47.073535+0000","last_clean_scrub_stamp":"2024-05-21T01:26:47.073535+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T13:05:21.179383+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"27'2","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:59.653649+0000","last_change":"2024-05-21T01:26:59.653706+0000","last_active":"2024-05-21T01:26:59.653649+0000","last_peered":"2024-05-21T01:26:59.653649+0000","last_clean":"2024-05-21T01:26:59.653649+0000","last_became_active":"2024-05-21T01:19:54.570373+0000","last_became_peered":"2024-05-21T01:19:54.570373+0000","last_unstale":"2024-05-21T01:26:59.653649+0000","last_undegraded":"2024-05-21T01:26:59.653649+0000","last_fullsized":"2024-05-21T01:26:59.653649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-21T01:26:59.653482+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-21T01:26:59.653482+0000","last_clean_scrub_stamp":"2024-05-21T01:26:59.653482+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:47:11.215573+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"27'6","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:27:05.123853+0000","last_change":"2024-05-21T01:27:05.123880+0000","last_active":"2024-05-21T01:27:05.123853+0000","last_peered":"2024-05-21T01:27:05.123853+0000","last_clean":"2024-05-21T01:27:05.123853+0000","last_became_active":"2024-05-21T01:19:54.574945+0000","last_became_peered":"2024-05-21T01:19:54.574945+0000","last_unstale":"2024-05-21T01:27:05.123853+0000","last_undegraded":"2024-05-21T01:27:05.123853+0000","last_fullsized":"2024-05-21T01:27:05.123853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-21T01:27:05.123767+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-21T01:27:05.123767+0000","last_clean_scrub_stamp":"2024-05-21T01:27:05.123767+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T13:07:54.194342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"27'8","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:54.630621+0000","last_change":"2024-05-21T01:26:54.630746+0000","last_active":"2024-05-21T01:26:54.630621+0000","last_peered":"2024-05-21T01:26:54.630621+0000","last_clean":"2024-05-21T01:26:54.630621+0000","last_became_active":"2024-05-21T01:19:54.565922+0000","last_became_peered":"2024-05-21T01:19:54.565922+0000","last_unstale":"2024-05-21T01:26:54.630621+0000","last_undegraded":"2024-05-21T01:26:54.630621+0000","last_fullsized":"2024-05-21T01:26:54.630621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-21T01:26:54.630337+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-21T01:26:54.630337+0000","last_clean_scrub_stamp":"2024-05-21T01:26:54.630337+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:12:55.698213+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"27'10","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:47.823174+0000","last_change":"2024-05-21T01:26:47.823194+0000","last_active":"2024-05-21T01:26:47.823174+0000","last_peered":"2024-05-21T01:26:47.823174+0000","last_clean":"2024-05-21T01:26:47.823174+0000","last_became_active":"2024-05-21T01:19:54.535957+0000","last_became_peered":"2024-05-21T01:19:54.535957+0000","last_unstale":"2024-05-21T01:26:47.823174+0000","last_undegraded":"2024-05-21T01:26:47.823174+0000","last_fullsized":"2024-05-21T01:26:47.823174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-05-21T01:26:47.823109+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-05-21T01:26:47.823109+0000","last_clean_scrub_stamp":"2024-05-21T01:26:47.823109+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T04:27:06.305010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"27'11","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:52.683376+0000","last_change":"2024-05-21T01:26:52.683439+0000","last_active":"2024-05-21T01:26:52.683376+0000","last_peered":"2024-05-21T01:26:52.683376+0000","last_clean":"2024-05-21T01:26:52.683376+0000","last_became_active":"2024-05-21T01:19:54.551790+0000","last_became_peered":"2024-05-21T01:19:54.551790+0000","last_unstale":"2024-05-21T01:26:52.683376+0000","last_undegraded":"2024-05-21T01:26:52.683376+0000","last_fullsized":"2024-05-21T01:26:52.683376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'11","last_scrub_stamp":"2024-05-21T01:26:52.683205+0000","last_deep_scrub":"27'11","last_deep_scrub_stamp":"2024-05-21T01:26:52.683205+0000","last_clean_scrub_stamp":"2024-05-21T01:26:52.683205+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:42:37.768211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"27'8","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:44.195055+0000","last_change":"2024-05-21T01:26:44.195074+0000","last_active":"2024-05-21T01:26:44.195055+0000","last_peered":"2024-05-21T01:26:44.195055+0000","last_clean":"2024-05-21T01:26:44.195055+0000","last_became_active":"2024-05-21T01:19:54.534793+0000","last_became_peered":"2024-05-21T01:19:54.534793+0000","last_unstale":"2024-05-21T01:26:44.195055+0000","last_undegraded":"2024-05-21T01:26:44.195055+0000","last_fullsized":"2024-05-21T01:26:44.195055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-21T01:26:44.194989+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-21T01:26:44.194989+0000","last_clean_scrub_stamp":"2024-05-21T01:26:44.194989+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:25:26.245486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"27'7","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:49.100476+0000","last_change":"2024-05-21T01:26:49.100499+0000","last_active":"2024-05-21T01:26:49.100476+0000","last_peered":"2024-05-21T01:26:49.100476+0000","last_clean":"2024-05-21T01:26:49.100476+0000","last_became_active":"2024-05-21T01:19:54.556043+0000","last_became_peered":"2024-05-21T01:19:54.556043+0000","last_unstale":"2024-05-21T01:26:49.100476+0000","last_undegraded":"2024-05-21T01:26:49.100476+0000","last_fullsized":"2024-05-21T01:26:49.100476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-05-21T01:26:49.100392+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-05-21T01:26:49.100392+0000","last_clean_scrub_stamp":"2024-05-21T01:26:49.100392+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:13:35.689703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"27'10","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:51.838759+0000","last_change":"2024-05-21T01:26:51.838759+0000","last_active":"2024-05-21T01:26:51.838759+0000","last_peered":"2024-05-21T01:26:51.838759+0000","last_clean":"2024-05-21T01:26:51.838759+0000","last_became_active":"2024-05-21T01:19:54.565326+0000","last_became_peered":"2024-05-21T01:19:54.565326+0000","last_unstale":"2024-05-21T01:26:51.838759+0000","last_undegraded":"2024-05-21T01:26:51.838759+0000","last_fullsized":"2024-05-21T01:26:51.838759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-05-21T01:26:51.838514+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-05-21T01:26:51.838514+0000","last_clean_scrub_stamp":"2024-05-21T01:26:51.838514+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:18:30.869056+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"27'8","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:27:03.117802+0000","last_change":"2024-05-21T01:27:03.117828+0000","last_active":"2024-05-21T01:27:03.117802+0000","last_peered":"2024-05-21T01:27:03.117802+0000","last_clean":"2024-05-21T01:27:03.117802+0000","last_became_active":"2024-05-21T01:19:54.558286+0000","last_became_peered":"2024-05-21T01:19:54.558286+0000","last_unstale":"2024-05-21T01:27:03.117802+0000","last_undegraded":"2024-05-21T01:27:03.117802+0000","last_fullsized":"2024-05-21T01:27:03.117802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-21T01:27:03.117709+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-21T01:27:03.117709+0000","last_clean_scrub_stamp":"2024-05-21T01:27:03.117709+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T02:22:41.823621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"27'9","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:48.131202+0000","last_change":"2024-05-21T01:26:48.131202+0000","last_active":"2024-05-21T01:26:48.131202+0000","last_peered":"2024-05-21T01:26:48.131202+0000","last_clean":"2024-05-21T01:26:48.131202+0000","last_became_active":"2024-05-21T01:19:54.548079+0000","last_became_peered":"2024-05-21T01:19:54.548079+0000","last_unstale":"2024-05-21T01:26:48.131202+0000","last_undegraded":"2024-05-21T01:26:48.131202+0000","last_fullsized":"2024-05-21T01:26:48.131202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-05-21T01:26:48.131107+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-05-21T01:26:48.131107+0000","last_clean_scrub_stamp":"2024-05-21T01:26:48.131107+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T05:11:41.499264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"27'7","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:56.638131+0000","last_change":"2024-05-21T01:26:56.638131+0000","last_active":"2024-05-21T01:26:56.638131+0000","last_peered":"2024-05-21T01:26:56.638131+0000","last_clean":"2024-05-21T01:26:56.638131+0000","last_became_active":"2024-05-21T01:19:54.567512+0000","last_became_peered":"2024-05-21T01:19:54.567512+0000","last_unstale":"2024-05-21T01:26:56.638131+0000","last_undegraded":"2024-05-21T01:26:56.638131+0000","last_fullsized":"2024-05-21T01:26:56.638131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-05-21T01:26:56.637893+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-05-21T01:26:56.637893+0000","last_clean_scrub_stamp":"2024-05-21T01:26:56.637893+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T12:16:16.449745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"27'8","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:53.003654+0000","last_change":"2024-05-21T01:26:53.003654+0000","last_active":"2024-05-21T01:26:53.003654+0000","last_peered":"2024-05-21T01:26:53.003654+0000","last_clean":"2024-05-21T01:26:53.003654+0000","last_became_active":"2024-05-21T01:19:54.555947+0000","last_became_peered":"2024-05-21T01:19:54.555947+0000","last_unstale":"2024-05-21T01:26:53.003654+0000","last_undegraded":"2024-05-21T01:26:53.003654+0000","last_fullsized":"2024-05-21T01:26:53.003654+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-21T01:26:53.003418+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-21T01:26:53.003418+0000","last_clean_scrub_stamp":"2024-05-21T01:26:53.003418+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:34:27.465308+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"27'10","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:54.005944+0000","last_change":"2024-05-21T01:26:54.005944+0000","last_active":"2024-05-21T01:26:54.005944+0000","last_peered":"2024-05-21T01:26:54.005944+0000","last_clean":"2024-05-21T01:26:54.005944+0000","last_became_active":"2024-05-21T01:19:54.557787+0000","last_became_peered":"2024-05-21T01:19:54.557787+0000","last_unstale":"2024-05-21T01:26:54.005944+0000","last_undegraded":"2024-05-21T01:26:54.005944+0000","last_fullsized":"2024-05-21T01:26:54.005944+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-05-21T01:26:54.005706+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-05-21T01:26:54.005706+0000","last_clean_scrub_stamp":"2024-05-21T01:26:54.005706+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T13:25:17.913268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"27'7","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:52.346643+0000","last_change":"2024-05-21T01:26:52.346643+0000","last_active":"2024-05-21T01:26:52.346643+0000","last_peered":"2024-05-21T01:26:52.346643+0000","last_clean":"2024-05-21T01:26:52.346643+0000","last_became_active":"2024-05-21T01:19:54.534472+0000","last_became_peered":"2024-05-21T01:19:54.534472+0000","last_unstale":"2024-05-21T01:26:52.346643+0000","last_undegraded":"2024-05-21T01:26:52.346643+0000","last_fullsized":"2024-05-21T01:26:52.346643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-05-21T01:26:52.346535+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-05-21T01:26:52.346535+0000","last_clean_scrub_stamp":"2024-05-21T01:26:52.346535+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:45:13.941585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"27'6","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:54.326906+0000","last_change":"2024-05-21T01:26:54.326906+0000","last_active":"2024-05-21T01:26:54.326906+0000","last_peered":"2024-05-21T01:26:54.326906+0000","last_clean":"2024-05-21T01:26:54.326906+0000","last_became_active":"2024-05-21T01:19:54.546055+0000","last_became_peered":"2024-05-21T01:19:54.546055+0000","last_unstale":"2024-05-21T01:26:54.326906+0000","last_undegraded":"2024-05-21T01:26:54.326906+0000","last_fullsized":"2024-05-21T01:26:54.326906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-21T01:26:54.326803+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-21T01:26:54.326803+0000","last_clean_scrub_stamp":"2024-05-21T01:26:54.326803+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:37:54.153133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"27'16","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:57.837280+0000","last_change":"2024-05-21T01:26:57.837339+0000","last_active":"2024-05-21T01:26:57.837280+0000","last_peered":"2024-05-21T01:26:57.837280+0000","last_clean":"2024-05-21T01:26:57.837280+0000","last_became_active":"2024-05-21T01:20:43.550179+0000","last_became_peered":"2024-05-21T01:20:43.550179+0000","last_unstale":"2024-05-21T01:26:57.837280+0000","last_undegraded":"2024-05-21T01:26:57.837280+0000","last_fullsized":"2024-05-21T01:26:57.837280+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'16","last_scrub_stamp":"2024-05-21T01:26:57.837110+0000","last_deep_scrub":"27'16","last_deep_scrub_stamp":"2024-05-21T01:26:57.837110+0000","last_clean_scrub_stamp":"2024-05-21T01:26:57.837110+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:28:17.786528+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.37","version":"27'11","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:48.846819+0000","last_change":"2024-05-21T01:26:48.846819+0000","last_active":"2024-05-21T01:26:48.846819+0000","last_peered":"2024-05-21T01:26:48.846819+0000","last_clean":"2024-05-21T01:26:48.846819+0000","last_became_active":"2024-05-21T01:19:54.547528+0000","last_became_peered":"2024-05-21T01:19:54.547528+0000","last_unstale":"2024-05-21T01:26:48.846819+0000","last_undegraded":"2024-05-21T01:26:48.846819+0000","last_fullsized":"2024-05-21T01:26:48.846819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'11","last_scrub_stamp":"2024-05-21T01:26:48.846694+0000","last_deep_scrub":"27'11","last_deep_scrub_stamp":"2024-05-21T01:26:48.846694+0000","last_clean_scrub_stamp":"2024-05-21T01:26:48.846694+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:30:24.322290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"27'9","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:27:00.610071+0000","last_change":"2024-05-21T01:27:00.610134+0000","last_active":"2024-05-21T01:27:00.610071+0000","last_peered":"2024-05-21T01:27:00.610071+0000","last_clean":"2024-05-21T01:27:00.610071+0000","last_became_active":"2024-05-21T01:19:54.570119+0000","last_became_peered":"2024-05-21T01:19:54.570119+0000","last_unstale":"2024-05-21T01:27:00.610071+0000","last_undegraded":"2024-05-21T01:27:00.610071+0000","last_fullsized":"2024-05-21T01:27:00.610071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-05-21T01:27:00.609852+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-05-21T01:27:00.609852+0000","last_clean_scrub_stamp":"2024-05-21T01:27:00.609852+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T01:33:03.269744+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"27'5","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:57.274575+0000","last_change":"2024-05-21T01:26:57.274575+0000","last_active":"2024-05-21T01:26:57.274575+0000","last_peered":"2024-05-21T01:26:57.274575+0000","last_clean":"2024-05-21T01:26:57.274575+0000","last_became_active":"2024-05-21T01:19:54.549617+0000","last_became_peered":"2024-05-21T01:19:54.549617+0000","last_unstale":"2024-05-21T01:26:57.274575+0000","last_undegraded":"2024-05-21T01:26:57.274575+0000","last_fullsized":"2024-05-21T01:26:57.274575+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-05-21T01:26:57.274420+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-05-21T01:26:57.274420+0000","last_clean_scrub_stamp":"2024-05-21T01:26:57.274420+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:24:13.974538+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"27'6","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:51.154162+0000","last_change":"2024-05-21T01:26:51.154162+0000","last_active":"2024-05-21T01:26:51.154162+0000","last_peered":"2024-05-21T01:26:51.154162+0000","last_clean":"2024-05-21T01:26:51.154162+0000","last_became_active":"2024-05-21T01:19:54.555274+0000","last_became_peered":"2024-05-21T01:19:54.555274+0000","last_unstale":"2024-05-21T01:26:51.154162+0000","last_undegraded":"2024-05-21T01:26:51.154162+0000","last_fullsized":"2024-05-21T01:26:51.154162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-21T01:26:51.154055+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-21T01:26:51.154055+0000","last_clean_scrub_stamp":"2024-05-21T01:26:51.154055+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T11:06:06.170386+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"27'4","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:59.249853+0000","last_change":"2024-05-21T01:26:59.249853+0000","last_active":"2024-05-21T01:26:59.249853+0000","last_peered":"2024-05-21T01:26:59.249853+0000","last_clean":"2024-05-21T01:26:59.249853+0000","last_became_active":"2024-05-21T01:19:54.568605+0000","last_became_peered":"2024-05-21T01:19:54.568605+0000","last_unstale":"2024-05-21T01:26:59.249853+0000","last_undegraded":"2024-05-21T01:26:59.249853+0000","last_fullsized":"2024-05-21T01:26:59.249853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-21T01:26:59.249751+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-21T01:26:59.249751+0000","last_clean_scrub_stamp":"2024-05-21T01:26:59.249751+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T03:44:22.003577+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"27'8","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:52.157649+0000","last_change":"2024-05-21T01:26:52.157675+0000","last_active":"2024-05-21T01:26:52.157649+0000","last_peered":"2024-05-21T01:26:52.157649+0000","last_clean":"2024-05-21T01:26:52.157649+0000","last_became_active":"2024-05-21T01:19:54.554976+0000","last_became_peered":"2024-05-21T01:19:54.554976+0000","last_unstale":"2024-05-21T01:26:52.157649+0000","last_undegraded":"2024-05-21T01:26:52.157649+0000","last_fullsized":"2024-05-21T01:26:52.157649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-21T01:26:52.157573+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-21T01:26:52.157573+0000","last_clean_scrub_stamp":"2024-05-21T01:26:52.157573+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T10:43:36.386460+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"27'7","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:55.669148+0000","last_change":"2024-05-21T01:26:55.669206+0000","last_active":"2024-05-21T01:26:55.669148+0000","last_peered":"2024-05-21T01:26:55.669148+0000","last_clean":"2024-05-21T01:26:55.669148+0000","last_became_active":"2024-05-21T01:19:54.566349+0000","last_became_peered":"2024-05-21T01:19:54.566349+0000","last_unstale":"2024-05-21T01:26:55.669148+0000","last_undegraded":"2024-05-21T01:26:55.669148+0000","last_fullsized":"2024-05-21T01:26:55.669148+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-05-21T01:26:55.668969+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-05-21T01:26:55.668969+0000","last_clean_scrub_stamp":"2024-05-21T01:26:55.668969+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:19:28.963729+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"27'4","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:27:01.627252+0000","last_change":"2024-05-21T01:27:01.627308+0000","last_active":"2024-05-21T01:27:01.627252+0000","last_peered":"2024-05-21T01:27:01.627252+0000","last_clean":"2024-05-21T01:27:01.627252+0000","last_became_active":"2024-05-21T01:19:54.574914+0000","last_became_peered":"2024-05-21T01:19:54.574914+0000","last_unstale":"2024-05-21T01:27:01.627252+0000","last_undegraded":"2024-05-21T01:27:01.627252+0000","last_fullsized":"2024-05-21T01:27:01.627252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-21T01:27:01.627083+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-21T01:27:01.627083+0000","last_clean_scrub_stamp":"2024-05-21T01:27:01.627083+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T08:27:30.495221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"27'8","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T01:26:55.293866+0000","last_change":"2024-05-21T01:26:55.293891+0000","last_active":"2024-05-21T01:26:55.293866+0000","last_peered":"2024-05-21T01:26:55.293866+0000","last_clean":"2024-05-21T01:26:55.293866+0000","last_became_active":"2024-05-21T01:19:54.546284+0000","last_became_peered":"2024-05-21T01:19:54.546284+0000","last_unstale":"2024-05-21T01:26:55.293866+0000","last_undegraded":"2024-05-21T01:26:55.293866+0000","last_fullsized":"2024-05-21T01:26:55.293866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-21T01:26:55.293779+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-21T01:26:55.293779+0000","last_clean_scrub_stamp":"2024-05-21T01:26:55.293779+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T06:45:55.855610+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5128,"num_read_kb":21004288,"num_write":9216,"num_write_kb":25165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9731,"ondisk_log_size":9731,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":503,"ondisk_log_size":503,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2846797,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":1595,"num_write_kb":3011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15000,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":5849088,"data_stored":5693594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1609,"ondisk_log_size":1609,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66932,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509536,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49516,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94322324,"statfs":{"total":96636764160,"available":96586059776,"internally_reserved":0,"allocated":299008,"data_stored":117691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":50395592},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509536,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48128,"kb_used_data":3064,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94323712,"statfs":{"total":96636764160,"available":96587481088,"internally_reserved":0,"allocated":3137536,"data_stored":2958758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509534,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53732,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94318108,"statfs":{"total":96636764160,"available":96581742592,"internally_reserved":0,"allocated":356352,"data_stored":706993,"data_compressed":33466,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509534,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35632,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336208,"statfs":{"total":96636764160,"available":96600276992,"internally_reserved":0,"allocated":303104,"data_stored":117781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542239,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49512,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94322328,"statfs":{"total":96636764160,"available":96586063872,"internally_reserved":0,"allocated":294912,"data_stored":118068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":50395591},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542239,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45428,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326412,"statfs":{"total":96636764160,"available":96590245888,"internally_reserved":0,"allocated":372736,"data_stored":708565,"data_compressed":33466,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574942,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49528,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94322312,"statfs":{"total":96636764160,"available":96586047488,"internally_reserved":0,"allocated":311296,"data_stored":117902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574942,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52316,"kb_used_data":3092,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94319524,"statfs":{"total":96636764160,"available":96583192576,"internally_reserved":0,"allocated":3166208,"data_stored":2960292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33466,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33466,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2854912,"data_stored":2842293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":2883584,"data_stored":2843827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-21T01:27:28.372 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-05-21T01:27:28.548 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.541+0000 7fd8a4e00640 1 Processor -- start 2024-05-21T01:27:28.624 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.545+0000 7fd8a4e00640 1 -- start start 2024-05-21T01:27:28.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.545+0000 7fd8a4e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd8a0156070 0x7fd8a0071640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:27:28.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.545+0000 7fd8a4e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd8a0071b80 0x7fd8a00cf530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:27:28.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.545+0000 7fd8a4e00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8a015bf20 con 0x7fd8a006f080 2024-05-21T01:27:28.628 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.545+0000 7fd8a4e00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7fd8a015c1e0 con 0x7fd8a0156070 2024-05-21T01:27:28.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.545+0000 7fd8a4e00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fd8a015c4c0 con 0x7fd8a0071b80 2024-05-21T01:27:28.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.545+0000 7fd89de00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd8a0156070 0x7fd8a0071640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:27:28.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.545+0000 7fd89e800640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fd8a006f080 0x7fd8a015d9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:45160/0 (socket says 172.21.15.63:45160) 2024-05-21T01:27:28.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.545+0000 7fd89e800640 1 -- 172.21.15.63:0/3829546492 learned_addr learned my addr 172.21.15.63:0/3829546492 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-05-21T01:27:28.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.545+0000 7fd895400640 1 --2- 172.21.15.63:0/3829546492 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd8a0071b80 0x7fd8a00cf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:27:28.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.545+0000 7fd89de00640 1 -- 172.21.15.63:0/3829546492 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd8a0071b80 msgr2=0x7fd8a00cf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:27:28.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.545+0000 7fd89de00640 1 --2- 172.21.15.63:0/3829546492 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd8a0071b80 0x7fd8a00cf530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:28.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.545+0000 7fd89de00640 1 -- 172.21.15.63:0/3829546492 >> v1:172.21.15.63:6789/0 conn(0x7fd8a006f080 legacy=0x7fd8a015d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:27:28.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.545+0000 7fd89de00640 1 -- 172.21.15.63:0/3829546492 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8a015c7a0 con 0x7fd8a0156070 2024-05-21T01:27:28.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.545+0000 7fd89d400640 1 -- 172.21.15.63:0/3829546492 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2751639494 0 0) 0x7fd8a015bf20 con 0x7fd8a006f080 2024-05-21T01:27:28.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.549+0000 7fd89de00640 1 --2- 172.21.15.63:0/3829546492 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8a0156070 0x7fd8a0071640 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fd8880097c0 tx=0x7fd88801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ab2b5128a522211 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:27:28.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.549+0000 7fd89d400640 1 -- 172.21.15.63:0/3829546492 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8880b0070 con 0x7fd8a0156070 2024-05-21T01:27:28.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.549+0000 7fd89d400640 1 -- 172.21.15.63:0/3829546492 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8880ab600 con 0x7fd8a0156070 2024-05-21T01:27:28.629 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.549+0000 7fd89d400640 1 -- 172.21.15.63:0/3829546492 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8880ab9d0 con 0x7fd8a0156070 2024-05-21T01:27:28.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.549+0000 7fd8a4e00640 1 -- 172.21.15.63:0/3829546492 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8a0156070 msgr2=0x7fd8a0071640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:27:28.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.549+0000 7fd8a4e00640 1 --2- 172.21.15.63:0/3829546492 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8a0156070 0x7fd8a0071640 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fd8880097c0 tx=0x7fd88801c4a0 comp rx=0 tx=0).stop 2024-05-21T01:27:28.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.549+0000 7fd8a4e00640 1 -- 172.21.15.63:0/3829546492 shutdown_connections 2024-05-21T01:27:28.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.549+0000 7fd8a4e00640 1 --2- 172.21.15.63:0/3829546492 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd8a0071b80 0x7fd8a00cf530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:28.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.549+0000 7fd8a4e00640 1 --2- 172.21.15.63:0/3829546492 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8a0156070 0x7fd8a0071640 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:28.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.549+0000 7fd8a4e00640 1 -- 172.21.15.63:0/3829546492 >> 172.21.15.63:0/3829546492 conn(0x7fd8a00735f0 msgr2=0x7fd8a0073a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:27:28.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.549+0000 7fd8a4e00640 1 -- 172.21.15.63:0/3829546492 shutdown_connections 2024-05-21T01:27:28.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.549+0000 7fd8a4e00640 1 -- 172.21.15.63:0/3829546492 wait complete. 2024-05-21T01:27:28.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.549+0000 7fd8a4e00640 1 Processor -- start 2024-05-21T01:27:28.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.549+0000 7fd8a4e00640 1 -- start start 2024-05-21T01:27:28.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.553+0000 7fd8a4e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd8a006f080 0x7fd8a0163250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:27:28.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.553+0000 7fd8a4e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8a0071b80 0x7fd8a00cbe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:27:28.630 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.553+0000 7fd8a4e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd8a0156070 0x7fd8a0160e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:27:28.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.553+0000 7fd8a4e00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fd8a01565d0 con 0x7fd8a0071b80 2024-05-21T01:27:28.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.553+0000 7fd8a4e00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd8a0156450 con 0x7fd8a006f080 2024-05-21T01:27:28.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.553+0000 7fd8a4e00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fd8a01690c0 con 0x7fd8a0156070 2024-05-21T01:27:28.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.553+0000 7fd895400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8a0071b80 0x7fd8a00cbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:27:28.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.553+0000 7fd895400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8a0071b80 0x7fd8a00cbe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43378/0 (socket says 172.21.15.63:43378) 2024-05-21T01:27:28.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.553+0000 7fd895400640 1 -- 172.21.15.63:0/1319498577 learned_addr learned my addr 172.21.15.63:0/1319498577 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:27:28.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.553+0000 7fd89de00640 1 --2- 172.21.15.63:0/1319498577 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd8a006f080 0x7fd8a0163250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:27:28.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.553+0000 7fd89e800640 1 --2- 172.21.15.63:0/1319498577 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd8a0156070 0x7fd8a0160e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:27:28.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.553+0000 7fd895400640 1 -- 172.21.15.63:0/1319498577 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd8a0156070 msgr2=0x7fd8a0160e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:27:28.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.553+0000 7fd895400640 1 --2- 172.21.15.63:0/1319498577 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd8a0156070 0x7fd8a0160e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:28.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.553+0000 7fd895400640 1 -- 172.21.15.63:0/1319498577 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd8a006f080 msgr2=0x7fd8a0163250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:27:28.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.553+0000 7fd895400640 1 --2- 172.21.15.63:0/1319498577 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd8a006f080 0x7fd8a0163250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:28.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.553+0000 7fd895400640 1 -- 172.21.15.63:0/1319498577 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8a015ffa0 con 0x7fd8a0071b80 2024-05-21T01:27:28.631 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.553+0000 7fd895400640 1 --2- 172.21.15.63:0/1319498577 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8a0071b80 0x7fd8a00cbe80 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fd89000d800 tx=0x7fd89000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:27:28.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.553+0000 7fd896a00640 1 -- 172.21.15.63:0/1319498577 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd89000b660 con 0x7fd8a0071b80 2024-05-21T01:27:28.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.553+0000 7fd896a00640 1 -- 172.21.15.63:0/1319498577 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd890019070 con 0x7fd8a0071b80 2024-05-21T01:27:28.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.553+0000 7fd8a4e00640 1 -- 172.21.15.63:0/1319498577 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8a0160c40 con 0x7fd8a0071b80 2024-05-21T01:27:28.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.553+0000 7fd896a00640 1 -- 172.21.15.63:0/1319498577 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd89000ba00 con 0x7fd8a0071b80 2024-05-21T01:27:28.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.553+0000 7fd8a4e00640 1 -- 172.21.15.63:0/1319498577 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8a0158350 con 0x7fd8a0071b80 2024-05-21T01:27:28.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.553+0000 7fd8a4e00640 1 -- 172.21.15.63:0/1319498577 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8a00507f0 con 0x7fd8a0071b80 2024-05-21T01:27:28.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.557+0000 7fd896a00640 1 -- 172.21.15.63:0/1319498577 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7fd89000bba0 con 0x7fd8a0071b80 2024-05-21T01:27:28.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.557+0000 7fd896a00640 1 --2- 172.21.15.63:0/1319498577 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fd87c06f400 0x7fd87c0718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:27:28.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.557+0000 7fd896a00640 1 -- 172.21.15.63:0/1319498577 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7fd89008f910 con 0x7fd8a0071b80 2024-05-21T01:27:28.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.557+0000 7fd89de00640 1 --2- 172.21.15.63:0/1319498577 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fd87c06f400 0x7fd87c0718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:27:28.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.557+0000 7fd89de00640 1 --2- 172.21.15.63:0/1319498577 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fd87c06f400 0x7fd87c0718c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd8880ad000 tx=0x7fd8880a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:27:28.632 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.561+0000 7fd896a00640 1 -- 172.21.15.63:0/1319498577 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fd89005bec0 con 0x7fd8a0071b80 2024-05-21T01:27:28.733 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.729+0000 7fd8a4e00640 1 -- 172.21.15.63:0/1319498577 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fd8a0071f60 con 0x7fd8a0071b80 2024-05-21T01:27:28.737 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.733+0000 7fd896a00640 1 -- 172.21.15.63:0/1319498577 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) ==== 123+0+0 (secure 0 0 0) 0x7fd8900601c0 con 0x7fd8a0071b80 2024-05-21T01:27:28.739 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.733+0000 7fd896a00640 1 -- 172.21.15.63:0/1319498577 <== mon.0 v2:172.21.15.63:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fd89008de50 con 0x7fd8a0071b80 2024-05-21T01:27:28.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.737+0000 7fd8a4e00640 1 -- 172.21.15.63:0/1319498577 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fd87c06f400 msgr2=0x7fd87c0718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:27:28.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.737+0000 7fd8a4e00640 1 --2- 172.21.15.63:0/1319498577 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fd87c06f400 0x7fd87c0718c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd8880ad000 tx=0x7fd8880a6000 comp rx=0 tx=0).stop 2024-05-21T01:27:28.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.737+0000 7fd8a4e00640 1 -- 172.21.15.63:0/1319498577 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8a0071b80 msgr2=0x7fd8a00cbe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:27:28.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.737+0000 7fd8a4e00640 1 --2- 172.21.15.63:0/1319498577 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8a0071b80 0x7fd8a00cbe80 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fd89000d800 tx=0x7fd89000dcc0 comp rx=0 tx=0).stop 2024-05-21T01:27:28.740 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.737+0000 7fd8a4e00640 1 -- 172.21.15.63:0/1319498577 shutdown_connections 2024-05-21T01:27:28.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.737+0000 7fd8a4e00640 1 --2- 172.21.15.63:0/1319498577 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fd87c06f400 0x7fd87c0718c0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:28.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.737+0000 7fd8a4e00640 1 --2- 172.21.15.63:0/1319498577 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd8a0156070 0x7fd8a0160e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:28.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.737+0000 7fd8a4e00640 1 --2- 172.21.15.63:0/1319498577 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8a0071b80 0x7fd8a00cbe80 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:28.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.737+0000 7fd8a4e00640 1 --2- 172.21.15.63:0/1319498577 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd8a006f080 0x7fd8a0163250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:28.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.737+0000 7fd8a4e00640 1 -- 172.21.15.63:0/1319498577 >> 172.21.15.63:0/1319498577 conn(0x7fd8a00735f0 msgr2=0x7fd8a00cd9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:27:28.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.737+0000 7fd8a4e00640 1 -- 172.21.15.63:0/1319498577 shutdown_connections 2024-05-21T01:27:28.741 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.737+0000 7fd8a4e00640 1 -- 172.21.15.63:0/1319498577 wait complete. 2024-05-21T01:27:28.760 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-21T01:27:28.760 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-21T01:27:28.903 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.897+0000 7f7f99c00640 1 Processor -- start 2024-05-21T01:27:28.903 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.897+0000 7f7f99c00640 1 -- start start 2024-05-21T01:27:28.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.901+0000 7f7f99c00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7f9406f9b0 0x7f7f94152a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:27:28.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.901+0000 7f7f99c00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f7f9415ce40 0x7f7f94152f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:27:28.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.901+0000 7f7f99c00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f94072550 con 0x7f7f9406f5d0 2024-05-21T01:27:28.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.901+0000 7f7f99c00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f7f94159100 con 0x7f7f9406f9b0 2024-05-21T01:27:28.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.901+0000 7f7f99c00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f7f941593e0 con 0x7f7f9415ce40 2024-05-21T01:27:28.904 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.901+0000 7f7f8be00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7f9406f9b0 0x7f7f94152a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:27:28.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.901+0000 7f7f8be00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7f9406f9b0 0x7f7f94152a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43386/0 (socket says 172.21.15.63:43386) 2024-05-21T01:27:28.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.901+0000 7f7f8be00640 1 -- 172.21.15.63:0/3491147403 learned_addr learned my addr 172.21.15.63:0/3491147403 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:27:28.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.901+0000 7f7f93400640 1 --2- 172.21.15.63:0/3491147403 >> v2:172.21.15.131:3300/0 conn(0x7f7f9415ce40 0x7f7f94152f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:27:28.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.901+0000 7f7f8be00640 1 -- 172.21.15.63:0/3491147403 >> v2:172.21.15.131:3300/0 conn(0x7f7f9415ce40 msgr2=0x7f7f94152f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:27:28.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.901+0000 7f7f8be00640 1 --2- 172.21.15.63:0/3491147403 >> v2:172.21.15.131:3300/0 conn(0x7f7f9415ce40 0x7f7f94152f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:28.905 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.901+0000 7f7f8be00640 1 -- 172.21.15.63:0/3491147403 >> v1:172.21.15.131:6789/0 conn(0x7f7f9406f5d0 legacy=0x7f7f940c8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:27:28.906 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.901+0000 7f7f8be00640 1 -- 172.21.15.63:0/3491147403 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f941596c0 con 0x7f7f9406f9b0 2024-05-21T01:27:28.907 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.901+0000 7f7f8be00640 1 --2- 172.21.15.63:0/3491147403 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7f9406f9b0 0x7f7f94152a40 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f7f940cadd0 tx=0x7f7f7c01ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f33a48cd221dbde2 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:27:28.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.905+0000 7f7f92000640 1 -- 172.21.15.63:0/3491147403 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f7c0b4070 con 0x7f7f9406f9b0 2024-05-21T01:27:28.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.905+0000 7f7f92000640 1 -- 172.21.15.63:0/3491147403 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f7f7c0a7bb0 con 0x7f7f9406f9b0 2024-05-21T01:27:28.908 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.905+0000 7f7f92000640 1 -- 172.21.15.63:0/3491147403 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f7c0af440 con 0x7f7f9406f9b0 2024-05-21T01:27:28.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.905+0000 7f7f99c00640 1 -- 172.21.15.63:0/3491147403 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7f9406f9b0 msgr2=0x7f7f94152a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:27:28.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.905+0000 7f7f99c00640 1 --2- 172.21.15.63:0/3491147403 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7f9406f9b0 0x7f7f94152a40 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f7f940cadd0 tx=0x7f7f7c01ebf0 comp rx=0 tx=0).stop 2024-05-21T01:27:28.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.905+0000 7f7f99c00640 1 -- 172.21.15.63:0/3491147403 shutdown_connections 2024-05-21T01:27:28.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.905+0000 7f7f99c00640 1 --2- 172.21.15.63:0/3491147403 >> v2:172.21.15.131:3300/0 conn(0x7f7f9415ce40 0x7f7f94152f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:28.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.905+0000 7f7f99c00640 1 --2- 172.21.15.63:0/3491147403 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7f9406f9b0 0x7f7f94152a40 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:28.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.905+0000 7f7f99c00640 1 -- 172.21.15.63:0/3491147403 >> 172.21.15.63:0/3491147403 conn(0x7f7f94068460 msgr2=0x7f7f94068870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:27:28.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.905+0000 7f7f99c00640 1 -- 172.21.15.63:0/3491147403 shutdown_connections 2024-05-21T01:27:28.909 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.905+0000 7f7f99c00640 1 -- 172.21.15.63:0/3491147403 wait complete. 2024-05-21T01:27:28.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.905+0000 7f7f99c00640 1 Processor -- start 2024-05-21T01:27:28.910 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.905+0000 7f7f99c00640 1 -- start start 2024-05-21T01:27:28.911 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.905+0000 7f7f99c00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7f9406f5d0 0x7f7f94071a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:27:28.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.905+0000 7f7f99c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7f9406f9b0 0x7f7f940cb4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:27:28.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.905+0000 7f7f99c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7f9415ce40 0x7f7f94144b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:27:28.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.905+0000 7f7f99c00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f7f940cd700 con 0x7f7f9415ce40 2024-05-21T01:27:28.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.905+0000 7f7f99c00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f7f940cd580 con 0x7f7f9406f9b0 2024-05-21T01:27:28.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.905+0000 7f7f99c00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f7f940cd880 con 0x7f7f9406f5d0 2024-05-21T01:27:28.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.905+0000 7f7f93400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7f9415ce40 0x7f7f94144b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:27:28.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.905+0000 7f7f93400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7f9415ce40 0x7f7f94144b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43398/0 (socket says 172.21.15.63:43398) 2024-05-21T01:27:28.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.905+0000 7f7f93400640 1 -- 172.21.15.63:0/1542140846 learned_addr learned my addr 172.21.15.63:0/1542140846 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:27:28.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.905+0000 7f7f92a00640 1 --2- 172.21.15.63:0/1542140846 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7f9406f5d0 0x7f7f94071a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:27:28.912 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.905+0000 7f7f8be00640 1 --2- 172.21.15.63:0/1542140846 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7f9406f9b0 0x7f7f940cb4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:27:28.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.909+0000 7f7f93400640 1 -- 172.21.15.63:0/1542140846 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7f9406f5d0 msgr2=0x7f7f94071a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:27:28.913 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.909+0000 7f7f93400640 1 --2- 172.21.15.63:0/1542140846 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7f9406f5d0 0x7f7f94071a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:28.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.909+0000 7f7f93400640 1 -- 172.21.15.63:0/1542140846 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7f9406f9b0 msgr2=0x7f7f940cb4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:27:28.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.909+0000 7f7f93400640 1 --2- 172.21.15.63:0/1542140846 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7f9406f9b0 0x7f7f940cb4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:28.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.909+0000 7f7f93400640 1 -- 172.21.15.63:0/1542140846 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f94072290 con 0x7f7f9415ce40 2024-05-21T01:27:28.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.909+0000 7f7f93400640 1 --2- 172.21.15.63:0/1542140846 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7f9415ce40 0x7f7f94144b60 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c007d80 tx=0x7f7f8c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:27:28.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.909+0000 7f7f8aa00640 1 -- 172.21.15.63:0/1542140846 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f8c014420 con 0x7f7f9415ce40 2024-05-21T01:27:28.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.909+0000 7f7f8aa00640 1 -- 172.21.15.63:0/1542140846 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f7f8c019070 con 0x7f7f9415ce40 2024-05-21T01:27:28.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.909+0000 7f7f8aa00640 1 -- 172.21.15.63:0/1542140846 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f8c014820 con 0x7f7f9415ce40 2024-05-21T01:27:28.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.909+0000 7f7f99c00640 1 -- 172.21.15.63:0/1542140846 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f941492d0 con 0x7f7f9415ce40 2024-05-21T01:27:28.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.909+0000 7f7f99c00640 1 -- 172.21.15.63:0/1542140846 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f94149850 con 0x7f7f9415ce40 2024-05-21T01:27:28.914 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.909+0000 7f7f99c00640 1 -- 172.21.15.63:0/1542140846 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f940507f0 con 0x7f7f9415ce40 2024-05-21T01:27:28.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.909+0000 7f7f8aa00640 1 -- 172.21.15.63:0/1542140846 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7f7f8c0149c0 con 0x7f7f9415ce40 2024-05-21T01:27:28.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.909+0000 7f7f8aa00640 1 --2- 172.21.15.63:0/1542140846 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f7f7006f400 0x7f7f700718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:27:28.915 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.909+0000 7f7f8aa00640 1 -- 172.21.15.63:0/1542140846 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f7f8c08fdb0 con 0x7f7f9415ce40 2024-05-21T01:27:28.916 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.913+0000 7f7f92a00640 1 --2- 172.21.15.63:0/1542140846 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f7f7006f400 0x7f7f700718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:27:28.916 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.913+0000 7f7f92a00640 1 --2- 172.21.15.63:0/1542140846 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f7f7006f400 0x7f7f700718c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7f84007fd0 tx=0x7f7f84009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:27:28.919 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:28.913+0000 7f7f8aa00640 1 -- 172.21.15.63:0/1542140846 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f7f8c094070 con 0x7f7f9415ce40 2024-05-21T01:27:29.120 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.117+0000 7f7f99c00640 1 -- 172.21.15.63:0/1542140846 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7f940ca360 con 0x7f7f9415ce40 2024-05-21T01:27:29.121 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.117+0000 7f7f8aa00640 1 -- 172.21.15.63:0/1542140846 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+6876 (secure 0 0 0) 0x7f7f8c05c240 con 0x7f7f9415ce40 2024-05-21T01:27:29.121 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-05-21T01:27:29.121 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6839/3045714273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6837","nonce":3045714273},{"type":"v1","addr":"172.21.15.131:6839","nonce":3045714273}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/2978367338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":2978367338},{"type":"v1","addr":"172.21.15.131:6835","nonce":2978367338}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/3005995321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6835","nonce":3005995321},{"type":"v1","addr":"172.21.15.63:6837","nonce":3005995321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-21T01:19:53.915775+0000","modified":"2024-05-21T01:20:31.724475+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4276,"mds_1":4270,"mds_2":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"e","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.63:6833/574189772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":574189772},{"type":"v1","addr":"172.21.15.63:6833","nonce":574189772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4270":{"gid":4270,"name":"f","rank":1,"incarnation":10,"state":"up:active","state_seq":11,"addr":"172.21.15.131:6838/3071941741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":3071941741},{"type":"v1","addr":"172.21.15.131:6838","nonce":3071941741}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.63:6836/2892727989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":2892727989},{"type":"v1","addr":"172.21.15.63:6836","nonce":2892727989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4276,"qdb_cluster":[4267,4270,4276]},"id":1}]} 2024-05-21T01:27:29.122 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 15 2024-05-21T01:27:29.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.117+0000 7f7f99c00640 1 -- 172.21.15.63:0/1542140846 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f7f7006f400 msgr2=0x7f7f700718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:27:29.123 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.117+0000 7f7f99c00640 1 --2- 172.21.15.63:0/1542140846 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f7f7006f400 0x7f7f700718c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7f84007fd0 tx=0x7f7f84009040 comp rx=0 tx=0).stop 2024-05-21T01:27:29.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.117+0000 7f7f99c00640 1 -- 172.21.15.63:0/1542140846 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7f9415ce40 msgr2=0x7f7f94144b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:27:29.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.117+0000 7f7f99c00640 1 --2- 172.21.15.63:0/1542140846 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7f9415ce40 0x7f7f94144b60 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c007d80 tx=0x7f7f8c00e4b0 comp rx=0 tx=0).stop 2024-05-21T01:27:29.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.117+0000 7f7f99c00640 1 -- 172.21.15.63:0/1542140846 shutdown_connections 2024-05-21T01:27:29.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.117+0000 7f7f99c00640 1 --2- 172.21.15.63:0/1542140846 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f7f7006f400 0x7f7f700718c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:29.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.117+0000 7f7f99c00640 1 --2- 172.21.15.63:0/1542140846 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7f9415ce40 0x7f7f94144b60 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:29.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.117+0000 7f7f99c00640 1 --2- 172.21.15.63:0/1542140846 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7f9406f9b0 0x7f7f940cb4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:29.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.117+0000 7f7f99c00640 1 --2- 172.21.15.63:0/1542140846 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7f9406f5d0 0x7f7f94071a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:29.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.117+0000 7f7f99c00640 1 -- 172.21.15.63:0/1542140846 >> 172.21.15.63:0/1542140846 conn(0x7f7f94068460 msgr2=0x7f7f94075ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:27:29.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.117+0000 7f7f99c00640 1 -- 172.21.15.63:0/1542140846 shutdown_connections 2024-05-21T01:27:29.124 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.117+0000 7f7f99c00640 1 -- 172.21.15.63:0/1542140846 wait complete. 2024-05-21T01:27:29.143 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-21T01:27:29.284 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.281+0000 7f5435600640 1 Processor -- start 2024-05-21T01:27:29.285 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.281+0000 7f5435600640 1 -- start start 2024-05-21T01:27:29.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.281+0000 7f5435600640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f54300cf790 0x7f54300c69a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:27:29.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.281+0000 7f5435600640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f54300cfb70 0x7f5430153b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:27:29.286 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.281+0000 7f5435600640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54300c8be0 con 0x7f54300ca810 2024-05-21T01:27:29.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.281+0000 7f5435600640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f54300c8e80 con 0x7f54300cfb70 2024-05-21T01:27:29.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.281+0000 7f5435600640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f54300c9160 con 0x7f54300cf790 2024-05-21T01:27:29.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.281+0000 7f5427e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f54300cfb70 0x7f5430153b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:27:29.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.281+0000 7f542f400640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f54300ca810 0x7f5430159e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:45170/0 (socket says 172.21.15.63:45170) 2024-05-21T01:27:29.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.281+0000 7f5427e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f54300cfb70 0x7f5430153b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43406/0 (socket says 172.21.15.63:43406) 2024-05-21T01:27:29.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.281+0000 7f542f400640 1 -- 172.21.15.63:0/1041924913 learned_addr learned my addr 172.21.15.63:0/1041924913 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-05-21T01:27:29.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.281+0000 7f542ea00640 1 --2- 172.21.15.63:0/1041924913 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f54300cf790 0x7f54300c69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:27:29.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.281+0000 7f5427e00640 1 -- 172.21.15.63:0/1041924913 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f54300cf790 msgr2=0x7f54300c69a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:27:29.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.281+0000 7f5427e00640 1 --2- 172.21.15.63:0/1041924913 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f54300cf790 0x7f54300c69a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:29.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.281+0000 7f5427e00640 1 -- 172.21.15.63:0/1041924913 >> v1:172.21.15.63:6789/0 conn(0x7f54300ca810 legacy=0x7f5430159e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:27:29.287 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.281+0000 7f5427e00640 1 -- 172.21.15.63:0/1041924913 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54300c9440 con 0x7f54300cfb70 2024-05-21T01:27:29.289 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.285+0000 7f5427e00640 1 --2- 172.21.15.63:0/1041924913 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f54300cfb70 0x7f5430153b40 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f54180097c0 tx=0x7f541801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6f6c439c9c181b2 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:27:29.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.285+0000 7f542e000640 1 -- 172.21.15.63:0/1041924913 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54180b0070 con 0x7f54300cfb70 2024-05-21T01:27:29.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.285+0000 7f542e000640 1 -- 172.21.15.63:0/1041924913 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f54180ab600 con 0x7f54300cfb70 2024-05-21T01:27:29.290 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.285+0000 7f542e000640 1 -- 172.21.15.63:0/1041924913 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54180ab9f0 con 0x7f54300cfb70 2024-05-21T01:27:29.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.285+0000 7f5435600640 1 -- 172.21.15.63:0/1041924913 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f54300cfb70 msgr2=0x7f5430153b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:27:29.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.285+0000 7f5435600640 1 --2- 172.21.15.63:0/1041924913 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f54300cfb70 0x7f5430153b40 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f54180097c0 tx=0x7f541801c410 comp rx=0 tx=0).stop 2024-05-21T01:27:29.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.285+0000 7f5435600640 1 -- 172.21.15.63:0/1041924913 shutdown_connections 2024-05-21T01:27:29.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.285+0000 7f5435600640 1 --2- 172.21.15.63:0/1041924913 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f54300cfb70 0x7f5430153b40 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:29.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.285+0000 7f5435600640 1 --2- 172.21.15.63:0/1041924913 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f54300cf790 0x7f54300c69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:29.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.285+0000 7f5435600640 1 -- 172.21.15.63:0/1041924913 >> 172.21.15.63:0/1041924913 conn(0x7f54300735f0 msgr2=0x7f5430073a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:27:29.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.285+0000 7f5435600640 1 -- 172.21.15.63:0/1041924913 shutdown_connections 2024-05-21T01:27:29.291 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.285+0000 7f5435600640 1 -- 172.21.15.63:0/1041924913 wait complete. 2024-05-21T01:27:29.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.289+0000 7f5435600640 1 Processor -- start 2024-05-21T01:27:29.292 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.289+0000 7f5435600640 1 -- start start 2024-05-21T01:27:29.293 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.289+0000 7f5435600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f54300ca810 0x7f54300cbf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:27:29.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.289+0000 7f5435600640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f54300cf790 0x7f5430156100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:27:29.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.289+0000 7f5435600640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f54300cfb70 0x7f5430156640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:27:29.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.289+0000 7f5435600640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f5430154410 con 0x7f54300cfb70 2024-05-21T01:27:29.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.289+0000 7f5435600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f5430154290 con 0x7f54300ca810 2024-05-21T01:27:29.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.289+0000 7f5435600640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f5430166ec0 con 0x7f54300cf790 2024-05-21T01:27:29.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.289+0000 7f542f400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f54300cfb70 0x7f5430156640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:27:29.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.289+0000 7f542f400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f54300cfb70 0x7f5430156640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43418/0 (socket says 172.21.15.63:43418) 2024-05-21T01:27:29.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.289+0000 7f542f400640 1 -- 172.21.15.63:0/1308573950 learned_addr learned my addr 172.21.15.63:0/1308573950 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:27:29.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.289+0000 7f5427e00640 1 --2- 172.21.15.63:0/1308573950 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f54300cf790 0x7f5430156100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:27:29.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.289+0000 7f542ea00640 1 --2- 172.21.15.63:0/1308573950 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f54300ca810 0x7f54300cbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:27:29.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.289+0000 7f542f400640 1 -- 172.21.15.63:0/1308573950 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f54300cf790 msgr2=0x7f5430156100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:27:29.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.289+0000 7f542f400640 1 --2- 172.21.15.63:0/1308573950 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f54300cf790 0x7f5430156100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:29.294 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.289+0000 7f542f400640 1 -- 172.21.15.63:0/1308573950 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f54300ca810 msgr2=0x7f54300cbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:27:29.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.289+0000 7f542f400640 1 --2- 172.21.15.63:0/1308573950 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f54300ca810 0x7f54300cbf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:29.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.289+0000 7f542f400640 1 -- 172.21.15.63:0/1308573950 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f543014d170 con 0x7f54300cfb70 2024-05-21T01:27:29.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.289+0000 7f542ea00640 1 --2- 172.21.15.63:0/1308573950 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f54300ca810 0x7f54300cbf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T01:27:29.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.289+0000 7f542f400640 1 --2- 172.21.15.63:0/1308573950 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f54300cfb70 0x7f5430156640 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f542800cb50 tx=0x7f542800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:27:29.295 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.289+0000 7f5426a00640 1 -- 172.21.15.63:0/1308573950 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5428017070 con 0x7f54300cfb70 2024-05-21T01:27:29.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.289+0000 7f5426a00640 1 -- 172.21.15.63:0/1308573950 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f542800ad40 con 0x7f54300cfb70 2024-05-21T01:27:29.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.289+0000 7f5426a00640 1 -- 172.21.15.63:0/1308573950 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5428012600 con 0x7f54300cfb70 2024-05-21T01:27:29.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.289+0000 7f5435600640 1 -- 172.21.15.63:0/1308573950 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f543014d450 con 0x7f54300cfb70 2024-05-21T01:27:29.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.289+0000 7f5435600640 1 -- 172.21.15.63:0/1308573950 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f543014da10 con 0x7f54300cfb70 2024-05-21T01:27:29.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.289+0000 7f5435600640 1 -- 172.21.15.63:0/1308573950 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f543014dd40 con 0x7f54300cfb70 2024-05-21T01:27:29.296 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.293+0000 7f5426a00640 1 -- 172.21.15.63:0/1308573950 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7f542801a070 con 0x7f54300cfb70 2024-05-21T01:27:29.297 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.293+0000 7f5426a00640 1 --2- 172.21.15.63:0/1308573950 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f540c06f430 0x7f540c0718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:27:29.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.293+0000 7f5426a00640 1 -- 172.21.15.63:0/1308573950 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f542808f480 con 0x7f54300cfb70 2024-05-21T01:27:29.298 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.293+0000 7f542ea00640 1 --2- 172.21.15.63:0/1308573950 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f540c06f430 0x7f540c0718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:27:29.299 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.293+0000 7f542ea00640 1 --2- 172.21.15.63:0/1308573950 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f540c06f430 0x7f540c0718f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5420007a70 tx=0x7f5420008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:27:29.302 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.297+0000 7f5426a00640 1 -- 172.21.15.63:0/1308573950 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f542805b910 con 0x7f54300cfb70 2024-05-21T01:27:29.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.497+0000 7f5435600640 1 -- 172.21.15.63:0/1308573950 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f54300507f0 con 0x7f54300cfb70 2024-05-21T01:27:29.501 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.497+0000 7f5426a00640 1 -- 172.21.15.63:0/1308573950 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+6876 (secure 0 0 0) 0x7f542805fc10 con 0x7f54300cfb70 2024-05-21T01:27:29.501 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-05-21T01:27:29.502 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6839/3045714273","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6837","nonce":3045714273},{"type":"v1","addr":"172.21.15.131:6839","nonce":3045714273}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4258,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/2978367338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":2978367338},{"type":"v1","addr":"172.21.15.131:6835","nonce":2978367338}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/3005995321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6835","nonce":3005995321},{"type":"v1","addr":"172.21.15.63:6837","nonce":3005995321}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-21T01:19:53.915775+0000","modified":"2024-05-21T01:20:31.724475+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4276,"mds_1":4270,"mds_2":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"e","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.63:6833/574189772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":574189772},{"type":"v1","addr":"172.21.15.63:6833","nonce":574189772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4270":{"gid":4270,"name":"f","rank":1,"incarnation":10,"state":"up:active","state_seq":11,"addr":"172.21.15.131:6838/3071941741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":3071941741},{"type":"v1","addr":"172.21.15.131:6838","nonce":3071941741}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.63:6836/2892727989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":2892727989},{"type":"v1","addr":"172.21.15.63:6836","nonce":2892727989}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4276,"qdb_cluster":[4267,4270,4276]},"id":1}]} 2024-05-21T01:27:29.502 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 15 2024-05-21T01:27:29.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.497+0000 7f5435600640 1 -- 172.21.15.63:0/1308573950 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f540c06f430 msgr2=0x7f540c0718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:27:29.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.497+0000 7f5435600640 1 --2- 172.21.15.63:0/1308573950 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f540c06f430 0x7f540c0718f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5420007a70 tx=0x7f5420008040 comp rx=0 tx=0).stop 2024-05-21T01:27:29.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.497+0000 7f5435600640 1 -- 172.21.15.63:0/1308573950 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f54300cfb70 msgr2=0x7f5430156640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:27:29.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.497+0000 7f5435600640 1 --2- 172.21.15.63:0/1308573950 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f54300cfb70 0x7f5430156640 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f542800cb50 tx=0x7f542800a430 comp rx=0 tx=0).stop 2024-05-21T01:27:29.503 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.497+0000 7f5435600640 1 -- 172.21.15.63:0/1308573950 shutdown_connections 2024-05-21T01:27:29.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.497+0000 7f5435600640 1 --2- 172.21.15.63:0/1308573950 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f540c06f430 0x7f540c0718f0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:29.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.497+0000 7f5435600640 1 --2- 172.21.15.63:0/1308573950 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f54300cfb70 0x7f5430156640 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:29.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.497+0000 7f5435600640 1 --2- 172.21.15.63:0/1308573950 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f54300cf790 0x7f5430156100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:29.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.497+0000 7f5435600640 1 --2- 172.21.15.63:0/1308573950 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f54300ca810 0x7f54300cbf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:29.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.497+0000 7f5435600640 1 -- 172.21.15.63:0/1308573950 >> 172.21.15.63:0/1308573950 conn(0x7f54300735f0 msgr2=0x7f54300cd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:27:29.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.497+0000 7f5435600640 1 -- 172.21.15.63:0/1308573950 shutdown_connections 2024-05-21T01:27:29.504 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.497+0000 7f5435600640 1 -- 172.21.15.63:0/1308573950 wait complete. 2024-05-21T01:27:29.523 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-21T01:27:29.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.661+0000 7f38a6c00640 1 Processor -- start 2024-05-21T01:27:29.665 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.661+0000 7f38a6c00640 1 -- start start 2024-05-21T01:27:29.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.661+0000 7f38a6c00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f38a006f9b0 0x7f38a0152a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:27:29.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.661+0000 7f38a6c00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f38a015ce40 0x7f38a0152f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:27:29.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.661+0000 7f38a6c00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38a0072550 con 0x7f38a006f5d0 2024-05-21T01:27:29.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.661+0000 7f38a6c00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f38a0159100 con 0x7f38a006f9b0 2024-05-21T01:27:29.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.661+0000 7f38a6c00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f38a01593e0 con 0x7f38a015ce40 2024-05-21T01:27:29.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.661+0000 7f389f400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f38a006f9b0 0x7f38a0152a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:27:29.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.661+0000 7f389f400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f38a006f9b0 0x7f38a0152a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43428/0 (socket says 172.21.15.63:43428) 2024-05-21T01:27:29.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.661+0000 7f389f400640 1 -- 172.21.15.63:0/2636516830 learned_addr learned my addr 172.21.15.63:0/2636516830 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:27:29.667 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.661+0000 7f38a4c00640 1 --2- 172.21.15.63:0/2636516830 >> v2:172.21.15.131:3300/0 conn(0x7f38a015ce40 0x7f38a0152f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:27:29.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.661+0000 7f389f400640 1 -- 172.21.15.63:0/2636516830 >> v2:172.21.15.131:3300/0 conn(0x7f38a015ce40 msgr2=0x7f38a0152f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:27:29.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.661+0000 7f389f400640 1 --2- 172.21.15.63:0/2636516830 >> v2:172.21.15.131:3300/0 conn(0x7f38a015ce40 0x7f38a0152f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:29.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.661+0000 7f389f400640 1 -- 172.21.15.63:0/2636516830 >> v1:172.21.15.131:6789/0 conn(0x7f38a006f5d0 legacy=0x7f38a00c8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:27:29.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.661+0000 7f389f400640 1 -- 172.21.15.63:0/2636516830 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38a01596c0 con 0x7f38a006f9b0 2024-05-21T01:27:29.668 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.661+0000 7f38a4c00640 1 --2- 172.21.15.63:0/2636516830 >> v2:172.21.15.131:3300/0 conn(0x7f38a015ce40 0x7f38a0152f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T01:27:29.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.665+0000 7f389f400640 1 --2- 172.21.15.63:0/2636516830 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f38a006f9b0 0x7f38a0152a40 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f38a00cadd0 tx=0x7f388c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2a112860f0cb127 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:27:29.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.665+0000 7f389ea00640 1 -- 172.21.15.63:0/2636516830 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f388c0ab610 con 0x7f38a006f9b0 2024-05-21T01:27:29.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.665+0000 7f389ea00640 1 -- 172.21.15.63:0/2636516830 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f388c0b0070 con 0x7f38a006f9b0 2024-05-21T01:27:29.670 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.665+0000 7f389ea00640 1 -- 172.21.15.63:0/2636516830 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f388c0ab9f0 con 0x7f38a006f9b0 2024-05-21T01:27:29.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.665+0000 7f38a6c00640 1 -- 172.21.15.63:0/2636516830 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f38a006f9b0 msgr2=0x7f38a0152a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:27:29.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.665+0000 7f38a6c00640 1 --2- 172.21.15.63:0/2636516830 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f38a006f9b0 0x7f38a0152a40 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f38a00cadd0 tx=0x7f388c01c520 comp rx=0 tx=0).stop 2024-05-21T01:27:29.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.665+0000 7f38a6c00640 1 -- 172.21.15.63:0/2636516830 shutdown_connections 2024-05-21T01:27:29.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.665+0000 7f38a6c00640 1 --2- 172.21.15.63:0/2636516830 >> v2:172.21.15.131:3300/0 conn(0x7f38a015ce40 0x7f38a0152f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:29.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.665+0000 7f38a6c00640 1 --2- 172.21.15.63:0/2636516830 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f38a006f9b0 0x7f38a0152a40 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:29.671 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.665+0000 7f38a6c00640 1 -- 172.21.15.63:0/2636516830 >> 172.21.15.63:0/2636516830 conn(0x7f38a0068460 msgr2=0x7f38a0068870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:27:29.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.665+0000 7f38a6c00640 1 -- 172.21.15.63:0/2636516830 shutdown_connections 2024-05-21T01:27:29.672 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.665+0000 7f38a6c00640 1 -- 172.21.15.63:0/2636516830 wait complete. 2024-05-21T01:27:29.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.669+0000 7f38a6c00640 1 Processor -- start 2024-05-21T01:27:29.673 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.669+0000 7f38a6c00640 1 -- start start 2024-05-21T01:27:29.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.669+0000 7f38a6c00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f38a006f5d0 0x7f38a01f57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:27:29.674 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.669+0000 7f38a6c00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f38a006f9b0 0x7f38a0149560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:27:29.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.669+0000 7f38a6c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38a015ce40 0x7f38a0147b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:27:29.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.669+0000 7f38a6c00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f38a0163890 con 0x7f38a006f9b0 2024-05-21T01:27:29.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.669+0000 7f38a6c00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f38a0163710 con 0x7f38a015ce40 2024-05-21T01:27:29.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.669+0000 7f38a6c00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f38a0163a10 con 0x7f38a006f5d0 2024-05-21T01:27:29.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.669+0000 7f389f400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f38a006f9b0 0x7f38a0149560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:27:29.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.669+0000 7f389f400640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f38a006f9b0 0x7f38a0149560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43442/0 (socket says 172.21.15.63:43442) 2024-05-21T01:27:29.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.669+0000 7f389f400640 1 -- 172.21.15.63:0/1535649439 learned_addr learned my addr 172.21.15.63:0/1535649439 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:27:29.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.669+0000 7f389fe00640 1 --2- 172.21.15.63:0/1535649439 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f38a006f5d0 0x7f38a01f57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:27:29.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.669+0000 7f38a4c00640 1 --2- 172.21.15.63:0/1535649439 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38a015ce40 0x7f38a0147b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:27:29.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.669+0000 7f389f400640 1 -- 172.21.15.63:0/1535649439 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f38a006f5d0 msgr2=0x7f38a01f57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:27:29.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.669+0000 7f389f400640 1 --2- 172.21.15.63:0/1535649439 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f38a006f5d0 0x7f38a01f57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:29.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.669+0000 7f389f400640 1 -- 172.21.15.63:0/1535649439 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38a015ce40 msgr2=0x7f38a0147b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:27:29.675 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.669+0000 7f389f400640 1 --2- 172.21.15.63:0/1535649439 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38a015ce40 0x7f38a0147b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:29.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.669+0000 7f389f400640 1 -- 172.21.15.63:0/1535649439 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38a014d960 con 0x7f38a006f9b0 2024-05-21T01:27:29.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.669+0000 7f389f400640 1 --2- 172.21.15.63:0/1535649439 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f38a006f9b0 0x7f38a0149560 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f388c0ad040 tx=0x7f388c01ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:27:29.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.669+0000 7f3897e00640 1 -- 172.21.15.63:0/1535649439 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f388c0b4600 con 0x7f38a006f9b0 2024-05-21T01:27:29.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.669+0000 7f3897e00640 1 -- 172.21.15.63:0/1535649439 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f388c0b47c0 con 0x7f38a006f9b0 2024-05-21T01:27:29.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.669+0000 7f3897e00640 1 -- 172.21.15.63:0/1535649439 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f388c0b4bd0 con 0x7f38a006f9b0 2024-05-21T01:27:29.676 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.669+0000 7f38a6c00640 1 -- 172.21.15.63:0/1535649439 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38a014bc20 con 0x7f38a006f9b0 2024-05-21T01:27:29.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.669+0000 7f38a6c00640 1 -- 172.21.15.63:0/1535649439 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38a014c1e0 con 0x7f38a006f9b0 2024-05-21T01:27:29.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.673+0000 7f38a6c00640 1 -- 172.21.15.63:0/1535649439 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38a00507f0 con 0x7f38a006f9b0 2024-05-21T01:27:29.677 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.673+0000 7f3897e00640 1 -- 172.21.15.63:0/1535649439 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7f388c0c7380 con 0x7f38a006f9b0 2024-05-21T01:27:29.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.673+0000 7f3897e00640 1 --2- 172.21.15.63:0/1535649439 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f388006f400 0x7f38800718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:27:29.678 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.673+0000 7f3897e00640 1 -- 172.21.15.63:0/1535649439 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f388c129c30 con 0x7f38a006f9b0 2024-05-21T01:27:29.679 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.673+0000 7f389fe00640 1 --2- 172.21.15.63:0/1535649439 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f388006f400 0x7f38800718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:27:29.680 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.677+0000 7f389fe00640 1 --2- 172.21.15.63:0/1535649439 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f388006f400 0x7f38800718c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3890001670 tx=0x7f3890009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:27:29.682 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.677+0000 7f3897e00640 1 -- 172.21.15.63:0/1535649439 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f388c0a8050 con 0x7f38a006f9b0 2024-05-21T01:27:29.851 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.845+0000 7f38a6c00640 1 -- 172.21.15.63:0/1535649439 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f38a00c5ef0 con 0x7f38a006f9b0 2024-05-21T01:27:29.852 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.849+0000 7f3897e00640 1 -- 172.21.15.63:0/1535649439 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18578 (secure 0 0 0) 0x7f388c016110 con 0x7f38a006f9b0 2024-05-21T01:27:29.853 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-05-21T01:27:29.853 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":27,"fsid":"9a7cbd84-ceb2-41c8-8b6e-ab931f86c51a","created":"2024-05-21T01:19:37.688082+0000","modified":"2024-05-21T01:20:43.525252+0000","last_up_change":"2024-05-21T01:19:48.472107+0000","last_in_change":"2024-05-21T01:19:39.973975+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-21T01:19:46.485266+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-21T01:19:52.032741+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-21T01:19:52.867322+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-21T01:19:56.562363+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"cda28135-00bb-4194-adcb-e0abf3ae43f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":3740454920},{"type":"v1","addr":"172.21.15.63:6801","nonce":3740454920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":3740454920},{"type":"v1","addr":"172.21.15.63:6804","nonce":3740454920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":3740454920},{"type":"v1","addr":"172.21.15.63:6812","nonce":3740454920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":3740454920},{"type":"v1","addr":"172.21.15.63:6808","nonce":3740454920}]},"public_addr":"172.21.15.63:6801/3740454920","cluster_addr":"172.21.15.63:6804/3740454920","heartbeat_back_addr":"172.21.15.63:6812/3740454920","heartbeat_front_addr":"172.21.15.63:6808/3740454920","state":["exists","up"]},{"osd":1,"uuid":"4aeb370d-ec2f-4a91-b17b-035fd72bdaea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6803","nonce":896993303},{"type":"v1","addr":"172.21.15.63:6805","nonce":896993303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6807","nonce":896993303},{"type":"v1","addr":"172.21.15.63:6809","nonce":896993303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":896993303},{"type":"v1","addr":"172.21.15.63:6816","nonce":896993303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6811","nonce":896993303},{"type":"v1","addr":"172.21.15.63:6813","nonce":896993303}]},"public_addr":"172.21.15.63:6805/896993303","cluster_addr":"172.21.15.63:6809/896993303","heartbeat_back_addr":"172.21.15.63:6816/896993303","heartbeat_front_addr":"172.21.15.63:6813/896993303","state":["exists","up"]},{"osd":2,"uuid":"8368b112-35a3-43cf-ad1c-803f05708091","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6815","nonce":845807419},{"type":"v1","addr":"172.21.15.63:6817","nonce":845807419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":845807419},{"type":"v1","addr":"172.21.15.63:6819","nonce":845807419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":845807419},{"type":"v1","addr":"172.21.15.63:6823","nonce":845807419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":845807419},{"type":"v1","addr":"172.21.15.63:6821","nonce":845807419}]},"public_addr":"172.21.15.63:6817/845807419","cluster_addr":"172.21.15.63:6819/845807419","heartbeat_back_addr":"172.21.15.63:6823/845807419","heartbeat_front_addr":"172.21.15.63:6821/845807419","state":["exists","up"]},{"osd":3,"uuid":"26208950-e3ca-4b9a-94cd-c159453a5dfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":521563809},{"type":"v1","addr":"172.21.15.63:6825","nonce":521563809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":521563809},{"type":"v1","addr":"172.21.15.63:6827","nonce":521563809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":521563809},{"type":"v1","addr":"172.21.15.63:6831","nonce":521563809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":521563809},{"type":"v1","addr":"172.21.15.63:6829","nonce":521563809}]},"public_addr":"172.21.15.63:6825/521563809","cluster_addr":"172.21.15.63:6827/521563809","heartbeat_back_addr":"172.21.15.63:6831/521563809","heartbeat_front_addr":"172.21.15.63:6829/521563809","state":["exists","up"]},{"osd":4,"uuid":"d8c93283-1e10-4419-9934-d5048c5d0ad1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":2660673588},{"type":"v1","addr":"172.21.15.131:6801","nonce":2660673588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":2660673588},{"type":"v1","addr":"172.21.15.131:6803","nonce":2660673588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":2660673588},{"type":"v1","addr":"172.21.15.131:6807","nonce":2660673588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":2660673588},{"type":"v1","addr":"172.21.15.131:6805","nonce":2660673588}]},"public_addr":"172.21.15.131:6801/2660673588","cluster_addr":"172.21.15.131:6803/2660673588","heartbeat_back_addr":"172.21.15.131:6807/2660673588","heartbeat_front_addr":"172.21.15.131:6805/2660673588","state":["exists","up"]},{"osd":5,"uuid":"93a6fe9b-eaa6-4474-bf9b-ae0571feacf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6809","nonce":2508702891},{"type":"v1","addr":"172.21.15.131:6811","nonce":2508702891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6813","nonce":2508702891},{"type":"v1","addr":"172.21.15.131:6815","nonce":2508702891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6821","nonce":2508702891},{"type":"v1","addr":"172.21.15.131:6823","nonce":2508702891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6817","nonce":2508702891},{"type":"v1","addr":"172.21.15.131:6819","nonce":2508702891}]},"public_addr":"172.21.15.131:6811/2508702891","cluster_addr":"172.21.15.131:6815/2508702891","heartbeat_back_addr":"172.21.15.131:6823/2508702891","heartbeat_front_addr":"172.21.15.131:6819/2508702891","state":["exists","up"]},{"osd":6,"uuid":"e05e6c8c-2dda-49ab-8116-5ea9038d0f0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":614380392},{"type":"v1","addr":"172.21.15.131:6810","nonce":614380392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":614380392},{"type":"v1","addr":"172.21.15.131:6814","nonce":614380392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":614380392},{"type":"v1","addr":"172.21.15.131:6822","nonce":614380392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":614380392},{"type":"v1","addr":"172.21.15.131:6818","nonce":614380392}]},"public_addr":"172.21.15.131:6810/614380392","cluster_addr":"172.21.15.131:6814/614380392","heartbeat_back_addr":"172.21.15.131:6822/614380392","heartbeat_front_addr":"172.21.15.131:6818/614380392","state":["exists","up"]},{"osd":7,"uuid":"0b393e5e-eeef-4e32-b23a-d405a8b0e7b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":4219797450},{"type":"v1","addr":"172.21.15.131:6825","nonce":4219797450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":4219797450},{"type":"v1","addr":"172.21.15.131:6827","nonce":4219797450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":4219797450},{"type":"v1","addr":"172.21.15.131:6831","nonce":4219797450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":4219797450},{"type":"v1","addr":"172.21.15.131:6829","nonce":4219797450}]},"public_addr":"172.21.15.131:6825/4219797450","cluster_addr":"172.21.15.131:6827/4219797450","heartbeat_back_addr":"172.21.15.131:6831/4219797450","heartbeat_front_addr":"172.21.15.131:6829/4219797450","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.647841+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.912560+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.684614+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.936286+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.380500+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.553497+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.517866+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T01:19:45.310320+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.36","mappings":[{"from":0,"to":7}]},{"pgid":"4.16","mappings":[{"from":7,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-21T01:27:29.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.849+0000 7f38a6c00640 1 -- 172.21.15.63:0/1535649439 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f388006f400 msgr2=0x7f38800718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:27:29.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.849+0000 7f38a6c00640 1 --2- 172.21.15.63:0/1535649439 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f388006f400 0x7f38800718c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3890001670 tx=0x7f3890009040 comp rx=0 tx=0).stop 2024-05-21T01:27:29.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.849+0000 7f38a6c00640 1 -- 172.21.15.63:0/1535649439 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f38a006f9b0 msgr2=0x7f38a0149560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:27:29.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.849+0000 7f38a6c00640 1 --2- 172.21.15.63:0/1535649439 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f38a006f9b0 0x7f38a0149560 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f388c0ad040 tx=0x7f388c01ad60 comp rx=0 tx=0).stop 2024-05-21T01:27:29.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.849+0000 7f38a6c00640 1 -- 172.21.15.63:0/1535649439 shutdown_connections 2024-05-21T01:27:29.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.849+0000 7f38a6c00640 1 --2- 172.21.15.63:0/1535649439 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f388006f400 0x7f38800718c0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:29.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.849+0000 7f38a6c00640 1 --2- 172.21.15.63:0/1535649439 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38a015ce40 0x7f38a0147b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:29.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.849+0000 7f38a6c00640 1 --2- 172.21.15.63:0/1535649439 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f38a006f9b0 0x7f38a0149560 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:29.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.849+0000 7f38a6c00640 1 --2- 172.21.15.63:0/1535649439 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f38a006f5d0 0x7f38a01f57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:29.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.849+0000 7f38a6c00640 1 -- 172.21.15.63:0/1535649439 >> 172.21.15.63:0/1535649439 conn(0x7f38a0068460 msgr2=0x7f38a00cd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:27:29.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.849+0000 7f38a6c00640 1 -- 172.21.15.63:0/1535649439 shutdown_connections 2024-05-21T01:27:29.855 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:29.849+0000 7f38a6c00640 1 -- 172.21.15.63:0/1535649439 wait complete. 2024-05-21T01:27:29.874 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-21T01:27:30.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.013+0000 7fa484800640 1 Processor -- start 2024-05-21T01:27:30.016 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.013+0000 7fa484800640 1 -- start start 2024-05-21T01:27:30.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.013+0000 7fa484800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa47c06f5d0 0x7fa47c0c8a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:27:30.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.013+0000 7fa484800640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa47c06f9b0 0x7fa47c152a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:27:30.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.013+0000 7fa484800640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa47c15ce40 0x7fa47c152f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:27:30.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.013+0000 7fa484800640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7fa47c072550 con 0x7fa47c06f9b0 2024-05-21T01:27:30.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.013+0000 7fa484800640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fa47c159100 con 0x7fa47c15ce40 2024-05-21T01:27:30.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.013+0000 7fa484800640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fa47c1593e0 con 0x7fa47c06f5d0 2024-05-21T01:27:30.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.013+0000 7fa481400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa47c06f9b0 0x7fa47c152a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:27:30.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.013+0000 7fa481400640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa47c06f9b0 0x7fa47c152a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43444/0 (socket says 172.21.15.63:43444) 2024-05-21T01:27:30.018 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.013+0000 7fa481400640 1 -- 172.21.15.63:0/2268593626 learned_addr learned my addr 172.21.15.63:0/2268593626 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:27:30.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.013+0000 7fa482800640 1 --2- 172.21.15.63:0/2268593626 >> v2:172.21.15.131:3300/0 conn(0x7fa47c15ce40 0x7fa47c152f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:27:30.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.013+0000 7fa481e00640 1 --2- 172.21.15.63:0/2268593626 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa47c06f5d0 0x7fa47c0c8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:27:30.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.013+0000 7fa481400640 1 -- 172.21.15.63:0/2268593626 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa47c06f5d0 msgr2=0x7fa47c0c8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:27:30.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.013+0000 7fa481400640 1 --2- 172.21.15.63:0/2268593626 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa47c06f5d0 0x7fa47c0c8a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:30.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.013+0000 7fa481400640 1 -- 172.21.15.63:0/2268593626 >> v2:172.21.15.131:3300/0 conn(0x7fa47c15ce40 msgr2=0x7fa47c152f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:27:30.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.013+0000 7fa481400640 1 --2- 172.21.15.63:0/2268593626 >> v2:172.21.15.131:3300/0 conn(0x7fa47c15ce40 0x7fa47c152f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:30.019 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.013+0000 7fa481400640 1 -- 172.21.15.63:0/2268593626 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa47c1596c0 con 0x7fa47c06f9b0 2024-05-21T01:27:30.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.017+0000 7fa481400640 1 --2- 172.21.15.63:0/2268593626 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa47c06f9b0 0x7fa47c152a40 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fa47c0cada0 tx=0x7fa46c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4c7c08ff94b26d8 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:27:30.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.017+0000 7fa480a00640 1 -- 172.21.15.63:0/2268593626 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa46c0b1070 con 0x7fa47c06f9b0 2024-05-21T01:27:30.021 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.017+0000 7fa480a00640 1 -- 172.21.15.63:0/2268593626 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fa46c0ac630 con 0x7fa47c06f9b0 2024-05-21T01:27:30.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.017+0000 7fa480a00640 1 -- 172.21.15.63:0/2268593626 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa46c0a8050 con 0x7fa47c06f9b0 2024-05-21T01:27:30.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.017+0000 7fa484800640 1 -- 172.21.15.63:0/2268593626 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa47c06f9b0 msgr2=0x7fa47c152a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:27:30.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.017+0000 7fa484800640 1 --2- 172.21.15.63:0/2268593626 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa47c06f9b0 0x7fa47c152a40 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fa47c0cada0 tx=0x7fa46c01c520 comp rx=0 tx=0).stop 2024-05-21T01:27:30.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.017+0000 7fa484800640 1 -- 172.21.15.63:0/2268593626 shutdown_connections 2024-05-21T01:27:30.022 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.017+0000 7fa484800640 1 --2- 172.21.15.63:0/2268593626 >> v2:172.21.15.131:3300/0 conn(0x7fa47c15ce40 0x7fa47c152f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:30.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.017+0000 7fa484800640 1 --2- 172.21.15.63:0/2268593626 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa47c06f9b0 0x7fa47c152a40 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:30.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.017+0000 7fa484800640 1 --2- 172.21.15.63:0/2268593626 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa47c06f5d0 0x7fa47c0c8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:30.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.017+0000 7fa484800640 1 -- 172.21.15.63:0/2268593626 >> 172.21.15.63:0/2268593626 conn(0x7fa47c068460 msgr2=0x7fa47c068870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:27:30.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.017+0000 7fa484800640 1 -- 172.21.15.63:0/2268593626 shutdown_connections 2024-05-21T01:27:30.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.017+0000 7fa484800640 1 -- 172.21.15.63:0/2268593626 wait complete. 2024-05-21T01:27:30.023 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.017+0000 7fa484800640 1 Processor -- start 2024-05-21T01:27:30.024 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.021+0000 7fa484800640 1 -- start start 2024-05-21T01:27:30.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.021+0000 7fa484800640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa47c06f5d0 0x7fa47c141280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:27:30.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.021+0000 7fa484800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa47c06f9b0 0x7fa47c1510b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:27:30.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.021+0000 7fa484800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa47c15ce40 0x7fa47c1515f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:27:30.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.021+0000 7fa484800640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fa47c071630 con 0x7fa47c15ce40 2024-05-21T01:27:30.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.021+0000 7fa484800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa47c0714b0 con 0x7fa47c06f9b0 2024-05-21T01:27:30.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.021+0000 7fa484800640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fa47c0717b0 con 0x7fa47c06f5d0 2024-05-21T01:27:30.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.021+0000 7fa482800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa47c15ce40 0x7fa47c1515f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:27:30.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.021+0000 7fa482800640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa47c15ce40 0x7fa47c1515f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43456/0 (socket says 172.21.15.63:43456) 2024-05-21T01:27:30.026 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.021+0000 7fa482800640 1 -- 172.21.15.63:0/792955935 learned_addr learned my addr 172.21.15.63:0/792955935 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:27:30.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.021+0000 7fa481400640 1 --2- 172.21.15.63:0/792955935 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa47c06f9b0 0x7fa47c1510b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:27:30.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.021+0000 7fa481e00640 1 --2- 172.21.15.63:0/792955935 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa47c06f5d0 0x7fa47c141280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:27:30.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.021+0000 7fa482800640 1 -- 172.21.15.63:0/792955935 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa47c06f5d0 msgr2=0x7fa47c141280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:27:30.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.021+0000 7fa482800640 1 --2- 172.21.15.63:0/792955935 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa47c06f5d0 0x7fa47c141280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:30.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.021+0000 7fa482800640 1 -- 172.21.15.63:0/792955935 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa47c06f9b0 msgr2=0x7fa47c1510b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:27:30.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.021+0000 7fa482800640 1 --2- 172.21.15.63:0/792955935 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa47c06f9b0 0x7fa47c1510b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:30.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.021+0000 7fa482800640 1 -- 172.21.15.63:0/792955935 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa47c146e30 con 0x7fa47c15ce40 2024-05-21T01:27:30.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.021+0000 7fa482800640 1 --2- 172.21.15.63:0/792955935 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa47c15ce40 0x7fa47c1515f0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fa47800efc0 tx=0x7fa47800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:27:30.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.021+0000 7fa476000640 1 -- 172.21.15.63:0/792955935 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa478018020 con 0x7fa47c15ce40 2024-05-21T01:27:30.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.021+0000 7fa476000640 1 -- 172.21.15.63:0/792955935 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fa478014480 con 0x7fa47c15ce40 2024-05-21T01:27:30.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.021+0000 7fa484800640 1 -- 172.21.15.63:0/792955935 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa47c14b7a0 con 0x7fa47c15ce40 2024-05-21T01:27:30.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.021+0000 7fa476000640 1 -- 172.21.15.63:0/792955935 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa478009e60 con 0x7fa47c15ce40 2024-05-21T01:27:30.027 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.021+0000 7fa484800640 1 -- 172.21.15.63:0/792955935 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa47c14ba60 con 0x7fa47c15ce40 2024-05-21T01:27:30.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.021+0000 7fa484800640 1 -- 172.21.15.63:0/792955935 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa47c0507f0 con 0x7fa47c15ce40 2024-05-21T01:27:30.028 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.025+0000 7fa476000640 1 -- 172.21.15.63:0/792955935 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7fa47801b020 con 0x7fa47c15ce40 2024-05-21T01:27:30.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.025+0000 7fa476000640 1 --2- 172.21.15.63:0/792955935 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fa46006f430 0x7fa4600718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:27:30.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.025+0000 7fa476000640 1 -- 172.21.15.63:0/792955935 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7fa478090290 con 0x7fa47c15ce40 2024-05-21T01:27:30.029 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.025+0000 7fa481e00640 1 --2- 172.21.15.63:0/792955935 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fa46006f430 0x7fa4600718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:27:30.030 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.025+0000 7fa481e00640 1 --2- 172.21.15.63:0/792955935 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fa46006f430 0x7fa4600718f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa470009a70 tx=0x7fa470008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:27:30.033 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.029+0000 7fa476000640 1 -- 172.21.15.63:0/792955935 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fa478022030 con 0x7fa47c15ce40 2024-05-21T01:27:30.233 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.229+0000 7fa484800640 1 -- 172.21.15.63:0/792955935 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fa47c1417c0 con 0x7fa47c15ce40 2024-05-21T01:27:30.236 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.233+0000 7fa476000640 1 -- 172.21.15.63:0/792955935 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v16) ==== 161+0+0 (secure 0 0 0) 0x7fa478010040 con 0x7fa47c15ce40 2024-05-21T01:27:30.236 INFO:teuthology.orchestra.run.smithi063.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-21T01:27:30.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.237+0000 7fa484800640 1 -- 172.21.15.63:0/792955935 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fa46006f430 msgr2=0x7fa4600718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:27:30.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.237+0000 7fa484800640 1 --2- 172.21.15.63:0/792955935 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fa46006f430 0x7fa4600718f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa470009a70 tx=0x7fa470008040 comp rx=0 tx=0).stop 2024-05-21T01:27:30.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.237+0000 7fa484800640 1 -- 172.21.15.63:0/792955935 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa47c15ce40 msgr2=0x7fa47c1515f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:27:30.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.237+0000 7fa484800640 1 --2- 172.21.15.63:0/792955935 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa47c15ce40 0x7fa47c1515f0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fa47800efc0 tx=0x7fa47800c490 comp rx=0 tx=0).stop 2024-05-21T01:27:30.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.237+0000 7fa484800640 1 -- 172.21.15.63:0/792955935 shutdown_connections 2024-05-21T01:27:30.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.237+0000 7fa484800640 1 --2- 172.21.15.63:0/792955935 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fa46006f430 0x7fa4600718f0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:30.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.237+0000 7fa484800640 1 --2- 172.21.15.63:0/792955935 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa47c15ce40 0x7fa47c1515f0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:30.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.237+0000 7fa484800640 1 --2- 172.21.15.63:0/792955935 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa47c06f9b0 0x7fa47c1510b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:30.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.237+0000 7fa484800640 1 --2- 172.21.15.63:0/792955935 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa47c06f5d0 0x7fa47c141280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:30.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.237+0000 7fa484800640 1 -- 172.21.15.63:0/792955935 >> 172.21.15.63:0/792955935 conn(0x7fa47c068460 msgr2=0x7fa47c0c91a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:27:30.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.237+0000 7fa484800640 1 -- 172.21.15.63:0/792955935 shutdown_connections 2024-05-21T01:27:30.241 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.237+0000 7fa484800640 1 -- 172.21.15.63:0/792955935 wait complete. 2024-05-21T01:27:30.268 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-21T01:27:30.308 INFO:tasks.ceph.mds.e.smithi063.stdout:starting mds.e at 2024-05-21T01:27:30.312 INFO:tasks.ceph.mds.c.smithi063.stdout:starting mds.c at 2024-05-21T01:27:30.330 INFO:tasks.ceph.mds.f.smithi131.stdout:starting mds.f at 2024-05-21T01:27:30.419 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.413+0000 7f9351e00640 1 Processor -- start 2024-05-21T01:27:30.419 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.413+0000 7f9351e00640 1 -- start start 2024-05-21T01:27:30.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.417+0000 7f9351e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f934c06f5d0 0x7f934c0c47f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:27:30.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.417+0000 7f9351e00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f934c0c4d30 con 0x7f934c0c69c0 2024-05-21T01:27:30.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.417+0000 7f9351e00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f934c0c4fc0 con 0x7f934c06f9b0 2024-05-21T01:27:30.420 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.417+0000 7f9351e00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f934c0c52a0 con 0x7f934c06f5d0 2024-05-21T01:27:30.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.417+0000 7f934b400640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f934c0c69c0 0x7f934c0c6df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:45200/0 (socket says 172.21.15.63:45200) 2024-05-21T01:27:30.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.417+0000 7f934b400640 1 -- 172.21.15.63:0/534053631 learned_addr learned my addr 172.21.15.63:0/534053631 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-05-21T01:27:30.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.417+0000 7f934aa00640 1 --2- 172.21.15.63:0/534053631 >> v2:172.21.15.131:3300/0 conn(0x7f934c06f5d0 0x7f934c0c47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:27:30.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.417+0000 7f934a000640 1 -- 172.21.15.63:0/534053631 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2722529702 0 0) 0x7f934c0c4d30 con 0x7f934c0c69c0 2024-05-21T01:27:30.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.417+0000 7f934a000640 1 -- 172.21.15.63:0/534053631 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9330003530 con 0x7f934c0c69c0 2024-05-21T01:27:30.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.417+0000 7f934aa00640 1 -- 172.21.15.63:0/534053631 >> v1:172.21.15.131:6789/0 conn(0x7f934c06f9b0 legacy=0x7f934c0c94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:27:30.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.417+0000 7f934aa00640 1 -- 172.21.15.63:0/534053631 >> v1:172.21.15.63:6789/0 conn(0x7f934c0c69c0 legacy=0x7f934c0c6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:27:30.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.417+0000 7f934a000640 1 -- 172.21.15.63:0/534053631 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3971758402 0 0) 0x7f9330003530 con 0x7f934c0c69c0 2024-05-21T01:27:30.421 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.417+0000 7f934aa00640 1 -- 172.21.15.63:0/534053631 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f934c0ca240 con 0x7f934c06f5d0 2024-05-21T01:27:30.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.421+0000 7f934aa00640 1 --2- 172.21.15.63:0/534053631 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f934c06f5d0 0x7f934c0c47f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f933c0097f0 tx=0x7f933c01c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81d5d47df38df57f server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:27:30.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.421+0000 7f934a000640 1 -- 172.21.15.63:0/534053631 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f933c0b0070 con 0x7f934c06f5d0 2024-05-21T01:27:30.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.421+0000 7f934a000640 1 -- 172.21.15.63:0/534053631 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f933c0ab400 con 0x7f934c06f5d0 2024-05-21T01:27:30.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.421+0000 7f934a000640 1 -- 172.21.15.63:0/534053631 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9344001a80 con 0x7f934c06f5d0 2024-05-21T01:27:30.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.421+0000 7f9351e00640 1 -- 172.21.15.63:0/534053631 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f934c06f5d0 msgr2=0x7f934c0c47f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:27:30.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.421+0000 7f9351e00640 1 --2- 172.21.15.63:0/534053631 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f934c06f5d0 0x7f934c0c47f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f933c0097f0 tx=0x7f933c01c3c0 comp rx=0 tx=0).stop 2024-05-21T01:27:30.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.421+0000 7f9351e00640 1 -- 172.21.15.63:0/534053631 shutdown_connections 2024-05-21T01:27:30.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.421+0000 7f9351e00640 1 --2- 172.21.15.63:0/534053631 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f934c06f5d0 0x7f934c0c47f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:30.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.421+0000 7f9351e00640 1 -- 172.21.15.63:0/534053631 >> 172.21.15.63:0/534053631 conn(0x7f934c068460 msgr2=0x7f934c068870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:27:30.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.421+0000 7f9351e00640 1 -- 172.21.15.63:0/534053631 shutdown_connections 2024-05-21T01:27:30.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.421+0000 7f9351e00640 1 -- 172.21.15.63:0/534053631 wait complete. 2024-05-21T01:27:30.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.421+0000 7f9351e00640 1 Processor -- start 2024-05-21T01:27:30.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.421+0000 7f9351e00640 1 -- start start 2024-05-21T01:27:30.429 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.425+0000 7f9351e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f934c06f5d0 0x7f934c14bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:27:30.429 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.425+0000 7f9351e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f934c06f9b0 0x7f934c143590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:27:30.429 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.425+0000 7f9351e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f934c0c69c0 0x7f934c143ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:27:30.429 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.425+0000 7f9351e00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f934c154350 con 0x7f934c06f9b0 2024-05-21T01:27:30.429 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.425+0000 7f9351e00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f934c1541d0 con 0x7f934c0c69c0 2024-05-21T01:27:30.429 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.425+0000 7f9351e00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f934c1544d0 con 0x7f934c06f5d0 2024-05-21T01:27:30.429 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.425+0000 7f9342000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f934c06f9b0 0x7f934c143590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:27:30.429 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.425+0000 7f9342000640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f934c06f9b0 0x7f934c143590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43490/0 (socket says 172.21.15.63:43490) 2024-05-21T01:27:30.429 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.425+0000 7f9342000640 1 -- 172.21.15.63:0/2883443214 learned_addr learned my addr 172.21.15.63:0/2883443214 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:27:30.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.425+0000 7f934aa00640 1 --2- 172.21.15.63:0/2883443214 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f934c06f5d0 0x7f934c14bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:27:30.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.425+0000 7f934b400640 1 --2- 172.21.15.63:0/2883443214 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f934c0c69c0 0x7f934c143ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:27:30.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.425+0000 7f9342000640 1 -- 172.21.15.63:0/2883443214 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f934c06f5d0 msgr2=0x7f934c14bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:27:30.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.425+0000 7f9342000640 1 --2- 172.21.15.63:0/2883443214 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f934c06f5d0 0x7f934c14bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:30.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.425+0000 7f9342000640 1 -- 172.21.15.63:0/2883443214 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f934c0c69c0 msgr2=0x7f934c143ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:27:30.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.425+0000 7f9342000640 1 --2- 172.21.15.63:0/2883443214 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f934c0c69c0 0x7f934c143ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:30.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.425+0000 7f9342000640 1 -- 172.21.15.63:0/2883443214 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f934c1465d0 con 0x7f934c06f9b0 2024-05-21T01:27:30.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.425+0000 7f934b400640 1 --2- 172.21.15.63:0/2883443214 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f934c0c69c0 0x7f934c143ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T01:27:30.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.425+0000 7f9342000640 1 --2- 172.21.15.63:0/2883443214 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f934c06f9b0 0x7f934c143590 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f933400c4e0 tx=0x7f933400c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:27:30.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.425+0000 7f9343e00640 1 -- 172.21.15.63:0/2883443214 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93340052d0 con 0x7f934c06f9b0 2024-05-21T01:27:30.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.425+0000 7f9343e00640 1 -- 172.21.15.63:0/2883443214 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f9334005470 con 0x7f934c06f9b0 2024-05-21T01:27:30.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.425+0000 7f9343e00640 1 -- 172.21.15.63:0/2883443214 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9334012870 con 0x7f934c06f9b0 2024-05-21T01:27:30.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.425+0000 7f9351e00640 1 -- 172.21.15.63:0/2883443214 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f934c0cb4a0 con 0x7f934c06f9b0 2024-05-21T01:27:30.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.425+0000 7f9351e00640 1 -- 172.21.15.63:0/2883443214 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f934c146b20 con 0x7f934c06f9b0 2024-05-21T01:27:30.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.425+0000 7f9351e00640 1 -- 172.21.15.63:0/2883443214 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f934c0507f0 con 0x7f934c06f9b0 2024-05-21T01:27:30.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.425+0000 7f9343e00640 1 -- 172.21.15.63:0/2883443214 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7f9334012a10 con 0x7f934c06f9b0 2024-05-21T01:27:30.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.429+0000 7f9343e00640 1 --2- 172.21.15.63:0/2883443214 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f932806f400 0x7f93280718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:27:30.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.429+0000 7f9343e00640 1 -- 172.21.15.63:0/2883443214 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6848+0+0 (secure 0 0 0) 0x7f933408f3c0 con 0x7f934c06f9b0 2024-05-21T01:27:30.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.429+0000 7f934aa00640 1 --2- 172.21.15.63:0/2883443214 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f932806f400 0x7f93280718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:27:30.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.429+0000 7f934aa00640 1 --2- 172.21.15.63:0/2883443214 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f932806f400 0x7f93280718c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f933c0ad000 tx=0x7f933c0a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:27:30.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.433+0000 7f9343e00640 1 -- 172.21.15.63:0/2883443214 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f933405bdc0 con 0x7f934c06f9b0 2024-05-21T01:27:30.640 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:30.637+0000 7f9351e00640 1 -- 172.21.15.63:0/2883443214 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f934c145450 con 0x7f934c06f9b0 2024-05-21T01:27:31.246 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:31.241+0000 7f9343e00640 1 -- 172.21.15.63:0/2883443214 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v17) ==== 104+0+0 (secure 0 0 0) 0x7f933405b6c0 con 0x7f934c06f9b0 2024-05-21T01:27:31.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:31.245+0000 7f9351e00640 1 -- 172.21.15.63:0/2883443214 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f932806f400 msgr2=0x7f93280718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:27:31.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:31.245+0000 7f9351e00640 1 --2- 172.21.15.63:0/2883443214 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f932806f400 0x7f93280718c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f933c0ad000 tx=0x7f933c0a6000 comp rx=0 tx=0).stop 2024-05-21T01:27:31.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:31.245+0000 7f9351e00640 1 -- 172.21.15.63:0/2883443214 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f934c06f9b0 msgr2=0x7f934c143590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:27:31.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:31.245+0000 7f9351e00640 1 --2- 172.21.15.63:0/2883443214 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f934c06f9b0 0x7f934c143590 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f933400c4e0 tx=0x7f933400c9a0 comp rx=0 tx=0).stop 2024-05-21T01:27:31.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:31.245+0000 7f9351e00640 1 -- 172.21.15.63:0/2883443214 shutdown_connections 2024-05-21T01:27:31.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:31.245+0000 7f9351e00640 1 --2- 172.21.15.63:0/2883443214 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f932806f400 0x7f93280718c0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:31.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:31.245+0000 7f9351e00640 1 --2- 172.21.15.63:0/2883443214 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f934c0c69c0 0x7f934c143ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:31.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:31.245+0000 7f9351e00640 1 --2- 172.21.15.63:0/2883443214 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f934c06f9b0 0x7f934c143590 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:31.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:31.245+0000 7f9351e00640 1 --2- 172.21.15.63:0/2883443214 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f934c06f5d0 0x7f934c14bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:31.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:31.245+0000 7f9351e00640 1 -- 172.21.15.63:0/2883443214 >> 172.21.15.63:0/2883443214 conn(0x7f934c068460 msgr2=0x7f934c14e030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:27:31.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:31.245+0000 7f9351e00640 1 -- 172.21.15.63:0/2883443214 shutdown_connections 2024-05-21T01:27:31.250 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:31.245+0000 7f9351e00640 1 -- 172.21.15.63:0/2883443214 wait complete. 2024-05-21T01:27:31.271 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-21T01:27:31.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:31.457+0000 7fe33fc00640 1 Processor -- start 2024-05-21T01:27:31.462 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:31.457+0000 7fe33fc00640 1 -- start start 2024-05-21T01:27:31.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:31.457+0000 7fe33fc00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fe338154000 0x7fe33815da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:27:31.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:31.457+0000 7fe33fc00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe338159cb0 0x7fe33806d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:27:31.463 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:31.457+0000 7fe33fc00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3381543e0 con 0x7fe33815df50 2024-05-21T01:27:31.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:31.457+0000 7fe33fc00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fe33815d2a0 con 0x7fe338154000 2024-05-21T01:27:31.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:31.457+0000 7fe33fc00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fe33815b1a0 con 0x7fe338159cb0 2024-05-21T01:27:31.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:31.457+0000 7fe33d200640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fe338154000 0x7fe33815da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:27:31.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:31.457+0000 7fe33dc00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe338159cb0 0x7fe33806d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:27:31.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:31.457+0000 7fe337e00640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fe33815df50 0x7fe3380735e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.63:34644/0 (socket says 172.21.15.63:34644) 2024-05-21T01:27:31.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:31.457+0000 7fe337e00640 1 -- 172.21.15.63:0/903507115 learned_addr learned my addr 172.21.15.63:0/903507115 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-05-21T01:27:31.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:31.461+0000 7fe33d200640 1 -- 172.21.15.63:0/903507115 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe338159cb0 msgr2=0x7fe33806d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:27:31.464 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:31.461+0000 7fe33d200640 1 --2- 172.21.15.63:0/903507115 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe338159cb0 0x7fe33806d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:31.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:31.461+0000 7fe33d200640 1 -- 172.21.15.63:0/903507115 >> v1:172.21.15.131:6789/0 conn(0x7fe33815df50 legacy=0x7fe3380735e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:27:31.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:31.461+0000 7fe33d200640 1 -- 172.21.15.63:0/903507115 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe33815a1f0 con 0x7fe338154000 2024-05-21T01:27:31.465 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:31.461+0000 7fe33dc00640 1 --2- 172.21.15.63:0/903507115 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe338159cb0 0x7fe33806d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-21T01:27:31.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:31.461+0000 7fe33d200640 1 --2- 172.21.15.63:0/903507115 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe338154000 0x7fe33815da10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe32c0097c0 tx=0x7fe32c01c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3228ffcefac19596 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:27:31.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:31.461+0000 7fe337400640 1 -- 172.21.15.63:0/903507115 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe32c0ab430 con 0x7fe338154000 2024-05-21T01:27:31.467 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:31.461+0000 7fe337400640 1 -- 172.21.15.63:0/903507115 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fe32c0b0070 con 0x7fe338154000 2024-05-21T01:27:31.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:31.461+0000 7fe337400640 1 -- 172.21.15.63:0/903507115 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe32c0ab810 con 0x7fe338154000 2024-05-21T01:27:31.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:31.465+0000 7fe33fc00640 1 -- 172.21.15.63:0/903507115 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe338154000 msgr2=0x7fe33815da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:27:31.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:31.465+0000 7fe33fc00640 1 --2- 172.21.15.63:0/903507115 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe338154000 0x7fe33815da10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe32c0097c0 tx=0x7fe32c01c410 comp rx=0 tx=0).stop 2024-05-21T01:27:31.468 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:31.465+0000 7fe33fc00640 1 -- 172.21.15.63:0/903507115 shutdown_connections 2024-05-21T01:27:31.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:31.465+0000 7fe33fc00640 1 --2- 172.21.15.63:0/903507115 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe338159cb0 0x7fe33806d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:31.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:31.465+0000 7fe33fc00640 1 --2- 172.21.15.63:0/903507115 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe338154000 0x7fe33815da10 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:31.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:31.465+0000 7fe33fc00640 1 -- 172.21.15.63:0/903507115 >> 172.21.15.63:0/903507115 conn(0x7fe33806efc0 msgr2=0x7fe33806f3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:27:31.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:31.465+0000 7fe33fc00640 1 -- 172.21.15.63:0/903507115 shutdown_connections 2024-05-21T01:27:31.469 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:31.465+0000 7fe33fc00640 1 -- 172.21.15.63:0/903507115 wait complete. 2024-05-21T01:27:31.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:31.465+0000 7fe33fc00640 1 Processor -- start 2024-05-21T01:27:31.470 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:31.465+0000 7fe33fc00640 1 -- start start 2024-05-21T01:27:31.471 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:31.465+0000 7fe33fc00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe338154000 0x7fe338072c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:27:31.471 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:31.465+0000 7fe33fc00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe338159cb0 0x7fe33814e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:27:31.471 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:31.465+0000 7fe33fc00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe33815df50 0x7fe33814e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:27:31.471 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:31.465+0000 7fe33fc00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7fe33815d4f0 con 0x7fe33815df50 2024-05-21T01:27:31.472 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:31.465+0000 7fe33fc00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fe33815aa90 con 0x7fe338159cb0 2024-05-21T01:27:31.472 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:31.465+0000 7fe33fc00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7fe338073cf0 con 0x7fe338154000 2024-05-21T01:27:31.472 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:31.465+0000 7fe33dc00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe33815df50 0x7fe33814e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:27:31.472 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:31.465+0000 7fe33dc00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe33815df50 0x7fe33814e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43494/0 (socket says 172.21.15.63:43494) 2024-05-21T01:27:31.472 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:31.465+0000 7fe33dc00640 1 -- 172.21.15.63:0/2531940600 learned_addr learned my addr 172.21.15.63:0/2531940600 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:27:31.472 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:31.465+0000 7fe33d200640 1 --2- 172.21.15.63:0/2531940600 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe338154000 0x7fe338072c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:27:31.472 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:31.465+0000 7fe337e00640 1 --2- 172.21.15.63:0/2531940600 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe338159cb0 0x7fe33814e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:27:31.473 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:31.469+0000 7fe33dc00640 1 -- 172.21.15.63:0/2531940600 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe338154000 msgr2=0x7fe338072c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:27:31.473 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:31.469+0000 7fe33dc00640 1 --2- 172.21.15.63:0/2531940600 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe338154000 0x7fe338072c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:31.473 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:31.469+0000 7fe33dc00640 1 -- 172.21.15.63:0/2531940600 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe338159cb0 msgr2=0x7fe33814e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:27:31.473 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:31.469+0000 7fe33dc00640 1 --2- 172.21.15.63:0/2531940600 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe338159cb0 0x7fe33814e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:31.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:31.469+0000 7fe33dc00640 1 -- 172.21.15.63:0/2531940600 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe33814c460 con 0x7fe33815df50 2024-05-21T01:27:31.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:31.469+0000 7fe337e00640 1 --2- 172.21.15.63:0/2531940600 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe338159cb0 0x7fe33814e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T01:27:31.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:31.469+0000 7fe33dc00640 1 --2- 172.21.15.63:0/2531940600 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe33815df50 0x7fe33814e560 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fe33000efc0 tx=0x7fe33000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:27:31.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:31.469+0000 7fe334c00640 1 -- 172.21.15.63:0/2531940600 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe330018030 con 0x7fe33815df50 2024-05-21T01:27:31.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:31.469+0000 7fe334c00640 1 -- 172.21.15.63:0/2531940600 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fe33000cdf0 con 0x7fe33815df50 2024-05-21T01:27:31.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:31.469+0000 7fe334c00640 1 -- 172.21.15.63:0/2531940600 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe330003be0 con 0x7fe33815df50 2024-05-21T01:27:31.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:31.469+0000 7fe33fc00640 1 -- 172.21.15.63:0/2531940600 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe338071eb0 con 0x7fe33815df50 2024-05-21T01:27:31.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:31.469+0000 7fe33fc00640 1 -- 172.21.15.63:0/2531940600 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe338072470 con 0x7fe33815df50 2024-05-21T01:27:31.474 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:31.469+0000 7fe33fc00640 1 -- 172.21.15.63:0/2531940600 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe33806c1a0 con 0x7fe33815df50 2024-05-21T01:27:31.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:31.469+0000 7fe334c00640 1 -- 172.21.15.63:0/2531940600 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7fe33001b070 con 0x7fe33815df50 2024-05-21T01:27:31.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:31.469+0000 7fe334c00640 1 --2- 172.21.15.63:0/2531940600 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fe31806f400 0x7fe3180718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:27:31.475 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:31.469+0000 7fe334c00640 1 -- 172.21.15.63:0/2531940600 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6848+0+0 (secure 0 0 0) 0x7fe330090060 con 0x7fe33815df50 2024-05-21T01:27:31.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:31.473+0000 7fe33d200640 1 --2- 172.21.15.63:0/2531940600 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fe31806f400 0x7fe3180718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:27:31.476 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:31.473+0000 7fe33d200640 1 --2- 172.21.15.63:0/2531940600 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fe31806f400 0x7fe3180718c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe32c0af000 tx=0x7fe32c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:27:31.479 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:31.473+0000 7fe334c00640 1 -- 172.21.15.63:0/2531940600 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fe330022070 con 0x7fe33815df50 2024-05-21T01:27:31.645 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:31.641+0000 7fe33fc00640 1 -- 172.21.15.63:0/2531940600 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fe338073680 con 0x7fe33815df50 2024-05-21T01:27:32.249 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:32.245+0000 7fe334c00640 1 -- 172.21.15.63:0/2531940600 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v29) ==== 181+0+0 (secure 0 0 0) 0x7fe330010040 con 0x7fe33815df50 2024-05-21T01:27:32.249 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_metadata' removed 2024-05-21T01:27:32.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:32.245+0000 7fe33fc00640 1 -- 172.21.15.63:0/2531940600 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fe31806f400 msgr2=0x7fe3180718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:27:32.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:32.245+0000 7fe33fc00640 1 --2- 172.21.15.63:0/2531940600 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fe31806f400 0x7fe3180718c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe32c0af000 tx=0x7fe32c008040 comp rx=0 tx=0).stop 2024-05-21T01:27:32.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:32.245+0000 7fe33fc00640 1 -- 172.21.15.63:0/2531940600 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe33815df50 msgr2=0x7fe33814e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:27:32.251 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:32.245+0000 7fe33fc00640 1 --2- 172.21.15.63:0/2531940600 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe33815df50 0x7fe33814e560 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fe33000efc0 tx=0x7fe33000c490 comp rx=0 tx=0).stop 2024-05-21T01:27:32.252 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:32.249+0000 7fe33fc00640 1 -- 172.21.15.63:0/2531940600 shutdown_connections 2024-05-21T01:27:32.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:32.249+0000 7fe33fc00640 1 --2- 172.21.15.63:0/2531940600 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7fe31806f400 0x7fe3180718c0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:32.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:32.249+0000 7fe33fc00640 1 --2- 172.21.15.63:0/2531940600 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe33815df50 0x7fe33814e560 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:32.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:32.249+0000 7fe33fc00640 1 --2- 172.21.15.63:0/2531940600 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe338159cb0 0x7fe33814e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:32.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:32.249+0000 7fe33fc00640 1 --2- 172.21.15.63:0/2531940600 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe338154000 0x7fe338072c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:32.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:32.249+0000 7fe33fc00640 1 -- 172.21.15.63:0/2531940600 >> 172.21.15.63:0/2531940600 conn(0x7fe33806efc0 msgr2=0x7fe3380cbdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:27:32.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:32.249+0000 7fe33fc00640 1 -- 172.21.15.63:0/2531940600 shutdown_connections 2024-05-21T01:27:32.253 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:32.249+0000 7fe33fc00640 1 -- 172.21.15.63:0/2531940600 wait complete. 2024-05-21T01:27:32.277 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-21T01:27:32.424 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:32.421+0000 7f6250e00640 1 Processor -- start 2024-05-21T01:27:32.425 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:32.421+0000 7f6250e00640 1 -- start start 2024-05-21T01:27:32.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:32.421+0000 7f6250e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f624c1564c0 0x7f624c0c9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:27:32.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:32.421+0000 7f6250e00640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f624c0cb510 0x7f624c0ca930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:27:32.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:32.421+0000 7f6250e00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f624c0c91f0 con 0x7f624c0cb130 2024-05-21T01:27:32.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:32.421+0000 7f6250e00640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 -- 0x7f624c06db80 con 0x7f624c0cb510 2024-05-21T01:27:32.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:32.421+0000 7f6250e00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f624c06d6f0 con 0x7f624c1564c0 2024-05-21T01:27:32.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:32.421+0000 7f624a800640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f624c0cb510 0x7f624c0ca930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:27:32.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:32.421+0000 7f624a800640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f624c0cb510 0x7f624c0ca930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43496/0 (socket says 172.21.15.63:43496) 2024-05-21T01:27:32.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:32.421+0000 7f624a800640 1 -- 172.21.15.63:0/1952647960 learned_addr learned my addr 172.21.15.63:0/1952647960 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:27:32.426 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:32.421+0000 7f6243e00640 1 --2- 172.21.15.63:0/1952647960 >> v2:172.21.15.131:3300/0 conn(0x7f624c1564c0 0x7f624c0c9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:27:32.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:32.421+0000 7f624a800640 1 -- 172.21.15.63:0/1952647960 >> v2:172.21.15.131:3300/0 conn(0x7f624c1564c0 msgr2=0x7f624c0c9dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T01:27:32.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:32.421+0000 7f624a800640 1 --2- 172.21.15.63:0/1952647960 >> v2:172.21.15.131:3300/0 conn(0x7f624c1564c0 0x7f624c0c9dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:32.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:32.421+0000 7f624a800640 1 -- 172.21.15.63:0/1952647960 >> v1:172.21.15.131:6789/0 conn(0x7f624c0cb130 legacy=0x7f624c155db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:27:32.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:32.421+0000 7f624a800640 1 -- 172.21.15.63:0/1952647960 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f624c0c8f30 con 0x7f624c0cb510 2024-05-21T01:27:32.427 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:32.421+0000 7f6243e00640 1 --2- 172.21.15.63:0/1952647960 >> v2:172.21.15.131:3300/0 conn(0x7f624c1564c0 0x7f624c0c9dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T01:27:32.429 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:32.425+0000 7f624a800640 1 --2- 172.21.15.63:0/1952647960 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f624c0cb510 0x7f624c0ca930 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f624c0c5720 tx=0x7f624401c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd2b4a395581b05a server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:27:32.429 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:32.425+0000 7f6249400640 1 -- 172.21.15.63:0/1952647960 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62440a5880 con 0x7f624c0cb510 2024-05-21T01:27:32.429 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:32.425+0000 7f6249400640 1 -- 172.21.15.63:0/1952647960 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f62440a5a20 con 0x7f624c0cb510 2024-05-21T01:27:32.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:32.425+0000 7f6249400640 1 -- 172.21.15.63:0/1952647960 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62440a5e10 con 0x7f624c0cb510 2024-05-21T01:27:32.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:32.425+0000 7f6250e00640 1 -- 172.21.15.63:0/1952647960 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f624c0cb510 msgr2=0x7f624c0ca930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:27:32.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:32.425+0000 7f6250e00640 1 --2- 172.21.15.63:0/1952647960 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f624c0cb510 0x7f624c0ca930 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f624c0c5720 tx=0x7f624401c9c0 comp rx=0 tx=0).stop 2024-05-21T01:27:32.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:32.425+0000 7f6250e00640 1 -- 172.21.15.63:0/1952647960 shutdown_connections 2024-05-21T01:27:32.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:32.425+0000 7f6250e00640 1 --2- 172.21.15.63:0/1952647960 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f624c0cb510 0x7f624c0ca930 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:32.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:32.425+0000 7f6250e00640 1 --2- 172.21.15.63:0/1952647960 >> v2:172.21.15.131:3300/0 conn(0x7f624c1564c0 0x7f624c0c9dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:32.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:32.425+0000 7f6250e00640 1 -- 172.21.15.63:0/1952647960 >> 172.21.15.63:0/1952647960 conn(0x7f624c0700d0 msgr2=0x7f624c0704e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:27:32.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:32.425+0000 7f6250e00640 1 -- 172.21.15.63:0/1952647960 shutdown_connections 2024-05-21T01:27:32.431 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:32.425+0000 7f6250e00640 1 -- 172.21.15.63:0/1952647960 wait complete. 2024-05-21T01:27:32.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:32.429+0000 7f6250e00640 1 Processor -- start 2024-05-21T01:27:32.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:32.429+0000 7f6250e00640 1 -- start start 2024-05-21T01:27:32.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:32.429+0000 7f6250e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f624c0cb130 0x7f624c14bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:27:32.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:32.429+0000 7f6250e00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f624c0cb510 0x7f624c14f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:27:32.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:32.429+0000 7f6250e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f624c1564c0 0x7f624c149880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:27:32.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:32.429+0000 7f6250e00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f624c1689c0 con 0x7f624c0cb130 2024-05-21T01:27:32.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:32.429+0000 7f6250e00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f624c168840 con 0x7f624c1564c0 2024-05-21T01:27:32.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:32.429+0000 7f6250e00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f624c168b40 con 0x7f624c0cb510 2024-05-21T01:27:32.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:32.429+0000 7f6249e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f624c0cb130 0x7f624c14bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:27:32.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:32.429+0000 7f6249e00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f624c0cb130 0x7f624c14bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43500/0 (socket says 172.21.15.63:43500) 2024-05-21T01:27:32.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:32.429+0000 7f6249e00640 1 -- 172.21.15.63:0/3065035342 learned_addr learned my addr 172.21.15.63:0/3065035342 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:27:32.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:32.429+0000 7f6243e00640 1 --2- 172.21.15.63:0/3065035342 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f624c0cb510 0x7f624c14f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:27:32.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:32.429+0000 7f624a800640 1 --2- 172.21.15.63:0/3065035342 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f624c1564c0 0x7f624c149880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:27:32.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:32.429+0000 7f6249e00640 1 -- 172.21.15.63:0/3065035342 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f624c0cb510 msgr2=0x7f624c14f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:27:32.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:32.429+0000 7f6249e00640 1 --2- 172.21.15.63:0/3065035342 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f624c0cb510 0x7f624c14f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:32.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:32.429+0000 7f6249e00640 1 -- 172.21.15.63:0/3065035342 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f624c1564c0 msgr2=0x7f624c149880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:27:32.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:32.429+0000 7f6249e00640 1 --2- 172.21.15.63:0/3065035342 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f624c1564c0 0x7f624c149880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:32.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:32.429+0000 7f6249e00640 1 -- 172.21.15.63:0/3065035342 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f624c14f120 con 0x7f624c0cb130 2024-05-21T01:27:32.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:32.429+0000 7f6249e00640 1 --2- 172.21.15.63:0/3065035342 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f624c0cb130 0x7f624c14bf50 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f623c00c530 tx=0x7f623c00c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:27:32.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:32.429+0000 7f6242000640 1 -- 172.21.15.63:0/3065035342 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f623c017070 con 0x7f624c0cb130 2024-05-21T01:27:32.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:32.429+0000 7f6242000640 1 -- 172.21.15.63:0/3065035342 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f623c0052d0 con 0x7f624c0cb130 2024-05-21T01:27:32.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:32.429+0000 7f6242000640 1 -- 172.21.15.63:0/3065035342 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f623c012890 con 0x7f624c0cb130 2024-05-21T01:27:32.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:32.429+0000 7f6250e00640 1 -- 172.21.15.63:0/3065035342 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f624c1f8560 con 0x7f624c0cb130 2024-05-21T01:27:32.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:32.429+0000 7f6250e00640 1 -- 172.21.15.63:0/3065035342 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f624c1f8b20 con 0x7f624c0cb130 2024-05-21T01:27:32.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:32.429+0000 7f6250e00640 1 -- 172.21.15.63:0/3065035342 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f624c06c1a0 con 0x7f624c0cb130 2024-05-21T01:27:32.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:32.433+0000 7f6242000640 1 -- 172.21.15.63:0/3065035342 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7f623c01a070 con 0x7f624c0cb130 2024-05-21T01:27:32.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:32.433+0000 7f6242000640 1 --2- 172.21.15.63:0/3065035342 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f622806f430 0x7f62280718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:27:32.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:32.433+0000 7f6242000640 1 -- 172.21.15.63:0/3065035342 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6410+0+0 (secure 0 0 0) 0x7f623c08e8a0 con 0x7f624c0cb130 2024-05-21T01:27:32.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:32.433+0000 7f6243e00640 1 --2- 172.21.15.63:0/3065035342 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f622806f430 0x7f62280718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:27:32.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:32.433+0000 7f6243e00640 1 --2- 172.21.15.63:0/3065035342 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f622806f430 0x7f62280718f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f624c152ec0 tx=0x7f6234008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:27:32.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:32.437+0000 7f6242000640 1 -- 172.21.15.63:0/3065035342 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f623c005480 con 0x7f624c0cb130 2024-05-21T01:27:32.606 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:32.601+0000 7f6250e00640 1 -- 172.21.15.63:0/3065035342 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f624c0c9e00 con 0x7f624c0cb130 2024-05-21T01:27:33.256 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:33.253+0000 7f6242000640 1 -- 172.21.15.63:0/3065035342 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v30) ==== 169+0+0 (secure 0 0 0) 0x7f623c05b4c0 con 0x7f624c0cb130 2024-05-21T01:27:33.257 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_data' removed 2024-05-21T01:27:33.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:33.253+0000 7f6250e00640 1 -- 172.21.15.63:0/3065035342 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f622806f430 msgr2=0x7f62280718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:27:33.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:33.253+0000 7f6250e00640 1 --2- 172.21.15.63:0/3065035342 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f622806f430 0x7f62280718f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f624c152ec0 tx=0x7f6234008040 comp rx=0 tx=0).stop 2024-05-21T01:27:33.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:33.253+0000 7f6250e00640 1 -- 172.21.15.63:0/3065035342 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f624c0cb130 msgr2=0x7f624c14bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:27:33.259 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:33.253+0000 7f6250e00640 1 --2- 172.21.15.63:0/3065035342 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f624c0cb130 0x7f624c14bf50 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f623c00c530 tx=0x7f623c00c9f0 comp rx=0 tx=0).stop 2024-05-21T01:27:33.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:33.253+0000 7f6250e00640 1 -- 172.21.15.63:0/3065035342 shutdown_connections 2024-05-21T01:27:33.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:33.253+0000 7f6250e00640 1 --2- 172.21.15.63:0/3065035342 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f622806f430 0x7f62280718f0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:33.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:33.253+0000 7f6250e00640 1 --2- 172.21.15.63:0/3065035342 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f624c1564c0 0x7f624c149880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:33.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:33.253+0000 7f6250e00640 1 --2- 172.21.15.63:0/3065035342 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f624c0cb510 0x7f624c14f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:33.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:33.253+0000 7f6250e00640 1 --2- 172.21.15.63:0/3065035342 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f624c0cb130 0x7f624c14bf50 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:33.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:33.253+0000 7f6250e00640 1 -- 172.21.15.63:0/3065035342 >> 172.21.15.63:0/3065035342 conn(0x7f624c0700d0 msgr2=0x7f624c0c6a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:27:33.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:33.257+0000 7f6250e00640 1 -- 172.21.15.63:0/3065035342 shutdown_connections 2024-05-21T01:27:33.261 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:33.257+0000 7f6250e00640 1 -- 172.21.15.63:0/3065035342 wait complete. 2024-05-21T01:27:33.283 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-05-21T01:27:33.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:33.425+0000 7f91cbc00640 1 Processor -- start 2024-05-21T01:27:33.430 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:33.425+0000 7f91cbc00640 1 -- start start 2024-05-21T01:27:33.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:33.425+0000 7f91cbc00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f91c406d240 0x7f91c406d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:27:33.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:33.425+0000 7f91cbc00640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91c41543e0 con 0x7f91c4154000 2024-05-21T01:27:33.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:33.425+0000 7f91cbc00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91c415b1a0 con 0x7f91c4159cb0 2024-05-21T01:27:33.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:33.425+0000 7f91cbc00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f91c415d2a0 con 0x7f91c406d240 2024-05-21T01:27:33.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:33.429+0000 7f91c9200640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f91c4154000 0x7f91c415da10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:45202/0 (socket says 172.21.15.63:45202) 2024-05-21T01:27:33.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:33.429+0000 7f91c9200640 1 -- 172.21.15.63:0/1575769696 learned_addr learned my addr 172.21.15.63:0/1575769696 (peer_addr_for_me v1:172.21.15.63:0/0) 2024-05-21T01:27:33.432 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:33.429+0000 7f91c9c00640 1 --2- 172.21.15.63:0/1575769696 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f91c406d240 0x7f91c406d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:27:33.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:33.429+0000 7f91c3e00640 1 -- 172.21.15.63:0/1575769696 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3087540587 0 0) 0x7f91b4001120 con 0x7f91c4154000 2024-05-21T01:27:33.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:33.429+0000 7f91c3e00640 1 -- 172.21.15.63:0/1575769696 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f91a8003530 con 0x7f91c4154000 2024-05-21T01:27:33.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:33.429+0000 7f91c3e00640 1 -- 172.21.15.63:0/1575769696 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2990562711 0 0) 0x7f91c415b1a0 con 0x7f91c4159cb0 2024-05-21T01:27:33.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:33.429+0000 7f91c3e00640 1 -- 172.21.15.63:0/1575769696 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f91b4001120 con 0x7f91c4159cb0 2024-05-21T01:27:33.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:33.429+0000 7f91c3e00640 1 -- 172.21.15.63:0/1575769696 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4206319638 0 0) 0x7f91a8003530 con 0x7f91c4154000 2024-05-21T01:27:33.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:33.429+0000 7f91c9c00640 1 -- 172.21.15.63:0/1575769696 >> v1:172.21.15.131:6789/0 conn(0x7f91c4159cb0 legacy=0x7f91c40735e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:27:33.433 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:33.429+0000 7f91c9c00640 1 -- 172.21.15.63:0/1575769696 >> v1:172.21.15.63:6789/0 conn(0x7f91c4154000 legacy=0x7f91c415da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:27:33.434 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:33.429+0000 7f91c9c00640 1 -- 172.21.15.63:0/1575769696 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91c415a1f0 con 0x7f91c406d240 2024-05-21T01:27:33.435 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:33.429+0000 7f91c9c00640 1 --2- 172.21.15.63:0/1575769696 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f91c406d240 0x7f91c406d6b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f91bc009dc0 tx=0x7f91bc01c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56fe2ad2b563b9d3 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:27:33.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:33.433+0000 7f91c3e00640 1 -- 172.21.15.63:0/1575769696 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91bc0b2070 con 0x7f91c406d240 2024-05-21T01:27:33.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:33.433+0000 7f91c3e00640 1 -- 172.21.15.63:0/1575769696 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f91bc0a5600 con 0x7f91c406d240 2024-05-21T01:27:33.436 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:33.433+0000 7f91c3e00640 1 -- 172.21.15.63:0/1575769696 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91b40018d0 con 0x7f91c406d240 2024-05-21T01:27:33.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:33.433+0000 7f91cbc00640 1 -- 172.21.15.63:0/1575769696 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f91c406d240 msgr2=0x7f91c406d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:27:33.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:33.433+0000 7f91cbc00640 1 --2- 172.21.15.63:0/1575769696 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f91c406d240 0x7f91c406d6b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f91bc009dc0 tx=0x7f91bc01c8b0 comp rx=0 tx=0).stop 2024-05-21T01:27:33.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:33.433+0000 7f91cbc00640 1 -- 172.21.15.63:0/1575769696 shutdown_connections 2024-05-21T01:27:33.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:33.433+0000 7f91cbc00640 1 --2- 172.21.15.63:0/1575769696 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f91c406d240 0x7f91c406d6b0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:33.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:33.433+0000 7f91cbc00640 1 -- 172.21.15.63:0/1575769696 >> 172.21.15.63:0/1575769696 conn(0x7f91c406efc0 msgr2=0x7f91c406f3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:27:33.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:33.433+0000 7f91cbc00640 1 -- 172.21.15.63:0/1575769696 shutdown_connections 2024-05-21T01:27:33.437 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:33.433+0000 7f91cbc00640 1 -- 172.21.15.63:0/1575769696 wait complete. 2024-05-21T01:27:33.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:33.433+0000 7f91cbc00640 1 Processor -- start 2024-05-21T01:27:33.438 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:33.433+0000 7f91cbc00640 1 -- start start 2024-05-21T01:27:33.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:33.433+0000 7f91cbc00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f91c406d240 0x7f91c413eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:27:33.439 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:33.433+0000 7f91cbc00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f91c4154000 0x7f91c4142510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:27:33.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:33.433+0000 7f91cbc00640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f91c4159cb0 0x7f91c413cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:27:33.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:33.433+0000 7f91cbc00640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 -- 0x7f91c415e120 con 0x7f91c4154000 2024-05-21T01:27:33.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:33.433+0000 7f91cbc00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f91c415d4f0 con 0x7f91c406d240 2024-05-21T01:27:33.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:33.433+0000 7f91cbc00640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 -- 0x7f91c4073cf0 con 0x7f91c4159cb0 2024-05-21T01:27:33.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:33.433+0000 7f91bbe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f91c4154000 0x7f91c4142510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:27:33.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:33.433+0000 7f91bbe00640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f91c4154000 0x7f91c4142510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:43514/0 (socket says 172.21.15.63:43514) 2024-05-21T01:27:33.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:33.433+0000 7f91bbe00640 1 -- 172.21.15.63:0/2708889917 learned_addr learned my addr 172.21.15.63:0/2708889917 (peer_addr_for_me v2:172.21.15.63:0/0) 2024-05-21T01:27:33.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:33.433+0000 7f91c9200640 1 --2- 172.21.15.63:0/2708889917 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f91c406d240 0x7f91c413eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:27:33.440 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:33.433+0000 7f91c9c00640 1 --2- 172.21.15.63:0/2708889917 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f91c4159cb0 0x7f91c413cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:27:33.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:33.437+0000 7f91bbe00640 1 -- 172.21.15.63:0/2708889917 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f91c4159cb0 msgr2=0x7f91c413cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:27:33.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:33.437+0000 7f91bbe00640 1 --2- 172.21.15.63:0/2708889917 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f91c4159cb0 0x7f91c413cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:33.441 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:33.437+0000 7f91bbe00640 1 -- 172.21.15.63:0/2708889917 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f91c406d240 msgr2=0x7f91c413eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:27:33.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:33.437+0000 7f91bbe00640 1 --2- 172.21.15.63:0/2708889917 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f91c406d240 0x7f91c413eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:33.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:33.437+0000 7f91bbe00640 1 -- 172.21.15.63:0/2708889917 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91c413f1e0 con 0x7f91c4154000 2024-05-21T01:27:33.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:33.437+0000 7f91c9c00640 1 --2- 172.21.15.63:0/2708889917 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f91c4159cb0 0x7f91c413cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T01:27:33.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:33.437+0000 7f91bbe00640 1 --2- 172.21.15.63:0/2708889917 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f91c4154000 0x7f91c4142510 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f91ac00c530 tx=0x7f91ac00c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:27:33.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:33.437+0000 7f91c1600640 1 -- 172.21.15.63:0/2708889917 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91ac0052d0 con 0x7f91c4154000 2024-05-21T01:27:33.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:33.437+0000 7f91c1600640 1 -- 172.21.15.63:0/2708889917 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f91ac005490 con 0x7f91c4154000 2024-05-21T01:27:33.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:33.437+0000 7f91cbc00640 1 -- 172.21.15.63:0/2708889917 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91c41f8300 con 0x7f91c4154000 2024-05-21T01:27:33.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:33.437+0000 7f91c1600640 1 -- 172.21.15.63:0/2708889917 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91ac012870 con 0x7f91c4154000 2024-05-21T01:27:33.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:33.437+0000 7f91cbc00640 1 -- 172.21.15.63:0/2708889917 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91c41f88c0 con 0x7f91c4154000 2024-05-21T01:27:33.442 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:33.437+0000 7f91cbc00640 1 -- 172.21.15.63:0/2708889917 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91c40c5300 con 0x7f91c4154000 2024-05-21T01:27:33.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:33.437+0000 7f91c1600640 1 -- 172.21.15.63:0/2708889917 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 6) ==== 93207+0+0 (secure 0 0 0) 0x7f91ac012a10 con 0x7f91c4154000 2024-05-21T01:27:33.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:33.437+0000 7f91c1600640 1 --2- 172.21.15.63:0/2708889917 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f91a006f400 0x7f91a00718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T01:27:33.443 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:33.437+0000 7f91c1600640 1 -- 172.21.15.63:0/2708889917 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5967+0+0 (secure 0 0 0) 0x7f91ac08ef50 con 0x7f91c4154000 2024-05-21T01:27:33.444 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:33.441+0000 7f91c9200640 1 --2- 172.21.15.63:0/2708889917 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f91a006f400 0x7f91a00718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T01:27:33.445 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:33.441+0000 7f91c9200640 1 --2- 172.21.15.63:0/2708889917 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f91a006f400 0x7f91a00718c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f91b4001a40 tx=0x7f91b40018b0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T01:27:33.448 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:33.445+0000 7f91c1600640 1 -- 172.21.15.63:0/2708889917 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f91ac05be60 con 0x7f91c4154000 2024-05-21T01:27:33.617 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:33.613+0000 7f91cbc00640 1 -- 172.21.15.63:0/2708889917 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f91c406c1a0 con 0x7f91c4154000 2024-05-21T01:27:34.260 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:34.257+0000 7f91c1600640 1 -- 172.21.15.63:0/2708889917 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v31) ==== 178+0+0 (secure 0 0 0) 0x7f91ac05b760 con 0x7f91c4154000 2024-05-21T01:27:34.260 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_data_ec' removed 2024-05-21T01:27:34.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:34.257+0000 7f91cbc00640 1 -- 172.21.15.63:0/2708889917 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f91a006f400 msgr2=0x7f91a00718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:27:34.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:34.257+0000 7f91cbc00640 1 --2- 172.21.15.63:0/2708889917 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f91a006f400 0x7f91a00718c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f91b4001a40 tx=0x7f91b40018b0 comp rx=0 tx=0).stop 2024-05-21T01:27:34.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:34.261+0000 7f91cbc00640 1 -- 172.21.15.63:0/2708889917 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f91c4154000 msgr2=0x7f91c4142510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T01:27:34.264 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:34.261+0000 7f91cbc00640 1 --2- 172.21.15.63:0/2708889917 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f91c4154000 0x7f91c4142510 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f91ac00c530 tx=0x7f91ac00c9f0 comp rx=0 tx=0).stop 2024-05-21T01:27:34.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:34.261+0000 7f91cbc00640 1 -- 172.21.15.63:0/2708889917 shutdown_connections 2024-05-21T01:27:34.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:34.261+0000 7f91cbc00640 1 --2- 172.21.15.63:0/2708889917 >> [v2:172.21.15.131:6832/921953667,v1:172.21.15.131:6833/921953667] conn(0x7f91a006f400 0x7f91a00718c0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:34.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:34.261+0000 7f91cbc00640 1 --2- 172.21.15.63:0/2708889917 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f91c4159cb0 0x7f91c413cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:34.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:34.261+0000 7f91cbc00640 1 --2- 172.21.15.63:0/2708889917 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f91c4154000 0x7f91c4142510 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:34.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:34.261+0000 7f91cbc00640 1 --2- 172.21.15.63:0/2708889917 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f91c406d240 0x7f91c413eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T01:27:34.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:34.261+0000 7f91cbc00640 1 -- 172.21.15.63:0/2708889917 >> 172.21.15.63:0/2708889917 conn(0x7f91c406efc0 msgr2=0x7f91c415da10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T01:27:34.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:34.261+0000 7f91cbc00640 1 -- 172.21.15.63:0/2708889917 shutdown_connections 2024-05-21T01:27:34.265 INFO:teuthology.orchestra.run.smithi063.stderr:2024-05-21T01:27:34.261+0000 7f91cbc00640 1 -- 172.21.15.63:0/2708889917 wait complete. 2024-05-21T01:27:34.291 INFO:teuthology.misc:Shutting down mds daemons... 2024-05-21T01:27:34.292 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-21T01:27:34.292 INFO:teuthology.orchestra.run:waiting for 300 2024-05-21T01:27:34.304 INFO:tasks.ceph.mds.a:Stopped 2024-05-21T01:27:34.305 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-21T01:27:34.305 INFO:teuthology.orchestra.run:waiting for 300 2024-05-21T01:27:34.364 INFO:tasks.ceph.mds.c:Stopped 2024-05-21T01:27:34.365 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2024-05-21T01:27:34.365 INFO:teuthology.orchestra.run:waiting for 300 2024-05-21T01:27:34.420 INFO:tasks.ceph.mds.e:Stopped 2024-05-21T01:27:34.420 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-21T01:27:34.420 INFO:teuthology.orchestra.run:waiting for 300 2024-05-21T01:27:34.437 INFO:tasks.ceph.mds.b:Stopped 2024-05-21T01:27:34.437 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-21T01:27:34.437 INFO:teuthology.orchestra.run:waiting for 300 2024-05-21T01:27:34.501 INFO:tasks.ceph.mds.d:Stopped 2024-05-21T01:27:34.501 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2024-05-21T01:27:34.501 INFO:teuthology.orchestra.run:waiting for 300 2024-05-21T01:27:34.558 INFO:tasks.ceph.mds.f:Stopped 2024-05-21T01:27:34.558 INFO:teuthology.misc:Shutting down osd daemons... 2024-05-21T01:27:34.558 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-05-21T01:27:34.558 INFO:teuthology.orchestra.run:waiting for 300 2024-05-21T01:27:34.652 INFO:tasks.ceph.osd.0:Stopped 2024-05-21T01:27:34.652 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-05-21T01:27:34.652 INFO:teuthology.orchestra.run:waiting for 300 2024-05-21T01:27:39.977 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-05-21T01:27:40.754 INFO:tasks.ceph.osd.1:Stopped 2024-05-21T01:27:40.754 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-05-21T01:27:40.754 INFO:teuthology.orchestra.run:waiting for 300 2024-05-21T01:27:40.833 INFO:tasks.ceph.osd.2:Stopped 2024-05-21T01:27:40.833 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-05-21T01:27:40.833 INFO:teuthology.orchestra.run:waiting for 300 2024-05-21T01:27:45.885 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-05-21T01:27:45.885 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-05-21T01:27:46.934 INFO:tasks.ceph.osd.3:Stopped 2024-05-21T01:27:46.935 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-05-21T01:27:46.935 INFO:teuthology.orchestra.run:waiting for 300 2024-05-21T01:27:47.005 INFO:tasks.ceph.osd.4:Stopped 2024-05-21T01:27:47.006 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-05-21T01:27:47.006 INFO:teuthology.orchestra.run:waiting for 300 2024-05-21T01:27:47.101 INFO:tasks.ceph.osd.5:Stopped 2024-05-21T01:27:47.101 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-05-21T01:27:47.101 INFO:teuthology.orchestra.run:waiting for 300 2024-05-21T01:27:47.164 INFO:tasks.ceph.osd.6:Stopped 2024-05-21T01:27:47.164 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-05-21T01:27:47.164 INFO:teuthology.orchestra.run:waiting for 300 2024-05-21T01:27:47.257 INFO:tasks.ceph.osd.7:Stopped 2024-05-21T01:27:47.257 INFO:teuthology.misc:Shutting down mgr daemons... 2024-05-21T01:27:47.257 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-05-21T01:27:47.257 INFO:teuthology.orchestra.run:waiting for 300 2024-05-21T01:27:47.314 INFO:tasks.ceph.mgr.y:Stopped 2024-05-21T01:27:47.315 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-05-21T01:27:47.315 INFO:teuthology.orchestra.run:waiting for 300 2024-05-21T01:27:47.344 INFO:tasks.ceph.mgr.x:Stopped 2024-05-21T01:27:47.345 INFO:teuthology.misc:Shutting down mon daemons... 2024-05-21T01:27:47.345 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-05-21T01:27:47.345 INFO:teuthology.orchestra.run:waiting for 300 2024-05-21T01:27:47.363 INFO:tasks.ceph.mon.a:Stopped 2024-05-21T01:27:47.364 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-05-21T01:27:47.364 INFO:teuthology.orchestra.run:waiting for 300 2024-05-21T01:27:47.405 INFO:tasks.ceph.mon.b:Stopped 2024-05-21T01:27:47.405 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-05-21T01:27:47.405 INFO:teuthology.orchestra.run:waiting for 300 2024-05-21T01:27:47.468 INFO:tasks.ceph.mon.c:Stopped 2024-05-21T01:27:47.468 INFO:tasks.ceph:Checking cluster log for badness... 2024-05-21T01:27:47.468 DEBUG:teuthology.orchestra.run.smithi063:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | head -n 1 2024-05-21T01:27:47.517 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi063.front.sepia.ceph.com 2024-05-21T01:27:47.518 DEBUG:teuthology.orchestra.run.smithi063:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-05-21T01:27:47.778 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi063.front.sepia.ceph.com 2024-05-21T01:27:47.778 DEBUG:teuthology.orchestra.run.smithi063:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-05-21T01:27:47.984 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi063.front.sepia.ceph.com 2024-05-21T01:27:47.984 DEBUG:teuthology.orchestra.run.smithi063:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-05-21T01:27:48.167 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi063.front.sepia.ceph.com 2024-05-21T01:27:48.168 DEBUG:teuthology.orchestra.run.smithi063:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-05-21T01:27:48.368 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi131.front.sepia.ceph.com 2024-05-21T01:27:48.368 DEBUG:teuthology.orchestra.run.smithi131:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-05-21T01:27:48.778 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi131.front.sepia.ceph.com 2024-05-21T01:27:48.778 DEBUG:teuthology.orchestra.run.smithi131:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-05-21T01:27:48.979 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi131.front.sepia.ceph.com 2024-05-21T01:27:48.979 DEBUG:teuthology.orchestra.run.smithi131:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-05-21T01:27:49.170 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi131.front.sepia.ceph.com 2024-05-21T01:27:49.170 DEBUG:teuthology.orchestra.run.smithi131:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-05-21T01:27:49.395 INFO:tasks.ceph:Archiving mon data... 2024-05-21T01:27:49.397 DEBUG:teuthology.misc:Transferring archived files from smithi063:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/leonidus-2024-05-20_23:57:18-fs-wip-lusov-quiesce-no-remote-ap-distro-default-smithi/7717467/data/mon.a.tgz 2024-05-21T01:27:49.397 DEBUG:teuthology.orchestra.run.smithi063:> mktemp 2024-05-21T01:27:49.407 INFO:teuthology.orchestra.run.smithi063.stdout:/tmp/tmp.vPvGc2JwC2 2024-05-21T01:27:49.407 DEBUG:teuthology.orchestra.run.smithi063:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.vPvGc2JwC2 2024-05-21T01:27:49.557 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 0666 /tmp/tmp.vPvGc2JwC2 2024-05-21T01:27:49.636 DEBUG:teuthology.orchestra.remote:smithi063:/tmp/tmp.vPvGc2JwC2 is 399KB 2024-05-21T01:27:49.701 DEBUG:teuthology.orchestra.run.smithi063:> rm -fr /tmp/tmp.vPvGc2JwC2 2024-05-21T01:27:49.710 DEBUG:teuthology.misc:Transferring archived files from smithi131:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/leonidus-2024-05-20_23:57:18-fs-wip-lusov-quiesce-no-remote-ap-distro-default-smithi/7717467/data/mon.b.tgz 2024-05-21T01:27:49.710 DEBUG:teuthology.orchestra.run.smithi131:> mktemp 2024-05-21T01:27:49.716 INFO:teuthology.orchestra.run.smithi131.stdout:/tmp/tmp.5XBUqP42to 2024-05-21T01:27:49.716 DEBUG:teuthology.orchestra.run.smithi131:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.5XBUqP42to 2024-05-21T01:27:49.880 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 0666 /tmp/tmp.5XBUqP42to 2024-05-21T01:27:49.940 DEBUG:teuthology.orchestra.remote:smithi131:/tmp/tmp.5XBUqP42to is 525KB 2024-05-21T01:27:50.003 DEBUG:teuthology.orchestra.run.smithi131:> rm -fr /tmp/tmp.5XBUqP42to 2024-05-21T01:27:50.009 DEBUG:teuthology.misc:Transferring archived files from smithi131:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/leonidus-2024-05-20_23:57:18-fs-wip-lusov-quiesce-no-remote-ap-distro-default-smithi/7717467/data/mon.c.tgz 2024-05-21T01:27:50.009 DEBUG:teuthology.orchestra.run.smithi131:> mktemp 2024-05-21T01:27:50.057 INFO:teuthology.orchestra.run.smithi131.stdout:/tmp/tmp.5dTPErO5Rd 2024-05-21T01:27:50.058 DEBUG:teuthology.orchestra.run.smithi131:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.5dTPErO5Rd 2024-05-21T01:27:50.230 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 0666 /tmp/tmp.5dTPErO5Rd 2024-05-21T01:27:50.293 DEBUG:teuthology.orchestra.remote:smithi131:/tmp/tmp.5dTPErO5Rd is 525KB 2024-05-21T01:27:50.357 DEBUG:teuthology.orchestra.run.smithi131:> rm -fr /tmp/tmp.5dTPErO5Rd 2024-05-21T01:27:50.363 INFO:tasks.ceph:Cleaning ceph cluster... 2024-05-21T01:27:50.363 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-21T01:27:50.366 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-21T01:27:50.436 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-21T01:27:50.465 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-21T01:27:50.466 INFO:tasks.ceph:Archiving crash dumps... 2024-05-21T01:27:50.468 DEBUG:teuthology.misc:Transferring archived files from smithi063:/var/lib/ceph/crash to /home/teuthworker/archive/leonidus-2024-05-20_23:57:18-fs-wip-lusov-quiesce-no-remote-ap-distro-default-smithi/7717467/remote/smithi063/crash 2024-05-21T01:27:50.469 DEBUG:teuthology.orchestra.run.smithi063:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-21T01:27:50.500 DEBUG:teuthology.misc:Transferring archived files from smithi131:/var/lib/ceph/crash to /home/teuthworker/archive/leonidus-2024-05-20_23:57:18-fs-wip-lusov-quiesce-no-remote-ap-distro-default-smithi/7717467/remote/smithi131/crash 2024-05-21T01:27:50.502 DEBUG:teuthology.orchestra.run.smithi131:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-21T01:27:50.521 INFO:tasks.ceph:Shutting down logrotate 2024-05-21T01:27:50.521 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-21T01:27:50.546 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-21T01:27:50.614 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-21T01:27:50.636 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-21T01:27:50.648 INFO:tasks.ceph:Compressing logs... 2024-05-21T01:27:50.648 DEBUG:teuthology.orchestra.run.smithi063:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-21T01:27:50.686 DEBUG:teuthology.orchestra.run.smithi131:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-21T01:27:50.715 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32594.log 2024-05-21T01:27:50.716 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32369.log 2024-05-21T01:27:50.716 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28258.log 2024-05-21T01:27:50.719 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.32594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32812.log 2024-05-21T01:27:50.719 INFO:teuthology.orchestra.run.smithi063.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.32594.log.gz 2024-05-21T01:27:50.719 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.32369.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-05-21T01:27:50.719 INFO:teuthology.orchestra.run.smithi063.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.32369.log.gz 2024-05-21T01:27:50.720 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.32812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32317.log 2024-05-21T01:27:50.720 INFO:teuthology.orchestra.run.smithi063.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.32812.log.gz 2024-05-21T01:27:50.720 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35643.log 2024-05-21T01:27:50.721 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28210.log 2024-05-21T01:27:50.721 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.28258.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-05-21T01:27:50.721 INFO:teuthology.orchestra.run.smithi131.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.28258.log.gz 2024-05-21T01:27:50.721 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.28210.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-05-21T01:27:50.721 INFO:teuthology.orchestra.run.smithi131.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.28210.log.gz 2024-05-21T01:27:50.721 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28306.log 2024-05-21T01:27:50.721 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-05-21T01:27:50.721 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.28306.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-05-21T01:27:50.721 INFO:teuthology.orchestra.run.smithi131.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.28306.log.gz 2024-05-21T01:27:50.722 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28234.log 2024-05-21T01:27:50.722 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.f.log 2024-05-21T01:27:50.722 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph-client.admin.28234.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-21T01:27:50.722 INFO:teuthology.orchestra.run.smithi131.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.28234.log.gz 2024-05-21T01:27:50.722 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28330.log 2024-05-21T01:27:50.725 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-05-21T01:27:50.725 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.28330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28186.log 2024-05-21T01:27:50.725 INFO:teuthology.orchestra.run.smithi131.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.28330.log.gz 2024-05-21T01:27:50.726 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-mon.c.log: 92.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-05-21T01:27:50.726 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-21T01:27:50.727 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.32317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32602.log 2024-05-21T01:27:50.728 INFO:teuthology.orchestra.run.smithi063.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.32317.log.gz 2024-05-21T01:27:50.728 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.35643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32525.log 2024-05-21T01:27:50.728 INFO:teuthology.orchestra.run.smithi063.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35643.log.gz 2024-05-21T01:27:50.728 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.32602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32551.log 2024-05-21T01:27:50.728 INFO:teuthology.orchestra.run.smithi063.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32602.log.gz 2024-05-21T01:27:50.728 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.32525.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-05-21T01:27:50.728 INFO:teuthology.orchestra.run.smithi063.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.32525.log.gz 2024-05-21T01:27:50.728 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.32551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32447.log 2024-05-21T01:27:50.728 INFO:teuthology.orchestra.run.smithi063.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32551.log.gz 2024-05-21T01:27:50.728 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-osd.0.log: 94.3% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-05-21T01:27:50.728 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33394.log 2024-05-21T01:27:50.728 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.32447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36125.log 2024-05-21T01:27:50.729 INFO:teuthology.orchestra.run.smithi063.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.32447.log.gz 2024-05-21T01:27:50.729 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.33394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34249.log 2024-05-21T01:27:50.729 INFO:teuthology.orchestra.run.smithi063.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33394.log.gz 2024-05-21T01:27:50.729 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.36125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32585.log 2024-05-21T01:27:50.729 INFO:teuthology.orchestra.run.smithi063.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36125.log.gz 2024-05-21T01:27:50.732 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.34249.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.34249.log.gz 2024-05-21T01:27:50.732 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33939.log 2024-05-21T01:27:50.732 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.32585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34941.log 2024-05-21T01:27:50.732 INFO:teuthology.orchestra.run.smithi063.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.32585.log.gz 2024-05-21T01:27:50.733 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.33939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32590.log 2024-05-21T01:27:50.733 INFO:teuthology.orchestra.run.smithi063.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.33939.log.gz 2024-05-21T01:27:50.733 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.34941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32809.log 2024-05-21T01:27:50.733 INFO:teuthology.orchestra.run.smithi063.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.34941.log.gz 2024-05-21T01:27:50.733 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.32590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35747.log 2024-05-21T01:27:50.733 INFO:teuthology.orchestra.run.smithi063.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.32590.log.gz 2024-05-21T01:27:50.734 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.28186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28282.log 2024-05-21T01:27:50.734 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph.audit.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.28186.log.gz 2024-05-21T01:27:50.734 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-05-21T01:27:50.734 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.28282.log: 88.1% 93.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-21T01:27:50.734 INFO:teuthology.orchestra.run.smithi131.stderr: -- replaced with /var/log/ceph/ceph-client.admin.28282.log.gz 2024-05-21T01:27:50.734 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-05-21T01:27:50.735 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-05-21T01:27:50.735 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-mds.b.log: 93.6% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-05-21T01:27:50.735 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-05-21T01:27:50.735 INFO:teuthology.orchestra.run.smithi131.stderr: 93.5%/var/log/ceph/ceph-mon.b.log: -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-05-21T01:27:50.735 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28354.log 2024-05-21T01:27:50.737 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.32809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33989.log 2024-05-21T01:27:50.737 INFO:teuthology.orchestra.run.smithi063.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.32809.log.gz 2024-05-21T01:27:50.737 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.35747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33237.log 2024-05-21T01:27:50.737 INFO:teuthology.orchestra.run.smithi063.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.35747.log.gz 2024-05-21T01:27:50.737 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.33989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34172.log 2024-05-21T01:27:50.737 INFO:teuthology.orchestra.run.smithi063.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.33989.log.gz 2024-05-21T01:27:50.738 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.33237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35591.log 2024-05-21T01:27:50.738 INFO:teuthology.orchestra.run.smithi063.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33237.log.gz 2024-05-21T01:27:50.738 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.34172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32421.log 2024-05-21T01:27:50.738 INFO:teuthology.orchestra.run.smithi063.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34172.log.gz 2024-05-21T01:27:50.739 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.35591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31409.log 2024-05-21T01:27:50.739 INFO:teuthology.orchestra.run.smithi063.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35591.log.gz 2024-05-21T01:27:50.739 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.32421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34589.log 2024-05-21T01:27:50.739 INFO:teuthology.orchestra.run.smithi063.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.32421.log.gz 2024-05-21T01:27:50.739 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.31409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33315.log 2024-05-21T01:27:50.739 INFO:teuthology.orchestra.run.smithi063.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.31409.log.gz 2024-05-21T01:27:50.740 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.34589.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34589.log.gz 2024-05-21T01:27:50.740 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36099.log 2024-05-21T01:27:50.741 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.33315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32605.log 2024-05-21T01:27:50.741 INFO:teuthology.orchestra.run.smithi063.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33315.log.gz 2024-05-21T01:27:50.742 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.36099.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-05-21T01:27:50.742 INFO:teuthology.orchestra.run.smithi063.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36099.log.gz 2024-05-21T01:27:50.743 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.32605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33027.log 2024-05-21T01:27:50.743 INFO:teuthology.orchestra.run.smithi063.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.32605.log.gz 2024-05-21T01:27:50.744 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32803.log 2024-05-21T01:27:50.745 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.33027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35669.log 2024-05-21T01:27:50.745 INFO:teuthology.orchestra.run.smithi063.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33027.log.gz 2024-05-21T01:27:50.746 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.32803.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32803.log.gz 2024-05-21T01:27:50.746 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33585.log 2024-05-21T01:27:50.747 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.35669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35020.log 2024-05-21T01:27:50.747 INFO:teuthology.orchestra.run.smithi063.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.35669.log.gz 2024-05-21T01:27:50.748 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.33585.log: gzip -5 --verbose 88.9% -- -- replaced with /var/log/ceph/ceph-client.admin.33585.log.gz /var/log/ceph/ceph-client.admin.34509.log 2024-05-21T01:27:50.748 INFO:teuthology.orchestra.run.smithi063.stderr: 2024-05-21T01:27:50.749 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.35020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35931.log 2024-05-21T01:27:50.749 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.34509.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.35020.log.gz 2024-05-21T01:27:50.750 INFO:teuthology.orchestra.run.smithi063.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34509.log.gz 2024-05-21T01:27:50.751 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-05-21T01:27:50.751 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-osd.4.log: /var/log/ceph/ceph-client.admin.28354.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.28354.log.gz 2024-05-21T01:27:50.751 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.22798.log 2024-05-21T01:27:50.752 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.35931.log: /var/log/ceph/ceph-mon.a.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35931.log.gz 2024-05-21T01:27:50.752 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33026.log 2024-05-21T01:27:50.753 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph.tmp-client.admin.22798.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.22798.log.gz 2024-05-21T01:27:50.753 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35357.log 2024-05-21T01:27:50.754 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35695.log 2024-05-21T01:27:50.755 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.33026.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33026.log.gz 2024-05-21T01:27:50.755 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.35357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31812.log 2024-05-21T01:27:50.756 INFO:teuthology.orchestra.run.smithi063.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.35357.log.gz 2024-05-21T01:27:50.757 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.35695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35855.log 2024-05-21T01:27:50.757 INFO:teuthology.orchestra.run.smithi063.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35695.log.gz 2024-05-21T01:27:50.757 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35799.log/var/log/ceph/ceph-client.admin.31812.log: 2024-05-21T01:27:50.758 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.35855.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.31812.log.gz 2024-05-21T01:27:50.758 INFO:teuthology.orchestra.run.smithi063.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.35855.log.gz 2024-05-21T01:27:50.759 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36009.log 2024-05-21T01:27:50.759 INFO:teuthology.orchestra.run.smithi063.stderr:gzip/var/log/ceph/ceph-client.admin.35799.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.33003.log 2024-05-21T01:27:50.760 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.36009.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35799.log.gz 2024-05-21T01:27:50.761 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32395.log 2024-05-21T01:27:50.761 INFO:teuthology.orchestra.run.smithi063.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36009.log.gz 2024-05-21T01:27:50.761 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35383.log 2024-05-21T01:27:50.762 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.33003.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33003.log.gz 2024-05-21T01:27:50.763 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.32395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33263.log 2024-05-21T01:27:50.763 INFO:teuthology.orchestra.run.smithi063.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.32395.log.gz 2024-05-21T01:27:50.764 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.35383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35409.log 2024-05-21T01:27:50.764 INFO:teuthology.orchestra.run.smithi063.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35383.log.gz 2024-05-21T01:27:50.765 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.33263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33014.log 2024-05-21T01:27:50.765 INFO:teuthology.orchestra.run.smithi063.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33263.log.gz 2024-05-21T01:27:50.766 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.35409.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35409.log.gz 2024-05-21T01:27:50.766 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31890.log 2024-05-21T01:27:50.767 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34119.log 2024-05-21T01:27:50.767 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.33014.log: /var/log/ceph/ceph-client.admin.31890.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33014.log.gz 2024-05-21T01:27:50.768 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35773.log 2024-05-21T01:27:50.768 INFO:teuthology.orchestra.run.smithi063.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.31890.log.gz 2024-05-21T01:27:50.769 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.34119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32790.log 2024-05-21T01:27:50.770 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.35773.log: gzip 91.2% -- replaced with /var/log/ceph/ceph-client.admin.34119.log.gz -5 2024-05-21T01:27:50.770 INFO:teuthology.orchestra.run.smithi063.stderr: --verbose -- /var/log/ceph/ceph-client.admin.33289.log 2024-05-21T01:27:50.770 INFO:teuthology.orchestra.run.smithi063.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.35773.log.gz 2024-05-21T01:27:50.771 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.32790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35957.log 2024-05-21T01:27:50.771 INFO:teuthology.orchestra.run.smithi063.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.32790.log.gz 2024-05-21T01:27:50.772 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.33289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27714.log 2024-05-21T01:27:50.773 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.35957.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.33289.log.gz 2024-05-21T01:27:50.773 INFO:teuthology.orchestra.run.smithi063.stderr:gzip 88.7% -5 -- replaced with /var/log/ceph/ceph-client.admin.35957.log.gz --verbose 2024-05-21T01:27:50.773 INFO:teuthology.orchestra.run.smithi063.stderr: -- /var/log/ceph/ceph-client.admin.33769.log 2024-05-21T01:27:50.774 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5/var/log/ceph/ceph-client.admin.27714.log: --verbose -- /var/log/ceph/ceph-osd.3.log 2024-05-21T01:27:50.775 INFO:teuthology.orchestra.run.smithi063.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.27714.log.gz 2024-05-21T01:27:50.775 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.33769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33031.log 2024-05-21T01:27:50.776 INFO:teuthology.orchestra.run.smithi063.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33769.log.gz 2024-05-21T01:27:50.776 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34696.log 2024-05-21T01:27:50.777 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.33031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31864.log 2024-05-21T01:27:50.778 INFO:teuthology.orchestra.run.smithi063.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.33031.log.gz 2024-05-21T01:27:50.779 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.34696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34092.log 2024-05-21T01:27:50.780 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.31864.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.34696.log.gz 2024-05-21T01:27:50.781 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35071.log 2024-05-21T01:27:50.781 INFO:teuthology.orchestra.run.smithi063.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.31864.log.gz 2024-05-21T01:27:50.781 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.34092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34333.log 2024-05-21T01:27:50.781 INFO:teuthology.orchestra.run.smithi063.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.34092.log.gz 2024-05-21T01:27:50.782 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.35071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33904.log 2024-05-21T01:27:50.782 INFO:teuthology.orchestra.run.smithi063.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35071.log.gz 2024-05-21T01:27:50.784 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.34333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32182.log 2024-05-21T01:27:50.784 INFO:teuthology.orchestra.run.smithi063.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34333.log.gz 2024-05-21T01:27:50.785 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.33904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35721.log 2024-05-21T01:27:50.785 INFO:teuthology.orchestra.run.smithi063.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33904.log.gz 2024-05-21T01:27:50.785 INFO:teuthology.orchestra.run.smithi131.stderr: 92.8% -- replaced with /var/log/ceph/ceph-mds.f.log.gz 2024-05-21T01:27:50.786 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.32182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35983.log 2024-05-21T01:27:50.786 INFO:teuthology.orchestra.run.smithi063.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.32182.log.gz 2024-05-21T01:27:50.787 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.35721.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-05-21T01:27:50.787 INFO:teuthology.orchestra.run.smithi063.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35721.log.gz 2024-05-21T01:27:50.788 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.35983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31759.log 2024-05-21T01:27:50.788 INFO:teuthology.orchestra.run.smithi063.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.35983.log.gz 2024-05-21T01:27:50.789 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34863.log 2024-05-21T01:27:50.791 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.31759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33420.log 2024-05-21T01:27:50.791 INFO:teuthology.orchestra.run.smithi063.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.31759.log.gz 2024-05-21T01:27:50.791 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.34863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35905.log 2024-05-21T01:27:50.793 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.33420.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.34863.log.gz 2024-05-21T01:27:50.793 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.35905.log: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.33420.log.gz 2024-05-21T01:27:50.794 INFO:teuthology.orchestra.run.smithi063.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35905.log.gz 2024-05-21T01:27:50.794 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31729.log 2024-05-21T01:27:50.796 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34752.log 2024-05-21T01:27:50.797 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.31729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32499.log 2024-05-21T01:27:50.798 INFO:teuthology.orchestra.run.smithi063.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.31729.log.gz 2024-05-21T01:27:50.798 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.34752.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.34752.log.gz 2024-05-21T01:27:50.799 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.32499.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.32499.log.gz 2024-05-21T01:27:50.800 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35238.log 2024-05-21T01:27:50.801 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35305.log 2024-05-21T01:27:50.802 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.35238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32239.log 2024-05-21T01:27:50.803 INFO:teuthology.orchestra.run.smithi063.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35238.log.gz 2024-05-21T01:27:50.804 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.35305.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35305.log.gz 2024-05-21T01:27:50.805 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.32239.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.32239.log.gz 2024-05-21T01:27:50.806 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36073.log 2024-05-21T01:27:50.807 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31703.log 2024-05-21T01:27:50.808 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.36073.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-21T01:27:50.808 INFO:teuthology.orchestra.run.smithi063.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36073.log.gz 2024-05-21T01:27:50.810 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.31703.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.31703.log.gz 2024-05-21T01:27:50.812 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34991.log 2024-05-21T01:27:50.813 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27604.log 2024-05-21T01:27:50.813 INFO:teuthology.orchestra.run.smithi063.stderr: 86.3% -- replaced with /var/log/ceph/ceph.log.gz 2024-05-21T01:27:50.814 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.34991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31561.log 2024-05-21T01:27:50.815 INFO:teuthology.orchestra.run.smithi063.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.34991.log.gz 2024-05-21T01:27:50.815 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.27604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35617.log 2024-05-21T01:27:50.816 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.31561.log: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.27604.log.gz 2024-05-21T01:27:50.816 INFO:teuthology.orchestra.run.smithi063.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.31561.log.gz 2024-05-21T01:27:50.818 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.35617.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35617.log.gz 2024-05-21T01:27:50.818 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31942.log 2024-05-21T01:27:50.819 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32209.log 2024-05-21T01:27:50.821 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.31942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32604.log 2024-05-21T01:27:50.821 INFO:teuthology.orchestra.run.smithi131.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-05-21T01:27:50.822 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.32209.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.31942.log.gz 2024-05-21T01:27:50.822 INFO:teuthology.orchestra.run.smithi063.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.32209.log.gz 2024-05-21T01:27:50.823 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.32604.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.32604.log.gz 2024-05-21T01:27:50.823 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32124.log 2024-05-21T01:27:50.824 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27824.log 2024-05-21T01:27:50.826 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.32124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35487.log 2024-05-21T01:27:50.828 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.27824.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.27824.log.gz 2024-05-21T01:27:50.828 INFO:teuthology.orchestra.run.smithi063.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.32124.log.gz 2024-05-21T01:27:50.828 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.35487.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35487.log.gz 2024-05-21T01:27:50.829 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32599.log 2024-05-21T01:27:50.830 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35186.log 2024-05-21T01:27:50.832 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.32599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32473.log 2024-05-21T01:27:50.832 INFO:teuthology.orchestra.run.smithi063.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.32599.log.gz 2024-05-21T01:27:50.833 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.35186.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.35186.log.gz 2024-05-21T01:27:50.834 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.32473.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.32473.log.gz 2024-05-21T01:27:50.834 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34360.log 2024-05-21T01:27:50.835 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34199.log 2024-05-21T01:27:50.837 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.34360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31613.log 2024-05-21T01:27:50.837 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.34199.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.34360.log.gz 2024-05-21T01:27:50.838 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.31613.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.34199.log.gz 2024-05-21T01:27:50.839 INFO:teuthology.orchestra.run.smithi063.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.31613.log.gz 2024-05-21T01:27:50.839 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35879.log 2024-05-21T01:27:50.840 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32291.log 2024-05-21T01:27:50.842 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.35879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34836.log 2024-05-21T01:27:50.842 INFO:teuthology.orchestra.run.smithi063.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35879.log.gz 2024-05-21T01:27:50.843 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.32291.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.32291.log.gz 2024-05-21T01:27:50.844 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35331.log 2024-05-21T01:27:50.845 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.34836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33821.log 2024-05-21T01:27:50.845 INFO:teuthology.orchestra.run.smithi063.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34836.log.gz 2024-05-21T01:27:50.846 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.35331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34039.log 2024-05-21T01:27:50.846 INFO:teuthology.orchestra.run.smithi063.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35331.log.gz 2024-05-21T01:27:50.848 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.33821.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33821.log.gz 2024-05-21T01:27:50.849 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.34039.log: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.34039.log.gz 2024-05-21T01:27:50.849 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33016.log 2024-05-21T01:27:50.850 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35461.log 2024-05-21T01:27:50.852 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.33016.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-21T01:27:50.852 INFO:teuthology.orchestra.run.smithi063.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33016.log.gz 2024-05-21T01:27:50.853 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.35461.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35461.log.gz 2024-05-21T01:27:50.855 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph.audit.log: 89.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-21T01:27:50.855 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32265.log 2024-05-21T01:27:50.857 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-05-21T01:27:50.858 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.32265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35513.log 2024-05-21T01:27:50.858 INFO:teuthology.orchestra.run.smithi063.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32265.log.gz 2024-05-21T01:27:50.861 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-mds.c.log: /var/log/ceph/ceph-client.admin.35513.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35513.log.gz 2024-05-21T01:27:50.861 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33795.log 2024-05-21T01:27:50.862 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33025.log 2024-05-21T01:27:50.864 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.33795.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33795.log.gz 2024-05-21T01:27:50.864 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33474.log 2024-05-21T01:27:50.866 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.33025.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.33025.log.gz 2024-05-21T01:27:50.866 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.33474.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-05-21T01:27:50.867 INFO:teuthology.orchestra.run.smithi063.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.33474.log.gz 2024-05-21T01:27:50.868 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31641.log 2024-05-21T01:27:50.870 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32800.log 2024-05-21T01:27:50.871 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.31641.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.31641.log.gz 2024-05-21T01:27:50.872 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.32800.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32800.log.gz 2024-05-21T01:27:50.872 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32597.log 2024-05-21T01:27:50.873 INFO:teuthology.orchestra.run.smithi063.stderr: 93.6% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-05-21T01:27:50.873 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35827.log 2024-05-21T01:27:50.875 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.32597.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32597.log.gz 2024-05-21T01:27:50.875 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.35827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31445.log 2024-05-21T01:27:50.875 INFO:teuthology.orchestra.run.smithi063.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35827.log.gz 2024-05-21T01:27:50.877 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33341.log 2024-05-21T01:27:50.878 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.31445.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.31445.log.gz 2024-05-21T01:27:50.879 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.33341.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33341.log.gz 2024-05-21T01:27:50.879 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.33701.log 2024-05-21T01:27:50.881 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33367.log 2024-05-21T01:27:50.882 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.0.33701.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.33701.log.gz 2024-05-21T01:27:50.884 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.33367.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.33367.log.gz 2024-05-21T01:27:50.884 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33023.log 2024-05-21T01:27:50.885 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32343.log 2024-05-21T01:27:50.886 INFO:teuthology.orchestra.run.smithi131.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-05-21T01:27:50.886 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-05-21T01:27:50.886 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.33023.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33023.log.gz 2024-05-21T01:27:50.887 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.32343.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.32343.log.gz 2024-05-21T01:27:50.888 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34669.log 2024-05-21T01:27:50.889 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34914.log 2024-05-21T01:27:50.891 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.34669.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34669.log.gz 2024-05-21T01:27:50.891 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.34914.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34914.log.gz 2024-05-21T01:27:50.892 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32808.log 2024-05-21T01:27:50.893 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31587.log 2024-05-21T01:27:50.895 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.32808.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32808.log.gz 2024-05-21T01:27:50.895 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.31587.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.31587.log.gz 2024-05-21T01:27:50.896 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31669.log 2024-05-21T01:27:50.897 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31996.log 2024-05-21T01:27:50.899 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.31669.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.31669.log.gz 2024-05-21T01:27:50.900 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.31996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33873.log 2024-05-21T01:27:50.900 INFO:teuthology.orchestra.run.smithi063.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.31996.log.gz 2024-05-21T01:27:50.901 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35539.log 2024-05-21T01:27:50.903 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.33873.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33873.log.gz 2024-05-21T01:27:50.903 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.35539.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35539.log.gz 2024-05-21T01:27:50.904 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31785.log 2024-05-21T01:27:50.905 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.33719.log 2024-05-21T01:27:50.907 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.31785.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.31785.log.gz 2024-05-21T01:27:50.907 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.0.33719.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.33719.log.gz 2024-05-21T01:27:50.908 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31916.log 2024-05-21T01:27:50.909 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33211.log 2024-05-21T01:27:50.910 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.31916.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.31916.log.gz 2024-05-21T01:27:50.911 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.33211.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.33211.log.gz 2024-05-21T01:27:50.912 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34779.log 2024-05-21T01:27:50.913 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33524.log 2024-05-21T01:27:50.916 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.34779.log: /var/log/ceph/ceph-client.admin.33524.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.34779.log.gz 2024-05-21T01:27:50.917 INFO:teuthology.orchestra.run.smithi063.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.33524.log.gz 2024-05-21T01:27:50.917 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35159.log 2024-05-21T01:27:50.918 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34616.log 2024-05-21T01:27:50.919 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.35159.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.35159.log.gz 2024-05-21T01:27:50.920 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.34616.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.34616.log.gz 2024-05-21T01:27:50.921 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34276.log 2024-05-21T01:27:50.922 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34536.log 2024-05-21T01:27:50.925 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.34276.log: /var/log/ceph/ceph-client.admin.34536.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.34276.log.gz 2024-05-21T01:27:50.925 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35279.log 2024-05-21T01:27:50.925 INFO:teuthology.orchestra.run.smithi063.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.34536.log.gz 2024-05-21T01:27:50.927 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.35279.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35279.log.gz 2024-05-21T01:27:50.927 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31838.log 2024-05-21T01:27:50.929 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33847.log 2024-05-21T01:27:50.930 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.31838.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.31838.log.gz 2024-05-21T01:27:50.931 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.33847.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.e.log 2024-05-21T01:27:50.931 INFO:teuthology.orchestra.run.smithi063.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33847.log.gz 2024-05-21T01:27:50.932 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33743.log 2024-05-21T01:27:50.935 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-mds.e.log: /var/log/ceph/ceph-client.admin.33743.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33743.log.gz 2024-05-21T01:27:50.935 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32813.log 2024-05-21T01:27:50.938 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.32813.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32813.log.gz 2024-05-21T01:27:50.938 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35435.log 2024-05-21T01:27:50.941 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.35435.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35435.log.gz 2024-05-21T01:27:50.941 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35565.log 2024-05-21T01:27:50.942 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32798.log 2024-05-21T01:27:50.945 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.35565.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35565.log.gz 2024-05-21T01:27:50.945 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35098.log 2024-05-21T01:27:50.946 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.32798.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.32798.log.gz 2024-05-21T01:27:50.949 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/ceph-client.admin.35098.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.35098.log.gz 2024-05-21T01:27:50.977 INFO:teuthology.orchestra.run.smithi063.stderr: 93.0% -- replaced with /var/log/ceph/ceph-mds.e.log.gz 2024-05-21T01:27:50.979 INFO:teuthology.orchestra.run.smithi131.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-05-21T01:27:51.224 INFO:teuthology.orchestra.run.smithi063.stderr: 90.8% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-05-21T01:27:51.770 INFO:teuthology.orchestra.run.smithi063.stderr: 94.0% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-05-21T01:27:56.404 INFO:teuthology.orchestra.run.smithi063.stderr: 93.1% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-05-21T01:27:58.071 INFO:teuthology.orchestra.run.smithi131.stderr: 92.9% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-05-21T01:27:58.678 INFO:teuthology.orchestra.run.smithi131.stderr: 92.9% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-05-21T01:27:58.920 INFO:teuthology.orchestra.run.smithi131.stderr: 92.9% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-05-21T01:27:59.093 INFO:teuthology.orchestra.run.smithi131.stderr: 92.9% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-05-21T01:27:59.095 INFO:teuthology.orchestra.run.smithi131.stderr: 2024-05-21T01:27:59.095 INFO:teuthology.orchestra.run.smithi131.stderr:real 0m8.402s 2024-05-21T01:27:59.095 INFO:teuthology.orchestra.run.smithi131.stderr:user 0m31.377s 2024-05-21T01:27:59.095 INFO:teuthology.orchestra.run.smithi131.stderr:sys 0m1.119s 2024-05-21T01:27:59.379 INFO:teuthology.orchestra.run.smithi063.stderr: 92.8% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-05-21T01:27:59.569 INFO:teuthology.orchestra.run.smithi063.stderr: 93.1% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-05-21T01:28:00.295 INFO:teuthology.orchestra.run.smithi063.stderr: 93.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-05-21T01:28:00.297 INFO:teuthology.orchestra.run.smithi063.stderr: 2024-05-21T01:28:00.298 INFO:teuthology.orchestra.run.smithi063.stderr:real 0m9.608s 2024-05-21T01:28:00.298 INFO:teuthology.orchestra.run.smithi063.stderr:user 0m31.812s 2024-05-21T01:28:00.298 INFO:teuthology.orchestra.run.smithi063.stderr:sys 0m2.697s 2024-05-21T01:28:00.299 INFO:tasks.ceph:Archiving logs... 2024-05-21T01:28:00.299 DEBUG:teuthology.misc:Transferring archived files from smithi063:/var/log/ceph to /home/teuthworker/archive/leonidus-2024-05-20_23:57:18-fs-wip-lusov-quiesce-no-remote-ap-distro-default-smithi/7717467/remote/smithi063/log 2024-05-21T01:28:00.300 DEBUG:teuthology.orchestra.run.smithi063:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-21T01:28:04.340 DEBUG:teuthology.misc:Transferring archived files from smithi131:/var/log/ceph to /home/teuthworker/archive/leonidus-2024-05-20_23:57:18-fs-wip-lusov-quiesce-no-remote-ap-distro-default-smithi/7717467/remote/smithi131/log 2024-05-21T01:28:04.341 DEBUG:teuthology.orchestra.run.smithi131:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-21T01:28:08.488 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-05-21T01:28:08.497 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-05-21T01:28:08.498 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-21T01:28:08.501 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-21T01:28:08.576 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-05-21T01:28:08.585 INFO:teuthology.task.clock:Checking final clock skew... 2024-05-21T01:28:08.585 DEBUG:teuthology.orchestra.run.smithi063:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-21T01:28:08.588 DEBUG:teuthology.orchestra.run.smithi131:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-21T01:28:08.601 INFO:teuthology.orchestra.run.smithi131.stdout: remote refid st t when poll reach delay offset jitter 2024-05-21T01:28:08.601 INFO:teuthology.orchestra.run.smithi131.stdout:============================================================================== 2024-05-21T01:28:08.601 INFO:teuthology.orchestra.run.smithi131.stdout:+hv01.front.sepi 67.205.162.81 3 u 9 64 377 0.093 -2.192 1.047 2024-05-21T01:28:08.601 INFO:teuthology.orchestra.run.smithi131.stdout:+hv02.front.sepi 63.231.80.2 3 u 13 64 377 0.086 -2.742 1.846 2024-05-21T01:28:08.601 INFO:teuthology.orchestra.run.smithi131.stdout:*hv03.front.sepi 74.6.168.72 3 u 66 64 377 0.093 -0.813 0.895 2024-05-21T01:28:08.601 INFO:teuthology.orchestra.run.smithi131.stdout: hv04.front.sepi .INIT. 16 u - 256 0 0.000 +0.000 0.000 2024-05-21T01:28:08.602 INFO:teuthology.orchestra.run.smithi063.stdout: remote refid st t when poll reach delay offset jitter 2024-05-21T01:28:08.602 INFO:teuthology.orchestra.run.smithi063.stdout:============================================================================== 2024-05-21T01:28:08.602 INFO:teuthology.orchestra.run.smithi063.stdout:+hv01.front.sepi 67.205.162.81 3 u 5 64 377 0.080 -1.482 0.089 2024-05-21T01:28:08.602 INFO:teuthology.orchestra.run.smithi063.stdout:*hv02.front.sepi 63.231.80.2 3 u 6 64 377 0.080 -0.032 0.097 2024-05-21T01:28:08.602 INFO:teuthology.orchestra.run.smithi063.stdout:+hv03.front.sepi 74.6.168.72 3 u 9 64 377 0.081 +0.055 0.130 2024-05-21T01:28:08.602 INFO:teuthology.orchestra.run.smithi063.stdout: hv04.front.sepi .INIT. 16 u - 256 0 0.000 +0.000 0.000 2024-05-21T01:28:08.604 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-05-21T01:28:08.618 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-05-21T01:28:08.618 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-05-21T01:28:08.660 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-05-21T01:28:08.702 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-05-21T01:28:08.743 INFO:teuthology.task.internal:Duration was 1210.723803 seconds 2024-05-21T01:28:08.744 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-05-21T01:28:08.785 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-05-21T01:28:08.785 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-21T01:28:08.789 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-21T01:28:08.877 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-05-21T01:28:08.877 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi063.front.sepia.ceph.com 2024-05-21T01:28:08.877 DEBUG:teuthology.orchestra.run.smithi063:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-21T01:28:08.898 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi131.front.sepia.ceph.com 2024-05-21T01:28:08.898 DEBUG:teuthology.orchestra.run.smithi131:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-21T01:28:08.909 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-05-21T01:28:08.909 DEBUG:teuthology.orchestra.run.smithi063:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-21T01:28:08.942 DEBUG:teuthology.orchestra.run.smithi131:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-21T01:28:08.984 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-05-21T01:28:08.984 DEBUG:teuthology.orchestra.run.smithi063:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-21T01:28:09.030 DEBUG:teuthology.orchestra.run.smithi131:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-21T01:28:09.112 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-05-21T01:28:09.122 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-05-21T01:28:09.122 DEBUG:teuthology.orchestra.run.smithi063:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-21T01:28:09.142 DEBUG:teuthology.orchestra.run.smithi131:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-21T01:28:09.156 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-05-21T01:28:09.166 DEBUG:teuthology.orchestra.run.smithi063:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-21T01:28:09.186 DEBUG:teuthology.orchestra.run.smithi131:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-21T01:28:09.200 INFO:teuthology.orchestra.run.smithi063.stdout:kernel.core_pattern = core 2024-05-21T01:28:09.208 INFO:teuthology.orchestra.run.smithi131.stdout:kernel.core_pattern = core 2024-05-21T01:28:09.257 DEBUG:teuthology.orchestra.run.smithi063:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-21T01:28:09.265 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-21T01:28:09.266 DEBUG:teuthology.orchestra.run.smithi131:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-21T01:28:09.305 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-21T01:28:09.305 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-05-21T01:28:09.315 INFO:teuthology.task.internal:Transferring archived files... 2024-05-21T01:28:09.316 DEBUG:teuthology.misc:Transferring archived files from smithi063:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/leonidus-2024-05-20_23:57:18-fs-wip-lusov-quiesce-no-remote-ap-distro-default-smithi/7717467/remote/smithi063 2024-05-21T01:28:09.316 DEBUG:teuthology.orchestra.run.smithi063:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-21T01:28:09.343 DEBUG:teuthology.misc:Transferring archived files from smithi131:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/leonidus-2024-05-20_23:57:18-fs-wip-lusov-quiesce-no-remote-ap-distro-default-smithi/7717467/remote/smithi131 2024-05-21T01:28:09.343 DEBUG:teuthology.orchestra.run.smithi131:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-21T01:28:09.369 INFO:teuthology.task.internal:Removing archive directory... 2024-05-21T01:28:09.369 DEBUG:teuthology.orchestra.run.smithi063:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-21T01:28:09.382 DEBUG:teuthology.orchestra.run.smithi131:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-21T01:28:09.413 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-05-21T01:28:09.425 INFO:teuthology.task.internal:Not uploading archives. 2024-05-21T01:28:09.425 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-05-21T01:28:09.453 INFO:teuthology.task.internal:Tidying up after the test... 2024-05-21T01:28:09.453 DEBUG:teuthology.orchestra.run.smithi063:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-21T01:28:09.456 DEBUG:teuthology.orchestra.run.smithi131:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-21T01:28:09.461 INFO:teuthology.orchestra.run.smithi063.stdout: 655432 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 21 01:28 /home/ubuntu/cephtest 2024-05-21T01:28:09.462 INFO:teuthology.orchestra.run.smithi131.stdout: 524291 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 21 01:28 /home/ubuntu/cephtest 2024-05-21T01:28:09.464 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-05-21T01:28:09.530 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-05-21T01:28:09.614 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 0fe9556839d28e65b29a64cc05a26a6884e8775d description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/with-quiesce 2-workunit/suites/iozone}} duration: 1210.723803281784 flavor: default owner: scheduled_leonidus@teuthology success: true 2024-05-21T01:28:09.614 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-21T01:28:09.700 INFO:teuthology.run:pass